[Bug 1572324] [NEW] ceph crush update fails if bucket doesn't exist

[Chris Holcombe]

*** This bug is a duplicate of bug 1570960 ***
    https://bugs.launchpad.net/bugs/1570960

Public bug reported:

During testing a bug has surfaced where the ceph-osd process fails to
start.  This is due to the ceph osd crush create-or-move command exiting
with a error 22.

Below are two create-or-move commands.  The first one is from the ceph charm that works properly.  The 2nd is from the ceph-osd charm that fails to start.  
  1 ceph --cluster=ceph --name=osd.1 --keyring=/var/lib/ceph/osd/ceph-1/keyring osd crush create-or-move -- 1 0.45 host=cylindrical-base root=default

  2 ceph --cluster=ceph --name=osd.3 --keyring=/var/lib/ceph/osd/ceph-3/keyring osd crush create-or-move -- 3 0.45 root=default rack=default host=fat-machine
 
The rack=default key and value are the problem.  The ceph osd tree command shows that the rack bucket doesn't exist in the tree.  

# id	weight	type name	up/down	reweight
-1	1.8	root default
-2	0.45		host imaginative-error
0	0.45			osd.0	up	1	
-3	0.45		host cylindrical-base
1	0.45			osd.1	up	1	
-4	0.45		host grizzled-family
2	0.45			osd.2	up	1	
-5	0.45		host fat-machine
3	0.45			osd.3	down	0	

I have a thought about a possible solution that leverages the crush
decompiler I created.  In the mean time I think we should revert
https://review.openstack.org/#/c/293694/ and revisit it again after the
16.04 release.

** Affects: cinder (Juju Charms Collection)
     Importance: Critical
     Assignee: Chris MacNaughton (chris.macnaughton)
         Status: New

** This bug has been marked a duplicate of bug 1570960
   ceph-osd status blocked on block device detection

-- 
You received this bug notification because you are a member of Ubuntu
OpenStack, which is subscribed to cinder in Juju Charms Collection.
Matching subscriptions: charm-bugs
https://bugs.launchpad.net/bugs/1572324

Title:
  ceph crush update fails if bucket doesn't exist

Status in cinder package in Juju Charms Collection:
  New

Bug description:
  During testing a bug has surfaced where the ceph-osd process fails to
  start.  This is due to the ceph osd crush create-or-move command
  exiting with a error 22.

  Below are two create-or-move commands.  The first one is from the ceph charm that works properly.  The 2nd is from the ceph-osd charm that fails to start.  
    1 ceph --cluster=ceph --name=osd.1 --keyring=/var/lib/ceph/osd/ceph-1/keyring osd crush create-or-move -- 1 0.45 host=cylindrical-base root=default

    2 ceph --cluster=ceph --name=osd.3 --keyring=/var/lib/ceph/osd/ceph-3/keyring osd crush create-or-move -- 3 0.45 root=default rack=default host=fat-machine
   
  The rack=default key and value are the problem.  The ceph osd tree command shows that the rack bucket doesn't exist in the tree.  

  # id	weight	type name	up/down	reweight
  -1	1.8	root default
  -2	0.45		host imaginative-error
  0	0.45			osd.0	up	1	
  -3	0.45		host cylindrical-base
  1	0.45			osd.1	up	1	
  -4	0.45		host grizzled-family
  2	0.45			osd.2	up	1	
  -5	0.45		host fat-machine
  3	0.45			osd.3	down	0	

  I have a thought about a possible solution that leverages the crush
  decompiler I created.  In the mean time I think we should revert
  https://review.openstack.org/#/c/293694/ and revisit it again after
  the 16.04 release.

To manage notifications about this bug go to:
https://bugs.launchpad.net/charms/+source/cinder/+bug/1572324/+subscriptions