[Openstack] cinder migrate/retype error

Iban Cabrillo cabrillo at ifca.unican.es
Thu May 5 08:20:48 UTC 2016


HI,
   I been looking into this.
   After  reset-state --reset-migration-status of a error volume, I try to
retype the same volume using --migration-policy on-demand flag.

   There is no error in cinder-schedule.log but cinder show <vol_id> show
the migrations state error again.

   Have a look at cinde-volume.log on my rbd backend, I see that the rbd
volume was created (with the correct size 2GB) and deleted:

   2016-05-05 09:56:46.400 28900 INFO
cinder.volume.flows.manager.create_volume
[req-67ac8546-e661-440b-9084-1ac1ad4d9ebb 6e57d91da967475b887ef485ca4db611
276c19f252d24f0ebe0aa9ff39307f56 - - -] *Volume
440d11b5-540c-4a11-b0d6-a834ad24c02a: being created as raw with
specification: {'status': u'creating', 'volume_size': 2, 'volume_name':
u'volume-440d11b5-540c-4a11-b0d6-a834ad24c02a'}*
2016-05-05 09:56:46.820 28900 INFO
cinder.volume.flows.manager.create_volume
[req-67ac8546-e661-440b-9084-1ac1ad4d9ebb 6e57d91da967475b887ef485ca4db611
276c19f252d24f0ebe0aa9ff39307f56 - - -] Volume
volume-440d11b5-540c-4a11-b0d6-a834ad24c02a
(440d11b5-540c-4a11-b0d6-a834ad24c02a): *created successfully*
2016-05-05 09:56:46.825 28900 INFO cinder.volume.manager
[req-67ac8546-e661-440b-9084-1ac1ad4d9ebb 6e57d91da967475b887ef485ca4db611
276c19f252d24f0ebe0aa9ff39307f56 - - -] *Created volume successfully*.
2016-05-05 09:56:48.118 28900 INFO cinder.volume.manager
[req-b60973b3-e31d-48fb-9fb2-de4bc5c3940f - - - - -] *Initialize volume
connection completed successfully*.
2016-05-05 09:56:48.717 28900 INFO cinder.volume.manager
[req-67ac8546-e661-440b-9084-1ac1ad4d9ebb 6e57d91da967475b887ef485ca4db611
276c19f252d24f0ebe0aa9ff39307f56 - - -] *Deleted volume successfully*.

Looking if the volume was really created:
cephvolume:~ # for i in {1..30};do rbd ls volumes;sleep 2;done
...................
volume-c092989d-56e7-445a-aba4-6e66b17aebe7
volume-1b840b3a-2f71-4a92-a15e-d0c4161e0cb4
volume-440d11b5-540c-4a11-b0d6-a834ad24c02a
...................

Two seconds after the volume-440d11b5-540c-4a11-b0d6-a834ad24c02a was not
there

in cinder-api.log

2016-05-05 10:14:15.850 28759 INFO cinder.volume.api
[req-f14dadc8-ffdb-4447-8b30-7c360c6db563 6e57d91da967475b887ef485ca4db611
276c19f252d24f0ebe0aa9ff39307f56 - - -] Volume info retrieved successfully.
2016-05-05 10:14:16.000 28759 INFO cinder.volume.api
[req-06e3ac2b-c63f-492d-baa3-3f3877306a25 - - - - -] Volume updated
successfully.
2016-05-05 10:14:16.007 28759 INFO cinder.volume.api
[req-06e3ac2b-c63f-492d-baa3-3f3877306a25 - - - - -] Retype volume request
issued successfully.
2016-05-05 10:14:16.007 28759 INFO cinder.api.openstack.wsgi
[req-06e3ac2b-c63f-492d-baa3-3f3877306a25 - - - - -]
https://cinder01.ifca.es:8776/v2/276c19f252d24f0ebe0aa9ff39307f56/volumes/19440b1b-4db5-43a9-bbe8-fef07fb69c20/action
returned with HTTP 202
2016-05-05 10:14:16.009 28759 INFO eventlet.wsgi.server
[req-06e3ac2b-c63f-492d-baa3-3f3877306a25 - - - - -] 10.10.32.1 - -
[05/May/2016 10:14:16] "POST
/v2/276c19f252d24f0ebe0aa9ff39307f56/volumes/19440b1b-4db5-43a9-bbe8-fef07fb69c20/action
HTTP/1.1" 202 211 0.215593
2016-05-05 10:15:29.052 28759 INFO cinder.api.openstack.wsgi
[req-74e3e806-6391-4ebc-a2e0-59bfee940c4d 6e57d91da967475b887ef485ca4db611
276c19f252d24f0ebe0aa9ff39307f56 - - -] GET
https://cinder01.ifca.es:8776/v2/276c19f252d24f0ebe0aa9ff39307f56/volumes/19440b1b-4db5-43a9-bbe8-fef07fb69c20
2016-05-05 10:15:29.207 28759 INFO cinder.volume.api
[req-74e3e806-6391-4ebc-a2e0-59bfee940c4d 6e57d91da967475b887ef485ca4db611
276c19f252d24f0ebe0aa9ff39307f56 - - -] Volume info retrieved successfully.

Any idea will be welcomed :)
Redgards, I




2016-05-04 15:54 GMT+02:00 Iban Cabrillo <cabrillo at ifca.unican.es>:

> Hi,
>
>  looking at cinder.conf
>
> # Default volume type to use (string value)
> default_volume_type=rbd
>
> [rbd-cephvolume]
> volume_backend_name=rbd
> volume_driver = cinder.volume.drivers.rbd.RBDDriver
> rbd_pool = volumes
> rbd_ceph_conf = /etc/ceph/ceph.conf
> rbd_flatten_volume_from_snapshot = false
> rbd_max_clone_depth = 5
> rbd_store_chunk_size = 4
> rados_connect_timeout = -1
> glance_api_version = 2
>
> regards, I
>
> 2016-05-04 15:13 GMT+02:00 Avishay Traeger <avishay at stratoscale.com>:
>
>> How is the volume's volume-type defined?
>>
>> On Wed, May 4, 2016 at 1:20 PM, Iban Cabrillo <cabrillo at ifca.unican.es>
>> wrote:
>>
>>> Hi,
>>>
>>>    I am trying to move block storage between servers with different
>>> storage types, one using iscsi and the other rbd, individually they work
>>> fine. nova version is 2:12.0.2-0ubuntu1~cloud0. Of course I have checked
>>> with attached and detached blocks for these tests.
>>>
>>>   I see both pools:
>>>   cloud:~ # cinder get-pools
>>>
>>> +----------+---------------------------------------------+
>>> | Property |                    Value                    |
>>> +----------+---------------------------------------------+
>>> |   name   | cloudvolume at iscsi-cloudvolume#iscsi |
>>> +----------+---------------------------------------------+
>>> +----------+---------------------------------------+
>>> | Property |                 Value                 |
>>> +----------+---------------------------------------+
>>> |   name   | rbdvolume at rbd-cephvolume#rbd |
>>> +----------+---------------------------------------+
>>>
>>> running:
>>>  #cinder migrate <vol_id>  rbdvolume at rbd-cephvolume#rbd
>>>   I see this error in cinder-schedule.log
>>>
>>>   2016-05-04 10:32:18.397 28665 ERROR cinder.scheduler.manager
>>> [req-609fb633-6c1d-419b-a0d7-193d10a0732a 6e57d91da967475b887ef485ca4db611
>>> 276c19f252d24f0ebe0aa9ff39307f56 - - -] Failed to
>>> schedule_migrate_volume_to_host: No valid host was found. Cannot place
>>> volume cc23af33-586c-4e0d-b248-127aef26acfd on rbdvolume at rbd-cephvolume
>>> #rbd
>>>
>>> Then I checked using retype instead of migrate for different backend
>>> types (iscsi and rbd):
>>>
>>> #cinder retype <vol_id> rbd
>>>
>>> show this log:
>>>
>>> 2016-05-04 10:45:04.506 28665 ERROR cinder.scheduler.manager
>>> [req-5c7066bf-6fb7-484c-9c95-25cd9508f381 6e57d91da967475b887ef485ca4db611
>>> 276c19f252d24f0ebe0aa9ff39307f56 - - -] Could not find a host for volume
>>> cc23af33-586c-4e0d-b248-127aef26acfd with type
>>> cc8705d5-98cb-4071-bd63-7440a5f95138.
>>>
>>> using  --migration-policy on-demand flag there is no error in scheduler
>>> log, but there is no migration either.
>>>
>>> Any Idea?
>>>
>>> Regards, I
>>> --
>>>
>>> ############################################################################
>>> Iban Cabrillo Bartolome
>>> Instituto de Fisica de Cantabria (IFCA)
>>> Santander, Spain
>>> Tel: +34942200969
>>> PGP PUBLIC KEY:
>>> http://pgp.mit.edu/pks/lookup?op=get&search=0xD9DF0B3D6C8C08AC
>>>
>>> ############################################################################
>>> Bertrand Russell:
>>> *"El problema con el mundo es que los estúpidos están seguros de todo y
>>> los inteligentes están llenos de dudas*"
>>>
>>> _______________________________________________
>>> Mailing list:
>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>> Post to     : openstack at lists.openstack.org
>>> Unsubscribe :
>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>>
>>>
>>
>>
>> --
>> *Avishay Traeger, PhD*
>> *System Architect*
>>
>> Mobile: +972 54 447 1475
>> E-mail: avishay at stratoscale.com
>>
>>
>>
>> Web <http://www.stratoscale.com/> | Blog
>> <http://www.stratoscale.com/blog/> | Twitter
>> <https://twitter.com/Stratoscale> | Google+
>> <https://plus.google.com/u/1/b/108421603458396133912/108421603458396133912/posts>
>>  | Linkedin <https://www.linkedin.com/company/stratoscale>
>>
>
>
>
> --
>
> ############################################################################
> Iban Cabrillo Bartolome
> Instituto de Fisica de Cantabria (IFCA)
> Santander, Spain
> Tel: +34942200969
> PGP PUBLIC KEY:
> http://pgp.mit.edu/pks/lookup?op=get&search=0xD9DF0B3D6C8C08AC
>
> ############################################################################
> Bertrand Russell:
> *"El problema con el mundo es que los estúpidos están seguros de todo y
> los inteligentes están llenos de dudas*"
>



-- 
############################################################################
Iban Cabrillo Bartolome
Instituto de Fisica de Cantabria (IFCA)
Santander, Spain
Tel: +34942200969
PGP PUBLIC KEY:
http://pgp.mit.edu/pks/lookup?op=get&search=0xD9DF0B3D6C8C08AC
############################################################################
Bertrand Russell:
*"El problema con el mundo es que los estúpidos están seguros de todo y los
inteligentes están llenos de dudas*"
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20160505/ae1fa720/attachment.html>


More information about the Openstack mailing list