Bonjour,

J’essaie sans succès d’effectuer des migrations de volumes attachés d’un backend LVM à un autre (tous les deux dans le même volume_type). J’obtiens systématiquement un message d’erreur dans les logs cinder-volume sur le noeud de storage me signalant un problème de endpoint.

2017-09-07 14:15:18.986 1031 INFO cinder.volume.flows.manager.create_volume [req-34f2d626-a9f0-4ed2-a6e3-819910b40178 7178992f9edf451f8904457fff664b36 c2507c3c11c544408f0486b3efe475a0 - default default] Volume 7c40cdba-d2b4-40ee-a8ac-cfc2826100dc: being created as raw with specification: {'status': u'creating', 'volume_size': 1, 'volume_name': 'volume-7c40cdba-d2b4-40ee-a8ac-cfc2826100dc'}

2017-09-07 14:15:19.604 1031 INFO cinder.volume.flows.manager.create_volume [req-34f2d626-a9f0-4ed2-a6e3-819910b40178 7178992f9edf451f8904457fff664b36 c2507c3c11c544408f0486b3efe475a0 - default default] Volume volume-7c40cdba-d2b4-40ee-a8ac-cfc2826100dc (7c40cdba-d2b4-40ee-a8ac-cfc2826100dc): created successfully

2017-09-07 14:15:19.609 1031 INFO cinder.volume.manager [req-34f2d626-a9f0-4ed2-a6e3-819910b40178 7178992f9edf451f8904457fff664b36 c2507c3c11c544408f0486b3efe475a0 - default default] Created volume successfully.

2017-09-07 14:15:20.025 1028 ERROR cinder.volume.manager [req-34f2d626-a9f0-4ed2-a6e3-819910b40178 7178992f9edf451f8904457fff664b36 c2507c3c11c544408f0486b3efe475a0 - default default] Failed to copy volume bf95207e-16ea-4100-b8fb-1edcc64e8137 to 7c40cdba-d2b4-40ee-a8ac-cfc2826100dc

2017-09-07 14:15:20.025 1028 ERROR cinder.volume.manager Traceback (most recent call last):

2017-09-07 14:15:20.025 1028 ERROR cinder.volume.manager   File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 1839, in _migrate_volume_generic

2017-09-07 14:15:20.025 1028 ERROR cinder.volume.manager     new_volume.id)

2017-09-07 14:15:20.025 1028 ERROR cinder.volume.manager   File "/usr/lib/python2.7/dist-packages/cinder/compute/nova.py", line 247, in update_server_volume

2017-09-07 14:15:20.025 1028 ERROR cinder.volume.manager     nova = novaclient(context, admin_endpoint=True, privileged_user=True)

2017-09-07 14:15:20.025 1028 ERROR cinder.volume.manager   File "/usr/lib/python2.7/dist-packages/cinder/compute/nova.py", line 203, in novaclient

2017-09-07 14:15:20.025 1028 ERROR cinder.volume.manager     **region_filter)

2017-09-07 14:15:20.025 1028 ERROR cinder.volume.manager   File "/usr/lib/python2.7/dist-packages/cinder/compute/nova.py", line 131, in url_for

2017-09-07 14:15:20.025 1028 ERROR cinder.volume.manager     raise nova_exceptions.EndpointNotFound()

2017-09-07 14:15:20.025 1028 ERROR cinder.volume.manager EndpointNotFound

2017-09-07 14:15:20.025 1028 ERROR cinder.volume.manager

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server [req-34f2d626-a9f0-4ed2-a6e3-819910b40178 7178992f9edf451f8904457fff664b36 c2507c3c11c544408f0486b3efe475a0 - default default] Exception during message handling

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server Traceback (most recent call last):

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 155, in _process_incoming

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 222, in dispatch

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 192, in _do_dispatch

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 2034, in migrate_volume

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server     volume.save()

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server     self.force_reraise()

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server     six.reraise(self.type_, self.value, self.tb)

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 2027, in migrate_volume

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server     self._migrate_volume_generic(ctxt, volume, host, new_type_id)

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 1846, in _migrate_volume_generic

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server     new_volume)

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server     self.force_reraise()

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server     six.reraise(self.type_, self.value, self.tb)

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 1839, in _migrate_volume_generic

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server     new_volume.id)

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/dist-packages/cinder/compute/nova.py", line 247, in update_server_volume

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server     nova = novaclient(context, admin_endpoint=True, privileged_user=True)

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/dist-packages/cinder/compute/nova.py", line 203, in novaclient

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server     **region_filter)

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/dist-packages/cinder/compute/nova.py", line 131, in url_for

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server     raise nova_exceptions.EndpointNotFound()

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server EndpointNotFound

2017-09-07 14:15:20.040 1028 ERROR oslo_messaging.rpc.server

2017-09-07 14:15:20.640 1031 INFO cinder.volume.targets.tgt [req-34f2d626-a9f0-4ed2-a6e3-819910b40178 7178992f9edf451f8904457fff664b36 c2507c3c11c544408f0486b3efe475a0 - default default] Removing iscsi_target for Volume ID: 7c40cdba-d2b4-40ee-a8ac-cfc2826100dc

2017-09-07 14:15:20.641 1031 WARNING cinder.volume.targets.tgt [req-34f2d626-a9f0-4ed2-a6e3-819910b40178 7178992f9edf451f8904457fff664b36 c2507c3c11c544408f0486b3efe475a0 - default default] Volume path /var/lib/cinder/volumes/volume-7c40cdba-d2b4-40ee-a8ac-cfc2826100dc does not exist, nothing to remove.

2017-09-07 14:15:21.554 1031 INFO cinder.volume.utils [req-34f2d626-a9f0-4ed2-a6e3-819910b40178 7178992f9edf451f8904457fff664b36 c2507c3c11c544408f0486b3efe475a0 - default default] Performing secure delete on volume: /dev/mapper/cinder--volumes2-volume--7c40cdba--d2b4--40ee--a8ac--cfc2826100dc

2017-09-07 14:15:22.760 1031 INFO cinder.volume.utils [req-34f2d626-a9f0-4ed2-a6e3-819910b40178 7178992f9edf451f8904457fff664b36 c2507c3c11c544408f0486b3efe475a0 - default default] Volume copy 1024.00 MB at 1024.00 MB/s

2017-09-07 14:15:23.374 1031 INFO cinder.volume.drivers.lvm [req-34f2d626-a9f0-4ed2-a6e3-819910b40178 7178992f9edf451f8904457fff664b36 c2507c3c11c544408f0486b3efe475a0 - default default] Successfully deleted volume: 7c40cdba-d2b4-40ee-a8ac-cfc2826100dc

2017-09-07 14:15:23.392 1031 INFO cinder.volume.manager [req-34f2d626-a9f0-4ed2-a6e3-819910b40178 7178992f9edf451f8904457fff664b36 c2507c3c11c544408f0486b3efe475a0 - default default] Deleted volume successfully.

Je ne pense pas avoir d’erreurs dans mes configuration étant donné que je peux sans problème créer des instances avec des volumes attachés, je peux également effectuer des migration live des instances entre différents nœuds compute (donc mes libvirtd sont bons). J’ai l’impression qu’il y a quelque chose de buggé qui empêche cinder de communiquer avec le endpoint de nova mais je ne trouve pas.

Est-ce que quelqu’un pourrait m’aider sur ce problème ?

Merci

Hervé