Hi All,
I'm having a few issues with live migration at the moment. This is an openstack train deployed with rdo packages.
1. when migrating some VMs the migration succeeds but the VM doesn't move and the following error can be found in the nova logs with nothing that seems to correspond in the neutron logs: 2022-09-30 11:04:04.069 716669 INFO nova.compute.manager [-] [instance: c10d1d9e-2baf-4ab5-ba3a-2f60f521aea6] Took 76.49 seconds for pre_live_migration on destination host hv548.nubes.rl. ac.uk. 2022-09-30 11:04:04.720 716669 ERROR nova.virt.libvirt.driver [-] [instance: c10d1d9e-2baf-4ab5-ba3a-2f60f521aea6] Live Migration failure: 'fa:ca:ad:1f:71:41'
2. When migrating some VMs the migration is marked as complete and the VM is moved from the source to the destination hypervisor but nova keeps the migrating state and doesn't update the host or the node fields. The following error is found in nova with no corresponding error that I can find in neutron. The config is the same across all hypervisors.
2022-09-13 10:37:23.709 12387 ERROR nova.network.neutronv2.api [req-ee51a8b4-911c-4f92-860b-9d6a7a24c786 27be800439c244c1bd742ff056cf700c 4de86830e89b4a46b590536571b6ccd4 - 38372510d9bb4ac7916178b062d387de 38372510d9bb4ac7916178b062d387de] Neutron client was not able to generate a valid admin token, please verify Neutron admin credential located in nova.conf: neutronclient.common.exceptions.Unauthorized: 401-{'error': {'message': 'The request you have made requires authentication.', 'code': 401, 'title': 'Unauthorized'}}
2022-09-13 10:37:23.845 12387 ERROR oslo_messaging.rpc.server [req-ee51a8b4-911c-4f92-860b-9d6a7a24c786 27be800439c244c1bd742ff056cf700c 4de86830e89b4a46b590536571b6ccd4 - 38372510d9bb4ac7916178b062d387de 38372510d9bb4ac7916178b062d387de] Exception during message handling: nova.exception.NeutronAdminCredentialConfigurationInvalid: Networking client is experiencing an unauthorized exception.
Regards
Alexander Dibbo - Cloud Architect / Cloud Operations Group Leader For STFC Cloud Documentation visit https://stfc-cloud-docs.readthedocs.iohttps://stfc-cloud-docs.readthedocs.io/ To raise a support ticket with the cloud team please email cloud-support@stfc.ac.ukmailto:cloud-support@stfc.ac.uk To receive notifications about the service please subscribe to our mailing list at: https://www.jiscmail.ac.uk/cgi-bin/webadmin?A0=STFC-CLOUD To receive fast notifications or to discuss usage of the cloud please join our Slack: https://stfc-cloud.slack.com/
This email and any attachments are intended solely for the use of the named recipients. If you are not the intended recipient you must not use, disclose, copy or distribute this email or any of its attachments and should notify the sender immediately and delete this email from your system. UK Research and Innovation (UKRI) has taken every reasonable precaution to minimise risk of this email or any attachments containing viruses or malware but the recipient should carry out its own virus and malware checks before opening the attachments. UKRI does not accept any liability for any losses or damages which the recipient may sustain due to presence of any viruses.