Open Stack

I think I found the issue, in the instances nova db in the node column the compute node name somehow changed to short hostname. It works fith FQDN but it doesn't work with short ☹ I hope I didn't mess-up anything if I change to FQDN to make it work.

Istvan Szabo
Senior Infrastructure Engineer
---------------------------------------------------
Agoda Services Co., Ltd.
e: istvan.szabo at agoda.com
---------------------------------------------------

-----Original Message-----
From: Szabo, Istvan (Agoda) <Istvan.Szabo at agoda.com> 
Sent: Thursday, April 22, 2021 11:19 AM
To: Eugen Block <eblock at nde.ag>
Cc: openstack-discuss at lists.openstack.org
Subject: RE: Live migration fails

Sorry, in the log I haven't commented out the servername ☹ it is xy-osfecn-40250

Istvan Szabo
Senior Infrastructure Engineer
---------------------------------------------------
Agoda Services Co., Ltd.
e: istvan.szabo at agoda.com
---------------------------------------------------

-----Original Message-----
From: Eugen Block <eblock at nde.ag>
Sent: Wednesday, April 21, 2021 5:37 PM
To: Szabo, Istvan (Agoda) <Istvan.Szabo at agoda.com>
Cc: openstack-discuss at lists.openstack.org
Subject: Re: Live migration fails

The error message seems correct, I can't find am-osfecn-4025 either in the list of compute nodes. Can you check in the database if there's an active instance (or several) allocated to that compute node? In that case you would need to correct the allocation in order for the migration to work.


Zitat von "Szabo, Istvan (Agoda)" <Istvan.Szabo at agoda.com>:

> Sure:
>
> https://jpst.it/2u3uh
>
> These are the one where can't live migrate:
> xy-osfecn-40250
> xy-osfecn-40281
> xy-osfecn-40290
> xy-osbecn-40073
> xy-osfecn-40238
>
> The compute service are disabled on these because we don't want 
> anybody spawn a vm on these anymore so want to evacuate all vms.
>
> Istvan Szabo
> Senior Infrastructure Engineer
> ---------------------------------------------------
> Agoda Services Co., Ltd.
> e: istvan.szabo at agoda.com
> ---------------------------------------------------
>
> -----Original Message-----
> From: Eugen Block <eblock at nde.ag>
> Sent: Wednesday, April 21, 2021 3:26 PM
> To: openstack-discuss at lists.openstack.org
> Subject: Re: Live migration fails
>
> Hi,
>
> can you share the output of these commands?
>
> nova-manage cell_v2 list_hosts
> openstack compute service list
>
>
> Zitat von "Szabo, Istvan (Agoda)" <Istvan.Szabo at agoda.com>:
>
>> Hi,
>>
>> I have couple of compute nodes where the live migration fails with 
>> existing vms.
>> When I quickly spawn a vm and try live migration it works so I assume 
>> shouldn't be a big problem with the compute node.
>> However I have many existing vms where it fails with a servername not found.
>>
>> /var/log/nova/nova-conductor.log:2021-04-21 14:47:12.605 227612 ERROR 
>> nova.conductor.tasks.migrate
>> [req-f4067a26-a233-4673-8c07-9a8a290980b0
>> dce35e6eceea4312bb0baa0510cef363 ca7e35079f4440c78bd9870724b9638b - 
>> default default] [instance: 1517a2ac-3b51-4d8d-80b3-89a5614d1ae0]
>> Unable to find record for source node servername on servername:
>> ComputeHostNotFound: Compute host servername could not be found.
>> /var/log/nova/nova-conductor.log:2021-04-21 14:47:12.605 227612 
>> WARNING nova.scheduler.utils
>> [req-f4067a26-a233-4673-8c07-9a8a290980b0
>> dce35e6eceea4312bb0baa0510cef363 ca7e35079f4440c78bd9870724b9638b - 
>> default default] Failed to compute_task_migrate_server: Compute host 
>> servername could not be found.: ComputeHostNotFound: Compute host 
>> servername could not be found.
>> /var/log/nova/nova-conductor.log:2021-04-21 14:47:12.605 227612 
>> WARNING nova.scheduler.utils
>> [req-f4067a26-a233-4673-8c07-9a8a290980b0
>> dce35e6eceea4312bb0baa0510cef363 ca7e35079f4440c78bd9870724b9638b - 
>> default default] [instance: 1517a2ac-3b51-4d8d-80b3-89a5614d1ae0]
>> Setting instance to ACTIVE state.: ComputeHostNotFound: Compute host 
>> servername could not be found.
>> /var/log/nova/nova-conductor.log:2021-04-21 14:47:12.672 227612 ERROR 
>> oslo_messaging.rpc.server
>> [req-f4067a26-a233-4673-8c07-9a8a290980b0
>> dce35e6eceea4312bb0baa0510cef363 ca7e35079f4440c78bd9870724b9638b - 
>> default default] Exception during message handling:
>> ComputeHostNotFound: Compute host am-osfecn-4025
>>
>> Tried with this command:
>>
>> nova live-migration --block-migrate id.
>>
>> Any idea?
>>
>> Thank you.
>>
>> ________________________________
>> This message is confidential and is for the sole use of the intended 
>> recipient(s). It may also be privileged or otherwise protected by 
>> copyright or other legal rules. If you have received it by mistake 
>> please let us know by reply email and delete it from your system. It 
>> is prohibited to copy this message or disclose its content to anyone.
>> Any confidentiality or privilege is not waived or lost by any 
>> mistaken delivery or unauthorized disclosure of the message. All 
>> messages sent to and from Agoda may be monitored to ensure compliance 
>> with company policies, to protect the company's interests and to 
>> remove potential malware. Electronic messages may be intercepted, 
>> amended, lost or deleted, or contain viruses.
>
>
>
>
>
> ________________________________
> This message is confidential and is for the sole use of the intended 
> recipient(s). It may also be privileged or otherwise protected by 
> copyright or other legal rules. If you have received it by mistake 
> please let us know by reply email and delete it from your system. It 
> is prohibited to copy this message or disclose its content to anyone.
> Any confidentiality or privilege is not waived or lost by any mistaken 
> delivery or unauthorized disclosure of the message. All messages sent 
> to and from Agoda may be monitored to ensure compliance with company 
> policies, to protect the company's interests and to remove potential 
> malware. Electronic messages may be intercepted, amended, lost or 
> deleted, or contain viruses.





________________________________
This message is confidential and is for the sole use of the intended recipient(s). It may also be privileged or otherwise protected by copyright or other legal rules. If you have received it by mistake please let us know by reply email and delete it from your system. It is prohibited to copy this message or disclose its content to anyone. Any confidentiality or privilege is not waived or lost by any mistaken delivery or unauthorized disclosure of the message. All messages sent to and from Agoda may be monitored to ensure compliance with company policies, to protect the company's interests and to remove potential malware. Electronic messages may be intercepted, amended, lost or deleted, or contain viruses.