Hi Tony,

 

If there was no instance power reset or reboot actions, probably it was shutdown by libvirt/quemu(the instance's qemu process could abnormally exit, if so you could find clue in libvirt or qemu logs). There is period task in nova-compute to sync instance state with libvirt.

https://opendev.org/openstack/nova/src/branch/master/nova/compute/manager.py#L10287

 

 

To HA(Masakari), if one compute node meets host failure, HA(Masakari) will disable the nova-compute service. It needs administrator to enable the nova-compute service again after host failure is completely fixed.

 

发件人: Karera Tony <tonykarera@gmail.com>
发送时间: 2024126 20:11
收件人: Sam Su (苏正伟) <suzhengwei@inspur.com>
抄送: openstack-discuss@lists.openstack.org
主题: Re: VMs shut themselves down

 

Hello Sam,

 

Yes Masakari is enabled.

 

My main issue is what caused the VMs fo shutdown as there was no power reset or reboot.

 

I checked on Horizon and found out that compute 1 was disabled and all is did was to re enable it. But I dont know what made it to be disabled.

Regards

 

Tony Karera

 

 

 

 

On Fri, Jan 26, 2024 at 11:30AM Sam Su (苏正伟) <suzhengwei@inspur.com> wrote:

From the log, three vms evacuate to other compute node, and the rest vms still remain on this compute node and reboot when nova-compute start again.

IMO the compute node meeted host failure. You can dig it out from system log.

Did you enabled HA(Masakari)?

Did the compute host power reset or reboot?

Did the host system crash?

...

More clue helps.

 

发件人: Karera Tony <tonykarera@gmail.com>
发送时间: 2024126 16:04
收件人: openstack-discuss <openstack-discuss@lists.openstack.org>
主题: VMs shut themselves down

 

Hello Team,
I have an openstack environment with 4 compute Nodes however yesterday out of the blue, the Instances on one of the compute nodes started shutting themselves down.
Then I realized the the compute service was disabled when I checked in Horizon. I enabled it and restarted the instances and all was well but I cant figure out what caused it.
I have attached the nova_compute logs here incase someone would like to support

 

Regards

 

Tony Karera