[Nova] Instances can't be started after compute nodes unexpectedly shut down because of power outage
Gökhan IŞIK
skylightcoder at gmail.com
Thu Jul 11 18:39:11 UTC 2019
I run virsh list --all command and output is below:
root at compute06:~# virsh list --all
Id Name State
----------------------------------------------------
- instance-000012f9 shut off
- instance-000013b6 shut off
- instance-000016fb shut off
- instance-0000190a shut off
- instance-00001a8a shut off
- instance-00001e05 shut off
- instance-0000202a shut off
- instance-00002135 shut off
- instance-00002141 shut off
- instance-000021b6 shut off
- instance-000021ec shut off
- instance-000023db shut off
- instance-00002ad7 shut off
And also when I try start instances with virsh , output is below:
root at compute06:~# virsh start instance-0000219b
error: Failed to start domain instance-000012f9
error: internal error: process exited while connecting to monitor:
2019-07-11T18:36:34.229534Z qemu-system-x86_64: -chardev
pty,id=charserial0,logfile=/dev/fdset/2,logappend=on: char device
redirected to /dev/pts/3 (label charserial0)
2019-07-11T18:36:34.243395Z qemu-system-x86_64: -drive
file=/var/lib/nova/instances/659b5853-d094-4425-85a9-5bcacf88c84e/disk,format=qcow2,if=none,id=drive-virtio-disk0,cache=none,discard=ignore:
Failed to get "write" lock
Is another process using the image?
Thanks,
Gökhan
Donny Davis <donny at fortnebula.com>, 11 Tem 2019 Per, 21:06 tarihinde şunu
yazdı:
> Can you ssh to the hypervisor and run virsh list to make sure your
> instances are in fact down?
>
> On Thu, Jul 11, 2019 at 3:02 AM Gökhan IŞIK <skylightcoder at gmail.com>
> wrote:
>
>> Can anyone help me please ? I can no't rescue my instances yet :(
>>
>> Thanks,
>> Gökhan
>>
>> Gökhan IŞIK <skylightcoder at gmail.com>, 9 Tem 2019 Sal, 15:46 tarihinde
>> şunu yazdı:
>>
>>> Hi folks,
>>> Because of power outage, Most of our compute nodes unexpectedly
>>> shut down and now I can not start our instances. Error message is "Failed
>>> to get "write" lock another process using the image?". Instances Power
>>> status is No State. Full error log is
>>> http://paste.openstack.org/show/754107/. My environment is OpenStack
>>> Pike on Ubuntu 16.04 LTS servers and Instances are on a nfs shared storage.
>>> Nova version is 16.1.6.dev2. qemu version is 2.10.1. libvirt version is
>>> 3.6.0. I saw a commit [1], but it doesn't solve this problem.
>>> There are important instances on my environment. How can I rescue my
>>> instances? What would you suggest ?
>>>
>>> Thanks,
>>> Gökhan
>>>
>>> [1] https://review.opendev.org/#/c/509774/
>>>
>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-discuss/attachments/20190711/fba4fb1b/attachment.html>
More information about the openstack-discuss
mailing list