[Openstack] [Grizzly] Unable to reboot instance after Migrate

Guilherme Russi luisguilherme.cr at gmail.com
Mon Sep 9 15:49:52 UTC 2013


Hello Happy,

 I've my NFS configuration again, but I keep getting this error on my
compute's logs:

Live Migration failure: not all arguments converted during string formatting

I don't know if it's a problem with my nova or my libvirt, my compute nodes
connect to another NFS server that is not my controller node, would may be
it?

Thank you.


2013/9/4 happy idea <guolongcang.work at gmail.com>

> o ...I just disable the firewall.....$ufw  disable
>
>
> 2013/9/5 Guilherme Russi <luisguilherme.cr at gmail.com>
>
>> Just to check, How did you do this part?
>>
>> 7. Configure your firewall to allow libvirt to communicate between nodes.
>>
>> Thank you.
>>
>>
>> 2013/9/3 happy idea <guolongcang.work at gmail.com>
>>
>>>
>>> follow this page's guide *carefully* ,
>>> http://docs.openstack.org/trunk/openstack-compute/admin/content/configuring-live-migrations.html
>>> replace 'NOVA-INST-DIR'  with '/var/lib/nova'
>>>
>>>
>>> 2013/9/4 Guilherme Russi <luisguilherme.cr at gmail.com>
>>>
>>>> Hey there, I made my NFS configuration again, I made this way:
>>>>
>>>> Controller node:
>>>> 1- mkdir -p /local2/instances
>>>>
>>>> 2- mount --bind /var/lib/nova/instances /local2/instances
>>>>
>>>> 3- added this inside /etc/exports
>>>> /var/lib/nova/instances
>>>> 192.168.3.0/24(rw,sync,fsid=0,no_root_squash,no_subtree_check)
>>>> /local2/instances
>>>> 192.168.3.0/24(rw,sync,fsid=0,no_root_squash,no_subtree_check,nohide)
>>>>
>>>> 4- added this inside /etc/fstab
>>>> /var/lib/nova/instances /local2/instances none bind 0 0
>>>>
>>>>
>>>> Compute node:
>>>> 1- added inside /etc/fstab
>>>> 192.168.3.1:/    /var/lib/nova/instances       nfs4     defaults
>>>>  0       0
>>>>
>>>>  2- mount -t nfs4 192.168.3.1:/ /var/lib/nova/instances/
>>>>
>>>> Do I need to do anything else?
>>>>
>>>> Regards.
>>>>
>>>> Guilherme.
>>>>
>>>>
>>>> 2013/9/1 happy idea <guolongcang.work at gmail.com>
>>>>
>>>>> 2013-08-30 14:42:51.569 12667 ERROR nova.virt.libvirt.driver [-]
>>>>> Getting disk size of instance-0000007d: [Errno 2] No such file or
>>>>> directory: '/var/lib/nova/instances/72ec37a3-b209-4729-b628-
>>>>> 005fdcea5a3c/disk'
>>>>>
>>>>> *I think may be your NFS config is not correct.*
>>>>>
>>>>>
>>>>> 2013/8/31 Guilherme Russi <luisguilherme.cr at gmail.com>
>>>>>
>>>>>> Hello Happy, these are my logs:
>>>>>>
>>>>>> 2013-08-30 14:42:51.402 12667 AUDIT nova.compute.resource_tracker
>>>>>> [-] Auditing locally available compute resources
>>>>>> 2013-08-30 14:42:51.562 12667 ERROR nova.virt.libvirt.driver [-]
>>>>>> Getting disk size of instance-00000084: [Errno 2] No such file or
>>>>>> directory:
>>>>>> '/var/lib/nova/instances/c9e1c5ed-a108-4196-bfbc-24495e2e71bd/disk'
>>>>>> 2013-08-30 14:42:51.564 12667 ERROR nova.virt.libvirt.driver [-]
>>>>>> Getting disk size of instance-00000077: [Errno 2] No such file or
>>>>>> directory:
>>>>>> '/var/lib/nova/instances/483f98e3-8ef5-43e2-8c3a-def55abdabcd/disk'
>>>>>> 2013-08-30 14:42:51.567 12667 ERROR nova.virt.libvirt.driver [-]
>>>>>> Getting disk size of instance-000000bd: [Errno 2] No such file or
>>>>>> directory:
>>>>>> '/var/lib/nova/instances/66abd40e-fb19-4cbe-a248-61d968fd84b7/disk'
>>>>>> 2013-08-30 14:42:51.569 12667 ERROR nova.virt.libvirt.driver [-]
>>>>>> Getting disk size of instance-0000007d: [Errno 2] No such file or
>>>>>> directory:
>>>>>> '/var/lib/nova/instances/72ec37a3-b209-4729-b628-005fdcea5a3c/disk'
>>>>>> 2013-08-30 14:42:51.679 12667 AUDIT nova.compute.resource_tracker
>>>>>> [-] Free ram (MB): 2746
>>>>>> 2013-08-30 14:42:51.679 12667 AUDIT nova.compute.resource_tracker
>>>>>> [-] Free disk (GB): 53
>>>>>> 2013-08-30 14:42:51.679 12667 AUDIT nova.compute.resource_tracker
>>>>>> [-] Free VCPUS: 1
>>>>>> 2013-08-30 14:42:51.773 12667 INFO nova.compute.resource_tracker [-]
>>>>>> Compute_service record updated for caos:caos
>>>>>> 2013-08-30 14:42:51.774 12667 INFO nova.compute.manager [-] Updating
>>>>>> host status
>>>>>>
>>>>>>
>>>>>> And here the output when I run the command:
>>>>>>
>>>>>> ERROR: Live migration of instance
>>>>>> c9af3e9e-87b1-4aa3-95aa-22700e1091e4 to host tiresias failed (HTTP 400)
>>>>>> (Request-ID: req-630d7837-6886-4e23-bc3d-a9fccc4a8868)
>>>>>>
>>>>>> My destiny host awsers ping when I ping.
>>>>>>
>>>>>> I've been fighting against it a quite while without success.
>>>>>>
>>>>>> Regards.
>>>>>>
>>>>>> Guilherme.
>>>>>>
>>>>>>
>>>>>> 2013/8/29 happy idea <guolongcang.work at gmail.com>
>>>>>>
>>>>>>> OK.
>>>>>>>
>>>>>>>
>>>>>>> 2013/8/30 Guilherme Russi <luisguilherme.cr at gmail.com>
>>>>>>>
>>>>>>>> I am too, if I find something I'll let you know.
>>>>>>>>
>>>>>>>> Regards.
>>>>>>>>
>>>>>>>>
>>>>>>>> 2013/8/29 happy idea <guolongcang.work at gmail.com>
>>>>>>>>
>>>>>>>>> I am trying to figure out what cause the bug.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> 2013/8/30 Guilherme Russi <luisguilherme.cr at gmail.com>
>>>>>>>>>
>>>>>>>>>> Well mine are:
>>>>>>>>>>
>>>>>>>>>> ii  nova-api
>>>>>>>>>> 1:2013.1-0ubuntu2.1~cloud0              OpenStack Compute - API frontend
>>>>>>>>>> ii  nova-cert
>>>>>>>>>>  1:2013.1-0ubuntu2.1~cloud0              OpenStack Compute - certificate
>>>>>>>>>> management
>>>>>>>>>> ii  nova-common
>>>>>>>>>>  1:2013.1-0ubuntu2.1~cloud0              OpenStack Compute - common files
>>>>>>>>>> ii  nova-conductor
>>>>>>>>>> 1:2013.1-0ubuntu2.1~cloud0              OpenStack Compute - conductor
>>>>>>>>>> service
>>>>>>>>>> ii  nova-consoleauth
>>>>>>>>>> 1:2013.1-0ubuntu2.1~cloud0              OpenStack Compute - Console
>>>>>>>>>> Authenticator
>>>>>>>>>> ii  nova-novncproxy
>>>>>>>>>>  1:2013.1-0ubuntu2.1~cloud0              OpenStack Compute - NoVNC proxy
>>>>>>>>>> ii  nova-scheduler
>>>>>>>>>> 1:2013.1-0ubuntu2.1~cloud0              OpenStack Compute - virtual machine
>>>>>>>>>> scheduler
>>>>>>>>>> ii  python-nova
>>>>>>>>>>  1:2013.1-0ubuntu2.1~cloud0              OpenStack Compute Python libraries
>>>>>>>>>> ii  python-novaclient
>>>>>>>>>>  1:2.13.0-0ubuntu1~cloud0
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> 2013/8/29 happy idea <guolongcang.work at gmail.com>
>>>>>>>>>>
>>>>>>>>>>> Thank you.
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> 2013/8/29 Razique Mahroua <razique.mahroua at gmail.com>
>>>>>>>>>>>
>>>>>>>>>>>> Looks like a bug to me, definitely….
>>>>>>>>>>>> but i can be wrong though
>>>>>>>>>>>>
>>>>>>>>>>>> *Razique Mahroua** - **Nuage & Co*
>>>>>>>>>>>> razique.mahroua at gmail.com
>>>>>>>>>>>> Tel : +33 9 72 37 94 15
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> Le 29 août 2013 à 11:29, happy idea <guolongcang.work at gmail.com>
>>>>>>>>>>>> a écrit :
>>>>>>>>>>>>
>>>>>>>>>>>> Thank you.
>>>>>>>>>>>>
>>>>>>>>>>>> ---------- Forwarded message ----------
>>>>>>>>>>>> From: happy idea <guolongcang.work at gmail.com>
>>>>>>>>>>>> Date: 2013/8/29
>>>>>>>>>>>> Subject: [Openstack][Grizzly] Unable to reboot instance after
>>>>>>>>>>>> Migrate
>>>>>>>>>>>> To: openstack <openstack at lists.openstack.org>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>  Hi All,
>>>>>>>>>>>>
>>>>>>>>>>>> Here's the stacktrace log:
>>>>>>>>>>>>
>>>>>>>>>>>> 2013-08-29 15:12:29.515 WARNING nova.compute.manager
>>>>>>>>>>>> [req-31944080-1a33-4679-98ce-af36e3660679 ae0f00ede33f42d9a12385b2c2ce8c0d
>>>>>>>>>>>> 57d53e1dcff540b6aeaf0d6fd60be7ab] [instance:
>>>>>>>>>>>> 038dbba7-534b-4c03-8914-a830c424ce21] Traceback (most recent call last):
>>>>>>>>>>>>   File
>>>>>>>>>>>> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1718, in
>>>>>>>>>>>> reboot_instance
>>>>>>>>>>>>     bad_volumes_callback=bad_volumes_callback)
>>>>>>>>>>>>   File
>>>>>>>>>>>> "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1295,
>>>>>>>>>>>> in reboot
>>>>>>>>>>>>     block_device_info)
>>>>>>>>>>>>   File
>>>>>>>>>>>> "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1371,
>>>>>>>>>>>> in _hard_reboot
>>>>>>>>>>>>     self._create_images_and_backing(context, instance,
>>>>>>>>>>>> disk_info_json)
>>>>>>>>>>>>   File
>>>>>>>>>>>> "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3248,
>>>>>>>>>>>> in _create_images_and_backing
>>>>>>>>>>>>     cache_name = os.path.basename(info['backing_file'])
>>>>>>>>>>>>   File "/usr/lib/python2.7/posixpath.py", line 121, in basename
>>>>>>>>>>>>     i = p.rfind('/') + 1
>>>>>>>>>>>> AttributeError: 'NoneType' object has no attribute 'rfind'
>>>>>>>>>>>>
>>>>>>>>>>>> 2013-08-29 15:12:29.516 ERROR nova.compute.manager
>>>>>>>>>>>> [req-31944080-1a33-4679-98ce-af36e3660679 ae0f00ede33f42d9a12385b2c2ce8c0d
>>>>>>>>>>>> 57d53e1dcff540b6aeaf0d6fd60be7ab] [instance:
>>>>>>>>>>>> 038dbba7-534b-4c03-8914-a830c424ce21] Cannot reboot instance: 'NoneType'
>>>>>>>>>>>> object has no attribute 'rfind'
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> Looking for any help.
>>>>>>>>>>>> Regards.
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> _______________________________________________
>>>>>>>>>>> Mailing list:
>>>>>>>>>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>>>>>>>>>> Post to     : openstack at lists.openstack.org
>>>>>>>>>>> Unsubscribe :
>>>>>>>>>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20130909/3041906b/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: NUAGECO-LOGO-Fblan_petit.jpg
Type: image/jpeg
Size: 10122 bytes
Desc: not available
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20130909/3041906b/attachment.jpg>


More information about the Openstack mailing list