[Openstack] [Grizzly] Unable to reboot instance after Migrate

happy idea guolongcang.work at gmail.com
Tue Sep 10 05:23:41 UTC 2013


"Live Migration failure: not all arguments converted during string
formatting"
You need to find the error code location, and log the stacktrace.


2013/9/9 Guilherme Russi <luisguilherme.cr at gmail.com>

> Hello Happy,
>
>  I've my NFS configuration again, but I keep getting this error on my
> compute's logs:
>
> Live Migration failure: not all arguments converted during string
> formatting
>
> I don't know if it's a problem with my nova or my libvirt, my compute
> nodes connect to another NFS server that is not my controller node, would
> may be it?
>
> Thank you.
>
>
> 2013/9/4 happy idea <guolongcang.work at gmail.com>
>
>> o ...I just disable the firewall.....$ufw  disable
>>
>>
>> 2013/9/5 Guilherme Russi <luisguilherme.cr at gmail.com>
>>
>>> Just to check, How did you do this part?
>>>
>>> 7. Configure your firewall to allow libvirt to communicate between nodes.
>>>
>>> Thank you.
>>>
>>>
>>> 2013/9/3 happy idea <guolongcang.work at gmail.com>
>>>
>>>>
>>>> follow this page's guide *carefully* ,
>>>> http://docs.openstack.org/trunk/openstack-compute/admin/content/configuring-live-migrations.html
>>>> replace 'NOVA-INST-DIR'  with '/var/lib/nova'
>>>>
>>>>
>>>> 2013/9/4 Guilherme Russi <luisguilherme.cr at gmail.com>
>>>>
>>>>> Hey there, I made my NFS configuration again, I made this way:
>>>>>
>>>>> Controller node:
>>>>> 1- mkdir -p /local2/instances
>>>>>
>>>>> 2- mount --bind /var/lib/nova/instances /local2/instances
>>>>>
>>>>> 3- added this inside /etc/exports
>>>>> /var/lib/nova/instances
>>>>> 192.168.3.0/24(rw,sync,fsid=0,no_root_squash,no_subtree_check)
>>>>> /local2/instances
>>>>> 192.168.3.0/24(rw,sync,fsid=0,no_root_squash,no_subtree_check,nohide)
>>>>>
>>>>> 4- added this inside /etc/fstab
>>>>> /var/lib/nova/instances /local2/instances none bind 0 0
>>>>>
>>>>>
>>>>> Compute node:
>>>>> 1- added inside /etc/fstab
>>>>> 192.168.3.1:/    /var/lib/nova/instances       nfs4     defaults
>>>>>    0       0
>>>>>
>>>>>  2- mount -t nfs4 192.168.3.1:/ /var/lib/nova/instances/
>>>>>
>>>>> Do I need to do anything else?
>>>>>
>>>>> Regards.
>>>>>
>>>>> Guilherme.
>>>>>
>>>>>
>>>>> 2013/9/1 happy idea <guolongcang.work at gmail.com>
>>>>>
>>>>>> 2013-08-30 14:42:51.569 12667 ERROR nova.virt.libvirt.driver [-]
>>>>>> Getting disk size of instance-0000007d: [Errno 2] No such file or
>>>>>> directory: '/var/lib/nova/instances/72ec37a3-b209-4729-b628-
>>>>>> 005fdcea5a3c/disk'
>>>>>>
>>>>>> *I think may be your NFS config is not correct.*
>>>>>>
>>>>>>
>>>>>> 2013/8/31 Guilherme Russi <luisguilherme.cr at gmail.com>
>>>>>>
>>>>>>> Hello Happy, these are my logs:
>>>>>>>
>>>>>>> 2013-08-30 14:42:51.402 12667 AUDIT nova.compute.resource_tracker
>>>>>>> [-] Auditing locally available compute resources
>>>>>>> 2013-08-30 14:42:51.562 12667 ERROR nova.virt.libvirt.driver [-]
>>>>>>> Getting disk size of instance-00000084: [Errno 2] No such file or
>>>>>>> directory:
>>>>>>> '/var/lib/nova/instances/c9e1c5ed-a108-4196-bfbc-24495e2e71bd/disk'
>>>>>>> 2013-08-30 14:42:51.564 12667 ERROR nova.virt.libvirt.driver [-]
>>>>>>> Getting disk size of instance-00000077: [Errno 2] No such file or
>>>>>>> directory:
>>>>>>> '/var/lib/nova/instances/483f98e3-8ef5-43e2-8c3a-def55abdabcd/disk'
>>>>>>> 2013-08-30 14:42:51.567 12667 ERROR nova.virt.libvirt.driver [-]
>>>>>>> Getting disk size of instance-000000bd: [Errno 2] No such file or
>>>>>>> directory:
>>>>>>> '/var/lib/nova/instances/66abd40e-fb19-4cbe-a248-61d968fd84b7/disk'
>>>>>>> 2013-08-30 14:42:51.569 12667 ERROR nova.virt.libvirt.driver [-]
>>>>>>> Getting disk size of instance-0000007d: [Errno 2] No such file or
>>>>>>> directory:
>>>>>>> '/var/lib/nova/instances/72ec37a3-b209-4729-b628-005fdcea5a3c/disk'
>>>>>>> 2013-08-30 14:42:51.679 12667 AUDIT nova.compute.resource_tracker
>>>>>>> [-] Free ram (MB): 2746
>>>>>>> 2013-08-30 14:42:51.679 12667 AUDIT nova.compute.resource_tracker
>>>>>>> [-] Free disk (GB): 53
>>>>>>> 2013-08-30 14:42:51.679 12667 AUDIT nova.compute.resource_tracker
>>>>>>> [-] Free VCPUS: 1
>>>>>>> 2013-08-30 14:42:51.773 12667 INFO nova.compute.resource_tracker
>>>>>>> [-] Compute_service record updated for caos:caos
>>>>>>> 2013-08-30 14:42:51.774 12667 INFO nova.compute.manager [-]
>>>>>>> Updating host status
>>>>>>>
>>>>>>>
>>>>>>> And here the output when I run the command:
>>>>>>>
>>>>>>> ERROR: Live migration of instance
>>>>>>> c9af3e9e-87b1-4aa3-95aa-22700e1091e4 to host tiresias failed (HTTP 400)
>>>>>>> (Request-ID: req-630d7837-6886-4e23-bc3d-a9fccc4a8868)
>>>>>>>
>>>>>>> My destiny host awsers ping when I ping.
>>>>>>>
>>>>>>> I've been fighting against it a quite while without success.
>>>>>>>
>>>>>>> Regards.
>>>>>>>
>>>>>>> Guilherme.
>>>>>>>
>>>>>>>
>>>>>>> 2013/8/29 happy idea <guolongcang.work at gmail.com>
>>>>>>>
>>>>>>>> OK.
>>>>>>>>
>>>>>>>>
>>>>>>>> 2013/8/30 Guilherme Russi <luisguilherme.cr at gmail.com>
>>>>>>>>
>>>>>>>>> I am too, if I find something I'll let you know.
>>>>>>>>>
>>>>>>>>> Regards.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> 2013/8/29 happy idea <guolongcang.work at gmail.com>
>>>>>>>>>
>>>>>>>>>> I am trying to figure out what cause the bug.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> 2013/8/30 Guilherme Russi <luisguilherme.cr at gmail.com>
>>>>>>>>>>
>>>>>>>>>>> Well mine are:
>>>>>>>>>>>
>>>>>>>>>>> ii  nova-api
>>>>>>>>>>> 1:2013.1-0ubuntu2.1~cloud0              OpenStack Compute - API frontend
>>>>>>>>>>> ii  nova-cert
>>>>>>>>>>>  1:2013.1-0ubuntu2.1~cloud0              OpenStack Compute - certificate
>>>>>>>>>>> management
>>>>>>>>>>> ii  nova-common
>>>>>>>>>>>  1:2013.1-0ubuntu2.1~cloud0              OpenStack Compute - common files
>>>>>>>>>>> ii  nova-conductor
>>>>>>>>>>> 1:2013.1-0ubuntu2.1~cloud0              OpenStack Compute - conductor
>>>>>>>>>>> service
>>>>>>>>>>> ii  nova-consoleauth
>>>>>>>>>>> 1:2013.1-0ubuntu2.1~cloud0              OpenStack Compute - Console
>>>>>>>>>>> Authenticator
>>>>>>>>>>> ii  nova-novncproxy
>>>>>>>>>>>  1:2013.1-0ubuntu2.1~cloud0              OpenStack Compute - NoVNC proxy
>>>>>>>>>>> ii  nova-scheduler
>>>>>>>>>>> 1:2013.1-0ubuntu2.1~cloud0              OpenStack Compute - virtual machine
>>>>>>>>>>> scheduler
>>>>>>>>>>> ii  python-nova
>>>>>>>>>>>  1:2013.1-0ubuntu2.1~cloud0              OpenStack Compute Python libraries
>>>>>>>>>>> ii  python-novaclient
>>>>>>>>>>>  1:2.13.0-0ubuntu1~cloud0
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> 2013/8/29 happy idea <guolongcang.work at gmail.com>
>>>>>>>>>>>
>>>>>>>>>>>> Thank you.
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> 2013/8/29 Razique Mahroua <razique.mahroua at gmail.com>
>>>>>>>>>>>>
>>>>>>>>>>>>> Looks like a bug to me, definitely….
>>>>>>>>>>>>> but i can be wrong though
>>>>>>>>>>>>>
>>>>>>>>>>>>> *Razique Mahroua** - **Nuage & Co*
>>>>>>>>>>>>> razique.mahroua at gmail.com
>>>>>>>>>>>>> Tel : +33 9 72 37 94 15
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> Le 29 août 2013 à 11:29, happy idea <
>>>>>>>>>>>>> guolongcang.work at gmail.com> a écrit :
>>>>>>>>>>>>>
>>>>>>>>>>>>> Thank you.
>>>>>>>>>>>>>
>>>>>>>>>>>>> ---------- Forwarded message ----------
>>>>>>>>>>>>> From: happy idea <guolongcang.work at gmail.com>
>>>>>>>>>>>>> Date: 2013/8/29
>>>>>>>>>>>>> Subject: [Openstack][Grizzly] Unable to reboot instance after
>>>>>>>>>>>>> Migrate
>>>>>>>>>>>>> To: openstack <openstack at lists.openstack.org>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>  Hi All,
>>>>>>>>>>>>>
>>>>>>>>>>>>> Here's the stacktrace log:
>>>>>>>>>>>>>
>>>>>>>>>>>>> 2013-08-29 15:12:29.515 WARNING nova.compute.manager
>>>>>>>>>>>>> [req-31944080-1a33-4679-98ce-af36e3660679 ae0f00ede33f42d9a12385b2c2ce8c0d
>>>>>>>>>>>>> 57d53e1dcff540b6aeaf0d6fd60be7ab] [instance:
>>>>>>>>>>>>> 038dbba7-534b-4c03-8914-a830c424ce21] Traceback (most recent call last):
>>>>>>>>>>>>>   File
>>>>>>>>>>>>> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1718, in
>>>>>>>>>>>>> reboot_instance
>>>>>>>>>>>>>     bad_volumes_callback=bad_volumes_callback)
>>>>>>>>>>>>>   File
>>>>>>>>>>>>> "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1295,
>>>>>>>>>>>>> in reboot
>>>>>>>>>>>>>     block_device_info)
>>>>>>>>>>>>>   File
>>>>>>>>>>>>> "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1371,
>>>>>>>>>>>>> in _hard_reboot
>>>>>>>>>>>>>     self._create_images_and_backing(context, instance,
>>>>>>>>>>>>> disk_info_json)
>>>>>>>>>>>>>   File
>>>>>>>>>>>>> "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3248,
>>>>>>>>>>>>> in _create_images_and_backing
>>>>>>>>>>>>>     cache_name = os.path.basename(info['backing_file'])
>>>>>>>>>>>>>   File "/usr/lib/python2.7/posixpath.py", line 121, in basename
>>>>>>>>>>>>>     i = p.rfind('/') + 1
>>>>>>>>>>>>> AttributeError: 'NoneType' object has no attribute 'rfind'
>>>>>>>>>>>>>
>>>>>>>>>>>>> 2013-08-29 15:12:29.516 ERROR nova.compute.manager
>>>>>>>>>>>>> [req-31944080-1a33-4679-98ce-af36e3660679 ae0f00ede33f42d9a12385b2c2ce8c0d
>>>>>>>>>>>>> 57d53e1dcff540b6aeaf0d6fd60be7ab] [instance:
>>>>>>>>>>>>> 038dbba7-534b-4c03-8914-a830c424ce21] Cannot reboot instance: 'NoneType'
>>>>>>>>>>>>> object has no attribute 'rfind'
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> Looking for any help.
>>>>>>>>>>>>> Regards.
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> _______________________________________________
>>>>>>>>>>>> Mailing list:
>>>>>>>>>>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>>>>>>>>>>> Post to     : openstack at lists.openstack.org
>>>>>>>>>>>> Unsubscribe :
>>>>>>>>>>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20130910/594386ef/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: NUAGECO-LOGO-Fblan_petit.jpg
Type: image/jpeg
Size: 10122 bytes
Desc: not available
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20130910/594386ef/attachment.jpg>


More information about the Openstack mailing list