[Openstack] Live Migrate failed

Andrew Stringer andrew at rainsbrook.co.uk
Tue May 6 09:59:21 UTC 2014


Hi Wenmao,

> Hi all:
> 
> I upgrade Openstack to Icehouse and find that there is a new horizon feature in which VM can be live migrated. So I tried to move a VM from node2 to node1, but got a "Error: Failed to live
> migrate instance to host "node1.expr-zone"." error.
> 
> There seems no error logs in nova compute services of node1 or node2, the nova api and nova schduler on controller does not give any hints either. The only error is found  in apache error
> log:
> 
> [Tue May 06 08:18:32 2014] [error] REQ: curl -i 'http://controller:8774/v2/53707d290204404dbff625378969c25c/os-hypervisors/detail' -X GET -H "X-Auth-Project-Id:
> 53707d290204404dbff625378969c25c" -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-Auth-Token: 6e3dcd16941b44a6aa19b07c64a4374f"
> [Tue May 06 08:18:32 2014] [error]
> [Tue May 06 08:18:32 2014] [error] RESP: [200] CaseInsensitiveDict({'date': 'Tue, 06 May 2014 08:18:32 GMT', 'content-length': '1561', 'content-type': 'application/json',
> 'x-compute-request-id': 'req-75b0e3d3-4f66-459d-a54f-b35163c6a730'})
> [Tue May 06 08:18:32 2014] [error] RESP BODY: {"hypervisors": [{"service": {"host": "node1", "id": 6}, "vcpus_used": 12, "hypervisor_type": "QEMU", "local_gb_used": 240, "host_ip":
> "20.0.0.11", "hypervisor_hostname": "node1.expr-zone", "memory_mb_used": 25088, "memory_mb": 128898, "current_workload": 0, "vcpus": 24, "cpu_info": "{\\"vendor\\": \\"Intel\\",
> \\"model\\": \\"SandyBridge\\", \\"arch\\": \\"x86_64\\", \\"features\\": [\\"pdpe1gb\\", \\"osxsave\\", \\"dca\\", \\"pcid\\", \\"pdcm\\", \\"xtpr\\", \\"tm2\\", \\"est\\", \\"smx\\",
> \\"vmx\\", \\"ds_cpl\\", \\"monitor\\", \\"dtes64\\", \\"pbe\\", \\"tm\\", \\"ht\\", \\"ss\\", \\"acpi\\", \\"ds\\", \\"vme\\"], \\"topology\\": {\\"cores\\": 6, \\"threads\\": 2,
> \\"sockets\\": 1}}", "running_vms": 3, "free_disk_gb": 1728, "hypervisor_version": 1005000, "disk_available_least": 1396, "local_gb": 1968, "free_ram_mb": 103810, "id": 1}, {"service":
> {"host": "node2", "id": 8}, "vcpus_used": 13, "hypervisor_type": "QEMU", "local_gb_used": 222, "host_ip": "20.0.0.12", "hypervisor_hostname": "node2.expr-zone", "memory_mb_used": 24064,
> "memory_mb": 128909, "current_workload": 0, "vcpus": 24, "cpu_info": "{\\"vendor\\": \\"Intel\\", \\"model\\": \\"SandyBridge\\", \\"arch\\": \\"x86_64\\", \\"features\\": [\\"pdpe1gb\\",
> \\"osxsave\\", \\"dca\\", \\"pcid\\", \\"pdcm\\", \\"xtpr\\", \\"tm2\\", \\"est\\", \\"smx\\", \\"vmx\\", \\"ds_cpl\\", \\"monitor\\", \\"dtes64\\", \\"pbe\\", \\"tm\\", \\"ht\\", \\"ss\\",
> \\"acpi\\", \\"ds\\", \\"vme\\"], \\"topology\\": {\\"cores\\": 6, \\"threads\\": 2, \\"sockets\\": 1}}", "running_vms": 7, "free_disk_gb": 1746, "hypervisor_version": 1005000,
> "disk_available_least": 1398, "local_gb": 1968, "free_ram_mb": 104845, "id": 2}]}
> [Tue May 06 08:18:32 2014] [error]
> [Tue May 06 08:18:32 2014] [error]
> [Tue May 06 08:18:32 2014] [error] REQ: curl -i 'http://controller:8774/v2/53707d290204404dbff625378969c25c/servers/f1df31ff-6e42-44ed-8697-1bd0dd708762/action' -X POST -H
> "X-Auth-Project-Id: 53707d290204404dbff625378969c25c" -H "User-Agent: python-novaclient" -H "Content-Type: application/json" -H "Accept: application/json" -H "X-Auth-Token:
> 6e3dcd16941b44a6aa19b07c64a4374f" -d '{"os-migrateLive": {"disk_over_commit": false, "block_migration": false, "host": "node1.expr-zone"}}'
> [Tue May 06 08:18:32 2014] [error]
> [Tue May 06 08:18:33 2014] [error] RESP: [400] CaseInsensitiveDict({'date': 'Tue, 06 May 2014 08:18:33 GMT', 'content-length': '107', 'content-type': 'application/json; charset=UTF-8',
> 'x-compute-request-id': 'req-ede459ef-cea4-42d3-a212-abe63021c05d'})
> [Tue May 06 08:18:33 2014] [error] RESP BODY: {"badRequest": {"message": "Compute service of node1.expr-zone is unavailable at this time.", "code": 400}}
> [Tue May 06 08:18:33 2014] [error]
> [Tue May 06 08:18:33 2014] [error] Recoverable error: Compute service of node1.expr-zone is unavailable at this time. (HTTP 400) (Request-ID: req-ede459ef-cea4-42d3-a212-abe63021c05d)
> 
> 
> the services seems to be up :
> root at controller:/usr/src/horizon# nova-manage service list
> Binary           Host                                 Zone             Status     State Updated_At
> nova-scheduler   controller                           internal         enabled    :-)   2014-05-06 08:28:57
> nova-cert        controller                           internal         enabled    :-)   2014-05-06 08:28:57
> nova-consoleauth controller                           internal         enabled    :-)   2014-05-06 08:28:57
> nova-conductor   controller                           internal         enabled    :-)   2014-05-06 08:28:57
> nova-compute     node1                                nova             enabled    :-)   2014-05-06 08:28:52
> nova-conductor   node1                                internal         enabled    :-)   2014-05-06 08:28:37
> nova-compute     node2                                nova             enabled    :-)   2014-05-06 08:28:58
> nova-conductor   node2                                internal         enabled    :-)   2014-05-06 08:29:14
> 
> So how can I solve this problem?
> 
> Thanks
> 
> Wenmao Liu
> NSFOCUS Inc
> 
>

I haven't tried Icehouse, but I have block live migration working on 
Havana, but to set this up, you have to edit some files to allow libvirt 
to do the work, this post seems to sum up what is needed and it works 
reliable for me.

http://kimizhang.wordpress.com/2013/08/26/openstack-vm-live-migration/

However, the migation is all done from the command line, not through 
Horizon.

Regards,
Andrew.




-- 
Windows, for life without walls.
Linux, for life without Windows.


More information about the Openstack mailing list