<div dir="ltr"><div><div><div><div><div><div><div>Hi all:<br><br></div>I upgrade Openstack to Icehouse and find that there is a new horizon feature in which VM can be live migrated. So I tried to move a VM from node2 to node1, but got a "<strong>Error: </strong>Failed to live migrate instance to host "node1.expr-zone"." error. <br>
<br></div>There seems no error logs in nova compute services of node1 or node2, the nova api and nova schduler on controller does not give any hints either. The only error is found in apache error log:<br><br>[Tue May 06 08:18:32 2014] [error] REQ: curl -i '<a href="http://controller:8774/v2/53707d290204404dbff625378969c25c/os-hypervisors/detail">http://controller:8774/v2/53707d290204404dbff625378969c25c/os-hypervisors/detail</a>' -X GET -H "X-Auth-Project-Id: 53707d290204404dbff625378969c25c" -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-Auth-Token: 6e3dcd16941b44a6aa19b07c64a4374f"<br>
[Tue May 06 08:18:32 2014] [error] <br>[Tue May 06 08:18:32 2014] [error] RESP: [200] CaseInsensitiveDict({'date': 'Tue, 06 May 2014 08:18:32 GMT', 'content-length': '1561', 'content-type': 'application/json', 'x-compute-request-id': 'req-75b0e3d3-4f66-459d-a54f-b35163c6a730'})<br>
[Tue May 06 08:18:32 2014] [error] RESP BODY: {"hypervisors": [{"service": {"host": "node1", "id": 6}, "vcpus_used": 12, "hypervisor_type": "QEMU", "local_gb_used": 240, "host_ip": "20.0.0.11", "hypervisor_hostname": "node1.expr-zone", "memory_mb_used": 25088, "memory_mb": 128898, "current_workload": 0, "vcpus": 24, "cpu_info": "{\\"vendor\\": \\"Intel\\", \\"model\\": \\"SandyBridge\\", \\"arch\\": \\"x86_64\\", \\"features\\": [\\"pdpe1gb\\", \\"osxsave\\", \\"dca\\", \\"pcid\\", \\"pdcm\\", \\"xtpr\\", \\"tm2\\", \\"est\\", \\"smx\\", \\"vmx\\", \\"ds_cpl\\", \\"monitor\\", \\"dtes64\\", \\"pbe\\", \\"tm\\", \\"ht\\", \\"ss\\", \\"acpi\\", \\"ds\\", \\"vme\\"], \\"topology\\": {\\"cores\\": 6, \\"threads\\": 2, \\"sockets\\": 1}}", "running_vms": 3, "free_disk_gb": 1728, "hypervisor_version": 1005000, "disk_available_least": 1396, "local_gb": 1968, "free_ram_mb": 103810, "id": 1}, {"service": {"host": "node2", "id": 8}, "vcpus_used": 13, "hypervisor_type": "QEMU", "local_gb_used": 222, "host_ip": "20.0.0.12", "hypervisor_hostname": "node2.expr-zone", "memory_mb_used": 24064, "memory_mb": 128909, "current_workload": 0, "vcpus": 24, "cpu_info": "{\\"vendor\\": \\"Intel\\", \\"model\\": \\"SandyBridge\\", \\"arch\\": \\"x86_64\\", \\"features\\": [\\"pdpe1gb\\", \\"osxsave\\", \\"dca\\", \\"pcid\\", \\"pdcm\\", \\"xtpr\\", \\"tm2\\", \\"est\\", \\"smx\\", \\"vmx\\", \\"ds_cpl\\", \\"monitor\\", \\"dtes64\\", \\"pbe\\", \\"tm\\", \\"ht\\", \\"ss\\", \\"acpi\\", \\"ds\\", \\"vme\\"], \\"topology\\": {\\"cores\\": 6, \\"threads\\": 2, \\"sockets\\": 1}}", "running_vms": 7, "free_disk_gb": 1746, "hypervisor_version": 1005000, "disk_available_least": 1398, "local_gb": 1968, "free_ram_mb": 104845, "id": 2}]}<br>
[Tue May 06 08:18:32 2014] [error] <br>[Tue May 06 08:18:32 2014] [error] <br>[Tue May 06 08:18:32 2014] [error] REQ: curl -i '<a href="http://controller:8774/v2/53707d290204404dbff625378969c25c/servers/f1df31ff-6e42-44ed-8697-1bd0dd708762/action">http://controller:8774/v2/53707d290204404dbff625378969c25c/servers/f1df31ff-6e42-44ed-8697-1bd0dd708762/action</a>' -X POST -H "X-Auth-Project-Id: 53707d290204404dbff625378969c25c" -H "User-Agent: python-novaclient" -H "Content-Type: application/json" -H "Accept: application/json" -H "X-Auth-Token: 6e3dcd16941b44a6aa19b07c64a4374f" -d '{"os-migrateLive": {"disk_over_commit": false, "block_migration": false, "host": "node1.expr-zone"}}'<br>
[Tue May 06 08:18:32 2014] [error] <br>[Tue May 06 08:18:33 2014] [error] RESP: [400] CaseInsensitiveDict({'date': 'Tue, 06 May 2014 08:18:33 GMT', 'content-length': '107', 'content-type': 'application/json; charset=UTF-8', 'x-compute-request-id': 'req-ede459ef-cea4-42d3-a212-abe63021c05d'})<br>
[Tue May 06 08:18:33 2014] [error] RESP BODY: {"badRequest": {"message": "Compute service of node1.expr-zone is unavailable at this time.", "code": 400}}<br>[Tue May 06 08:18:33 2014] [error] <br>
[Tue May 06 08:18:33 2014] [error] Recoverable error: Compute service of node1.expr-zone is unavailable at this time. (HTTP 400) (Request-ID: req-ede459ef-cea4-42d3-a212-abe63021c05d)<br><br><br></div>the services seems to be up :<br>
root@controller:/usr/src/horizon# nova-manage service list<br>Binary Host Zone Status State Updated_At<br>nova-scheduler controller internal enabled :-) 2014-05-06 08:28:57<br>
nova-cert controller internal enabled :-) 2014-05-06 08:28:57<br>nova-consoleauth controller internal enabled :-) 2014-05-06 08:28:57<br>
nova-conductor controller internal enabled :-) 2014-05-06 08:28:57<br>nova-compute node1 nova enabled :-) 2014-05-06 08:28:52<br>
nova-conductor node1 internal enabled :-) 2014-05-06 08:28:37<br>nova-compute node2 nova enabled :-) 2014-05-06 08:28:58<br>
nova-conductor node2 internal enabled :-) 2014-05-06 08:29:14<br><br></div>So how can I solve this problem?<br><br></div>Thanks<br><br></div>Wenmao Liu<br></div>NSFOCUS Inc<br>
</div>