Open Stack

Hi,

My icehouse installation fails to start VMs. I have done the installation according to installation guide but the nova-compute.log shows errors listed below. The result is the same for ubuntu 12.04 and ubuntu 14.04. I use neutron and ML2 plugin with ovs. There is no difference whether virt_type=kvm or qemu. Havana installation worked fine in the same servers. (I did clean installation for icehouse.) Do you have ideas how to fix this?

Regards,
Johanna


2014-02-03 03:02:53.135 5561 AUDIT nova.compute.manager [req-a18ba4ce-048d-4e64-b3ba-1ae7a02bf25c 222d961af18b46c1a27e254e5717bb5d 4d6cf4028cbc448f8827a43f97233389] [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783] Starting instance...
2014-02-03 03:02:53.256 5561 AUDIT nova.compute.claims [req-a18ba4ce-048d-4e64-b3ba-1ae7a02bf25c 222d961af18b46c1a27e254e5717bb5d 4d6cf4028cbc448f8827a43f97233389] [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783] Attempting claim: memory 2048 MB, disk 20 GB, VCPUs 1
2014-02-03 03:02:53.256 5561 AUDIT nova.compute.claims [req-a18ba4ce-048d-4e64-b3ba-1ae7a02bf25c 222d961af18b46c1a27e254e5717bb5d 4d6cf4028cbc448f8827a43f97233389] [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783] Total memory: 128905 MB, used: 8704.00 MB
2014-02-03 03:02:53.257 5561 AUDIT nova.compute.claims [req-a18ba4ce-048d-4e64-b3ba-1ae7a02bf25c 222d961af18b46c1a27e254e5717bb5d 4d6cf4028cbc448f8827a43f97233389] [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783] memory limit: 193357.50 MB, free: 184653.50 MB
2014-02-03 03:02:53.257 5561 AUDIT nova.compute.claims [req-a18ba4ce-048d-4e64-b3ba-1ae7a02bf25c 222d961af18b46c1a27e254e5717bb5d 4d6cf4028cbc448f8827a43f97233389] [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783] Total disk: 802 GB, used: 80.00 GB
2014-02-03 03:02:53.258 5561 AUDIT nova.compute.claims [req-a18ba4ce-048d-4e64-b3ba-1ae7a02bf25c 222d961af18b46c1a27e254e5717bb5d 4d6cf4028cbc448f8827a43f97233389] [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783] disk limit not specified, defaulting to unlimited
2014-02-03 03:02:53.258 5561 AUDIT nova.compute.claims [req-a18ba4ce-048d-4e64-b3ba-1ae7a02bf25c 222d961af18b46c1a27e254e5717bb5d 4d6cf4028cbc448f8827a43f97233389] [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783] Total CPUs: 32 VCPUs, used: 4.00 VCPUs
2014-02-03 03:02:53.259 5561 AUDIT nova.compute.claims [req-a18ba4ce-048d-4e64-b3ba-1ae7a02bf25c 222d961af18b46c1a27e254e5717bb5d 4d6cf4028cbc448f8827a43f97233389] [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783] CPUs limit not specified, defaulting to unlimited
2014-02-03 03:02:53.259 5561 AUDIT nova.compute.claims [req-a18ba4ce-048d-4e64-b3ba-1ae7a02bf25c 222d961af18b46c1a27e254e5717bb5d 4d6cf4028cbc448f8827a43f97233389] [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783] Claim successful
2014-02-03 03:02:54.314 5561 INFO nova.virt.libvirt.driver [req-a18ba4ce-048d-4e64-b3ba-1ae7a02bf25c 222d961af18b46c1a27e254e5717bb5d 4d6cf4028cbc448f8827a43f97233389] [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783] Creating image
2014-02-03 03:03:07.285 5561 WARNING nova.virt.disk.vfs.guestfs [req-a18ba4ce-048d-4e64-b3ba-1ae7a02bf25c 222d961af18b46c1a27e254e5717bb5d 4d6cf4028cbc448f8827a43f97233389] Failed to close augeas aug_close: do_aug_close: you must call 'aug-init' first to initialize Augeas
2014-02-03 03:03:25.235 5561 AUDIT nova.compute.resource_tracker [-] Auditing locally available compute resources
2014-02-03 03:03:25.923 5561 AUDIT nova.compute.resource_tracker [-] Free ram (MB): 118153
2014-02-03 03:03:25.924 5561 AUDIT nova.compute.resource_tracker [-] Free disk (GB): 702
2014-02-03 03:03:25.924 5561 AUDIT nova.compute.resource_tracker [-] Free VCPUS: 27
2014-02-03 03:03:25.985 5561 INFO nova.compute.resource_tracker [-] Compute_service record updated for icehouse229:icehouse229
2014-02-03 03:03:26.051 5561 WARNING nova.compute.manager [-] Found 5 in the database and 0 on the hypervisor.
2014-02-03 03:03:26.051 5561 INFO nova.compute.manager [-] [instance: edff8020-2002-4ef0-9370-e1b197b7ed73] During sync_power_state the instance has a pending task. Skip.
2014-02-03 03:03:26.051 5561 INFO nova.compute.manager [-] [instance: 45d96b86-c8cc-43c9-bcda-53fb20ede176] During sync_power_state the instance has a pending task. Skip.
2014-02-03 03:03:26.148 5561 INFO nova.compute.manager [-] [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783] During sync_power_state the instance has a pending task. Skip.
2014-02-03 03:03:53.782 5561 ERROR nova.compute.manager [-] Instance failed network setup after 1 attempt(s)
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager Traceback (most recent call last):
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1510, in _allocate_network_async
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager     dhcp_options=dhcp_options)
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 94, in wrapped
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager     return func(self, context, *args, **kwargs)
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 48, in wrapper
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager     res = f(self, context, *args, **kwargs)
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 302, in allocate_for_instance
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager     nw_info = self.network_rpcapi.allocate_for_instance(context, **args)
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager   File "/usr/lib/python2.7/dist-packages/nova/network/rpcapi.py", line 170, in allocate_for_instance
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager     macs=jsonutils.to_primitive(macs))
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/client.py", line 150, in call
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager     wait_for_reply=True, timeout=timeout)
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager   File "/usr/lib/python2.7/dist-packages/oslo/messaging/transport.py", line 90, in _send
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager     timeout=timeout)
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 412, in send
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager     return self._send(target, ctxt, message, wait_for_reply, timeout)
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 403, in _send
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager     result = self._waiter.wait(msg_id, timeout)
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 280, in wait
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager     reply, ending, trylock = self._poll_queue(msg_id, timeout)
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 220, in _poll_queue
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager     message = self.waiters.get(msg_id, timeout)
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 126, in get
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager     'to message ID %s' % msg_id)
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager MessagingTimeout: Timed out waiting for a reply to message ID 0f47e260dccb4dfd945eb6442108c769
2014-02-03 03:03:53.782 5561 TRACE nova.compute.manager
2014-02-03 03:03:53.786 5561 ERROR nova.compute.manager [req-a18ba4ce-048d-4e64-b3ba-1ae7a02bf25c 222d961af18b46c1a27e254e5717bb5d 4d6cf4028cbc448f8827a43f97233389] [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783] Instance failed to spawn
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783] Traceback (most recent call last):
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1720, in _spawn
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]     block_device_info)
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2250, in spawn
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]     write_to_disk=True)
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 3420, in to_xml
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]     network_info_str = str(network_info)
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]   File "/usr/lib/python2.7/dist-packages/nova/network/model.py", line 424, in __str__
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]     return self._sync_wrapper(fn, *args, **kwargs)
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]   File "/usr/lib/python2.7/dist-packages/nova/network/model.py", line 407, in _sync_wrapper
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]     self.wait()
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]   File "/usr/lib/python2.7/dist-packages/nova/network/model.py", line 439, in wait
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]     self[:] = self._gt.wait()
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]   File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 168, in wait
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]     return self._exit_event.wait()
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]   File "/usr/lib/python2.7/dist-packages/eventlet/event.py", line 116, in wait
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]     return hubs.get_hub().switch()
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]   File "/usr/lib/python2.7/dist-packages/eventlet/hubs/hub.py", line 187, in switch
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]     return self.greenlet.switch()
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]   File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 194, in main
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]     result = function(*args, **kwargs)
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1510, in _allocate_network_async
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]     dhcp_options=dhcp_options)
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 94, in wrapped
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]     return func(self, context, *args, **kwargs)
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 48, in wrapper
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]     res = f(self, context, *args, **kwargs)
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 302, in allocate_for_instance
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]     nw_info = self.network_rpcapi.allocate_for_instance(context, **args)
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]   File "/usr/lib/python2.7/dist-packages/nova/network/rpcapi.py", line 170, in allocate_for_instance
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]     macs=jsonutils.to_primitive(macs))
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/client.py", line 150, in call
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]     wait_for_reply=True, timeout=timeout)
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]   File "/usr/lib/python2.7/dist-packages/oslo/messaging/transport.py", line 90, in _send
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]     timeout=timeout)
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 412, in send
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]     return self._send(target, ctxt, message, wait_for_reply, timeout)
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 403, in _send
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]     result = self._waiter.wait(msg_id, timeout)
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 280, in wait
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]     reply, ending, trylock = self._poll_queue(msg_id, timeout)
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 220, in _poll_queue
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]     message = self.waiters.get(msg_id, timeout)
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 126, in get
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]     'to message ID %s' % msg_id)
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783] MessagingTimeout: Timed out waiting for a reply to message ID 0f47e260dccb4dfd945eb6442108c769
2014-02-03 03:03:53.786 5561 TRACE nova.compute.manager [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783]
2014-02-03 03:03:53.909 5561 AUDIT nova.compute.manager [req-a18ba4ce-048d-4e64-b3ba-1ae7a02bf25c 222d961af18b46c1a27e254e5717bb5d 4d6cf4028cbc448f8827a43f97233389] [instance: 45048c4b-d3fd-46d8-8259-a3bcf93db783] Terminating instance

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20140513/42a92b3f/attachment.html>