<div dir="ltr"><div><div><div>Hi Kevil<br><br>Log is too much mixed. Based logs here<br><br></div>Can you check your neutron credentials are working correctly with keystone ? Also I seeing error 400 it means url sent is wrong and not understood by server.<br>
</div><div>Can you run the command with --debug option and see the what is being sent to keystone ?<br></div><div><br></div>-dheeru<br></div>@Community Service<br><div><div><div><div><br></div></div></div></div></div><div class="gmail_extra">
<br><br><div class="gmail_quote">On Thu, Nov 28, 2013 at 11:31 PM, <a href="mailto:kevin.breit@kevinbreit.net">kevin.breit@kevinbreit.net</a> <span dir="ltr"><<a href="mailto:kevin.breit@kevinbreit.net" target="_blank">kevin.breit@kevinbreit.net</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word"><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">
I’m running CentOS 6.4 and using the Red Hat install guide to setup OpenStack. When I try to boot a Cirros instance, it errors out.</div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">
<br></div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">[kbreit@controller ~]$ nova --no-cache boot --image e677daf8-b717-48fe-a1c9-b70002b08fe3 --flavor 1 Cirros-Instance</div>
<div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto"><br></div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">
Nova outputs the correct output and as it spawns, the log files on my compute node reveal this information. Note, I am not sure exactly where this log starts since there are a few other instances performing similar functions. Let me know if I need to clean up the log more. What appears to be wrong?</div>
<div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto"><br></div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">
<div style="margin:0px">2013-11-28 11:58:08.022 1668 ERROR nova.network.neutronv2 [req-0a14b4b8-5691-4797-8454-fb64abc4195d None None] Neutron client authentication failed: {"error": {"message": "object of type 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}</div>
<div style="margin:0px">2013-11-28 11:58:08.022 1668 ERROR nova.compute.manager [req-0a14b4b8-5691-4797-8454-fb64abc4195d None None] Instance failed network setup after 1 attempt(s)</div><div style="margin:0px">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager Traceback (most recent call last):</div>
<div style="margin:0px">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1228, in _allocate_network_async</div><div style="margin:0px">
2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager dhcp_options=dhcp_options)</div><div style="margin:0px">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File "/usr/lib/python2.6/site-packages/nova/network/api.py", line 49, in wrapper</div>
<div style="margin:0px">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager res = f(self, context, *args, **kwargs)</div><div style="margin:0px">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 358, in allocate_for_instance</div>
<div style="margin:0px">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager LOG.exception(msg, port_id)</div><div style="margin:0px">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 323, in allocate_for_instance</div>
<div style="margin:0px">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager port_req_body)</div><div style="margin:0px">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 392, in _populate_neutron_extension_values</div>
<div style="margin:0px">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager self._refresh_neutron_extensions_cache()</div><div style="margin:0px">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 375, in _refresh_neutron_extensions_cache</div>
<div style="margin:0px">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager neutron = neutronv2.get_client(context.get_admin_context())</div><div style="margin:0px">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 71, in get_client</div>
<div style="margin:0px">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager return _get_client(token=token)</div><div style="margin:0px">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 52, in _get_client</div>
<div style="margin:0px">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager token = _get_auth_token()</div><div style="margin:0px">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 47, in _get_auth_token</div>
<div style="margin:0px">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager LOG.error(_('Neutron client authentication failed: %s'), e)</div><div style="margin:0px">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 43, in _get_auth_token</div>
<div style="margin:0px">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager httpclient.authenticate()</div><div style="margin:0px">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File "/usr/lib/python2.6/site-packages/neutronclient/client.py", line 237, in authenticate</div>
<div style="margin:0px">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager raise exceptions.Unauthorized(message=body)</div><div style="margin:0px">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager Unauthorized: {"error": {"message": "object of type 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}</div>
<div style="margin:0px">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager </div><div style="margin:0px">2013-11-28 11:58:36.425 1668 ERROR nova.compute.manager [req-d8071fcc-4e38-4004-bbd0-59b86223dd81 b33886f56aac4e5db6a161ef401d652f 73c480d7ade84433926e91db400e28cd] [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Instance failed to spawn</div>
<div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Traceback (most recent call last):</div><div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1407, in _spawn</div>
<div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] block_device_info)</div><div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2063, in spawn</div>
<div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] admin_pass=admin_password)</div><div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2441, in _create_image</div>
<div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] net = netutils.get_injected_network_template(network_info)</div><div style="margin:0px">
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/virt/netutils.py", line 74, in get_injected_network_template</div>
<div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] if not (network_info and template):</div><div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 379, in __len__</div>
<div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] return self._sync_wrapper(fn, *args, **kwargs)</div><div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 366, in _sync_wrapper</div>
<div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] self.wait()</div><div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 398, in wait</div>
<div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] self[:] = self._gt.wait()</div><div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 166, in wait</div>
<div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] return self._exit_event.wait()</div><div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/eventlet/event.py", line 120, in wait</div>
<div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] current.throw(*self._exc)</div><div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 192, in main</div>
<div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] result = function(*args, **kwargs)</div><div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1228, in _allocate_network_async</div>
<div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] dhcp_options=dhcp_options)</div><div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/api.py", line 49, in wrapper</div>
<div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] res = f(self, context, *args, **kwargs)</div><div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 358, in allocate_for_instance</div>
<div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] LOG.exception(msg, port_id)</div><div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 323, in allocate_for_instance</div>
<div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] port_req_body)</div><div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 392, in _populate_neutron_extension_values</div>
<div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] self._refresh_neutron_extensions_cache()</div><div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 375, in _refresh_neutron_extensions_cache</div>
<div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] neutron = neutronv2.get_client(context.get_admin_context())</div><div style="margin:0px">
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 71, in get_client</div>
<div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] return _get_client(token=token)</div><div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 52, in _get_client</div>
<div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] token = _get_auth_token()</div><div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 47, in _get_auth_token</div>
<div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] LOG.error(_('Neutron client authentication failed: %s'), e)</div><div style="margin:0px">
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 43, in _get_auth_token</div>
<div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] httpclient.authenticate()</div><div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/neutronclient/client.py", line 237, in authenticate</div>
<div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] raise exceptions.Unauthorized(message=body)</div><div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Unauthorized: {"error": {"message": "object of type 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}</div>
<div style="margin:0px">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] </div><div style="margin:0px">2013-11-28 11:58:36.627 1668 ERROR nova.network.neutronv2 [req-d8071fcc-4e38-4004-bbd0-59b86223dd81 b33886f56aac4e5db6a161ef401d652f 73c480d7ade84433926e91db400e28cd] Neutron client authentication failed: {"error": {"message": "object of type 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}</div>
<div style="margin:0px">2013-11-28 11:58:36.627 1668 ERROR nova.compute.manager [req-d8071fcc-4e38-4004-bbd0-59b86223dd81 b33886f56aac4e5db6a161ef401d652f 73c480d7ade84433926e91db400e28cd] [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Error: {"error": {"message": "object of type 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}</div>
<div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Traceback (most recent call last):</div><div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1037, in _build_instance</div>
<div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] set_access_ip=set_access_ip)</div><div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1410, in _spawn</div>
<div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] LOG.exception(_('Instance failed to spawn'), instance=instance)</div><div style="margin:0px">
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1407, in _spawn</div><div style="margin:0px">
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] block_device_info)</div><div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2063, in spawn</div>
<div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] admin_pass=admin_password)</div><div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2441, in _create_image</div>
<div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] net = netutils.get_injected_network_template(network_info)</div><div style="margin:0px">
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/virt/netutils.py", line 74, in get_injected_network_template</div>
<div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] if not (network_info and template):</div><div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 379, in __len__</div>
<div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] return self._sync_wrapper(fn, *args, **kwargs)</div><div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 366, in _sync_wrapper</div>
<div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] self.wait()</div><div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 398, in wait</div>
<div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] self[:] = self._gt.wait()</div><div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 166, in wait</div>
<div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] return self._exit_event.wait()</div><div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/eventlet/event.py", line 120, in wait</div>
<div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] current.throw(*self._exc)</div><div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 192, in main</div>
<div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] result = function(*args, **kwargs)</div><div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1228, in _allocate_network_async</div>
<div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] dhcp_options=dhcp_options)</div><div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/api.py", line 49, in wrapper</div>
<div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] res = f(self, context, *args, **kwargs)</div><div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 358, in allocate_for_instance</div>
<div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] LOG.exception(msg, port_id)</div><div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 323, in allocate_for_instance</div>
<div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] port_req_body)</div><div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 392, in _populate_neutron_extension_values</div>
<div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] self._refresh_neutron_extensions_cache()</div><div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 375, in _refresh_neutron_extensions_cache</div>
<div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] neutron = neutronv2.get_client(context.get_admin_context())</div><div style="margin:0px">
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 71, in get_client</div>
<div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] return _get_client(token=token)</div><div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 52, in _get_client</div>
<div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] token = _get_auth_token()</div><div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 47, in _get_auth_token</div>
<div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] LOG.error(_('Neutron client authentication failed: %s'), e)</div><div style="margin:0px">
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 43, in _get_auth_token</div>
<div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] httpclient.authenticate()</div><div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/neutronclient/client.py", line 237, in authenticate</div>
<div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] raise exceptions.Unauthorized(message=body)</div><div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Unauthorized: {"error": {"message": "object of type 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}</div>
<div style="margin:0px">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] </div><div style="margin:0px">2013-11-28 11:58:37.313 1668 ERROR nova.openstack.common.rpc.amqp [req-d8071fcc-4e38-4004-bbd0-59b86223dd81 b33886f56aac4e5db6a161ef401d652f 73c480d7ade84433926e91db400e28cd] Exception during message handling</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/amqp.py", line 461, in _process_data</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp **args)</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp result = getattr(proxyobj, method)(ctxt, **kwargs)</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/exception.py", line 90, in wrapped</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp payload)</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/exception.py", line 73, in wrapped</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp return f(self, context, *args, **kw)</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 243, in decorated_function</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp pass</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 229, in decorated_function</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp return function(self, context, *args, **kwargs)</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 294, in decorated_function</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp function(self, context, *args, **kwargs)</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 271, in decorated_function</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp e, sys.exc_info())</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 258, in decorated_function</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp return function(self, context, *args, **kwargs)</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1613, in run_instance</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp do_run_instance()</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/openstack/common/lockutils.py", line 246, in inner</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp return f(*args, **kwargs)</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1612, in do_run_instance</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp legacy_bdm_in_spec)</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 962, in _run_instance</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp notify("error", msg=unicode(e)) # notify that build failed</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 946, in _run_instance</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp instance, image_meta, legacy_bdm_in_spec)</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1075, in _build_instance</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp filter_properties, bdms, legacy_bdm_in_spec)</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1119, in _reschedule_or_error</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp self._log_original_error(exc_info, instance_uuid)</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1114, in _reschedule_or_error</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp bdms, requested_networks)</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1639, in _shutdown_instance</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp network_info = self._get_instance_nw_info(context, instance)</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 876, in _get_instance_nw_info</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp instance)</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 455, in get_instance_nw_info</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp result = self._get_instance_nw_info(context, instance, networks)</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 463, in _get_instance_nw_info</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp nw_info = self._build_network_info_model(context, instance, networks)</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 979, in _build_network_info_model</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp client = neutronv2.get_client(context, admin=True)</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 71, in get_client</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp return _get_client(token=token)</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 52, in _get_client</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp token = _get_auth_token()</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 47, in _get_auth_token</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp LOG.error(_('Neutron client authentication failed: %s'), e)</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 43, in _get_auth_token</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp httpclient.authenticate()</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/neutronclient/client.py", line 237, in authenticate</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp raise exceptions.Unauthorized(message=body)</div><div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp Unauthorized: {"error": {"message": "object of type 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}</div>
<div style="margin:0px">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp </div><div style="margin:0px">2013-11-28 11:58:37.397 1668 ERROR nova.network.neutronv2 [-] Neutron client authentication failed: {"error": {"message": "object of type 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}</div>
<div style="margin:0px">2013-11-28 11:58:53.145 1668 WARNING nova.compute.manager [-] Found 7 in the database and 0 on the hypervisor.</div></div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">
<br></div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto"><br></div><br><div></div></div><br>_______________________________________________<br>
Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
Post to : <a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a><br>
Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
<br></blockquote></div><br><br clear="all"><br>-- <br><div dir="ltr"><div>-dheeru<br></div>@Community Service<br></div>
</div>