<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><div id="bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px; color: rgba(0,0,0,1.0); margin: 0px; line-height: auto;">I’m running CentOS 6.4 and using the Red Hat install guide to setup OpenStack. When I try to boot a Cirros instance, it errors out.</div><div id="bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px; color: rgba(0,0,0,1.0); margin: 0px; line-height: auto;"><br></div><div id="bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px; color: rgba(0,0,0,1.0); margin: 0px; line-height: auto;">[kbreit@controller ~]$ nova --no-cache boot --image e677daf8-b717-48fe-a1c9-b70002b08fe3 --flavor 1 Cirros-Instance</div><div id="bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px; color: rgba(0,0,0,1.0); margin: 0px; line-height: auto;"><br></div><div id="bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px; color: rgba(0,0,0,1.0); margin: 0px; line-height: auto;">Nova outputs the correct output and as it spawns, the log files on my compute node reveal this information. Note, I am not sure exactly where this log starts since there are a few other instances performing similar functions. Let me know if I need to clean up the log more. What appears to be wrong?</div><div id="bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px; color: rgba(0,0,0,1.0); margin: 0px; line-height: auto;"><br></div><div id="bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px; color: rgba(0,0,0,1.0); margin: 0px; line-height: auto;"><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 ERROR nova.network.neutronv2 [req-0a14b4b8-5691-4797-8454-fb64abc4195d None None] Neutron client authentication failed: {"error": {"message": "object of type 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 ERROR nova.compute.manager [req-0a14b4b8-5691-4797-8454-fb64abc4195d None None] Instance failed network setup after 1 attempt(s)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager Traceback (most recent call last):</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1228, in _allocate_network_async</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager dhcp_options=dhcp_options)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File "/usr/lib/python2.6/site-packages/nova/network/api.py", line 49, in wrapper</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager res = f(self, context, *args, **kwargs)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 358, in allocate_for_instance</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager LOG.exception(msg, port_id)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 323, in allocate_for_instance</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager port_req_body)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 392, in _populate_neutron_extension_values</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager self._refresh_neutron_extensions_cache()</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 375, in _refresh_neutron_extensions_cache</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager neutron = neutronv2.get_client(context.get_admin_context())</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 71, in get_client</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager return _get_client(token=token)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 52, in _get_client</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager token = _get_auth_token()</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 47, in _get_auth_token</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager LOG.error(_('Neutron client authentication failed: %s'), e)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 43, in _get_auth_token</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager httpclient.authenticate()</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File "/usr/lib/python2.6/site-packages/neutronclient/client.py", line 237, in authenticate</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager raise exceptions.Unauthorized(message=body)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager Unauthorized: {"error": {"message": "object of type 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager </div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 ERROR nova.compute.manager [req-d8071fcc-4e38-4004-bbd0-59b86223dd81 b33886f56aac4e5db6a161ef401d652f 73c480d7ade84433926e91db400e28cd] [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Instance failed to spawn</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Traceback (most recent call last):</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1407, in _spawn</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] block_device_info)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2063, in spawn</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] admin_pass=admin_password)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2441, in _create_image</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] net = netutils.get_injected_network_template(network_info)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/virt/netutils.py", line 74, in get_injected_network_template</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] if not (network_info and template):</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 379, in __len__</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] return self._sync_wrapper(fn, *args, **kwargs)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 366, in _sync_wrapper</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] self.wait()</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 398, in wait</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] self[:] = self._gt.wait()</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 166, in wait</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] return self._exit_event.wait()</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/eventlet/event.py", line 120, in wait</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] current.throw(*self._exc)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 192, in main</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] result = function(*args, **kwargs)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1228, in _allocate_network_async</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] dhcp_options=dhcp_options)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/api.py", line 49, in wrapper</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] res = f(self, context, *args, **kwargs)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 358, in allocate_for_instance</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] LOG.exception(msg, port_id)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 323, in allocate_for_instance</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] port_req_body)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 392, in _populate_neutron_extension_values</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] self._refresh_neutron_extensions_cache()</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 375, in _refresh_neutron_extensions_cache</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] neutron = neutronv2.get_client(context.get_admin_context())</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 71, in get_client</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] return _get_client(token=token)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 52, in _get_client</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] token = _get_auth_token()</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 47, in _get_auth_token</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] LOG.error(_('Neutron client authentication failed: %s'), e)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 43, in _get_auth_token</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] httpclient.authenticate()</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/neutronclient/client.py", line 237, in authenticate</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] raise exceptions.Unauthorized(message=body)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Unauthorized: {"error": {"message": "object of type 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] </div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 ERROR nova.network.neutronv2 [req-d8071fcc-4e38-4004-bbd0-59b86223dd81 b33886f56aac4e5db6a161ef401d652f 73c480d7ade84433926e91db400e28cd] Neutron client authentication failed: {"error": {"message": "object of type 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 ERROR nova.compute.manager [req-d8071fcc-4e38-4004-bbd0-59b86223dd81 b33886f56aac4e5db6a161ef401d652f 73c480d7ade84433926e91db400e28cd] [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Error: {"error": {"message": "object of type 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Traceback (most recent call last):</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1037, in _build_instance</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] set_access_ip=set_access_ip)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1410, in _spawn</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] LOG.exception(_('Instance failed to spawn'), instance=instance)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1407, in _spawn</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] block_device_info)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2063, in spawn</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] admin_pass=admin_password)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2441, in _create_image</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] net = netutils.get_injected_network_template(network_info)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/virt/netutils.py", line 74, in get_injected_network_template</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] if not (network_info and template):</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 379, in __len__</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] return self._sync_wrapper(fn, *args, **kwargs)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 366, in _sync_wrapper</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] self.wait()</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 398, in wait</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] self[:] = self._gt.wait()</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 166, in wait</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] return self._exit_event.wait()</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/eventlet/event.py", line 120, in wait</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] current.throw(*self._exc)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 192, in main</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] result = function(*args, **kwargs)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1228, in _allocate_network_async</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] dhcp_options=dhcp_options)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/api.py", line 49, in wrapper</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] res = f(self, context, *args, **kwargs)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 358, in allocate_for_instance</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] LOG.exception(msg, port_id)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 323, in allocate_for_instance</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] port_req_body)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 392, in _populate_neutron_extension_values</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] self._refresh_neutron_extensions_cache()</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 375, in _refresh_neutron_extensions_cache</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] neutron = neutronv2.get_client(context.get_admin_context())</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 71, in get_client</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] return _get_client(token=token)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 52, in _get_client</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] token = _get_auth_token()</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 47, in _get_auth_token</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] LOG.error(_('Neutron client authentication failed: %s'), e)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 43, in _get_auth_token</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] httpclient.authenticate()</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File "/usr/lib/python2.6/site-packages/neutronclient/client.py", line 237, in authenticate</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] raise exceptions.Unauthorized(message=body)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Unauthorized: {"error": {"message": "object of type 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] </div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 ERROR nova.openstack.common.rpc.amqp [req-d8071fcc-4e38-4004-bbd0-59b86223dd81 b33886f56aac4e5db6a161ef401d652f 73c480d7ade84433926e91db400e28cd] Exception during message handling</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/amqp.py", line 461, in _process_data</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp **args)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp result = getattr(proxyobj, method)(ctxt, **kwargs)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/exception.py", line 90, in wrapped</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp payload)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/exception.py", line 73, in wrapped</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp return f(self, context, *args, **kw)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 243, in decorated_function</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp pass</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 229, in decorated_function</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp return function(self, context, *args, **kwargs)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 294, in decorated_function</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp function(self, context, *args, **kwargs)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 271, in decorated_function</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp e, sys.exc_info())</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 258, in decorated_function</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp return function(self, context, *args, **kwargs)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1613, in run_instance</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp do_run_instance()</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/openstack/common/lockutils.py", line 246, in inner</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp return f(*args, **kwargs)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1612, in do_run_instance</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp legacy_bdm_in_spec)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 962, in _run_instance</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp notify("error", msg=unicode(e)) # notify that build failed</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 946, in _run_instance</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp instance, image_meta, legacy_bdm_in_spec)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1075, in _build_instance</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp filter_properties, bdms, legacy_bdm_in_spec)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1119, in _reschedule_or_error</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp self._log_original_error(exc_info, instance_uuid)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1114, in _reschedule_or_error</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp bdms, requested_networks)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1639, in _shutdown_instance</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp network_info = self._get_instance_nw_info(context, instance)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 876, in _get_instance_nw_info</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp instance)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 455, in get_instance_nw_info</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp result = self._get_instance_nw_info(context, instance, networks)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 463, in _get_instance_nw_info</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp nw_info = self._build_network_info_model(context, instance, networks)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 979, in _build_network_info_model</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp client = neutronv2.get_client(context, admin=True)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 71, in get_client</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp return _get_client(token=token)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 52, in _get_client</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp token = _get_auth_token()</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 47, in _get_auth_token</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp LOG.error(_('Neutron client authentication failed: %s'), e)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 43, in _get_auth_token</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp httpclient.authenticate()</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.6/site-packages/neutronclient/client.py", line 237, in authenticate</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp raise exceptions.Unauthorized(message=body)</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp Unauthorized: {"error": {"message": "object of type 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp </div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:37.397 1668 ERROR nova.network.neutronv2 [-] Neutron client authentication failed: {"error": {"message": "object of type 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}</div><div id="bloop_customfont" style="margin: 0px;">2013-11-28 11:58:53.145 1668 WARNING nova.compute.manager [-] Found 7 in the database and 0 on the hypervisor.</div></div><div id="bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px; color: rgba(0,0,0,1.0); margin: 0px; line-height: auto;"><br></div><div id="bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px; color: rgba(0,0,0,1.0); margin: 0px; line-height: auto;"><br></div><br><div class="" id="bloop_sign_1385661404836374016"></div></body></html>