Open Stack

Dheeru,

I tried deleting my instances and noticed they wouldn’t delete. I think the authentication error which is causing the error is preventing me from deleting instances as well. Either way, here are log files I created which hopefully should be cleaner. Let me know if you’re not seeing the information you were looking for.

On November 29, 2013 at 11:11:27 AM, Kevin Breit (kevin.breit at kevinbreit.net) wrote:

Dheeru,

I tried deleting my instances and noticed they wouldn’t delete. I think the authentication error which is causing the error is preventing me from deleting instances as well. Either way, here are log files I created which hopefully should be cleaner. Let me know if you’re not seeing the information you were looking for.

There should be three attachments.

On November 29, 2013 at 9:08:38 AM, dheeru (dheerendra.madhusudhana at gmail.com) wrote:

Hi Kevil

Log is  too much mixed. Based logs here

Can you check your neutron credentials are working correctly with keystone ? Also I seeing error 400 it means url sent is wrong and not understood by server.
Can you run the command with --debug option and see the what is being sent to keystone ?

-dheeru
@Community Service



On Thu, Nov 28, 2013 at 11:31 PM, kevin.breit at kevinbreit.net <kevin.breit at kevinbreit.net> wrote:
I’m running CentOS 6.4 and using the Red Hat install guide to setup OpenStack. When I try to boot a Cirros instance, it errors out.

[kbreit at controller ~]$ nova --no-cache boot --image e677daf8-b717-48fe-a1c9-b70002b08fe3 --flavor 1 Cirros-Instance

Nova outputs the correct output and as it spawns, the log files on my compute node reveal this information. Note, I am not sure exactly where this log starts since there are a few other instances performing similar functions. Let me know if I need to clean up the log more. What appears to be wrong?

2013-11-28 11:58:08.022 1668 ERROR nova.network.neutronv2 [req-0a14b4b8-5691-4797-8454-fb64abc4195d None None] Neutron client authentication failed: {"error": {"message": "object of type 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}
2013-11-28 11:58:08.022 1668 ERROR nova.compute.manager [req-0a14b4b8-5691-4797-8454-fb64abc4195d None None] Instance failed network setup after 1 attempt(s)
2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager Traceback (most recent call last):
2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1228, in _allocate_network_async
2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager     dhcp_options=dhcp_options)
2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager   File "/usr/lib/python2.6/site-packages/nova/network/api.py", line 49, in wrapper
2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager     res = f(self, context, *args, **kwargs)
2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 358, in allocate_for_instance
2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager     LOG.exception(msg, port_id)
2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 323, in allocate_for_instance
2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager     port_req_body)
2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 392, in _populate_neutron_extension_values
2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager     self._refresh_neutron_extensions_cache()
2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 375, in _refresh_neutron_extensions_cache
2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager     neutron = neutronv2.get_client(context.get_admin_context())
2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 71, in get_client
2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager     return _get_client(token=token)
2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 52, in _get_client
2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager     token = _get_auth_token()
2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 47, in _get_auth_token
2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager     LOG.error(_('Neutron client authentication failed: %s'), e)
2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 43, in _get_auth_token
2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager     httpclient.authenticate()
2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager   File "/usr/lib/python2.6/site-packages/neutronclient/client.py", line 237, in authenticate
2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager     raise exceptions.Unauthorized(message=body)
2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager Unauthorized: {"error": {"message": "object of type 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}
2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager 
2013-11-28 11:58:36.425 1668 ERROR nova.compute.manager [req-d8071fcc-4e38-4004-bbd0-59b86223dd81 b33886f56aac4e5db6a161ef401d652f 73c480d7ade84433926e91db400e28cd] [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Instance failed to spawn
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Traceback (most recent call last):
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1407, in _spawn
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     block_device_info)
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2063, in spawn
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     admin_pass=admin_password)
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2441, in _create_image
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     net = netutils.get_injected_network_template(network_info)
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/virt/netutils.py", line 74, in get_injected_network_template
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     if not (network_info and template):
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 379, in __len__
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     return self._sync_wrapper(fn, *args, **kwargs)
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 366, in _sync_wrapper
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     self.wait()
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 398, in wait
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     self[:] = self._gt.wait()
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 166, in wait
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     return self._exit_event.wait()
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/eventlet/event.py", line 120, in wait
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     current.throw(*self._exc)
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 192, in main
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     result = function(*args, **kwargs)
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1228, in _allocate_network_async
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     dhcp_options=dhcp_options)
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/network/api.py", line 49, in wrapper
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     res = f(self, context, *args, **kwargs)
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 358, in allocate_for_instance
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     LOG.exception(msg, port_id)
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 323, in allocate_for_instance
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     port_req_body)
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 392, in _populate_neutron_extension_values
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     self._refresh_neutron_extensions_cache()
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 375, in _refresh_neutron_extensions_cache
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     neutron = neutronv2.get_client(context.get_admin_context())
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 71, in get_client
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     return _get_client(token=token)
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 52, in _get_client
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     token = _get_auth_token()
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 47, in _get_auth_token
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     LOG.error(_('Neutron client authentication failed: %s'), e)
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 43, in _get_auth_token
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     httpclient.authenticate()
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/neutronclient/client.py", line 237, in authenticate
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     raise exceptions.Unauthorized(message=body)
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Unauthorized: {"error": {"message": "object of type 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}
2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] 
2013-11-28 11:58:36.627 1668 ERROR nova.network.neutronv2 [req-d8071fcc-4e38-4004-bbd0-59b86223dd81 b33886f56aac4e5db6a161ef401d652f 73c480d7ade84433926e91db400e28cd] Neutron client authentication failed: {"error": {"message": "object of type 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}
2013-11-28 11:58:36.627 1668 ERROR nova.compute.manager [req-d8071fcc-4e38-4004-bbd0-59b86223dd81 b33886f56aac4e5db6a161ef401d652f 73c480d7ade84433926e91db400e28cd] [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Error: {"error": {"message": "object of type 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Traceback (most recent call last):
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1037, in _build_instance
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     set_access_ip=set_access_ip)
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1410, in _spawn
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     LOG.exception(_('Instance failed to spawn'), instance=instance)
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1407, in _spawn
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     block_device_info)
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2063, in spawn
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     admin_pass=admin_password)
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2441, in _create_image
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     net = netutils.get_injected_network_template(network_info)
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/virt/netutils.py", line 74, in get_injected_network_template
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     if not (network_info and template):
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 379, in __len__
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     return self._sync_wrapper(fn, *args, **kwargs)
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 366, in _sync_wrapper
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     self.wait()
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 398, in wait
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     self[:] = self._gt.wait()
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 166, in wait
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     return self._exit_event.wait()
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/eventlet/event.py", line 120, in wait
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     current.throw(*self._exc)
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 192, in main
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     result = function(*args, **kwargs)
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1228, in _allocate_network_async
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     dhcp_options=dhcp_options)
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/network/api.py", line 49, in wrapper
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     res = f(self, context, *args, **kwargs)
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 358, in allocate_for_instance
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     LOG.exception(msg, port_id)
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 323, in allocate_for_instance
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     port_req_body)
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 392, in _populate_neutron_extension_values
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     self._refresh_neutron_extensions_cache()
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 375, in _refresh_neutron_extensions_cache
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     neutron = neutronv2.get_client(context.get_admin_context())
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 71, in get_client
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     return _get_client(token=token)
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 52, in _get_client
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     token = _get_auth_token()
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 47, in _get_auth_token
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     LOG.error(_('Neutron client authentication failed: %s'), e)
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 43, in _get_auth_token
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     httpclient.authenticate()
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]   File "/usr/lib/python2.6/site-packages/neutronclient/client.py", line 237, in authenticate
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f]     raise exceptions.Unauthorized(message=body)
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Unauthorized: {"error": {"message": "object of type 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}
2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance: 18cc70bc-3c59-4a3b-af22-6080427ceb4f] 
2013-11-28 11:58:37.313 1668 ERROR nova.openstack.common.rpc.amqp [req-d8071fcc-4e38-4004-bbd0-59b86223dd81 b33886f56aac4e5db6a161ef401d652f 73c480d7ade84433926e91db400e28cd] Exception during message handling
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/amqp.py", line 461, in _process_data
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     **args)
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     result = getattr(proxyobj, method)(ctxt, **kwargs)
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/exception.py", line 90, in wrapped
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     payload)
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/exception.py", line 73, in wrapped
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     return f(self, context, *args, **kw)
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 243, in decorated_function
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     pass
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 229, in decorated_function
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     return function(self, context, *args, **kwargs)
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 294, in decorated_function
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     function(self, context, *args, **kwargs)
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 271, in decorated_function
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     e, sys.exc_info())
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 258, in decorated_function
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     return function(self, context, *args, **kwargs)
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1613, in run_instance
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     do_run_instance()
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/openstack/common/lockutils.py", line 246, in inner
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     return f(*args, **kwargs)
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1612, in do_run_instance
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     legacy_bdm_in_spec)
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 962, in _run_instance
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     notify("error", msg=unicode(e))  # notify that build failed
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 946, in _run_instance
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     instance, image_meta, legacy_bdm_in_spec)
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1075, in _build_instance
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     filter_properties, bdms, legacy_bdm_in_spec)
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1119, in _reschedule_or_error
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     self._log_original_error(exc_info, instance_uuid)
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1114, in _reschedule_or_error
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     bdms, requested_networks)
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1639, in _shutdown_instance
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     network_info = self._get_instance_nw_info(context, instance)
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 876, in _get_instance_nw_info
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     instance)
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 455, in get_instance_nw_info
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     result = self._get_instance_nw_info(context, instance, networks)
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 463, in _get_instance_nw_info
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     nw_info = self._build_network_info_model(context, instance, networks)
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 979, in _build_network_info_model
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     client = neutronv2.get_client(context, admin=True)
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 71, in get_client
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     return _get_client(token=token)
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 52, in _get_client
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     token = _get_auth_token()
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 47, in _get_auth_token
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     LOG.error(_('Neutron client authentication failed: %s'), e)
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line 43, in _get_auth_token
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     httpclient.authenticate()
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.6/site-packages/neutronclient/client.py", line 237, in authenticate
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp     raise exceptions.Unauthorized(message=body)
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp Unauthorized: {"error": {"message": "object of type 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}
2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp 
2013-11-28 11:58:37.397 1668 ERROR nova.network.neutronv2 [-] Neutron client authentication failed: {"error": {"message": "object of type 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}
2013-11-28 11:58:53.145 1668 WARNING nova.compute.manager [-] Found 7 in the database and 0 on the hypervisor.




_______________________________________________
Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Post to     : openstack at lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack




--
-dheeru
@Community Service
- compute1.neutron.log, 148 KB
- compute1.nova-compute.log, 599 KB
- controller-neutron.log, 37 KB
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20131129/23c38c05/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Archive.zip
Type: application/octet-stream
Size: 45875 bytes
Desc: not available
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20131129/23c38c05/attachment.obj>