[Openstack] Client authentication error booting VM instance
dheeru
dheerendra.madhusudhana at gmail.com
Mon Dec 2 09:40:25 UTC 2013
Hi Kevin
Are you still facing the problem ? Do let me know. If not we can
troubleshoot together.
-dheeru
@Community Service
On Fri, Nov 29, 2013 at 10:44 PM, Kevin Breit <kevin.breit at kevinbreit.net>wrote:
> Dheeru,
>
> I tried deleting my instances and noticed they wouldn’t delete. I think
> the authentication error which is causing the error is preventing me from
> deleting instances as well. Either way, here are log files I created which
> hopefully should be cleaner. Let me know if you’re not seeing the
> information you were looking for.
>
> On November 29, 2013 at 11:11:27 AM, Kevin Breit (
> kevin.breit at kevinbreit.net <//kevin.breit at kevinbreit.net>) wrote:
>
> Dheeru,
>
> I tried deleting my instances and noticed they wouldn’t delete. I think
> the authentication error which is causing the error is preventing me from
> deleting instances as well. Either way, here are log files I created which
> hopefully should be cleaner. Let me know if you’re not seeing the
> information you were looking for.
>
> There should be three attachments.
>
> On November 29, 2013 at 9:08:38 AM, dheeru (
> dheerendra.madhusudhana at gmail.com <//dheerendra.madhusudhana at gmail.com>)
> wrote:
>
> Hi Kevil
>
> Log is too much mixed. Based logs here
>
>
> Can you check your neutron credentials are working correctly with keystone
> ? Also I seeing error 400 it means url sent is wrong and not understood by
> server.
> Can you run the command with --debug option and see the what is being sent
> to keystone ?
>
> -dheeru
> @Community Service
>
>
>
> On Thu, Nov 28, 2013 at 11:31 PM, kevin.breit at kevinbreit.net <
> kevin.breit at kevinbreit.net> wrote:
>
>> I’m running CentOS 6.4 and using the Red Hat install guide to setup
>> OpenStack. When I try to boot a Cirros instance, it errors out.
>>
>> [kbreit at controller ~]$ nova --no-cache boot --image
>> e677daf8-b717-48fe-a1c9-b70002b08fe3 --flavor 1 Cirros-Instance
>>
>> Nova outputs the correct output and as it spawns, the log files on my
>> compute node reveal this information. Note, I am not sure exactly where
>> this log starts since there are a few other instances performing similar
>> functions. Let me know if I need to clean up the log more. What appears to
>> be wrong?
>>
>> 2013-11-28 11:58:08.022 1668 ERROR nova.network.neutronv2
>> [req-0a14b4b8-5691-4797-8454-fb64abc4195d None None] Neutron client
>> authentication failed: {"error": {"message": "object of type 'NoneType' has
>> no len()", "code": 400, "title": "Bad Request"}}
>> 2013-11-28 11:58:08.022 1668 ERROR nova.compute.manager
>> [req-0a14b4b8-5691-4797-8454-fb64abc4195d None None] Instance failed
>> network setup after 1 attempt(s)
>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager Traceback (most
>> recent call last):
>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File
>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1228, in
>> _allocate_network_async
>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager
>> dhcp_options=dhcp_options)
>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File
>> "/usr/lib/python2.6/site-packages/nova/network/api.py", line 49, in wrapper
>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager res = f(self,
>> context, *args, **kwargs)
>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 358,
>> in allocate_for_instance
>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager
>> LOG.exception(msg, port_id)
>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 323,
>> in allocate_for_instance
>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager port_req_body)
>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 392,
>> in _populate_neutron_extension_values
>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager
>> self._refresh_neutron_extensions_cache()
>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 375,
>> in _refresh_neutron_extensions_cache
>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager neutron =
>> neutronv2.get_client(context.get_admin_context())
>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>> 71, in get_client
>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager return
>> _get_client(token=token)
>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>> 52, in _get_client
>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager token =
>> _get_auth_token()
>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>> 47, in _get_auth_token
>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager
>> LOG.error(_('Neutron client authentication failed: %s'), e)
>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>> 43, in _get_auth_token
>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager
>> httpclient.authenticate()
>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File
>> "/usr/lib/python2.6/site-packages/neutronclient/client.py", line 237, in
>> authenticate
>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager raise
>> exceptions.Unauthorized(message=body)
>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager Unauthorized:
>> {"error": {"message": "object of type 'NoneType' has no len()", "code":
>> 400, "title": "Bad Request"}}
>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager
>> 2013-11-28 11:58:36.425 1668 ERROR nova.compute.manager
>> [req-d8071fcc-4e38-4004-bbd0-59b86223dd81 b33886f56aac4e5db6a161ef401d652f
>> 73c480d7ade84433926e91db400e28cd] [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Instance failed to spawn
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Traceback (most recent call last):
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1407, in
>> _spawn
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] block_device_info)
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2063,
>> in spawn
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] admin_pass=admin_password)
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2441,
>> in _create_image
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] net =
>> netutils.get_injected_network_template(network_info)
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/virt/netutils.py", line 74, in
>> get_injected_network_template
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] if not (network_info and
>> template):
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/network/model.py", line 379, in
>> __len__
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] return self._sync_wrapper(fn,
>> *args, **kwargs)
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/network/model.py", line 366, in
>> _sync_wrapper
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] self.wait()
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/network/model.py", line 398, in wait
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] self[:] = self._gt.wait()
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 166, in
>> wait
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] return self._exit_event.wait()
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/eventlet/event.py", line 120, in wait
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] current.throw(*self._exc)
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 192, in
>> main
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] result = function(*args, **kwargs)
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1228, in
>> _allocate_network_async
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] dhcp_options=dhcp_options)
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/network/api.py", line 49, in wrapper
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] res = f(self, context, *args,
>> **kwargs)
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 358,
>> in allocate_for_instance
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] LOG.exception(msg, port_id)
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 323,
>> in allocate_for_instance
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] port_req_body)
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 392,
>> in _populate_neutron_extension_values
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f]
>> self._refresh_neutron_extensions_cache()
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 375,
>> in _refresh_neutron_extensions_cache
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] neutron =
>> neutronv2.get_client(context.get_admin_context())
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>> 71, in get_client
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] return _get_client(token=token)
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>> 52, in _get_client
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] token = _get_auth_token()
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>> 47, in _get_auth_token
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] LOG.error(_('Neutron client
>> authentication failed: %s'), e)
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>> 43, in _get_auth_token
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] httpclient.authenticate()
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/neutronclient/client.py", line 237, in
>> authenticate
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] raise
>> exceptions.Unauthorized(message=body)
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Unauthorized: {"error": {"message":
>> "object of type 'NoneType' has no len()", "code": 400, "title": "Bad
>> Request"}}
>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f]
>> 2013-11-28 11:58:36.627 1668 ERROR nova.network.neutronv2
>> [req-d8071fcc-4e38-4004-bbd0-59b86223dd81 b33886f56aac4e5db6a161ef401d652f
>> 73c480d7ade84433926e91db400e28cd] Neutron client authentication failed:
>> {"error": {"message": "object of type 'NoneType' has no len()", "code":
>> 400, "title": "Bad Request"}}
>> 2013-11-28 11:58:36.627 1668 ERROR nova.compute.manager
>> [req-d8071fcc-4e38-4004-bbd0-59b86223dd81 b33886f56aac4e5db6a161ef401d652f
>> 73c480d7ade84433926e91db400e28cd] [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Error: {"error": {"message": "object
>> of type 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Traceback (most recent call last):
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1037, in
>> _build_instance
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] set_access_ip=set_access_ip)
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1410, in
>> _spawn
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] LOG.exception(_('Instance failed
>> to spawn'), instance=instance)
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1407, in
>> _spawn
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] block_device_info)
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2063,
>> in spawn
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] admin_pass=admin_password)
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2441,
>> in _create_image
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] net =
>> netutils.get_injected_network_template(network_info)
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/virt/netutils.py", line 74, in
>> get_injected_network_template
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] if not (network_info and
>> template):
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/network/model.py", line 379, in
>> __len__
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] return self._sync_wrapper(fn,
>> *args, **kwargs)
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/network/model.py", line 366, in
>> _sync_wrapper
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] self.wait()
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/network/model.py", line 398, in wait
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] self[:] = self._gt.wait()
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 166, in
>> wait
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] return self._exit_event.wait()
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/eventlet/event.py", line 120, in wait
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] current.throw(*self._exc)
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 192, in
>> main
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] result = function(*args, **kwargs)
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1228, in
>> _allocate_network_async
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] dhcp_options=dhcp_options)
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/network/api.py", line 49, in wrapper
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] res = f(self, context, *args,
>> **kwargs)
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 358,
>> in allocate_for_instance
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] LOG.exception(msg, port_id)
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 323,
>> in allocate_for_instance
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] port_req_body)
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 392,
>> in _populate_neutron_extension_values
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f]
>> self._refresh_neutron_extensions_cache()
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 375,
>> in _refresh_neutron_extensions_cache
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] neutron =
>> neutronv2.get_client(context.get_admin_context())
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>> 71, in get_client
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] return _get_client(token=token)
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>> 52, in _get_client
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] token = _get_auth_token()
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>> 47, in _get_auth_token
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] LOG.error(_('Neutron client
>> authentication failed: %s'), e)
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>> 43, in _get_auth_token
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] httpclient.authenticate()
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>> "/usr/lib/python2.6/site-packages/neutronclient/client.py", line 237, in
>> authenticate
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] raise
>> exceptions.Unauthorized(message=body)
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Unauthorized: {"error": {"message":
>> "object of type 'NoneType' has no len()", "code": 400, "title": "Bad
>> Request"}}
>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f]
>> 2013-11-28 11:58:37.313 1668 ERROR nova.openstack.common.rpc.amqp
>> [req-d8071fcc-4e38-4004-bbd0-59b86223dd81 b33886f56aac4e5db6a161ef401d652f
>> 73c480d7ade84433926e91db400e28cd] Exception during message handling
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> Traceback (most recent call last):
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/amqp.py", line
>> 461, in _process_data
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> **args)
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/dispatcher.py",
>> line 172, in dispatch
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> result = getattr(proxyobj, method)(ctxt, **kwargs)
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/nova/exception.py", line 90, in wrapped
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> payload)
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/nova/exception.py", line 73, in wrapped
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> return f(self, context, *args, **kw)
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 243, in
>> decorated_function
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp pass
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 229, in
>> decorated_function
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> return function(self, context, *args, **kwargs)
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 294, in
>> decorated_function
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> function(self, context, *args, **kwargs)
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 271, in
>> decorated_function
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp e,
>> sys.exc_info())
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 258, in
>> decorated_function
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> return function(self, context, *args, **kwargs)
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1613, in
>> run_instance
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> do_run_instance()
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/nova/openstack/common/lockutils.py", line
>> 246, in inner
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> return f(*args, **kwargs)
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1612, in
>> do_run_instance
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> legacy_bdm_in_spec)
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 962, in
>> _run_instance
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> notify("error", msg=unicode(e)) # notify that build failed
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 946, in
>> _run_instance
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> instance, image_meta, legacy_bdm_in_spec)
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1075, in
>> _build_instance
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> filter_properties, bdms, legacy_bdm_in_spec)
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1119, in
>> _reschedule_or_error
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> self._log_original_error(exc_info, instance_uuid)
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1114, in
>> _reschedule_or_error
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> bdms, requested_networks)
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1639, in
>> _shutdown_instance
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> network_info = self._get_instance_nw_info(context, instance)
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 876, in
>> _get_instance_nw_info
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> instance)
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 455,
>> in get_instance_nw_info
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> result = self._get_instance_nw_info(context, instance, networks)
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 463,
>> in _get_instance_nw_info
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> nw_info = self._build_network_info_model(context, instance, networks)
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 979,
>> in _build_network_info_model
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> client = neutronv2.get_client(context, admin=True)
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>> 71, in get_client
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> return _get_client(token=token)
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>> 52, in _get_client
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> token = _get_auth_token()
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>> 47, in _get_auth_token
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> LOG.error(_('Neutron client authentication failed: %s'), e)
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>> 43, in _get_auth_token
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> httpclient.authenticate()
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>> "/usr/lib/python2.6/site-packages/neutronclient/client.py", line 237, in
>> authenticate
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> raise exceptions.Unauthorized(message=body)
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> Unauthorized: {"error": {"message": "object of type 'NoneType' has no
>> len()", "code": 400, "title": "Bad Request"}}
>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>> 2013-11-28 11:58:37.397 1668 ERROR nova.network.neutronv2 [-] Neutron
>> client authentication failed: {"error": {"message": "object of type
>> 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}
>> 2013-11-28 11:58:53.145 1668 WARNING nova.compute.manager [-] Found 7 in
>> the database and 0 on the hypervisor.
>>
>>
>>
>>
>> _______________________________________________
>> Mailing list:
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>> Post to : openstack at lists.openstack.org
>> Unsubscribe :
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>
>>
>
>
> --
> -dheeru
> @Community Service
>
> ------------------------------
> - compute1.neutron.log, 148 KB
> - compute1.nova-compute.log, 599 KB
> - controller-neutron.log, 37 KB
>
>
--
-dheeru
@Community Service
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20131202/4f9387ff/attachment.html>
More information about the Openstack
mailing list