[Openstack] Client authentication error booting VM instance
dheeru
dheerendra.madhusudhana at gmail.com
Mon Dec 2 12:48:18 UTC 2013
yes kevin. I looked at them. It was difficult to co-relate as too with many
things. You can ping on my gmail. I can help you
-Dheeru
@Community Service
On Mon, Dec 2, 2013 at 6:15 PM, Kevin Breit <kevin.breit at kevinbreit.net>wrote:
> Yes I am still having this problem. Did you receive the logs I attached as
> a .zip file?
>
> On December 2, 2013 at 3:40:30 AM, dheeru (
> dheerendra.madhusudhana at gmail.com <//dheerendra.madhusudhana at gmail.com>)
> wrote:
>
> Hi Kevin
>
> Are you still facing the problem ? Do let me know. If not we can
> troubleshoot together.
>
> -dheeru
> @Community Service
>
>
> On Fri, Nov 29, 2013 at 10:44 PM, Kevin Breit <kevin.breit at kevinbreit.net>wrote:
>
>> Dheeru,
>>
>> I tried deleting my instances and noticed they wouldn’t delete. I think
>> the authentication error which is causing the error is preventing me from
>> deleting instances as well. Either way, here are log files I created which
>> hopefully should be cleaner. Let me know if you’re not seeing the
>> information you were looking for.
>>
>> On November 29, 2013 at 11:11:27 AM, Kevin Breit (
>> kevin.breit at kevinbreit.net <//kevin.breit at kevinbreit.net>) wrote:
>>
>> Dheeru,
>>
>> I tried deleting my instances and noticed they wouldn’t delete. I think
>> the authentication error which is causing the error is preventing me from
>> deleting instances as well. Either way, here are log files I created which
>> hopefully should be cleaner. Let me know if you’re not seeing the
>> information you were looking for.
>>
>> There should be three attachments.
>>
>> On November 29, 2013 at 9:08:38 AM, dheeru (
>> dheerendra.madhusudhana at gmail.com <//dheerendra.madhusudhana at gmail.com>)
>> wrote:
>>
>> Hi Kevil
>>
>> Log is too much mixed. Based logs here
>>
>>
>> Can you check your neutron credentials are working correctly with
>> keystone ? Also I seeing error 400 it means url sent is wrong and not
>> understood by server.
>> Can you run the command with --debug option and see the what is being
>> sent to keystone ?
>>
>> -dheeru
>> @Community Service
>>
>>
>>
>> On Thu, Nov 28, 2013 at 11:31 PM, kevin.breit at kevinbreit.net <
>> kevin.breit at kevinbreit.net> wrote:
>>
>>> I’m running CentOS 6.4 and using the Red Hat install guide to setup
>>> OpenStack. When I try to boot a Cirros instance, it errors out.
>>>
>>> [kbreit at controller ~]$ nova --no-cache boot --image
>>> e677daf8-b717-48fe-a1c9-b70002b08fe3 --flavor 1 Cirros-Instance
>>>
>>> Nova outputs the correct output and as it spawns, the log files on my
>>> compute node reveal this information. Note, I am not sure exactly where
>>> this log starts since there are a few other instances performing similar
>>> functions. Let me know if I need to clean up the log more. What appears to
>>> be wrong?
>>>
>>> 2013-11-28 11:58:08.022 1668 ERROR nova.network.neutronv2
>>> [req-0a14b4b8-5691-4797-8454-fb64abc4195d None None] Neutron client
>>> authentication failed: {"error": {"message": "object of type 'NoneType' has
>>> no len()", "code": 400, "title": "Bad Request"}}
>>> 2013-11-28 11:58:08.022 1668 ERROR nova.compute.manager
>>> [req-0a14b4b8-5691-4797-8454-fb64abc4195d None None] Instance failed
>>> network setup after 1 attempt(s)
>>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager Traceback (most
>>> recent call last):
>>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File
>>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1228, in
>>> _allocate_network_async
>>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager
>>> dhcp_options=dhcp_options)
>>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File
>>> "/usr/lib/python2.6/site-packages/nova/network/api.py", line 49, in wrapper
>>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager res =
>>> f(self, context, *args, **kwargs)
>>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 358,
>>> in allocate_for_instance
>>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager
>>> LOG.exception(msg, port_id)
>>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 323,
>>> in allocate_for_instance
>>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager
>>> port_req_body)
>>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 392,
>>> in _populate_neutron_extension_values
>>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager
>>> self._refresh_neutron_extensions_cache()
>>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 375,
>>> in _refresh_neutron_extensions_cache
>>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager neutron =
>>> neutronv2.get_client(context.get_admin_context())
>>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>>> 71, in get_client
>>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager return
>>> _get_client(token=token)
>>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>>> 52, in _get_client
>>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager token =
>>> _get_auth_token()
>>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>>> 47, in _get_auth_token
>>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager
>>> LOG.error(_('Neutron client authentication failed: %s'), e)
>>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>>> 43, in _get_auth_token
>>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager
>>> httpclient.authenticate()
>>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager File
>>> "/usr/lib/python2.6/site-packages/neutronclient/client.py", line 237, in
>>> authenticate
>>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager raise
>>> exceptions.Unauthorized(message=body)
>>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager Unauthorized:
>>> {"error": {"message": "object of type 'NoneType' has no len()", "code":
>>> 400, "title": "Bad Request"}}
>>> 2013-11-28 11:58:08.022 1668 TRACE nova.compute.manager
>>> 2013-11-28 11:58:36.425 1668 ERROR nova.compute.manager
>>> [req-d8071fcc-4e38-4004-bbd0-59b86223dd81 b33886f56aac4e5db6a161ef401d652f
>>> 73c480d7ade84433926e91db400e28cd] [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Instance failed to spawn
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Traceback (most recent call last):
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1407, in
>>> _spawn
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] block_device_info)
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2063,
>>> in spawn
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] admin_pass=admin_password)
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2441,
>>> in _create_image
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] net =
>>> netutils.get_injected_network_template(network_info)
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/virt/netutils.py", line 74, in
>>> get_injected_network_template
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] if not (network_info and
>>> template):
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/network/model.py", line 379, in
>>> __len__
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] return self._sync_wrapper(fn,
>>> *args, **kwargs)
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/network/model.py", line 366, in
>>> _sync_wrapper
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] self.wait()
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/network/model.py", line 398, in wait
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] self[:] = self._gt.wait()
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 166, in
>>> wait
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] return self._exit_event.wait()
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/eventlet/event.py", line 120, in wait
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] current.throw(*self._exc)
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 192, in
>>> main
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] result = function(*args, **kwargs)
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1228, in
>>> _allocate_network_async
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] dhcp_options=dhcp_options)
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/network/api.py", line 49, in wrapper
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] res = f(self, context, *args,
>>> **kwargs)
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 358,
>>> in allocate_for_instance
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] LOG.exception(msg, port_id)
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 323,
>>> in allocate_for_instance
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] port_req_body)
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 392,
>>> in _populate_neutron_extension_values
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f]
>>> self._refresh_neutron_extensions_cache()
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 375,
>>> in _refresh_neutron_extensions_cache
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] neutron =
>>> neutronv2.get_client(context.get_admin_context())
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>>> 71, in get_client
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] return _get_client(token=token)
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>>> 52, in _get_client
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] token = _get_auth_token()
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>>> 47, in _get_auth_token
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] LOG.error(_('Neutron client
>>> authentication failed: %s'), e)
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>>> 43, in _get_auth_token
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] httpclient.authenticate()
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/neutronclient/client.py", line 237, in
>>> authenticate
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] raise
>>> exceptions.Unauthorized(message=body)
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Unauthorized: {"error": {"message":
>>> "object of type 'NoneType' has no len()", "code": 400, "title": "Bad
>>> Request"}}
>>> 2013-11-28 11:58:36.425 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f]
>>> 2013-11-28 11:58:36.627 1668 ERROR nova.network.neutronv2
>>> [req-d8071fcc-4e38-4004-bbd0-59b86223dd81 b33886f56aac4e5db6a161ef401d652f
>>> 73c480d7ade84433926e91db400e28cd] Neutron client authentication failed:
>>> {"error": {"message": "object of type 'NoneType' has no len()", "code":
>>> 400, "title": "Bad Request"}}
>>> 2013-11-28 11:58:36.627 1668 ERROR nova.compute.manager
>>> [req-d8071fcc-4e38-4004-bbd0-59b86223dd81 b33886f56aac4e5db6a161ef401d652f
>>> 73c480d7ade84433926e91db400e28cd] [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Error: {"error": {"message": "object
>>> of type 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Traceback (most recent call last):
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1037, in
>>> _build_instance
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] set_access_ip=set_access_ip)
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1410, in
>>> _spawn
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] LOG.exception(_('Instance failed
>>> to spawn'), instance=instance)
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1407, in
>>> _spawn
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] block_device_info)
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2063,
>>> in spawn
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] admin_pass=admin_password)
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2441,
>>> in _create_image
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] net =
>>> netutils.get_injected_network_template(network_info)
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/virt/netutils.py", line 74, in
>>> get_injected_network_template
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] if not (network_info and
>>> template):
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/network/model.py", line 379, in
>>> __len__
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] return self._sync_wrapper(fn,
>>> *args, **kwargs)
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/network/model.py", line 366, in
>>> _sync_wrapper
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] self.wait()
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/network/model.py", line 398, in wait
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] self[:] = self._gt.wait()
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 166, in
>>> wait
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] return self._exit_event.wait()
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/eventlet/event.py", line 120, in wait
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] current.throw(*self._exc)
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 192, in
>>> main
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] result = function(*args, **kwargs)
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1228, in
>>> _allocate_network_async
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] dhcp_options=dhcp_options)
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/network/api.py", line 49, in wrapper
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] res = f(self, context, *args,
>>> **kwargs)
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 358,
>>> in allocate_for_instance
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] LOG.exception(msg, port_id)
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 323,
>>> in allocate_for_instance
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] port_req_body)
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 392,
>>> in _populate_neutron_extension_values
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f]
>>> self._refresh_neutron_extensions_cache()
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 375,
>>> in _refresh_neutron_extensions_cache
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] neutron =
>>> neutronv2.get_client(context.get_admin_context())
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>>> 71, in get_client
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] return _get_client(token=token)
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>>> 52, in _get_client
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] token = _get_auth_token()
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>>> 47, in _get_auth_token
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] LOG.error(_('Neutron client
>>> authentication failed: %s'), e)
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>>> 43, in _get_auth_token
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] httpclient.authenticate()
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] File
>>> "/usr/lib/python2.6/site-packages/neutronclient/client.py", line 237, in
>>> authenticate
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] raise
>>> exceptions.Unauthorized(message=body)
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f] Unauthorized: {"error": {"message":
>>> "object of type 'NoneType' has no len()", "code": 400, "title": "Bad
>>> Request"}}
>>> 2013-11-28 11:58:36.627 1668 TRACE nova.compute.manager [instance:
>>> 18cc70bc-3c59-4a3b-af22-6080427ceb4f]
>>> 2013-11-28 11:58:37.313 1668 ERROR nova.openstack.common.rpc.amqp
>>> [req-d8071fcc-4e38-4004-bbd0-59b86223dd81 b33886f56aac4e5db6a161ef401d652f
>>> 73c480d7ade84433926e91db400e28cd] Exception during message handling
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> Traceback (most recent call last):
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/amqp.py", line
>>> 461, in _process_data
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> **args)
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/nova/openstack/common/rpc/dispatcher.py",
>>> line 172, in dispatch
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> result = getattr(proxyobj, method)(ctxt, **kwargs)
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/nova/exception.py", line 90, in wrapped
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> payload)
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/nova/exception.py", line 73, in wrapped
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> return f(self, context, *args, **kw)
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 243, in
>>> decorated_function
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> pass
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 229, in
>>> decorated_function
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> return function(self, context, *args, **kwargs)
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 294, in
>>> decorated_function
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> function(self, context, *args, **kwargs)
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 271, in
>>> decorated_function
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp e,
>>> sys.exc_info())
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 258, in
>>> decorated_function
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> return function(self, context, *args, **kwargs)
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1613, in
>>> run_instance
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> do_run_instance()
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/nova/openstack/common/lockutils.py", line
>>> 246, in inner
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> return f(*args, **kwargs)
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1612, in
>>> do_run_instance
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> legacy_bdm_in_spec)
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 962, in
>>> _run_instance
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> notify("error", msg=unicode(e)) # notify that build failed
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 946, in
>>> _run_instance
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> instance, image_meta, legacy_bdm_in_spec)
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1075, in
>>> _build_instance
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> filter_properties, bdms, legacy_bdm_in_spec)
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1119, in
>>> _reschedule_or_error
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> self._log_original_error(exc_info, instance_uuid)
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1114, in
>>> _reschedule_or_error
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> bdms, requested_networks)
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1639, in
>>> _shutdown_instance
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> network_info = self._get_instance_nw_info(context, instance)
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 876, in
>>> _get_instance_nw_info
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> instance)
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 455,
>>> in get_instance_nw_info
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> result = self._get_instance_nw_info(context, instance, networks)
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 463,
>>> in _get_instance_nw_info
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> nw_info = self._build_network_info_model(context, instance, networks)
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 979,
>>> in _build_network_info_model
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> client = neutronv2.get_client(context, admin=True)
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>>> 71, in get_client
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> return _get_client(token=token)
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>>> 52, in _get_client
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> token = _get_auth_token()
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>>> 47, in _get_auth_token
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> LOG.error(_('Neutron client authentication failed: %s'), e)
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/nova/network/neutronv2/__init__.py", line
>>> 43, in _get_auth_token
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> httpclient.authenticate()
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp File
>>> "/usr/lib/python2.6/site-packages/neutronclient/client.py", line 237, in
>>> authenticate
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> raise exceptions.Unauthorized(message=body)
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> Unauthorized: {"error": {"message": "object of type 'NoneType' has no
>>> len()", "code": 400, "title": "Bad Request"}}
>>> 2013-11-28 11:58:37.313 1668 TRACE nova.openstack.common.rpc.amqp
>>> 2013-11-28 11:58:37.397 1668 ERROR nova.network.neutronv2 [-] Neutron
>>> client authentication failed: {"error": {"message": "object of type
>>> 'NoneType' has no len()", "code": 400, "title": "Bad Request"}}
>>> 2013-11-28 11:58:53.145 1668 WARNING nova.compute.manager [-] Found 7 in
>>> the database and 0 on the hypervisor.
>>>
>>>
>>>
>>>
>>> _______________________________________________
>>> Mailing list:
>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>> Post to : openstack at lists.openstack.org
>>> Unsubscribe :
>>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
>>>
>>>
>>
>>
>> --
>> -dheeru
>> @Community Service
>>
>> ------------------------------
>> - compute1.neutron.log, 148 KB
>> - compute1.nova-compute.log, 599 KB
>> - controller-neutron.log, 37 KB
>>
>>
>
>
> --
> -dheeru
> @Community Service
>
>
--
-dheeru
@Community Service
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20131202/60403e9c/attachment.html>
More information about the Openstack
mailing list