[Openstack] Can't start instance after upgrade to Mitaka release
Eugen Block
eblock at nde.ag
Thu Apr 21 07:13:30 UTC 2016
Well, the error is quite clear to me, it seems you don't provide a
password in your config, it's described pretty good in the docs. Here
is the excerpt for nova.conf to use neutron:
---cut here---
[neutron]
...
url = http://controller:9696
auth_url = http://controller:35357
auth_type = password
project_domain_name = default
user_domain_name = default
region_name = RegionOne
project_name = service
username = neutron
password = NEUTRON_PASS
---cut here---
You should try to follow all steps from the install guide [1], the
option "use_neutron" is new since Mitaka and it's mentioned there.
[1]
http://docs.openstack.org/mitaka/install-guide-obs/neutron-compute-install.html
Zitat von K K <nnex at mail.ru>:
> okey. Yes, it's a trouble. I solved that problem by add
> use_neutron = true
> to nova.conf at compute and controller nodes.
> Also I added to nova.conf at compute node:
> [neutron]
> auth_type = password
> auth_url = http://controller:35357
> But now I get else error when I try to start instance. Nova at compute01 said:
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> [req-2eca880a-78dd-4035-9d6f-fcabb8917a3c
> 79401c3a746740ef826762ca9eaeb207 3029462986ac400ca2c2c6ac4c9af5a7 -
> - -] Exception during message handling: Expecting to find username
> or userId in passwordCredentials - the server could not comply with
> the request since it is either malformed or otherwise incorrect. The
> client is assumed to be in error. (HTTP 400) (Request-ID:
> req-de7b439f-2a6b-4636-953b-1a6b24668e83)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> Traceback (most recent call last):
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File
> "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py",
> line 138, in _dispatch_and_reply
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> incoming.message))
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File
> "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py",
> line 185, in _dispatch
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> return self._do_dispatch(endpoint, method, ctxt, args)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File
> "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py",
> line 127, in _do_dispatch
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> result = func(ctxt, **new_args)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 110,
> in wrapped
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher payload)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line
> 220, in __exit__
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> self.force_reraise()
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line
> 196, in force_reraise
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> six.reraise(self.type_, self.value, self.tb)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 89,
> in wrapped
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> return f(self, context, *args, **kw)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py",
> line 359, in decorated_function
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> LOG.warning(msg, e, instance=instance)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line
> 220, in __exit__
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> self.force_reraise()
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line
> 196, in force_reraise
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> six.reraise(self.type_, self.value, self.tb)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py",
> line 328, in decorated_function
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> return function(self, context, *args, **kwargs)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py",
> line 409, in decorated_function
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> return function(self, context, *args, **kwargs)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py",
> line 387, in decorated_function
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> kwargs['instance'], e, sys.exc_info())
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line
> 220, in __exit__
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> self.force_reraise()
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line
> 196, in force_reraise
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> six.reraise(self.type_, self.value, self.tb)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py",
> line 375, in decorated_function
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> return function(self, context, *args, **kwargs)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py",
> line 2598, in start_instance
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> self._power_on(context, instance)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py",
> line 2566, in _power_on
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> network_info = self.network_api.get_instance_nw_info(context,
> instance)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File "/usr/lib/python2.7/dist-packages/nova/network/base_api.py",
> line 253, in get_instance_nw_info
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> result = self._get_instance_nw_info(context, instance, **kwargs)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File
> "/usr/lib/python2.7/dist-packages/nova/network/neutronv2/api.py",
> line 915, in _get_instance_nw_info
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> preexisting_port_ids)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File
> "/usr/lib/python2.7/dist-packages/nova/network/neutronv2/api.py",
> line 1690, in _build_network_info_model
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> data = client.list_ports(**search_opts)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File
> "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py",
> line 97, in with_params
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> ret = self.function(instance, *args, **kwargs)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File
> "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py",
> line 644, in list_ports
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher **_params)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File
> "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py",
> line 373, in list
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> for r in self._pagination(collection, path, **params):
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File
> "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py",
> line 388, in _pagination
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> res = self.get(path, params=params)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File
> "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py",
> line 358, in get
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> headers=headers, params=params)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File
> "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py",
> line 335, in retry_request
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> headers=headers, params=params)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File
> "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py",
> line 286, in do_request
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> resp, replybody = self.httpclient.do_request(action, method,
> body=body)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File "/usr/lib/python2.7/dist-packages/neutronclient/client.py",
> line 306, in do_request
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> return self.request(url, method, **kwargs)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File "/usr/lib/python2.7/dist-packages/neutronclient/client.py",
> line 294, in request
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> resp = super(SessionClient, self).request(*args, **kwargs)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File "/usr/lib/python2.7/dist-packages/keystoneauth1/adapter.py",
> line 98, in request
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> return self.session.request(url, method, **kwargs)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File "/usr/lib/python2.7/dist-packages/positional/__init__.py", line
> 94, in inner
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> return func(*args, **kwargs)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File "/usr/lib/python2.7/dist-packages/keystoneauth1/session.py",
> line 370, in request
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> auth_headers = self.get_auth_headers(auth)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File "/usr/lib/python2.7/dist-packages/keystoneauth1/session.py",
> line 624, in get_auth_headers
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> return auth.get_headers(self, **kwargs)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File "/usr/lib/python2.7/dist-packages/keystoneauth1/plugin.py",
> line 84, in get_headers
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> token = self.get_token(session)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File
> "/usr/lib/python2.7/dist-packages/keystoneauth1/identity/base.py",
> line 90, in get_token
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> return self.get_access(session).auth_token
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File
> "/usr/lib/python2.7/dist-packages/keystoneauth1/identity/base.py",
> line 136, in get_access
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> self.auth_ref = self.get_auth_ref(session)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File
> "/usr/lib/python2.7/dist-packages/keystoneauth1/identity/generic/base.py",
> line 181, in get_auth_ref
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> return self._plugin.get_auth_ref(session, **kwargs)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File
> "/usr/lib/python2.7/dist-packages/keystoneauth1/identity/v2.py",
> line 65, in get_auth_ref
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> authenticated=False, log=False)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File "/usr/lib/python2.7/dist-packages/keystoneauth1/session.py",
> line 572, in post
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> return self.request(url, 'POST', **kwargs)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File "/usr/lib/python2.7/dist-packages/positional/__init__.py", line
> 94, in inner
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> return func(*args, **kwargs)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> File "/usr/lib/python2.7/dist-packages/keystoneauth1/session.py",
> line 467, in request
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> raise exceptions.from_response(resp, method, url)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
> BadRequest: Expecting to find username or userId in
> passwordCredentials - the server could not comply with the request
> since it is either malformed or otherwise incorrect. The client is
> assumed to be in error. (HTTP 400) (Request-ID:
> req-de7b439f-2a6b-4636-953b-1a6b24668e83)
> 2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher
>
> tcpdump show strange message:
> Host: controller:35357
> Content-Length: 53
> Accept-Encoding: gzip, deflate
> Accept: application/json
> User-Agent: keystoneauth1/2.4.0 python-requests/2.9.1 CPython/2.7.11+
> Connection: keep-alive
> Content-Type: application/json
> {"auth": {"passwordCredentials": {"password": null}}}
> during communication with controller.
> Where I must to specify a password?
>
>
> okay. I change Среда, 20 апреля 2016, 19:05 +05:00 от "Van Leeuwen,
> Robert" < rovanleeuwen at ebay.com >:
>>
>>> I upgraded release OpenStack from Kilo to Mitaka.
>>> But now I can't start any Instance. At the compute node nova daemons said:
>>> 2016-04-20 12:40:15.395 226509 ERROR oslo_messaging.rpc.dispatcher
>>> [req-86e4ab2e-229a-438d-87d2-d9ce9f749dbc
>>> 79401c3a746740ef826762ca9eaeb207 3029462986ac400ca2c2c6ac4c9af5a7
>>> - - -] Exception during message handling: Timed out waiting for a
>>> reply to message ID cb754491dfb14d8793ca6ee05ae420c9
>>
>> This indicates something is not responding to a RPC call (via rabbitmq)
>>
>>
>>> snip
>>> 2016-04-20 12:40:15.395 226509 ERROR oslo_messaging.rpc.dispatcher
>>> File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line
>>> 385, in _get_instance_nw_info
>>> 2016-04-20 12:40:15.395 226509 ERROR oslo_messaging.rpc.dispatcher
>>> nw_info = self.network_rpcapi.get_instance_nw_info(context, **args)
>>> 2016-04-20 12:40:15.395 226509 ERROR oslo_messaging.rpc.dispatcher
>>> File "/usr/lib/python2.7/dist-packages/nova/network/rpcapi.py",
>>> line 209, in get_instance_nw_info
>> This suggests it has something to do with nova doing a call to Neutron.
>> Have you checked if Neutron is working properly and can connect to
>> the neutron-agent?
>>
>> Cheers,
>> Robert van Leeuwen
>>
--
Eugen Block voice : +49-40-559 51 75
NDE Netzdesign und -entwicklung AG fax : +49-40-559 51 77
Postfach 61 03 15
D-22423 Hamburg e-mail : eblock at nde.ag
Vorsitzende des Aufsichtsrates: Angelika Mozdzen
Sitz und Registergericht: Hamburg, HRB 90934
Vorstand: Jens-U. Mozdzen
USt-IdNr. DE 814 013 983
More information about the Openstack
mailing list