[Openstack] Can't start instance after upgrade to Mitaka release

K K nnex at mail.ru
Thu Apr 21 06:47:55 UTC 2016


okey. Yes, it's a trouble. I solved that problem by add
use_neutron = true
to nova.conf at compute and controller nodes.
Also I added to  nova.conf at compute  node:
[neutron]
auth_type = password
auth_url = http://controller:35357
But now I get else error when I try to start instance.  Nova at compute01  said:
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher [req-2eca880a-78dd-4035-9d6f-fcabb8917a3c 79401c3a746740ef826762ca9eaeb207 3029462986ac400ca2c2c6ac4c9af5a7 - - -] Exception during message handling: Expecting to find username or userId in passwordCredentials - the server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-de7b439f-2a6b-4636-953b-1a6b24668e83)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher Traceback (most recent call last):
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher incoming.message))
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher return self._do_dispatch(endpoint, method, ctxt, args)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher result = func(ctxt, **new_args)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 110, in wrapped
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher payload)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher self.force_reraise()
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 89, in wrapped
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher return f(self, context, *args, **kw)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 359, in decorated_function
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher LOG.warning(msg, e, instance=instance)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher self.force_reraise()
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 328, in decorated_function
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher return function(self, context, *args, **kwargs)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 409, in decorated_function
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher return function(self, context, *args, **kwargs)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 387, in decorated_function
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher kwargs['instance'], e, sys.exc_info())
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher self.force_reraise()
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 375, in decorated_function
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher return function(self, context, *args, **kwargs)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2598, in start_instance
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher self._power_on(context, instance)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2566, in _power_on
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher network_info = self.network_api.get_instance_nw_info(context, instance)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/network/base_api.py", line 253, in get_instance_nw_info
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher result = self._get_instance_nw_info(context, instance, **kwargs)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/network/neutronv2/api.py", line 915, in _get_instance_nw_info
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher preexisting_port_ids)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/network/neutronv2/api.py", line 1690, in _build_network_info_model
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher data = client.list_ports(**search_opts)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 97, in with_params
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher ret = self.function(instance, *args, **kwargs)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 644, in list_ports
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher **_params)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 373, in list
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher for r in self._pagination(collection, path, **params):
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 388, in _pagination
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher res = self.get(path, params=params)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 358, in get
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher headers=headers, params=params)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 335, in retry_request
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher headers=headers, params=params)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 286, in do_request
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher resp, replybody = self.httpclient.do_request(action, method, body=body)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutronclient/client.py", line 306, in do_request
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher return self.request(url, method, **kwargs)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutronclient/client.py", line 294, in request
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher resp = super(SessionClient, self).request(*args, **kwargs)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/keystoneauth1/adapter.py", line 98, in request
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher return self.session.request(url, method, **kwargs)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/positional/__init__.py", line 94, in inner
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher return func(*args, **kwargs)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/keystoneauth1/session.py", line 370, in request
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher auth_headers = self.get_auth_headers(auth)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/keystoneauth1/session.py", line 624, in get_auth_headers
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher return auth.get_headers(self, **kwargs)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/keystoneauth1/plugin.py", line 84, in get_headers
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher token = self.get_token(session)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/keystoneauth1/identity/base.py", line 90, in get_token
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher return self.get_access(session).auth_token
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/keystoneauth1/identity/base.py", line 136, in get_access
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher self.auth_ref = self.get_auth_ref(session)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/keystoneauth1/identity/generic/base.py", line 181, in get_auth_ref
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher return self._plugin.get_auth_ref(session, **kwargs)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/keystoneauth1/identity/v2.py", line 65, in get_auth_ref
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher authenticated=False, log=False)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/keystoneauth1/session.py", line 572, in post
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher return self.request(url, 'POST', **kwargs)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/positional/__init__.py", line 94, in inner
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher return func(*args, **kwargs)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/keystoneauth1/session.py", line 467, in request
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher raise exceptions.from_response(resp, method, url)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher BadRequest: Expecting to find username or userId in passwordCredentials - the server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-de7b439f-2a6b-4636-953b-1a6b24668e83)
2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher

tcpdump show strange message:
Host: controller:35357
Content-Length: 53
Accept-Encoding: gzip, deflate
Accept: application/json
User-Agent: keystoneauth1/2.4.0 python-requests/2.9.1 CPython/2.7.11+
Connection: keep-alive
Content-Type: application/json
{"auth": {"passwordCredentials": {"password": null}}}
during communication with controller.
Where I must to specify a password?


okay. I change  Среда, 20 апреля 2016, 19:05 +05:00 от "Van Leeuwen, Robert" < rovanleeuwen at ebay.com >:
>
>> I upgraded release OpenStack from Kilo to Mitaka.
>>But now I can't start any Instance. At the compute node nova daemons said:
>> 2016-04-20 12:40:15.395 226509 ERROR oslo_messaging.rpc.dispatcher [req-86e4ab2e-229a-438d-87d2-d9ce9f749dbc 79401c3a746740ef826762ca9eaeb207 3029462986ac400ca2c2c6ac4c9af5a7 - - -] Exception during message handling: Timed out waiting for a reply to message ID cb754491dfb14d8793ca6ee05ae420c9
>
>This indicates something is not responding to a RPC call (via rabbitmq)
>
>
>> snip
>> 2016-04-20 12:40:15.395 226509 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 385, in _get_instance_nw_info
>> 2016-04-20 12:40:15.395 226509 ERROR oslo_messaging.rpc.dispatcher nw_info = self.network_rpcapi.get_instance_nw_info(context, **args)
>> 2016-04-20 12:40:15.395 226509 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/network/rpcapi.py", line 209, in get_instance_nw_info
>This suggests it has something to do with nova doing a call to Neutron.
>Have you checked if Neutron is working properly and can connect to the neutron-agent?
>
>Cheers,
>Robert van Leeuwen
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20160421/f59a44d9/attachment.html>


More information about the Openstack mailing list