<HTML><BODY><div class="js-helper js-readmsg-msg"><div id="style_14612196230000000826_BODY"><p>okey. Yes, it's a trouble. I solved that problem by add<br>use_neutron = true<br>to nova.conf at compute and controller nodes.<br>Also I added to <a href="mailto:nova.conf@compute" data-mce-href="mailto:nova.conf@compute">nova.conf@compute</a> node:<br>[neutron]<br>auth_type = password<br>auth_url = http://controller:35357</p><p>But now I get else error when I try to start instance. <a href="//e.mail.ru/compose/?mailto=mailto%3anova@compute01" target="_blank" data-mce-href="//e.mail.ru/compose/?mailto=mailto%3anova@compute01">Nova@compute01</a> said:<br></p><p>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher [req-2eca880a-78dd-4035-9d6f-fcabb8917a3c 79401c3a746740ef826762ca9eaeb207 3029462986ac400ca2c2c6ac4c9af5a7 - - -] Exception during message handling: Expecting to find username or userId in passwordCredentials - the server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-de7b439f-2a6b-4636-953b-1a6b24668e83)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher Traceback (most recent call last):<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher incoming.message))<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher return self._do_dispatch(endpoint, method, ctxt, args)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher result = func(ctxt, **new_args)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 110, in wrapped<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher payload)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher self.force_reraise()<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 89, in wrapped<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher return f(self, context, *args, **kw)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 359, in decorated_function<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher LOG.warning(msg, e, instance=instance)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher self.force_reraise()<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 328, in decorated_function<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher return function(self, context, *args, **kwargs)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 409, in decorated_function<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher return function(self, context, *args, **kwargs)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 387, in decorated_function<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher kwargs['instance'], e, sys.exc_info())<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher self.force_reraise()<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 375, in decorated_function<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher return function(self, context, *args, **kwargs)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2598, in start_instance<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher self._power_on(context, instance)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2566, in _power_on<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher network_info = self.network_api.get_instance_nw_info(context, instance)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/network/base_api.py", line 253, in get_instance_nw_info<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher result = self._get_instance_nw_info(context, instance, **kwargs)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/network/neutronv2/api.py", line 915, in _get_instance_nw_info<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher preexisting_port_ids)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/network/neutronv2/api.py", line 1690, in _build_network_info_model<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher data = client.list_ports(**search_opts)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 97, in with_params<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher ret = self.function(instance, *args, **kwargs)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 644, in list_ports<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher **_params)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 373, in list<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher for r in self._pagination(collection, path, **params):<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 388, in _pagination<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher res = self.get(path, params=params)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 358, in get<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher headers=headers, params=params)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 335, in retry_request<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher headers=headers, params=params)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 286, in do_request<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher resp, replybody = self.httpclient.do_request(action, method, body=body)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutronclient/client.py", line 306, in do_request<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher return self.request(url, method, **kwargs)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/neutronclient/client.py", line 294, in request<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher resp = super(SessionClient, self).request(*args, **kwargs)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/keystoneauth1/adapter.py", line 98, in request<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher return self.session.request(url, method, **kwargs)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/positional/__init__.py", line 94, in inner<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher return func(*args, **kwargs)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/keystoneauth1/session.py", line 370, in request<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher auth_headers = self.get_auth_headers(auth)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/keystoneauth1/session.py", line 624, in get_auth_headers<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher return auth.get_headers(self, **kwargs)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/keystoneauth1/plugin.py", line 84, in get_headers<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher token = self.get_token(session)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/keystoneauth1/identity/base.py", line 90, in get_token<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher return self.get_access(session).auth_token<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/keystoneauth1/identity/base.py", line 136, in get_access<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher self.auth_ref = self.get_auth_ref(session)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/keystoneauth1/identity/generic/base.py", line 181, in get_auth_ref<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher return self._plugin.get_auth_ref(session, **kwargs)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/keystoneauth1/identity/v2.py", line 65, in get_auth_ref<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher authenticated=False, log=False)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/keystoneauth1/session.py", line 572, in post<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher return self.request(url, 'POST', **kwargs)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/positional/__init__.py", line 94, in inner<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher return func(*args, **kwargs)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/keystoneauth1/session.py", line 467, in request<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher raise exceptions.from_response(resp, method, url)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher BadRequest: Expecting to find username or userId in passwordCredentials - the server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-de7b439f-2a6b-4636-953b-1a6b24668e83)<br>2016-04-21 11:43:37.714 495228 ERROR oslo_messaging.rpc.dispatcher<br><br>tcpdump show strange message:<br></p><p>Host: controller:35357<br>Content-Length: 53<br>Accept-Encoding: gzip, deflate<br>Accept: application/json<br>User-Agent: keystoneauth1/2.4.0 python-requests/2.9.1 CPython/2.7.11+<br>Connection: keep-alive<br>Content-Type: application/json</p><p>{"auth": {"passwordCredentials": {"password": null}}}</p><p>during communication with controller.</p><p>Where I must to specify a password?</p><p><br><br>okay. I change </p><blockquote style="border-left:1px solid #0857A6;margin:10px;padding:0 0 0 10px;" data-mce-style="border-left: 1px solid #0857A6; margin: 10px; padding: 0 0 0 10px;">Среда, 20 апреля 2016, 19:05 +05:00 от "Van Leeuwen, Robert" <<a href="/compose?To=rovanleeuwen@ebay.com" data-mce-href="/compose?To=rovanleeuwen@ebay.com">rovanleeuwen@ebay.com</a>>:<br> <br><div><div><div><div><div><div><div>> I upgraded release OpenStack from Kilo to Mitaka.</div><div>>But now I can't start any Instance. At the compute node nova daemons said:</div><div>> 2016-04-20 12:40:15.395 226509 ERROR oslo_messaging.rpc.dispatcher [req-86e4ab2e-229a-438d-87d2-d9ce9f749dbc 79401c3a746740ef826762ca9eaeb207 3029462986ac400ca2c2c6ac4c9af5a7 - - -] Exception during message handling: Timed out waiting for a reply to message ID cb754491dfb14d8793ca6ee05ae420c9</div></div></div><div><br></div><div>This indicates something is not responding to a RPC call (via rabbitmq)</div><div><br></div><div><br></div><p>> snip<br> > 2016-04-20 12:40:15.395 226509 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 385, in _get_instance_nw_info<br> > 2016-04-20 12:40:15.395 226509 ERROR oslo_messaging.rpc.dispatcher nw_info = self.network_rpcapi.get_instance_nw_info(context, **args)<br> > 2016-04-20 12:40:15.395 226509 ERROR oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/dist-packages/nova/network/rpcapi.py", line 209, in get_instance_nw_info<br></p><div>This suggests it has something to do with nova doing a call to Neutron.</div><div>Have you checked if Neutron is working properly and can connect to the neutron-agent?</div><div><br></div><div>Cheers,</div><div>Robert van Leeuwen</div><p><br></p></div></div></div></div></blockquote><br></div></div></BODY></HTML>