<div dir="ltr">Further debugging shows that nova cannot connect to neutron. Something is wrong with config params? How to check?<div><br></div><div><div>2015-01-20 16:06:50.774 8152 ERROR nova.compute.manager [-] Instance failed network setup after 1 attempt(s)</div><div>2015-01-20 16:06:50.774 8152 TRACE nova.compute.manager Traceback (most recent call last):</div><div>2015-01-20 16:06:50.774 8152 TRACE nova.compute.manager File "/usr/local/lib/python2.7/site-packages/nova/compute/manager.py", line 1682, in _allocate_network_async</div><div>2015-01-20 16:06:50.774 8152 TRACE nova.compute.manager dhcp_options=dhcp_options)</div><div>2015-01-20 16:06:50.774 8152 TRACE nova.compute.manager File "/usr/local/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 261, in allocate_for_insta</div><div>nce</div><div>2015-01-20 16:06:50.774 8152 TRACE nova.compute.manager refresh_cache=True, neutron=neutron) else</div><div>2015-01-20 16:06:50.774 8152 TRACE nova.compute.manager File "/usr/local/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 454, in _has_port_binding_</div><div>extension</div><div>2015-01-20 16:06:50.774 8152 TRACE nova.compute.manager self._refresh_neutron_extensions_cache(context, neutron=neutron)</div><div>2015-01-20 16:06:50.774 8152 TRACE nova.compute.manager File "/usr/local/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 445, in _refresh_neutron_e</div><div>xtensions_cache</div><div>2015-01-20 16:06:50.774 8152 TRACE nova.compute.manager extensions_list = neutron.list_extensions()['extensions']</div><div>2015-01-20 16:06:50.774 8152 TRACE nova.compute.manager File "/usr/local/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 108, in with_params</div><div>2015-01-20 16:06:50.774 8152 TRACE nova.compute.manager ret = self.function(instance, *args, **kwargs)</div><div>2015-01-20 16:06:50.774 8152 TRACE nova.compute.manager File "/usr/local/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 286, in list_extensions</div><div>2015-01-20 16:06:50.774 8152 TRACE nova.compute.manager return self.get(self.extensions_path, params=_params)</div><div>2015-01-20 16:06:50.774 8152 TRACE nova.compute.manager File "/usr/local/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 1183, in get</div><div>2015-01-20 16:06:50.774 8152 TRACE nova.compute.manager headers=headers, params=params)</div><div>2015-01-20 16:06:50.774 8152 TRACE nova.compute.manager File "/usr/local/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 1175, in retry_request</div><div>2015-01-20 16:06:50.774 8152 TRACE nova.compute.manager raise exceptions.ConnectionFailed(reason=_("Maximum attempts reached"))</div><div>2015-01-20 16:06:50.774 8152 TRACE nova.compute.manager ConnectionFailed: Connection to neutron failed: Maximum attempts reached</div></div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Jan 20, 2015 at 4:02 PM, Geo Varghese <span dir="ltr"><<a href="mailto:gvarghese@aqorn.com" target="_blank">gvarghese@aqorn.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Restart your rabbitmq server. Seems its an issue with messaging server.<br></div><div class="gmail_extra"><br><div class="gmail_quote"><div><div class="h5">On Tue, Jan 20, 2015 at 2:52 PM, Shyam Nadiminti <span dir="ltr"><<a href="mailto:nsv.shyam@gmail.com" target="_blank">nsv.shyam@gmail.com</a>></span> wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div class="h5"><div dir="ltr"><div class="gmail_extra"><p class="MsoNormal"><span style="color:rgb(31,73,125)"> </span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">I'm trying to create new instance and it has been failing with the following stack - failed to get network information. </span><br></p><p class="MsoNormal"><span style="color:rgb(31,73,125)"><br></span></p><p class="MsoNormal"><font color="#1f497d">- build_and_run_instance is called.</font><br></p><p class="MsoNormal"><font color="#1f497d">-locked_do_build_and_run_instance is called to get resources.<br></font></p><p class="MsoNormal"><font color="#1f497d">-Memory, disk space resource claim is successful.</font></p><p class="MsoNormal"><font color="#1f497d">- Then, trying to build network resource asynchronously: _allocat</font><span style="color:rgb(31,73,125)">e_network_async</span><span style="color:rgb(31,73,125)"> </span></p><p class="MsoNormal"><span style="color:rgb(31,73,125)"><br></span></p><p class="MsoNormal"><font color="#1f497d">The issue is started. I found that message has been sent but response is not received. Can anyone suggest me what logs should I look into to see what is happening in response? Why is it timed out? How to debug it further? Any issue with nova.conf that I may be missing?</font></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)"> </span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">015-01-19 21:17:56.350 17307
ERROR nova.compute.manager [-] Instance failed network setup after 1 attempt(s)</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307
TRACE nova.compute.manager Traceback (most recent call last):</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307
TRACE nova.compute.manager File
"/usr/local/lib/python2.7/site-packages/nova/compute/manager.py",
line 1682, in _allocate_network_async</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307
TRACE nova.compute.manager dhcp_options=dhcp_options)</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307
TRACE nova.compute.manager File
"/usr/local/lib/python2.7/site-packages/nova/network/api.py", line
47, in wrapped</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307
TRACE nova.compute.manager return func(self, context,
*args, **kwargs)</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307
TRACE nova.compute.manager File
"/usr/local/lib/python2.7/site-packages/nova/network/base_api.py",
line 64, in wrapper</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307
TRACE nova.compute.manager res = f(self, context,
*args, **kwargs)</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307
TRACE nova.compute.manager File
"/usr/local/lib/python2.7/site-packages/nova/network/api.py", line
277, in allocate_for_instance</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307
TRACE nova.compute.manager nw_info =
self.network_rpcapi.allocate_for_instance(context, **args)</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307
TRACE nova.compute.manager File
"/usr/local/lib/python2.7/site-packages/nova/network/rpcapi.py", line
188, in allocate_for_instance</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307
TRACE nova.compute.manager
macs=jsonutils.to_primitive(macs))</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307
TRACE nova.compute.manager File
"/usr/local/lib/python2.7/site-packages/oslo/messaging/rpc/client.py",
line 159, in call</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307
TRACE nova.compute.manager retry=self.retry)</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307 TRACE
nova.compute.manager File
"/usr/local/lib/python2.7/site-packages/oslo/messaging/transport.py",
line 90, in _send</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307
TRACE nova.compute.manager timeout=timeout,
retry=retry)</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307
TRACE nova.compute.manager File
"/usr/local/lib/python2.7/site-packages/oslo/messaging/_drivers/amqpdriver.py",
line 408, in send</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307
TRACE nova.compute.manager retry=retry)</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307
TRACE nova.compute.manager File
"/usr/local/lib/python2.7/site-packages/oslo/messaging/_drivers/amqpdriver.py",
line 397, in _send</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307
TRACE nova.compute.manager result =
self._waiter.wait(msg_id, timeout)</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307
TRACE nova.compute.manager File
"/usr/local/lib/python2.7/site-packages/oslo/messaging/_drivers/amqpdriver.py",
line 298, in wait</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307
TRACE nova.compute.manager reply, ending, trylock =
self._poll_queue(msg_id, timeout)</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307
TRACE nova.compute.manager File
"/usr/local/lib/python2.7/site-packages/oslo/messaging/_drivers/amqpdriver.py",
line 238, in _poll_queue</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307
TRACE nova.compute.manager message =
self.waiters.get(msg_id, timeout)</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307
TRACE nova.compute.manager File
"/usr/local/lib/python2.7/site-packages/oslo/messaging/_drivers/amqpdriver.py",
line 144, in get</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307
TRACE nova.compute.manager 'to message ID %s' % msg_id)</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307
TRACE nova.compute.manager MessagingTimeout: Timed out waiting for a reply to
message ID 56262582185f4a5cb0d11a7f85239c3f</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">2015-01-19 21:17:56.350 17307
TRACE nova.compute.manager</span></p></div></div>
<br></div></div>_______________________________________________<br>
Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
Post to : <a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a><br>
Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
<br></blockquote></div><span class="HOEnZb"><font color="#888888"><br><br clear="all"><br>-- <br><div><div dir="ltr">--<div>Regards,</div><div>Geo Varghese</div></div></div>
</font></span></div>
</blockquote></div><br></div>