<div dir="ltr">Maybe u should check whether the neutron-server consumed the message and issued the reply.</div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Aug 1, 2017 at 2:17 PM, Xu, Rongjie (NSB - CN/Hangzhou) <span dir="ltr"><<a href="mailto:rongjie.xu@nokia-sbell.com" target="_blank">rongjie.xu@nokia-sbell.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">





<div lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="m_-7643497812059311674WordSection1">
<p class="MsoNormal"><span style="color:#0070c0">Hi,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0">I manually deployed OpenStack with one controller and several computes, which is working well for months. Recently I get one issue after server power off and on again due to high temperate warning.
<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0">Issue it neutron-linuxbridge-agent service on compute nodes failed to get messages from rabbitmq on controller nodes. The error log is like follows:<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0">2017-08-01 11:13:45.435 44071 ERROR neutron.plugins.ml2.drivers.<wbr>agent._common_agent [-] Failed reporting state!<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0">2017-08-01 11:13:45.435 44071 ERROR neutron.plugins.ml2.drivers.<wbr>agent._common_agent Traceback (most recent call last):<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0">2017-08-01 11:13:45.435 44071 ERROR neutron.plugins.ml2.drivers.<wbr>agent._common_agent   File "/usr/lib/python2.7/dist-<wbr>packages/neutron/plugins/ml2/<wbr>drivers/agent/_common_agent.<wbr>py", line 130, in _report_state<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0">2017-08-01 11:13:45.435 44071 ERROR neutron.plugins.ml2.drivers.<wbr>agent._common_agent     True)<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0">2017-08-01 11:13:45.435 44071 ERROR neutron.plugins.ml2.drivers.<wbr>agent._common_agent   File "/usr/lib/python2.7/dist-<wbr>packages/neutron/agent/rpc.py"<wbr>, line 88, in report_state<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0">2017-08-01 11:13:45.435 44071 ERROR neutron.plugins.ml2.drivers.<wbr>agent._common_agent     return method(context, 'report_state', **kwargs)<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0">2017-08-01 11:13:45.435 44071 ERROR neutron.plugins.ml2.drivers.<wbr>agent._common_agent   File "/usr/lib/python2.7/dist-<wbr>packages/oslo_messaging/rpc/<wbr>client.py", line 169, in call<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0">2017-08-01 11:13:45.435 44071 ERROR neutron.plugins.ml2.drivers.<wbr>agent._common_agent     retry=self.retry)<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0">2017-08-01 11:13:45.435 44071 ERROR neutron.plugins.ml2.drivers.<wbr>agent._common_agent   File "/usr/lib/python2.7/dist-<wbr>packages/oslo_messaging/<wbr>transport.py", line 97, in _send<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0">2017-08-01 11:13:45.435 44071 ERROR neutron.plugins.ml2.drivers.<wbr>agent._common_agent     timeout=timeout, retry=retry)<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0">2017-08-01 11:13:45.435 44071 ERROR neutron.plugins.ml2.drivers.<wbr>agent._common_agent   File "/usr/lib/python2.7/dist-<wbr>packages/oslo_messaging/_<wbr>drivers/amqpdriver.py", line 464, in send<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0">2017-08-01 11:13:45.435 44071 ERROR neutron.plugins.ml2.drivers.<wbr>agent._common_agent     retry=retry)<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0">2017-08-01 11:13:45.435 44071 ERROR neutron.plugins.ml2.drivers.<wbr>agent._common_agent   File "/usr/lib/python2.7/dist-<wbr>packages/oslo_messaging/_<wbr>drivers/amqpdriver.py", line 453, in _send<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0">2017-08-01 11:13:45.435 44071 ERROR neutron.plugins.ml2.drivers.<wbr>agent._common_agent     result = self._waiter.wait(msg_id, timeout)<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0">2017-08-01 11:13:45.435 44071 ERROR neutron.plugins.ml2.drivers.<wbr>agent._common_agent   File "/usr/lib/python2.7/dist-<wbr>packages/oslo_messaging/_<wbr>drivers/amqpdriver.py", line 336, in wait<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0">2017-08-01 11:13:45.435 44071 ERROR neutron.plugins.ml2.drivers.<wbr>agent._common_agent     message = self.waiters.get(msg_id, timeout=timeout)<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0">2017-08-01 11:13:45.435 44071 ERROR neutron.plugins.ml2.drivers.<wbr>agent._common_agent   File "/usr/lib/python2.7/dist-<wbr>packages/oslo_messaging/_<wbr>drivers/amqpdriver.py", line 238, in get<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0">2017-08-01 11:13:45.435 44071 ERROR neutron.plugins.ml2.drivers.<wbr>agent._common_agent     'to message ID %s' % msg_id)<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0">2017-08-01 11:13:45.435 44071 ERROR neutron.plugins.ml2.drivers.<wbr>agent._common_agent MessagingTimeout: Timed out waiting for a reply to message ID 6c54bbf0b01d49eaa8babfdd5f9ba8<wbr>0<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0">This is what I configured in /etc/neutron/neutron.conf for rabbitmq connection.<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:.5in">
<u></u><span style="font-family:Symbol;color:#0070c0"><span>·<span style="font:7.0pt "Times New Roman"">        
</span></span></span><u></u><span style="color:#0070c0">transport_url = rabbit://openstack:<password>@<wbr>controller<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0">And from controller I see the user is valid:<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:1.0in"><span style="color:#0070c0">root@controller:~# rabbitmqctl list_users<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:1.0in"><span style="color:#0070c0">Listing users ...<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:1.0in"><span style="color:#0070c0">guest     [administrator]<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:1.0in"><span style="color:#0070c0">openstack           [administrator]<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:1.0in"><span style="color:#0070c0">root@controller:~# rabbitmqctl list_user_permissions openstack<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:1.0in"><span style="color:#0070c0">Listing permissions for user "openstack" ...<u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:1.0in"><span style="color:#0070c0">/              .*            .*            .*<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0">And from rabbitmq management GUI, I see there are connections established between controller and compute. What could cause this problem then? And how can I get further? Thanks.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0">Best Regards<u></u><u></u></span></p>
<p class="MsoNormal"><span style="color:#0070c0">Xu Rongjie (Max)<u></u><u></u></span></p>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>

<br>______________________________<wbr>_________________<br>
Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" rel="noreferrer" target="_blank">http://lists.openstack.org/<wbr>cgi-bin/mailman/listinfo/<wbr>openstack</a><br>
Post to     : <a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a><br>
Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" rel="noreferrer" target="_blank">http://lists.openstack.org/<wbr>cgi-bin/mailman/listinfo/<wbr>openstack</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div>Services Computing Technology and System Lab && Cluster and Grid Computing Lab.<br>School of Computer Science and Technology,<br>Huazhong University of Science and Technology,<br>Wuhan,430074,China.</div></div>
</div>