<div dir="ltr"><div>Hello folks:</div><div><br></div><div>I replied in [1]. I think we could have a potential problem when executing a DB change the impies a OF controller re-initialization. Most of the time we don't have problems but as we see in the CI, we could sometimes.</div><div><br></div><div>I'll push a patch to add a retry decorator on the methods that trigger this OF controller restart.</div><div><br></div><div>Regards.<br></div><div><br></div><div>[1]<a href="https://bugs.launchpad.net/neutron/+bug/1944201/comments/4">https://bugs.launchpad.net/neutron/+bug/1944201/comments/4</a></div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Sep 22, 2021 at 4:36 PM Slawek Kaplonski <<a href="mailto:skaplons@redhat.com">skaplons@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Hi<br>
<br>
On Wed, Sep 22, 2021 at 03:30:08PM +0200, Lajos Katona wrote:<br>
> Hi Slawek,<br>
> Thanks for the summary.<br>
> Regarding <a href="https://bugs.launchpad.net/neutron/+bug/1944201" rel="noreferrer" target="_blank">https://bugs.launchpad.net/neutron/+bug/1944201</a> not sure about if<br>
> it is related to the number of hosts, there's some failure in<br>
> singlenode jobs as well:<br>
> <a href="http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22error%20Datapath%20Invalid%5C%22" rel="noreferrer" target="_blank">http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22error%20Datapath%20Invalid%5C%22</a><br>
> <br>
> example:<br>
> <a href="https://9f672e0630f459ee81cb-e4093b1756a9a5a7c7d28e6575b4af7f.ssl.cf5.rackcdn.com/805849/10/check/neutron-ovs-rally-task/5981df8/controller/logs/screen-q-agt.txt" rel="noreferrer" target="_blank">https://9f672e0630f459ee81cb-e4093b1756a9a5a7c7d28e6575b4af7f.ssl.cf5.rackcdn.com/805849/10/check/neutron-ovs-rally-task/5981df8/controller/logs/screen-q-agt.txt</a><br>
<br>
Ok. So it happens on all types of jobs where neutron-ovs-agent is used :/<br>
<br>
> <br>
> Lajos (lajoskatona)<br>
> <br>
> Slawek Kaplonski <<a href="mailto:skaplons@redhat.com" target="_blank">skaplons@redhat.com</a>> ezt írta (időpont: 2021. szept. 22.,<br>
> Sze, 12:10):<br>
> <br>
> > Hi,<br>
> ><br>
> > Due to very urgent things which I had yesterday, I wasn't able to run<br>
> > Neutron<br>
> > CI meeting as usually. Fortunatelly we don't have many new issues in our<br>
> > CI.<br>
> > There is only one new issue in our scenario jobs which I wanted to discuss<br>
> > [1]. It's impacting Ironic gates but I noticed it also in the Neutron CI<br>
> > as<br>
> > well. See [2] or [3] for example. I'm not sure about Ironic jobs but in<br>
> > Neutron I saw it mostly (or only, I'm not sure) in the multinode jobs.<br>
> ><br>
> > [1] <a href="https://bugs.launchpad.net/neutron/+bug/1944201" rel="noreferrer" target="_blank">https://bugs.launchpad.net/neutron/+bug/1944201</a><br>
> > [2] https://<br>
> > <a href="http://e36beaa2ff297ebe7d5f-5944c3d62ed334b8cdf50b534c246731.ssl.cf5.rackcdn.com/" rel="noreferrer" target="_blank">e36beaa2ff297ebe7d5f-5944c3d62ed334b8cdf50b534c246731.ssl.cf5.rackcdn.com/</a><br>
> > 805849/9/check/neutron-ovs-tempest-dvr-ha-multinode-full/f83fa96/compute1/<br>
> > logs/screen-q-agt.txt<br>
> > <<a href="http://e36beaa2ff297ebe7d5f-5944c3d62ed334b8cdf50b534c246731.ssl.cf5.rackcdn.com/805849/9/check/neutron-ovs-tempest-dvr-ha-multinode-full/f83fa96/compute1/logs/screen-q-agt.txt" rel="noreferrer" target="_blank">http://e36beaa2ff297ebe7d5f-5944c3d62ed334b8cdf50b534c246731.ssl.cf5.rackcdn.com/805849/9/check/neutron-ovs-tempest-dvr-ha-multinode-full/f83fa96/compute1/logs/screen-q-agt.txt</a>><br>
> > [3] <a href="https://storage.bhs.cloud.ovh.net/v1/" rel="noreferrer" target="_blank">https://storage.bhs.cloud.ovh.net/v1/</a><br>
> ><br>
> > AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_88f/803045/12/check/<br>
> > neutron-ovs-tempest-slow/88f8bb7/job-output.txt<br>
> ><br>
> > --<br>
> > Slawek Kaplonski<br>
> > Principal Software Engineer<br>
> > Red Hat<br>
<br>
-- <br>
Slawek Kaplonski<br>
Principal Software Engineer<br>
Red Hat<br>
</blockquote></div>