[openstack-dev] [neutron][infra] Functional job failure rate at 100%
Daniel Alvarez Sanchez
dalvarez at redhat.com
Wed Aug 9 14:20:22 UTC 2017
Some more info added to Jakub's excellent report :)
New kernel Ubuntu-4.4.0-89.112HEADUbuntu-4.4.0-89.112master was
tagged 9 days ago (07/31/2017) .
>From a quick look, the only commit around this function is .
On Wed, Aug 9, 2017 at 3:29 PM, Jakub Libosvar <jlibosva at redhat.com> wrote:
> Daniel Alvarez and I spent some time looking at it and the culprit was
> finally found.
> We updated a kernel on machines to one containing bug when creating
> conntrack entries which makes functional tests stuck. More info at .
> For now, I sent a patch  to disable for now jobs that create
> conntrack entries manually, it needs update of commit message. Once it
> merges, we an enable back functional job to voting to avoid regressions.
> Is it possible to switch used image for jenkins machines to use back the
> older version? Any other ideas how to deal with the kernel bug?
>  https://review.openstack.org/#/c/492068/1
> On 07/08/2017 11:52, Jakub Libosvar wrote:
> > Hi all,
> > as per grafana  the functional job is broken. Looking at logstash 
> > it started happening consistently since 2017-08-03 16:27. I didn't find
> > any particular patch in Neutron that could cause it.
> > The culprit is that ovsdb starts misbehaving  and then we retry calls
> > indefinitely. We still use 2.5.2 openvswitch as we had before. I opened
> > a bug  and started investigation, I'll update my findings there.
> > I think at this point there is no reason to run "recheck" on your
> > Thanks,
> > Jakub
> > 
> > http://grafana.openstack.org/dashboard/db/neutron-failure-
> >  http://bit.ly/2vdKMwy
> > 
> > http://logs.openstack.org/14/488914/8/check/gate-neutron-
> >  https://bugs.launchpad.net/neutron/+bug/1709032
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: OpenStack-dev-request at lists.openstack.org?subject:unsubscribe
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the OpenStack-dev