Le mar. 29 nov. 2022 à 09:33, Sylvain Bauza <sbauza@redhat.com> a écrit :
(early morning, needing a coffee apparently)
Le mar. 29 nov. 2022 à 09:32, Sylvain Bauza <sbauza@redhat.com> a écrit :
Le lun. 28 nov. 2022 à 14:28, Sylvain Bauza <sbauza@redhat.com> a écrit :
Sorry folks, that's kind of an email I hate writing but let's be honest : our gate is busted. Until we figure out a correct path for resolution, I hereby ask you to *NOT* recheck in order to not spill our precious CI resources for tests that are certain to fail.
Long story story, there are currently two problems : #1 https://launchpad.net/bugs/1940425 nova-ovs-hybrid-plug and nova-next jobs 100% fail due to a port remaining in down state. #2 https://bugs.launchpad.net/nova/+bug/1960346 nova-lvm job 100% fails due to a volume detach failure probably due to QEMU
Today's update :
#1 is currently investigated by the Neutron team meanwhile a patch [1] has been proposed against Zuul to skip the failing tests. Unfortunately, this patch [1] is unable to merge due to #2.
Good news, kudos to the Neutron team which delivered a bugfix against the rootcause, which is always better than just skipping tests (and lacking then coverage). https://review.opendev.org/c/openstack/neutron/+/837780/18
Accordingly, [1] is no longer necessary and has been abandoned after a recheck to verify the job runs.
#2 has a Tempest patch that's being worked on [2] but the current state of this patch is WIP. We somehow need to have an agreement on the way forward during this afternoon (UTC) to identify whether we can reasonably progress on [2] or skip the failing tests on nova-lvm.
Given [2] is hard to write, gmann proposed a patch [3] for skipping some nova-lvm tests. Reviews of [3] ongoing, should be hopefully merged today around noon UTC.
Once [3] is merged, the gate should be unblocked. Again, an email will be sent once we progress on [3].
[3] is merged, so now the gate is back \o/ Thanks all folks who helped on those issues !
-S
Again, sorry about the bad news and I'll keep you informed. -Sylvain
[1] https://review.opendev.org/c/openstack/nova/+/865658/ [2] https://review.opendev.org/c/openstack/tempest/+/842240