Open Stack

Hello,


Since we migrated our jobs from Ubuntu Focal to Ubuntu Jammy, heat gate
jobs have
become very flaky. Further investigation revealed that the issue is related
to something
in libvirt from Ubuntu Jammy and that prevents detaching devices from
instances[1].

The same problem appears in different jobs[2] and we workaround the problem
by disabling
some affected jobs. In heat we also disabled some flaky tests but because
of this we no longer
run basic scenario tests which deploys instance/volume/network in a single
stack, which means
we lost the quite basic test coverage.

My question is, is there anyone in the Nova team working on "fixing" this
problem ?
We might be able to implement some workaround (like checking status of the
instances before
attempting to delete it) but this should be fixed in libvirt side IMO, as
this looks like a "regression"
in Ubuntu Jammy.
Probably we should report a bug against the libvirt package in Ubuntu but
I'd like to hear some
thoughts from the nova team because they are more directly affected by this
problem.

I'm now trying to set up a centos stream 9 job in Heat repo to see whether
this can be reproduced
if we use centos stream 9. I've been running that specific scenario test in
centos stream 9 jobs
in puppet repos but I've never seen this issue, so I suspect the issue is
really specific to libvirt
in Jammy.

[1] https://bugs.launchpad.net/nova/+bug/1998274
[2] https://bugs.launchpad.net/nova/+bug/1998148

Thank you,
Takashi
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.openstack.org/pipermail/openstack-discuss/attachments/20230330/1828f451/attachment-0001.htm>