[nova][gate] nova-multi-cell job failing test_*_with_qos_min_bw_allocation
Balázs Gibizer
balazs.gibizer at est.tech
Fri Dec 11 16:01:22 UTC 2020
On Thu, Dec 10, 2020 at 17:50, Balázs Gibizer
<balazs.gibizer at est.tech> wrote:
>
>
> On Thu, Dec 10, 2020 at 13:18, Balázs Gibizer
> <balazs.gibizer at est.tech> wrote:
>>
>>
>> On Wed, Dec 9, 2020 at 19:33, melanie witt <melwittt at gmail.com>
>> wrote:
>>> Howdy all,
>>>
>>> FYI we have gate failures of the recently added
>>> test_*_with_qos_min_bw_allocation tests [1] in the
>>> nova-multi-cell job on the master, stable/victoria, and
>>> stable/ussuri branches. The failures occur during cross cell
>>> migrations.
>>>
>>> I have opened a bug for the failure on the master branch:
>>>
>>> * https://bugs.launchpad.net/nova/+bug/1907522
>>>
>>> The issue here is that we fail to create port bindings in neutron
>>> during a cross cell migration in the superconductor:
>>>
>>> nova.exception.PortBindingFailed: Binding failed for port <port
>>> uuid>
>>>
>>> and that corresponds to a failure in the neutron server log where
>>> it fails the port binding with:
>>>
>>> neutron_lib.exceptions.placement.UnknownResourceProvider: No such
>>> resource provider known by Neutron
>>>
>>> I don't yet know what is going on here ^.
>>>
>>> For the bug on stable/victoria and stable/ussuri I have opened this
>>> bug:
>>>
>>> * https://bugs.launchpad.net/nova/+bug/1907511
>>>
>>> and have a WIP stable-only patch proposed that needs tests:
>>>
>>> https://review.opendev.org/c/openstack/nova/+/766364
>>>
>>> I just wanted to see ASAP if the nova-multi-cell job will pass on
>>> it.
>>>
>>> The issue here ^ is that during a cross cell migration, we aren't
>>> targeting the cell database for the target host when we attempt
>>> to lookup the service record of the target host.
>>>
>>> For the stable branch failures I think the failure rate is 100% and
>>> it looks like it might also be 100% for the master branch
>>> failures.
>>
>> Thanks Melanie!
>>
>> A sort update. The test result in
>> https://review.opendev.org/c/openstack/nova/+/766364 shows that
>> after fixing the stable only
>> https://bugs.launchpad.net/nova/+bug/1907511 we now hit the same
>> failure on stable that is seen on master
>> https://bugs.launchpad.net/nova/+bug/1907522
>>
>> Both master and stable branches are blocked at the moment.
>
> Now we have patches to unblock master and stable/victoria, we just
> need to push the through the gate:
>
> * master: https://review.opendev.org/c/openstack/nova/+/766471
This patch has been merged so the master branch is unblocked now and
you can recheck your patches.
> * stable/victoria:
> https://review.opendev.org/c/openstack/nova/+/765749
This still needs to land before stable/victoria can be used
Cheers,
gibi
>
> Cheers,
> gibi
>
>>
>> Cheers,
>> gibi
>>>
>>> Cheers,
>>> -melanie
>>>
>>> [1] https://review.opendev.org/c/openstack/tempest/+/694539
>>>
>>
>>
>>
>
>
>
More information about the openstack-discuss
mailing list