[openstack-dev] asymmetric gating and stable vs unstable tests

Sergey Lukjanov slukjanov at mirantis.com
Fri Mar 7 11:46:19 UTC 2014

Hey Deva,

It really could be a huge issue for incubated projects.

I have now good ideas about how to solve it...

One of the bad ideas is that we could extend jenkins success message
to include note that will be visible even if comment isn't expanded.
Or post separated comment like "Please, note that following jobs
marked as stable and, please, treat their failure"...

On Fri, Feb 28, 2014 at 12:52 AM, Devananda van der Veen
<devananda.vdv at gmail.com> wrote:
> Hi all,
> I'd like to point out how asymmetric gating is challenging for incubated
> projects, and propose that there may be a way to make it less so.
> For reference, incubated projects aren't allowed to have symmetric gating
> with integrated projects. This is why our devstack and tempest tests are
> "*-check-nv" in devstack and tempest, but "*-check" and "*-gate" in our
> pipeline. So, these jobs are stable from Ironic's point of view because
> we've been gating on them for the last month.
> Cut forward to this morning. A devstack patch [1] was merged and broke
> Ironic's gate because of a one-line issue in devstack/lib/ironic which I've
> since proposed a fix for [2]. This issue was visible in the non-voting check
> results before the patch was approved -- but those non-voting checks got
> ignored because of an assumption of instability (they must be non-voting for
> a reason, right?).
> I'm not suggesting we gate integrated projects on incubated projects, but I
> would like to point out that not all non-voting checks are non-voting
> *because they're unstable*. It would be great if there were a way to
> indicate that certain tests are voting for someone else and a failure
> actually matters to them.
> Thanks for listening,
> -Deva
> [1] https://review.openstack.org/#/c/71996/
> [2] https://review.openstack.org/#/c/76943/  -- It's been approved already,
> just waiting in the merge queue ...
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Sincerely yours,
Sergey Lukjanov
Savanna Technical Lead
Mirantis Inc.

More information about the OpenStack-dev mailing list