[openstack-dev] Help us reduce gate resets by being specific about bugs being found
Joe Gordon
joe.gordon0 at gmail.com
Thu Sep 26 18:02:48 UTC 2013
On Thu, Sep 26, 2013 at 7:49 AM, Sean Dague <sean at dague.net> wrote:
> As many folks know, gerrit takes comments of either the form
>
> recheck bug #XXXXX
> or
> recheck no bug
>
> To kick off the check queue jobs again to handle flakey tests.
>
> The problem is that we're getting a lot more "no bug" than bugs at this
> point. If a failure happens in the OpenStack gate, it's usually an actual
> OpenStack race somewhere. Figuring out what the top races are is *really*
> important to actually fixing those races, as it gives us focus on what the
> top issues are in OpenStack that we need to fix. That makes the gate good
> for everyone, and means less time babysitting your patches through merge.
>
++
>
> Now that Matt, Joe, and Clark have built the elastic-recheck bot, you will
> often be given a hint in your review about the most probably race that it
> was found. Please confirm the bug looks right before rechecking with it,
> but it should help expedite finding the right issue.
> http://status.openstack.org/**rechecks/<http://status.openstack.org/rechecks/>is also helpful in seeing what's most recently been causing issues.
>
> Here's the score card of how we are doing now at the project level
> (percentage is the percentage of rechecks with a bug, and the fraction
> shows number with a bug / total rechecks issued)
>
> Project Rechecks percentages (last 3000 gerrit reviews)
> openstack/requirements 100% (1 / 1)
> openstack/cinder 78% (25 / 32)
> openstack/heat 66% (8 / 12)
> openstack/keystone 66% (4 / 6)
> openstack/python-**keystoneclient 66% (4 / 6)
> openstack/swift 52% (10 / 19)
> openstack-infra/devstack-gate 50% (2 / 4)
> openstack/horizon 50% (5 / 10)
> openstack/python-**ceilometerclient 44% (4 / 9)
> openstack/python-cinderclient 42% (3 / 7)
> openstack/glance 40% (2 / 5)
> openstack-dev/devstack 38% (7 / 18)
> openstack/neutron 33% (6 / 18)
> openstack/python-novaclient 33% (1 / 3)
> openstack/nova 25% (34 / 134)
> openstack/tempest 17% (12 / 69)
> openstack/ceilometer 11% (4 / 34)
> stackforge/taskflow 0% (0 / 1)
> openstack/ironic 0% (0 / 5)
> openstack/oslo-incubator 0% (0 / 3)
> openstack-dev/hacking 0% (0 / 1)
> openstack/trove 0% (0 / 8)
> stackforge/savanna 0% (0 / 1)
> openstack-infra/config 0% (0 / 1)
> openstack/python-neutronclient 0% (0 / 1)
> stackforge/rally 0% (0 / 3)
>
>
> -Sean
>
> --
> Sean Dague
> http://dague.net
>
> ______________________________**_________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.**org <OpenStack-dev at lists.openstack.org>
> http://lists.openstack.org/**cgi-bin/mailman/listinfo/**openstack-dev<http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20130926/6ac3bc15/attachment.html>
More information about the OpenStack-dev
mailing list