[openstack-dev] Help us reduce gate resets by being specific about bugs being found

Joe Gordon joe.gordon0 at gmail.com
Thu Sep 26 18:02:48 UTC 2013


On Thu, Sep 26, 2013 at 7:49 AM, Sean Dague <sean at dague.net> wrote:

> As many folks know, gerrit takes comments of either the form
>
> recheck bug #XXXXX
> or
> recheck no bug
>
> To kick off the check queue jobs again to handle flakey tests.
>
> The problem is that we're getting a lot more "no bug" than bugs at this
> point. If a failure happens in the OpenStack gate, it's usually an actual
> OpenStack race somewhere. Figuring out what the top races are is *really*
> important to actually fixing those races, as it gives us focus on what the
> top issues are in OpenStack that we need to fix. That makes the gate good
> for everyone, and means less time babysitting your patches through merge.
>

++


>
> Now that Matt, Joe, and Clark have built the elastic-recheck bot, you will
> often be given a hint in your review about the most probably race that it
> was found. Please confirm the bug looks right before rechecking with it,
> but it should help expedite finding the right issue.
> http://status.openstack.org/**rechecks/<http://status.openstack.org/rechecks/>is also helpful in seeing what's most recently been causing issues.
>
> Here's the score card of how we are doing now at the project level
> (percentage is the percentage of rechecks with a bug, and the fraction
> shows number with a bug / total rechecks issued)
>
> Project Rechecks percentages (last 3000 gerrit reviews)
> openstack/requirements                   100% (1 / 1)
> openstack/cinder                          78% (25 / 32)
> openstack/heat                            66% (8 / 12)
> openstack/keystone                        66% (4 / 6)
> openstack/python-**keystoneclient           66% (4 / 6)
> openstack/swift                           52% (10 / 19)
> openstack-infra/devstack-gate             50% (2 / 4)
> openstack/horizon                         50% (5 / 10)
> openstack/python-**ceilometerclient         44% (4 / 9)
> openstack/python-cinderclient             42% (3 / 7)
> openstack/glance                          40% (2 / 5)
> openstack-dev/devstack                    38% (7 / 18)
> openstack/neutron                         33% (6 / 18)
> openstack/python-novaclient               33% (1 / 3)
> openstack/nova                            25% (34 / 134)
> openstack/tempest                         17% (12 / 69)
> openstack/ceilometer                      11% (4 / 34)
> stackforge/taskflow                        0% (0 / 1)
> openstack/ironic                           0% (0 / 5)
> openstack/oslo-incubator                   0% (0 / 3)
> openstack-dev/hacking                      0% (0 / 1)
> openstack/trove                            0% (0 / 8)
> stackforge/savanna                         0% (0 / 1)
> openstack-infra/config                     0% (0 / 1)
> openstack/python-neutronclient             0% (0 / 1)
> stackforge/rally                           0% (0 / 3)
>
>
>         -Sean
>
> --
> Sean Dague
> http://dague.net
>
> ______________________________**_________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.**org <OpenStack-dev at lists.openstack.org>
> http://lists.openstack.org/**cgi-bin/mailman/listinfo/**openstack-dev<http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20130926/6ac3bc15/attachment.html>


More information about the OpenStack-dev mailing list