Open Stack

On 07/03/2014 02:41 PM, Fawad Khaliq wrote:
>
> On Thu, Jul 3, 2014 at 10:27 AM, Kevin Benton <blak111 at gmail.com
> <mailto:blak111 at gmail.com>> wrote:
>
>      >This allows the viewer to see categories of reviews based upon their
>     >divergence from OpenStack's Jenkins results. I think evaluating
>     >divergence from Jenkins might be a metric worth consideration.
>
>     I think the only thing this really reflects though is how much the
>     third party CI system is mirroring Jenkins.
>     A system that frequently diverges may be functioning perfectly fine
>     and just has a vastly different code path that it is integration
>     testing so it is legitimately detecting failures the OpenStack CI
>     cannot.
>
> Exactly. +1

Unfortunately, there's no good way to prove that.

-jay