Open Stack

TL;DR: In my opinion Grenade job is performing reliably.

Using the table at:
http://ci-watch.tintri.com/project?project=ironic&time=7+days
Note: Unable to extract the data out of the web page to do more thorough data evaluation.

The Grenade job appears to be performing successfully. On Thursday evening it may appear that grenade was failing without reason, but the cause is: https://bugs.launchpad.net/ironic/+bug/1590139

This bug was fixed in master, but the patch to stable/mitaka had not yet landed. And since Grenade runs tests on stable/mitaka it continued to fail. This morning the patch to fix stable/mitaka landed and the Grenade job is passing again.

Unfortunately https://bugs.launchpad.net/ironic/+bug/1590139 (which started around 6-June-2016) would cause random Ironic jobs to fail, as only some jobs would get sent to the new Zuul builders. Any job to the new Zuul builders would fail.  So some jobs would pass and some fail for the same patch.

I did my best to take all of that into account and in my opinion the grenade job is performing reliably. If I can figure out how to extract better statistics I will update this email.

Please let me know if you have questions or if I'm wrong :)

Thanks,
John