<div dir="ltr">Thanks a lot!<div><br></div><div>We now need to get on these bugs, and define with QA an acceptable failure rate criterion for switching the full job to voting.</div><div>It would be good to have a chance to only run the tests against code which is already in master.</div>
<div>To this aim we might push a dummy patch, and keep it spinning in the check queue.</div><div><br></div><div>Salvatore</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On 24 March 2014 21:45, Rossella Sblendido <span dir="ltr"><<a href="mailto:rsblendido@suse.com" target="_blank">rsblendido@suse.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hello all,<br>
<br>
here is an update regarding the Neutron full parallel job.<br>
I used the following Logstash query [1]  that checks the failures of the last<br>
4 days (the last bug fix related with the full job was merged 4 days ago).<br>
These are the results:<br>
<br>
123 failure (25% of the total)<br>
<br>
I took a sample of 50 failures and I obtained the following:<br>
<br>
22% legitimate failures (they are due to the code change introduced by the patch)<br>
22% infra issues<br>
12% <a href="https://bugs.launchpad.net/openstack-ci/+bug/1291611" target="_blank">https://bugs.launchpad.net/<u></u>openstack-ci/+bug/1291611</a><br>
12% <a href="https://bugs.launchpad.net/tempest/+bug/1281969" target="_blank">https://bugs.launchpad.net/<u></u>tempest/+bug/1281969</a><br>
8% <a href="https://bugs.launchpad.net/tempest/+bug/1294603" target="_blank">https://bugs.launchpad.net/<u></u>tempest/+bug/1294603</a><br>
3% <a href="https://bugs.launchpad.net/neutron/+bug/1283522" target="_blank">https://bugs.launchpad.net/<u></u>neutron/+bug/1283522</a><br>
3% <a href="https://bugs.launchpad.net/neutron/+bug/1291920" target="_blank">https://bugs.launchpad.net/<u></u>neutron/+bug/1291920</a><br>
3% <a href="https://bugs.launchpad.net/nova/+bug/1290642" target="_blank">https://bugs.launchpad.net/<u></u>nova/+bug/1290642</a><br>
3% <a href="https://bugs.launchpad.net/tempest/+bug/1252971" target="_blank">https://bugs.launchpad.net/<u></u>tempest/+bug/1252971</a><br>
3% <a href="https://bugs.launchpad.net/horizon/+bug/1257885" target="_blank">https://bugs.launchpad.net/<u></u>horizon/+bug/1257885</a><br>
3% <a href="https://bugs.launchpad.net/tempest/+bug/1292242" target="_blank">https://bugs.launchpad.net/<u></u>tempest/+bug/1292242</a><br>
3% <a href="https://bugs.launchpad.net/neutron/+bug/1277439" target="_blank">https://bugs.launchpad.net/<u></u>neutron/+bug/1277439</a><br>
3% <a href="https://bugs.launchpad.net/neutron/+bug/1283599" target="_blank">https://bugs.launchpad.net/<u></u>neutron/+bug/1283599</a><br>
<br>
cheers,<br>
<br>
Rossella<br>
<br>
[1] <a href="http://logstash.openstack.org/#eyJzZWFyY2giOiJidWlsZF9uYW1lOiBcImNoZWNrLXRlbXBlc3QtZHN2bS1uZXV0cm9uLWZ1bGxcIiBBTkQgbWVzc2FnZTpcIkZpbmlzaGVkOiBGQUlMVVJFXCIgQU5EIHRhZ3M6Y29uc29sZSIsImZpZWxkcyI6W10sIm9mZnNldCI6MCwidGltZWZyYW1lIjoiY3VzdG9tIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7ImZyb20iOiIyMDE0LTAzLTIwVDEzOjU0OjI1KzAwOjAwIiwidG8iOiIyMDE0LTAzLTI0VDEzOjU0OjI1KzAwOjAwIiwidXNlcl9pbnRlcnZhbCI6IjAifSwibW9kZSI6IiIsImFuYWx5emVfZmllbGQiOiIiLCJzdGFtcCI6MTM5NTY3MDY2ODc0OX0=" target="_blank">http://logstash.openstack.org/<u></u>#<u></u>eyJzZWFyY2giOiJidWlsZF9uYW1lOi<u></u>BcImNoZWNrLXRlbXBlc3QtZHN2bS1u<u></u>ZXV0cm9uLWZ1bGxcIiBBTkQgbWVzc2<u></u>FnZTpcIkZpbmlzaGVkOiBGQUlMVVJF<u></u>XCIgQU5EIHRhZ3M6Y29uc29sZSIsIm<u></u>ZpZWxkcyI6W10sIm9mZnNldCI6MCwi<u></u>dGltZWZyYW1lIjoiY3VzdG9tIiwiZ3<u></u>JhcGhtb2RlIjoiY291bnQiLCJ0aW1l<u></u>Ijp7ImZyb20iOiIyMDE0LTAzLTIwVD<u></u>EzOjU0OjI1KzAwOjAwIiwidG8iOiIy<u></u>MDE0LTAzLTI0VDEzOjU0OjI1KzAwOj<u></u>AwIiwidXNlcl9pbnRlcnZhbCI6IjAi<u></u>fSwibW9kZSI6IiIsImFuYWx5emVfZm<u></u>llbGQiOiIiLCJzdGFtcCI6MTM5NTY3<u></u>MDY2ODc0OX0=</a><br>

<br>
______________________________<u></u>_________________<br>
OpenStack-dev mailing list<br>
<a href="mailto:OpenStack-dev@lists.openstack.org" target="_blank">OpenStack-dev@lists.openstack.<u></u>org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/<u></u>cgi-bin/mailman/listinfo/<u></u>openstack-dev</a><br>
</blockquote></div><br></div>