On Thu, Jul 17, 2014 at 10:59:27AM +0200, Sean Dague wrote: > We've talked about the 'CI the world plan' for a while, which this would > be part of. That's a ton of work that no one is signed up for. > > But more importantly setting up and running the tests is < 10% of the > time cost. Triage and fixing bugs long term is a real cost. As we've > seen with the existing gate bugs we can't even close the bugs that are > preventing ourselves from merging code - > http://status.openstack.org/elastic-recheck/, so I'm not sure which band > of magical elves we'd expect to debug and fix these things. :) Yep, this is really a critical blocking problem we need to figure out and resolve, before we attempt any plan to make our testing requirements stricter. Making our testing reqiurements stricter without first improving our overall test reliability will inflict untold pain & misery on both our code contributors and people who are maintaining the CI systems. Regards, Daniel -- |: http://berrange.com -o- http://www.flickr.com/photos/dberrange/ :| |: http://libvirt.org -o- http://virt-manager.org :| |: http://autobuild.org -o- http://search.cpan.org/~danberr/ :| |: http://entangle-photo.org -o- http://live.gnome.org/gtk-vnc :|