[openstack-dev] [swift] [qa] which test configs does the swift team find useful
Sean Dague
sean at dague.net
Tue Nov 25 15:03:41 UTC 2014
As we are trying to do smart disaggregation of tests in the gate, I
think it's important to figure out which test configurations seem to be
actually helping, and which aren't. As the swift team has long had a
functional test job, this seems like a good place to start. (Also the
field deploy / upgrade story on Swift is probably one of the best of any
OpenStack project, so removing friction is probably in order.)
gate-swift-pep8 SUCCESS in 1m 16s
gate-swift-docs SUCCESS in 1m 48s
gate-swift-python27 SUCCESS in 3m 24s
check-tempest-dsvm-full SUCCESS in 56m 51s
check-tempest-dsvm-postgres-full SUCCESS in 54m 53s
check-tempest-dsvm-neutron-full SUCCESS in 1h 06m 09s
check-tempest-dsvm-neutron-heat-slow SUCCESS in 31m 18s
check-grenade-dsvm SUCCESS in 39m 33s
gate-tempest-dsvm-large-ops SUCCESS in 29m 34s
gate-tempest-dsvm-neutron-large-ops SUCCESS in 22m 11s
gate-swift-tox-func SUCCESS in 2m 50s (non-voting)
check-swift-dsvm-functional SUCCESS in 17m 12s
check-devstack-dsvm-cells SUCCESS in 15m 18s
I think in looking at that it's obvious that:
* check-devstack-dsvm-cells
* check-tempest-dsvm-postgres-full
* gate-tempest-dsvm-large-ops
* gate-tempest-dsvm-neutron-large-ops
* check-tempest-dsvm-neutron-full
Provide nothing new to swift, the access patterns on the glance => swift
interaction aren't impacted on any of those, neither is the heat / swift
resource tests or volumes / swift backup tests.
check-tempest-dsvm-neutron-heat-slow doesn't touch swift either (it's
actually remarkably sparse of any content).
Which kind of leaves us with 1 full stack run, and the grenade job. Have
those caught real bugs? Does there remain value in them? Have other
teams that rely on swift found those to block regressions?
Let's figure out what's helpful, and what's not, and purge out all the
non helpful stuff.
-Sean
--
Sean Dague
http://dague.net
More information about the OpenStack-dev
mailing list