Open Stack

Hi Stackers,
   devstack-plugin doesn't have ability to override tempest settings.
Currently it only
provides a way to override localrc settings, but over time we have seen
that many CI jobs
fail due to many different issues (lack of support, new tempest test
enabled recently which fails for a particular backend etc) and there is no
way for the plugin to override tempest tests using
its stackforge/{plugin} repo

   Recently GlusterFS hit upon a issue due to enablement of
test_volume_boot_pattern test
for which we needed to skip this test (until the issue gets fixed) and sent
patch [1] but it was shot down (see [1]'s comments) and hence we sent
another patch to disable it using tempest regex filter to project-config
[2] ) Since devstack-plugin uses common template for all 3rd party CI jobs,
it becomes a bit messy to skip for backend specific only.

  It would good and ideal to have plugin be able to do the same via
stackforge/{plugin} repo
that ways the CI job can be tested with the tempest changes well before it
run against cinder patches.  Something liek tempest/settings in plugin repo
and change devstack-gate-wrap.sh ? to source tempest regex from plugin repo
and pass on to the tempest cmdline ?

Thoughts ?

thanx,
deepak
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20150415/dc991b2d/attachment.html>