[openstack-dev] [devstack] plugin: Giving ability for plugin repo to override tempest tests

Deepak Shetty dpkshetty at gmail.com
Wed Apr 15 05:26:05 UTC 2015


Forgot to mention the patch links.. see below


On Wed, Apr 15, 2015 at 10:49 AM, Deepak Shetty <dpkshetty at gmail.com> wrote:

> Hi Stackers,
>    devstack-plugin doesn't have ability to override tempest settings.
> Currently it only
> provides a way to override localrc settings, but over time we have seen
> that many CI jobs
> fail due to many different issues (lack of support, new tempest test
> enabled recently which fails for a particular backend etc) and there is no
> way for the plugin to override tempest tests using
> its stackforge/{plugin} repo
>
>    Recently GlusterFS hit upon a issue due to enablement of
> test_volume_boot_pattern test
> for which we needed to skip this test (until the issue gets fixed) and
> sent patch [1] but it was shot down (see [1]'s comments) and hence we sent
> another patch to disable it using tempest regex filter to project-config
> [2] ) Since devstack-plugin uses common template for all 3rd party CI jobs,
> it becomes a bit messy to skip for backend specific only.
>
>   It would good and ideal to have plugin be able to do the same via
> stackforge/{plugin} repo
> that ways the CI job can be tested with the tempest changes well before it
> run against cinder patches.  Something liek tempest/settings in plugin repo
> and change devstack-gate-wrap.sh ? to source tempest regex from plugin repo
> and pass on to the tempest cmdline ?
>
> Thoughts ?
>

[1]: https://review.openstack.org/172841
[2]: https://review.openstack.org/173408
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20150415/97e78644/attachment.html>


More information about the OpenStack-dev mailing list