[openstack-dev] [devstack] plugin: Giving ability for plugin repo to override tempest tests
Deepak Shetty
dpkshetty at gmail.com
Wed Apr 15 05:26:05 UTC 2015
Forgot to mention the patch links.. see below
On Wed, Apr 15, 2015 at 10:49 AM, Deepak Shetty <dpkshetty at gmail.com> wrote:
> Hi Stackers,
> devstack-plugin doesn't have ability to override tempest settings.
> Currently it only
> provides a way to override localrc settings, but over time we have seen
> that many CI jobs
> fail due to many different issues (lack of support, new tempest test
> enabled recently which fails for a particular backend etc) and there is no
> way for the plugin to override tempest tests using
> its stackforge/{plugin} repo
>
> Recently GlusterFS hit upon a issue due to enablement of
> test_volume_boot_pattern test
> for which we needed to skip this test (until the issue gets fixed) and
> sent patch [1] but it was shot down (see [1]'s comments) and hence we sent
> another patch to disable it using tempest regex filter to project-config
> [2] ) Since devstack-plugin uses common template for all 3rd party CI jobs,
> it becomes a bit messy to skip for backend specific only.
>
> It would good and ideal to have plugin be able to do the same via
> stackforge/{plugin} repo
> that ways the CI job can be tested with the tempest changes well before it
> run against cinder patches. Something liek tempest/settings in plugin repo
> and change devstack-gate-wrap.sh ? to source tempest regex from plugin repo
> and pass on to the tempest cmdline ?
>
> Thoughts ?
>
[1]: https://review.openstack.org/172841
[2]: https://review.openstack.org/173408
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20150415/97e78644/attachment.html>
More information about the OpenStack-dev
mailing list