[openstack-dev] [OpenStack-Dev] [third-party-ci] Clarifications on the goal and skipping tests

Duncan Thomas duncan.thomas at gmail.com
Tue Mar 31 06:19:15 UTC 2015


On 31 March 2015 at 01:35, John Griffith <john.griffith8 at gmail.com> wrote:

> On Mon, Mar 30, 2015 at 4:06 PM, Doug Wiegley <
> dougwig at parksidesoftware.com> wrote:
>
>>>>
>>
> - Test relies on some “optional” feature, like overlapping IP subnets that
>> the backend doesn’t support.  I’d argue it’s another case of broken tests
>> if they require an optional feature, but it still needs skipping in the
>> meantime.
>>
>
> ​This may be something specific to Neutron perhaps?  In Cinder LVM is
> pretty much the "lowest common denominator".  I'm not aware of any volume
> tests in Tempest that rely on optional features that don't pick this up
> automatically out of the config (like multi-backend for example).
>>
>

That I know of off the top of my head:
- Snapshot of an attached volume works for most drivers but not all
- Backup of a volume that has snapshots fails for some drivers
- Restore to a volume that has snapshots fails on some drivers

I think all of the above are things that we should fix, but they exist
today.

Since one obscure bug can lead to CI failing on every patch, is it better
to say 'no skips without active bugs, and record your open bugs somewhere'?
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20150331/4007071b/attachment.html>


More information about the OpenStack-dev mailing list