[openstack-dev] [glance][tempest][defcore] Process to imrpove tests coverge in temepest

Flavio Percoco flavio at redhat.com
Thu Dec 17 19:29:52 UTC 2015


On 17/12/15 02:00 +0000, Egle Sigler wrote:
>Thank you Flavio for bringing this up! We are using tempest tests for
>DefCore testing, and we would like to work with anyone willing to increase
>coverages in any of the current covered capabilities. We would also like
>to hear from the teams when they are planning on removing, changing, or
>renaming tests, as that could affect what DefCore tests.
>
>Upcoming DefCore guidelines and tests:
>https://github.com/openstack/defcore/blob/master/2016.01.json

+1

It's taking me a bit longer than I expeced but I'm working on a list
of tests that would be great to have in tempest and some that would
perhaps be better to remove.

Thanks for the feedback,
Flavio

>
>Thank you,
>Egle
>
>On 12/8/15, 1:25 PM, "Flavio Percoco" <flavio at redhat.com> wrote:
>
>>Greetings,
>>
>>I just reviewed a patch in tempest that proposed adding new tests for
>>the Glance's task API. While I believe it's awesome that folks in the
>>tempest team keep adding missing tests for projects, I think it'd be
>>better for the tempest team, the project's team and defcore if we'd
>>discuss these tests before they are worked on. This should help people
>>avoid wasting time.
>>
>>I believe these cases are rare but the benefits of discussing missing
>>tests across teams could also help prioritizing the work based on what
>>the teams goals are, what the defcore team needs are, etc.
>>
>>So, I'd like to start improving this process by inviting folks from
>>the tempest team to join project's meeting whenever new tests are
>>going to be worked on.
>>
>>I'd also like to invite PTLs (or anyone, really) from each team to go
>>through what's in tempest and what's missing and help this team
>>improve the test suite. Remember that these tests are also used by the
>>defcore team and they are not important just for the CI but have an
>>impact on other areas as well.
>>
>>I'm doing the above for Glance and I can't stress enough how important
>>it is for projects to do the same.
>>
>>Do teams have a different workflow/process to increase tests coverage
>>in tempest?
>>
>>Cheers,
>>Flavio
>>
>>--
>>@flaper87
>>Flavio Percoco
>>
>>__________________________________________________________________________
>>OpenStack Development Mailing List (not for usage questions)
>>Unsubscribe: OpenStack-dev-request at lists.openstack.org?subject:unsubscribe
>>http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>

-- 
@flaper87
Flavio Percoco



More information about the OpenStack-dev mailing list