[openstack-qa] New Client Test Suite

Sean Dague sdague at linux.vnet.ibm.com
Tue Feb 12 23:23:30 UTC 2013


On 02/12/2013 05:39 PM, Joe Gordon wrote:
> Hi All,
>
> We currently have thorough API tests (Tempest) that do an excellent job
> of testing nova, glance, keystone, etc.  But to date we don't have
> anything that tests the assorted python clients.
>
> Extensive python client tests, which would consist of mostly shell
> commands, would prevent many bugs from arising such as:
> https://bugs.launchpad.net/python-novaclient/+bug/1122958.
>
> The question is where should theses tests live?
>
> * Devstack/smoketests - these are just smoketests and are not designed
> to be exhaustive
> * Tempest  - currently explicitly doesn't use the python clients, but we
> can add a separate folder that tests the clients
> * In respective client repos -  easier to require new tests when adding
> to client, but will result in divergent test suites
> * Separate Repo - perhaps this is premature?
>
> I propose adding a separate folder in tempest to run the python client
> tests, and taking it from there.

I think it's reasonable to start with a new top level directory for 
tempest, and if this grows enough that it needs it's own repository 
later, we can do that. There is a lot of convenience on having a 
singular test tree though, especially from getting enough reviewer eyes 
on things.

	-Sean

-- 
Sean Dague
IBM Linux Technology Center
email: sdague at linux.vnet.ibm.com
alt-email: sldague at us.ibm.com




More information about the openstack-qa mailing list