<html dir="ltr">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style id="owaParaStyle">P {
MARGIN-BOTTOM: 0px; MARGIN-TOP: 0px
}
</style>
</head>
<body fPStyle="1" ocsi="0">
<div style="direction: ltr;font-family: Tahoma;color: #000000;font-size: 10pt;">
<p>We've bumped into some Novaclient only issues before in the past as well. Sam and some of his team did prototype some tests that execute using Novaclient. If there's any interest I can see about getting it into a WIP branch to get eyes on it.</p>
<p> </p>
<p>Daryl</p>
<div style="FONT-SIZE: 16px; FONT-FAMILY: Times New Roman; COLOR: #000000">
<hr tabindex="-1">
<div id="divRpF879667" style="DIRECTION: ltr"><font color="#000000" size="2" face="Tahoma"><b>From:</b> Joe Gordon [jogo@cloudscaling.com]<br>
<b>Sent:</b> Tuesday, February 12, 2013 4:39 PM<br>
<b>To:</b> openstack-qa@lists.openstack.org<br>
<b>Subject:</b> [openstack-qa] New Client Test Suite<br>
</font><br>
</div>
<div></div>
<div>
<div>Hi All,</div>
<div><br>
</div>
We currently have thorough API tests (Tempest) that do an excellent job of testing nova, glance, keystone, etc. But to date we don't have anything that tests the assorted python clients.
<div><br>
</div>
<div>Extensive python client tests, which would consist of mostly shell commands, would prevent many bugs from arising such as: <a href="https://bugs.launchpad.net/python-novaclient/+bug/1122958" target="_blank">https://bugs.launchpad.net/python-novaclient/+bug/1122958</a>.</div>
<div><br>
</div>
<div>The question is where should theses tests live?</div>
<div><br>
</div>
<div>* Devstack/smoketests - these are just smoketests and are not designed to be exhaustive</div>
<div>* Tempest - currently explicitly doesn't use the python clients, but we can add a separate folder that tests the clients</div>
<div>* In respective client repos - easier to require new tests when adding to client, but will result in divergent test suites </div>
<div>* Separate Repo - perhaps this is premature?</div>
<div><br>
</div>
<div>I propose adding a separate folder in tempest to run the python client tests, and taking it from there.</div>
<div><br>
</div>
<div><br>
</div>
<div>best,</div>
<div>Joe Gordon</div>
</div>
</div>
</div>
</body>
</html>