[openstack-dev] [qa] Issue with tests of host admin api

David Kranz dkranz at redhat.com
Fri Oct 25 13:31:45 UTC 2013


On 10/25/2013 09:10 AM, Sean Dague wrote:
> On 10/25/2013 08:39 AM, David Kranz wrote:
>> A patch was submitted with some new tests of this api
>> https://review.openstack.org/#/c/49778/. I gave a -1 because if a
>> negative test to shutdown a host fails, a compute node will be shutdown.
>> The author thinks this test should be part of tempest. My issue was that
>> we should not have tempest tests for apis that:
>>
>> 1. May corrupt the underlying system (that is part of the reason we
>> moved whitebox out)
>
> I really felt the reason we moved out whitebox is that OpenStack 
> internals move way to fast to have them being validated by an external 
> system. We have defined surfaces (i.e. API) and that should be the focus.
It was also because we were side-effecting the database out-of-band.
>
>> 2. Can have only negative tests because positive ones could prevent
>> other tests from executing
>
> Honestly, trying to shut down the host with invalid credentials seems 
> like a fair test. Because if we fail, we're going to know really quick 
> when everything blackholes.
>
> In the gate this is slightly funnier because tempest is running on the 
> same place as the host, however it seems like a sane check to have in 
> there.
>
>     -Sean
>
OK, I don't feel strongly about it. Just seemed like a potential landmine.

  -David




More information about the OpenStack-dev mailing list