Open Stack

On 03/17/2014 03:22 PM, Joe Gordon wrote:
> 
> 
> 
> On Mon, Mar 17, 2014 at 11:55 AM, Matthew Treinish <mtreinish at kortar.org
> <mailto:mtreinish at kortar.org>> wrote:
> 
>     Hi everyone,
> 
>     So a little while ago we noticed that in all the gate runs one of
>     the ceilometer
>     cli tests is consistently in the list of slowest tests. (and often
>     the slowest)
>     This was a bit surprising given the nature of the cli tests we
>     expect them to
>     execute very quickly.
> 
>     test_ceilometer_resource_list which just calls ceilometer
>     resource_list from the
>     CLI once is taking >=2 min to respond. For example:
>     http://logs.openstack.org/68/80168/3/gate/gate-tempest-dsvm-postgres-full/07ab7f5/logs/tempest.txt.gz#_2014-03-17_17_08_25_003
>     (where it takes > 3min)
> 
>     The cli tests are supposed to be quick read-only sanity checks of
>     the cli
>     functionality and really shouldn't ever be on the list of slowest
>     tests for a
>     gate run. I think there was possibly a performance regression
>     recently in
>     ceilometer because from I can tell this test used to normally take
>     ~60 sec.
>     (which honestly is probably too slow for a cli test too) but it is
>     currently
>     much slower than that.
> 
> 
> Sounds like we should add another round of sanity checking to the CLI
> tests: make sure all commands return within x seconds.   As a first pass
> we can say x=60 and than crank it down in the future.

So, the last thing I want to do is trigger a race here by us
artificially timing out on tests. However I do think cli tests should be
returning in < 2s otherwise they are not simple readonly tests.

	-Sean

-- 
Sean Dague
Samsung Research America
sean at dague.net / sean.dague at samsung.com
http://dague.net

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 482 bytes
Desc: OpenPGP digital signature
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20140317/edb62f85/attachment.pgp>