Open Stack

On Mon, Mar 17, 2014 at 12:25 PM, Sean Dague <sean at dague.net> wrote:

> On 03/17/2014 03:22 PM, Joe Gordon wrote:
> >
> >
> >
> > On Mon, Mar 17, 2014 at 11:55 AM, Matthew Treinish <mtreinish at kortar.org
> > <mailto:mtreinish at kortar.org>> wrote:
> >
> >     Hi everyone,
> >
> >     So a little while ago we noticed that in all the gate runs one of
> >     the ceilometer
> >     cli tests is consistently in the list of slowest tests. (and often
> >     the slowest)
> >     This was a bit surprising given the nature of the cli tests we
> >     expect them to
> >     execute very quickly.
> >
> >     test_ceilometer_resource_list which just calls ceilometer
> >     resource_list from the
> >     CLI once is taking >=2 min to respond. For example:
> >
> http://logs.openstack.org/68/80168/3/gate/gate-tempest-dsvm-postgres-full/07ab7f5/logs/tempest.txt.gz#_2014-03-17_17_08_25_003
> >     (where it takes > 3min)
> >
> >     The cli tests are supposed to be quick read-only sanity checks of
> >     the cli
> >     functionality and really shouldn't ever be on the list of slowest
> >     tests for a
> >     gate run. I think there was possibly a performance regression
> >     recently in
> >     ceilometer because from I can tell this test used to normally take
> >     ~60 sec.
> >     (which honestly is probably too slow for a cli test too) but it is
> >     currently
> >     much slower than that.
> >
> >
> > Sounds like we should add another round of sanity checking to the CLI
> > tests: make sure all commands return within x seconds.   As a first pass
> > we can say x=60 and than crank it down in the future.
>
> So, the last thing I want to do is trigger a race here by us
> artificially timing out on tests. However I do think cli tests should be
> returning in < 2s otherwise they are not simple readonly tests.
>

Agreed, I said 60 just as a starting point.


>
>         -Sean
>
> --
> Sean Dague
> Samsung Research America
> sean at dague.net / sean.dague at samsung.com
> http://dague.net
>
>
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20140317/ff993d34/attachment-0001.html>