[Openstack-operators] regression testing before upgrade (operators view)

Boris Pavlovic boris at pavlovic.me
Tue Aug 29 20:34:38 UTC 2017


George,

(with reduction of load to normal levels),

Probably it's not the best idea just to run samples, they are called
samples for the reason  ;)

Basically you can run same Rally task two times before/after upgrade and
compare results (Rally has sort of trends support)
Usually what I have heard from Ops guys is next:

   - Run Rally on periodic basis
   - Convert data Rally DB -> ElasticSearch
   - Build Kibana/Grafana on top


FYI I am working on making above scenario work out of the box.

-- 

So can you provide some more details on what you are looking for? What's
missing?


Best regards,
Boris Pavlovic

On Tue, Aug 29, 2017 at 2:24 AM, George Shuklin <george.shuklin at gmail.com>
wrote:

> Hello everyone.
>
> Does someone do regression testing before performing upgrade (within same
> major version)? How do you do this? Do you know any tools for such tests? I
> started to research this area, and I see three openstack-specific tools:
> rally (with reduction of load to normal levels), tempest (can it be used by
> operators?) and granade.
>
> If you use any of tools, how do you feel about them? Are they worth time
> spent?
>
>
> Thanks!
>
>
> _______________________________________________
> OpenStack-operators mailing list
> OpenStack-operators at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-operators/attachments/20170829/9a389a8c/attachment.html>


More information about the OpenStack-operators mailing list