[Openstack-operators] regression testing before upgrade (operators view)

Boris Pavlovic boris at pavlovic.me
Tue Aug 29 20:34:38 UTC 2017


(with reduction of load to normal levels),

Probably it's not the best idea just to run samples, they are called
samples for the reason  ;)

Basically you can run same Rally task two times before/after upgrade and
compare results (Rally has sort of trends support)
Usually what I have heard from Ops guys is next:

   - Run Rally on periodic basis
   - Convert data Rally DB -> ElasticSearch
   - Build Kibana/Grafana on top

FYI I am working on making above scenario work out of the box.


So can you provide some more details on what you are looking for? What's

Best regards,
Boris Pavlovic

On Tue, Aug 29, 2017 at 2:24 AM, George Shuklin <george.shuklin at gmail.com>

> Hello everyone.
> Does someone do regression testing before performing upgrade (within same
> major version)? How do you do this? Do you know any tools for such tests? I
> started to research this area, and I see three openstack-specific tools:
> rally (with reduction of load to normal levels), tempest (can it be used by
> operators?) and granade.
> If you use any of tools, how do you feel about them? Are they worth time
> spent?
> Thanks!
> _______________________________________________
> OpenStack-operators mailing list
> OpenStack-operators at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-operators/attachments/20170829/9a389a8c/attachment.html>

More information about the OpenStack-operators mailing list