<html>
<head>
<meta content="text/html; charset=utf-8" http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<div class="moz-cite-prefix">Hello.<br>
<br>
Thank you for reply.<br>
<br>
In those days I've tested tempest and rally. I found rally more
suited for my goals. Insofar I'd like to admit that it's too
overloaded and when I start poking around I quickly stuck with
'verify' mode, which in turn stuck in our neutron configuration
(we have no tenant-allocated networks, only public ones).<br>
<br>
But after I found rally task start, and mangled samples a bit to
fit to our needs, it really, really extremely close to what we
want to have. I was disappointed by Ubuntu packaging (as usual) -
their rally package broken and does not create any entry points at
all. It worked much better in venv environment.<br>
<br>
Probably I'll try to combine jenkins, grafana, kibana and rally
together, may be even for periodic service validation.<br>
<br>
Thank you for advice.<br>
<br>
On 08/29/2017 11:34 PM, Boris Pavlovic wrote:<br>
</div>
<blockquote
cite="mid:CAD85om0PSvFb5dBt2Xq10SrsoNo3ggzuv1Wx3kAxQqsZf08pqA@mail.gmail.com"
type="cite">
<div dir="ltr">George,
<div><br>
</div>
<div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex"><span
style="font-size:12.8px">(with reduction of load to normal
levels),</span></blockquote>
<div>Probably it's not the best idea just to run samples, they
are called samples for the reason ;) </div>
<div><br>
</div>
<div>Basically you can run same Rally task two times
before/after upgrade and compare results (Rally has sort of
trends support) </div>
<div>Usually what I have heard from Ops guys is next: </div>
<div>
<ul>
<li>Run Rally on periodic basis </li>
<li>Convert data Rally DB -> ElasticSearch</li>
<li>Build Kibana/Grafana on top </li>
</ul>
<div><br>
</div>
</div>
<div>FYI I am working on making above scenario work out of the
box. </div>
<div><br>
</div>
<div>-- </div>
<div><br>
</div>
<div>
<div>So can you provide some more details on what you are
looking for? What's missing? </div>
</div>
<div><br>
</div>
<div><br>
</div>
<div>Best regards,</div>
<div>Boris Pavlovic</div>
</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Tue, Aug 29, 2017 at 2:24 AM, George
Shuklin <span dir="ltr"><<a moz-do-not-send="true"
href="mailto:george.shuklin@gmail.com" target="_blank">george.shuklin@gmail.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">Hello
everyone.<br>
<br>
Does someone do regression testing before performing upgrade
(within same major version)? How do you do this? Do you know
any tools for such tests? I started to research this area,
and I see three openstack-specific tools: rally (with
reduction of load to normal levels), tempest (can it be used
by operators?) and granade.<br>
<br>
If you use any of tools, how do you feel about them? Are
they worth time spent?<br>
</blockquote>
</div>
</div>
</blockquote>
<br>
</body>
</html>