<div dir="ltr"><div class="gmail_quote"><div dir="ltr">On Fri, Aug 28, 2015 at 6:35 PM Sergey Lukjanov <<a href="mailto:slukjanov@mirantis.com">slukjanov@mirantis.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi,<div><br></div><div>great, it seems like migration to convergence could happen soon.</div><div><br></div><div>How many times you were running each test case? Does time changing with number of iterations? Are you planning to test parallel stacks creation?</div></div></blockquote><div><br></div><div>Given the test matrix convergence/non-convergence and 2,4,8 engines, I have not done a lot of iterations - it's just time consuming. I might kill off the 2-engine case to gain more iterations.</div><div>But from what I have observed the duration does not vary significantly.</div><div><br></div><div>I'll test smaller stacks with lots of iterations and with a high concurrency. All this testing is currently on just one host so it is somewhat limited. Hopefully this is at least giving a useful comparison with these limitations.</div><div><br></div><div>-Angus</div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><br></div><div>Thanks.</div></div><div class="gmail_extra"></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Aug 28, 2015 at 10:17 AM, Sergey Kraynev <span dir="ltr"><<a href="mailto:skraynev@mirantis.com" target="_blank">skraynev@mirantis.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_extra">Angus! </div><div class="gmail_extra"><br></div><div class="gmail_extra">it's Awesome! Thank you for the investigation.</div><div class="gmail_extra">I had a talk with guys from Sahara team and we decided to start testing convergence with Sahara after L release.</div><div class="gmail_extra">I suppose, that Murano can also join to this process.</div><div class="gmail_extra"><br></div><div class="gmail_extra">Also AFAIK Sahara team plan to create functional tests with Heat-engine. We may add it as a non-voting job for our gate. </div><div class="gmail_extra">Probably it will be good to have two different type of this job: with convergence and with default Heat.</div><div class="gmail_extra"><br><div class="gmail_quote"><span>On 28 August 2015 at 04:35, Angus Salkeld <span dir="ltr"><<a href="mailto:asalkeld@mirantis.com" target="_blank">asalkeld@mirantis.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr">Hi<div><br></div><div>I have been running some rally tests against convergence and our existing implementation to compare.</div><div><br></div><div>So far I have done the following:</div><div><ol><li>defined a template with a resource group <a href="https://github.com/asalkeld/convergence-rally/blob/master/templates/resource_group_test_resource.yaml.template" target="_blank">https://github.com/asalkeld/convergence-rally/blob/master/templates/resource_group_test_resource.yaml.template</a><br></li><li>the inner resource looks like this: <a href="https://github.com/asalkeld/convergence-rally/blob/master/templates/server_with_volume.yaml.template" target="_blank">https://github.com/asalkeld/convergence-rally/blob/master/templates/server_with_volume.yaml.template</a> (it uses TestResource to attempt to be a reasonable simulation of a server+volume+floatingip)</li><li>defined a rally job: <a href="https://github.com/asalkeld/convergence-rally/blob/master/increasing_resources.yaml" target="_blank">https://github.com/asalkeld/convergence-rally/blob/master/increasing_resources.yaml</a> that creates X resources then updates to X*2 then deletes.</li><li>I then ran the above with/without convergence and with 2,4,8 heat-engines</li></ol><div>Here are the results compared:</div><div><a href="https://docs.google.com/spreadsheets/d/12kRtPsmZBl_y78aw684PTBg3op1ftUYsAEqXBtT800A/edit?usp=sharing" target="_blank">https://docs.google.com/spreadsheets/d/12kRtPsmZBl_y78aw684PTBg3op1ftUYsAEqXBtT800A/edit?usp=sharing</a></div></div></div></blockquote><div><br></div></span><div>Results look pretty nice (especially for create) :)</div><div>The strange thing for me: why on update "8 engines" shows worse results then with "4 engines"? (may be mistake in graph... ?)</div><span><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr"><div><div><br></div></div><div><br></div><div>Some notes on the results so far:</div><div><ul><li> convergence with only 2 engines does suffer from RPC overload (it gets message timeouts on larger templates). I wonder if this is the problem in our convergence gate...</li></ul></div></div></blockquote></span><div>Good spotting. If it's true, probably we should try to change number of engines... (not sure, how gate hardware react on it).<br></div><span><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr"><div><ul><li>convergence does very well with a reasonable number of engines running.<br></li><li>delete is slightly slower on convergence</li></ul></div></div></blockquote><br></span><div>Also about delete - may be we may to optimize it later, when convergence way get more feedback. </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><span><div dir="ltr"><div><br></div><div>Still to test:</div><div><ul><li>the above, but measure memory usage</li><li>many small templates (run concurrently)</li><li>we need to ask projects using Heat to try with convergence (Murano, TripleO, Magnum, Sahara, etc..)</li></ul></div><div>Any feedback welcome (suggestions on what else to test).</div><span><font color="#888888"><div><br></div><div>-Angus</div></font></span></div>
<br></span><span>__________________________________________________________________________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" rel="noreferrer" target="_blank">OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
<br></span></blockquote><div><br></div><br><br clear="all"><div><div><div dir="ltr">Regards,<div>Sergey.</div></div></div></div><div> </div></div><br></div></div>
<br>__________________________________________________________________________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" rel="noreferrer" target="_blank">OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div></div><div class="gmail_extra">-- <br><div>Sincerely yours,<br>Sergey Lukjanov<br>Sahara Technical Lead<br>(OpenStack Data Processing)<br>Principal Software Engineer<br>Mirantis Inc.</div>
</div>
__________________________________________________________________________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" rel="noreferrer" target="_blank">OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
</blockquote></div></div>