Open Stack

Angus!

it's Awesome!  Thank you for the investigation.
I had a talk with guys from Sahara team and we decided to start testing
convergence with Sahara after L release.
I suppose, that Murano can also join to this process.

Also AFAIK Sahara team plan to create functional tests with Heat-engine. We
may add it as a non-voting job for our gate.
Probably it will be good to have two different type of this job: with
convergence and with default Heat.

On 28 August 2015 at 04:35, Angus Salkeld <asalkeld at mirantis.com> wrote:

> Hi
>
> I have been running some rally tests against convergence and our existing
> implementation to compare.
>
> So far I have done the following:
>
>    1. defined a template with a resource group
>    https://github.com/asalkeld/convergence-rally/blob/master/templates/resource_group_test_resource.yaml.template
>    2. the inner resource looks like this:
>    https://github.com/asalkeld/convergence-rally/blob/master/templates/server_with_volume.yaml.template (it
>    uses TestResource to attempt to be a reasonable simulation of a
>    server+volume+floatingip)
>    3. defined a rally job:
>    https://github.com/asalkeld/convergence-rally/blob/master/increasing_resources.yaml that
>    creates X resources then updates to X*2 then deletes.
>    4. I then ran the above with/without convergence and with 2,4,8
>    heat-engines
>
> Here are the results compared:
>
> https://docs.google.com/spreadsheets/d/12kRtPsmZBl_y78aw684PTBg3op1ftUYsAEqXBtT800A/edit?usp=sharing
>

Results look pretty nice (especially for create) :)
The strange thing for me: why on update "8 engines" shows worse results
then with "4 engines"? (may be mistake in graph... ?)



>
>
> Some notes on the results so far:
>
>    -  convergence with only 2 engines does suffer from RPC overload (it
>    gets message timeouts on larger templates). I wonder if this is the problem
>    in our convergence gate...
>
> Good spotting. If it's true, probably we should try to change  number of
engines... (not sure, how gate hardware react on it).

>
>    - convergence does very well with a reasonable number of engines
>    running.
>    - delete is slightly slower on convergence
>
>
Also about delete - may be we may to optimize it later, when convergence
way get more feedback.

>
> Still to test:
>
>    - the above, but measure memory usage
>    - many small templates (run concurrently)
>    - we need to ask projects using Heat to try with convergence (Murano,
>    TripleO, Magnum, Sahara, etc..)
>
> Any feedback welcome (suggestions on what else to test).
>
> -Angus
>
> __________________________________________________________________________
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: OpenStack-dev-request at lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>


Regards,
Sergey.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20150828/d6e44c16/attachment.html>