Open Stack

Anastasia, any start is a good start. 

> 1 api 1 engine 1 executor, list-workbooks

what exactly doest it mean: 1) is mistral deployed on 3 boxes with component per box, or all three are processes on the same box? 2) is list-workbooks test running while workflow executions going on? How many? what’s the character of the load 3) when it says 60% success what exactly does it mean, what kind of failures? 4) what is the durability criteria, how long do we expect Mistral to withstand the load.  

Let’s discuss this in details on the next IRC meeting? 

Thanks again for getting this started. 

DZ.


On Dec 19, 2014, at 7:44 AM, Anastasia Kuznetsova <akuznetsova at mirantis.com> wrote:

> Boris,
> 
> Thanks for feedback! 
> 
> > But I belive that you should put bigger load here: https://etherpad.openstack.org/p/mistral-rally-testing-results
> 
> As I said it is only beginning and  I will increase the load and change its type. 
> 
> >As well concurrency should be at least 2-3 times bigger than times otherwise it won't generate proper load and you won't collect >enough data for statistical analyze.  
> >
> >As well use  "rps" runner that generates more real life load.
> >Plus it will be nice to share as well output of "rally task report" command.
> 
> Thanks for the advice, I will consider it in further testing and reporting.
> 
> Answering to your question about using Rally for integration testing, as I mentioned in our load testing plan published on wiki page,  one of our final goals is to have a Rally gate in one of Mistral repositories, so we are interested in it and I already prepare first commits to Rally.
> 
> Thanks,
> Anastasia Kuznetsova
> 
> On Fri, Dec 19, 2014 at 4:51 PM, Boris Pavlovic <bpavlovic at mirantis.com> wrote:
> Anastasia, 
> 
> Nice work on this. But I belive that you should put bigger load here: https://etherpad.openstack.org/p/mistral-rally-testing-results
> 
> As well concurrency should be at least 2-3 times bigger than times otherwise it won't generate proper load and you won't collect enough data for statistical analyze.  
> 
> As well use  "rps" runner that generates more real life load.
> Plus it will be nice to share as well output of "rally task report" command.
> 
> 
> By the way what do you think about using Rally scenarios (that you already wrote) for integration testing as well? 
> 
> 
> Best regards,
> Boris Pavlovic 
> 
> On Fri, Dec 19, 2014 at 2:39 PM, Anastasia Kuznetsova <akuznetsova at mirantis.com> wrote:
> Hello everyone,
> 
> I want to announce that Mistral team has started work on load and performance testing in this release cycle.
> 
> Brief information about scope of our work can be found here: 
> https://wiki.openstack.org/wiki/Mistral/Testing#Load_and_Performance_Testing
> 
> First results are published here:
> https://etherpad.openstack.org/p/mistral-rally-testing-results
> 
> Thanks,
> Anastasia Kuznetsova
> @ Mirantis Inc.
> 
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
> 
> 
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
> 
> _______________________________________________
> OpenStack-dev mailing list
> OpenStack-dev at lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20141219/8ae6e381/attachment.html>