<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.gingersoftwaremark
{mso-style-name:ginger_software_mark;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-GB" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D;mso-fareast-language:EN-US">As I mentioned on the review, the title could cause confusion.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D;mso-fareast-language:EN-US">Rally tests performance and scalability but the title could lead people to think that if you install Rally, you will get Performance
and Scale from your OpenStack instance. Adding Benchmark or Testing in to the description would clarify this.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D;mso-fareast-language:EN-US">Tim<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0cm 0cm 0cm 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif"">From:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif""> Baohua Yang [mailto:yangbaohua@gmail.com]
<br>
<b>Sent:</b> 22 July 2014 10:59<br>
<b>To:</b> OpenStack Development Mailing List (not for usage questions)<br>
<b>Subject:</b> Re: [openstack-dev] [tc][rally] Application for a new OpenStack Program: Performance and Scalability<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">It's interesting and practical!<o:p></o:p></p>
<div>
<p class="MsoNormal">There're some early efforts to make openstack more robust and efficient, however, we're still lacking one such framework.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Just a little question.<o:p></o:p></p>
<div>
<p class="MsoNormal">On the wiki, it says to consider the scalability problem.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">How can we measure the performance at large scale? By real deployment or just simulating the input?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Through the descriptions, seems the method is to try testing every single component.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Also, suggest adding necessary <span class="gingersoftwaremark">
perf</span> checks into the test/integration jobs, too.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Thanks!<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On Tue, Jul 22, 2014 at 5:53 AM, Boris Pavlovic <<a href="mailto:boris@pavlovic.me" target="_blank">boris@pavlovic.me</a>> wrote:<o:p></o:p></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<div>
<p class="MsoNormal">Hi Stackers and TC,<br>
<br>
The Rally contributor team would like to propose a new OpenStack program<br>
with a mission to provide scalability and performance benchmarking, and<br>
code profiling tools for OpenStack components.<br>
<br>
We feel we've achieved a critical mass in the Rally project, with an<br>
active, diverse contributor team. The Rally project will be the initial<br>
project in a new proposed "Performance and Scalability" program.<br>
<br>
Below, the details on our proposed new program.<br>
<br>
Thanks for your consideration,<br>
Boris<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><br>
<br>
[1] <a href="https://review.openstack.org/#/c/108502/" target="_blank">https://review.openstack.org/#/c/108502/</a><o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Official Name<br>
=============<br>
<br>
Performance and Scalability<br>
<br>
Codename<br>
========<br>
<br>
Rally<br>
<br>
Scope<br>
=====<br>
<br>
Scalability benchmarking, performance analysis, and profiling of<br>
OpenStack components and workloads<br>
<br>
Mission<br>
=======<br>
<br>
To increase the scalability and performance of OpenStack clouds by:<br>
<br>
* defining standard benchmarks<br>
* sharing performance data between operators and developers<br>
* providing transparency of code paths through profiling tools<br>
<br>
Maturity<br>
========<br>
<br>
* Meeting logs <a href="http://eavesdrop.openstack.org/meetings/rally/2014/" target="_blank">
http://eavesdrop.openstack.org/meetings/rally/2014/</a><br>
* IRC channel: #openstack-rally<br>
* Rally performance jobs are in (Cinder, Glance, Keystone & Neutron)<br>
check pipelines.<br>
* > 950 commits over last 10 months<br>
* Large, diverse contributor community<br>
* <a href="http://stackalytics.com/?release=juno&metric=commits&project_type=All&module=rally" target="_blank">http://stackalytics.com/?release=juno&metric=commits&project_type=All&module=rally</a><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> * <a href="http://stackalytics.com/report/contribution/rally/180" target="_blank">
http://stackalytics.com/report/contribution/rally/180</a><br>
<br>
* Non official lead of project is Boris Pavlovic<br>
* Official election In progress.<br>
<br>
Deliverables<br>
============<br>
<br>
Critical deliverables in the Juno cycle are:<br>
<br>
* extending Rally Benchmark framework to cover all use cases that are<br>
required by all OpenStack projects<br>
* integrating OSprofiler in all core projects<br>
* increasing functional & unit testing coverage of Rally.<br>
<br>
Discussion<br>
==========<br>
<br>
One of the major goals of Rally is to make it simple to share results of<br>
standardized benchmarks and experiments between operators and<br>
developers. When an operator needs to verify certain performance<br>
indicators meet some service level agreement, he will be able to run<br>
benchmarks (from Rally) and share with the developer community the<br>
results along with his OpenStack configuration. These benchmark results<br>
will assist developers in diagnosing particular performance and<br>
scalability problems experienced with the operator's configuration.<br>
<br>
Another interesting area is Rally & the OpenStack CI process. Currently,<br>
working on performance issues upstream tends to be a more social than<br>
technical process. We can use Rally in the upstream gates to identify<br>
performance regressions and measure improvement in scalability over<br>
time. The use of Rally in the upstream gates will allow a more rigorous,<br>
scientific approach to performance analysis. In the case of an<br>
integrated OSprofiler, it will be possible to get detailed information<br>
about API call flows (e.g. duration of API calls in different services).<o:p></o:p></p>
</div>
</div>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
_______________________________________________<br>
OpenStack-dev mailing list<br>
<a href="mailto:OpenStack-dev@lists.openstack.org">OpenStack-dev@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><o:p></o:p></p>
</blockquote>
</div>
<p class="MsoNormal"><br>
<br clear="all">
<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<p class="MsoNormal">-- <br>
<span style="color:#999999">Best wishes!<br>
Baohua</span><o:p></o:p></p>
</div>
</div>
</div>
</body>
</html>