<div dir="ltr">Jose, <div><br></div><div><br></div><div>Rally community provides official docker images here: <a href="https://hub.docker.com/r/rallyforge/rally/">https://hub.docker.com/r/rallyforge/rally/</a><br></div><div>So I would suggest to use them. </div><div><br></div><div><br></div><div>Best regards,</div><div>Boris Pavlovic </div><div><br></div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Sep 25, 2015 at 5:07 AM, Jose Lausuch <span dir="ltr"><<a href="mailto:jose.lausuch@ericsson.com" target="_blank">jose.lausuch@ericsson.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="EN-US" link="blue" vlink="purple">
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Hi,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Thanks for the hint Boris.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Regarding what we do at functest with Rally, yes, we clone the latest from the Rally repo. We thought about that before and the possible errors it can convey,
compatibility and so on. <u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">As I am working on a Docker image where all the Functest environment will be pre-installed, we might get rid of such potential problems. But, that image will
need constant updates if there are major patches/bugfixes in the rally repo.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">What is your opinion on this? What do you think it makes more sense?<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">/Jose<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> <a href="mailto:boris@pavlovic.ru" target="_blank">boris@pavlovic.ru</a> [mailto:<a href="mailto:boris@pavlovic.ru" target="_blank">boris@pavlovic.ru</a>]
<b>On Behalf Of </b>Boris Pavlovic<br>
<b>Sent:</b> Friday, September 25, 2015 7:56 AM<br>
<b>To:</b> OpenStack Development Mailing List (not for usage questions)<br>
<b>Cc:</b> EXT <a href="mailto:morgan.richomme@orange.com" target="_blank">morgan.richomme@orange.com</a>; Kosonen, Juha (Nokia - FI/Espoo); Jose Lausuch<br>
<b>Subject:</b> Re: [openstack-dev] [OPNFV] [Functest] Tempest & Rally<u></u><u></u></span></p><div><div class="h5">
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">Morgan, <u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">You should add at least: <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<p class="MsoNormal"><span style="font-family:"Courier New"">sla: <br>
failure_rate: <br>
max: 0 </span><u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Otherwise rally will pass 100% no matter what is happening. <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Best regards,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Boris Pavlovic <u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">On Thu, Sep 24, 2015 at 10:29 PM, Tikkanen, Viktor (Nokia - FI/Espoo) <<a href="mailto:viktor.tikkanen@nokia.com" target="_blank">viktor.tikkanen@nokia.com</a>> wrote:<u></u><u></u></p>
<p class="MsoNormal">Hi Morgan<br>
<br>
and thank you for the overview.<br>
<br>
I'm now waiting for the POD#2 VPN profile (will be ready soon). We will try then to figure out what OpenStack/tempest/rally configuration changes are needed in order to get rid of those test failures.<br>
<br>
I suppose that most of the problems (like "Multiple possible networks found" etc.) are relatively easy to solve.<br>
<br>
BTW, since tempest is being currently developed in "branchless" mode (without release specific stable versions), do we have some common understanding/requirements how "dynamically" Functest should use its code?<br>
<br>
For example, config_functest.py seems to contain routines for cloning/installing rally (and indirectly tempest) code, does it mean that the code will be cloned/installed at the time when the test set is executed for the first time? (I'm just wondering if it
is necessary or not to "freeze" somehow used code for each OPNFV release to make sure that it will remain compatible and that test results will be comparable between different OPNFV setups).<br>
<br>
-Viktor<br>
<br>
> -----Original Message-----<br>
> From: EXT <a href="mailto:morgan.richomme@orange.com" target="_blank">morgan.richomme@orange.com</a> [mailto:<a href="mailto:morgan.richomme@orange.com" target="_blank">morgan.richomme@orange.com</a>]<br>
> Sent: Thursday, September 24, 2015 4:56 PM<br>
> To: Kosonen, Juha (Nokia - FI/Espoo); Tikkanen, Viktor (Nokia - FI/Espoo)<br>
> Cc: Jose Lausuch<br>
> Subject: [OPNFV] [Functest] Tempest & Rally<br>
><br>
> Hi,<br>
><br>
> I was wondering whether you could have a look at Rally/Tempest tests we<br>
> automatically launch in Functest.<br>
> We have still some errors and I assume most of them are due to<br>
> misconfiguration and/or quota ...<br>
> With Jose, we planned to have a look after SR0 but we do not have much<br>
> time and we are not fully skilled (even if we progressed a little bit:))<br>
><br>
> If you could have a look and give your feedback, it would be very<br>
> helpful, we could discuss it during an IRC weekly meeting<br>
> In Arno we did not use the SLA criteria, that is also something we could<br>
> do for the B Release<br>
><br>
> for instance if you look at<br>
> <a href="https://build.opnfv.org/ci/view/functest/job/functest-foreman-" target="_blank">
https://build.opnfv.org/ci/view/functest/job/functest-foreman-</a><br>
> master/19/consoleText<br>
><br>
> you will see rally and Tempest log<br>
><br>
> Rally scenario are a compilation of default Rally scenario played one<br>
> after the other and can be found in<br>
> <a href="https://git.opnfv.org/cgit/functest/tree/testcases/VIM/OpenStack/CI/suites" target="_blank">
https://git.opnfv.org/cgit/functest/tree/testcases/VIM/OpenStack/CI/suites</a><br>
><br>
> the Rally artifacts are also pushed into the artifact server<br>
> <a href="http://artifacts.opnfv.org/" target="_blank">http://artifacts.opnfv.org/</a><br>
> e.g.<br>
> <a href="http://artifacts.opnfv.org/functest/lf_pod2/2015-09-23_17-36-" target="_blank">
http://artifacts.opnfv.org/functest/lf_pod2/2015-09-23_17-36-</a><br>
> 07/results/rally/opnfv-authenticate.html<br>
> look for 09-23 to get Rally json/html files and tempest.conf<br>
><br>
> thanks<br>
><br>
> Morgan<br>
><br>
><br>
> __________________________________________________________________________<br>
> _______________________________________________<br>
><br>
> Ce message et ses pieces jointes peuvent contenir des informations<br>
> confidentielles ou privilegiees et ne doivent donc<br>
> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez<br>
> recu ce message par erreur, veuillez le signaler<br>
> a l'expediteur et le detruire ainsi que les pieces jointes. Les messages<br>
> electroniques etant susceptibles d'alteration,<br>
> Orange decline toute responsabilite si ce message a ete altere, deforme ou<br>
> falsifie. Merci.<br>
><br>
> This message and its attachments may contain confidential or privileged<br>
> information that may be protected by law;<br>
> they should not be distributed, used or copied without authorisation.<br>
> If you have received this email in error, please notify the sender and<br>
> delete this message and its attachments.<br>
> As emails may be altered, Orange is not liable for messages that have been<br>
> modified, changed or falsified.<br>
> Thank you.<br>
<br>
__________________________________________________________________________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" target="_blank">
OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><u></u><u></u></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div></div></div>
</div>
</blockquote></div><br></div>