<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Apr 17, 2017 at 6:50 AM, Ihar Hrachyshka <span dir="ltr"><<a href="mailto:ihrachys@redhat.com" target="_blank">ihrachys@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Hi all,<br>
<br>
so I tried to inject a failure in a tempest test and was surprised<br>
that no gate job failed because of that:<br>
<a href="https://review.openstack.org/#/c/457102/1" rel="noreferrer" target="_blank">https://review.openstack.org/#<wbr>/c/457102/1</a><br>
<br>
It turned out that the test is not executed because we always ignore<br>
all 'slow' tagged test cases:<br>
<a href="http://logs.openstack.org/02/457102/1/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/89a08cc/console.html#_2017-04-17_01_43_39_115768" rel="noreferrer" target="_blank">http://logs.openstack.org/02/<wbr>457102/1/check/gate-tempest-<wbr>dsvm-neutron-full-ubuntu-<wbr>xenial/89a08cc/console.html#_<wbr>2017-04-17_01_43_39_115768</a></blockquote><div>Indeed, we don't run slow tests. Many network scenarios are not run since <a href="https://review.openstack.org/#/c/439698/">https://review.openstack.org/#/c/439698/</a>  </div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><br>
<br>
Question: do we execute those tests anywhere in gate, and if so,<br>
where? (And if not, why, and how do we guarantee that they are not<br>
broken by new changes?)<br></blockquote><div>We don"t run slow tests because the QA team think that they don't bring enough value to be executed, every time and everywhere. The idea is that if some specific slow tests are of some interest to some specific openstack projects, those projects can change the config of their jobs to enable these tests.</div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<br>
Ihar<br>
<br>
______________________________<wbr>______________________________<wbr>______________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" rel="noreferrer" target="_blank">OpenStack-dev-request@lists.<wbr>openstack.org?subject:<wbr>unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" rel="noreferrer" target="_blank">http://lists.openstack.org/<wbr>cgi-bin/mailman/listinfo/<wbr>openstack-dev</a><br>
</blockquote></div><br></div></div>