<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">I just ran it and got …<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Ran: 304 tests in 412.0000 sec.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">- Passed: 293<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">- Skipped: 11<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Ryan Hsu [mailto:rhsu@vmware.com]
<br>
<b>Sent:</b> Thursday, March 26, 2015 4:45 PM<br>
<b>To:</b> OpenStack Development Mailing List (not for usage questions)<br>
<b>Subject:</b> Re: [openstack-dev] [cinder] Deadline For Volume Drivers to Be Readded<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Hmm, that's what I thought at first but when I looked at the "What tests do I use" FAQ, the tests that it says to use links to:
<a href="http://git.openstack.org/cgit/openstack/tempest/tree/tempest/api/volume">
http://git.openstack.org/cgit/openstack/tempest/tree/tempest/api/volume</a>, which is exactly what we're running. Even so, I ran the "tox -e all -- volume" command and that just runs 4 more tests.
<o:p></o:p></p>
<div>
<div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">-Ryan<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">[1] <a href="https://wiki.openstack.org/wiki/Cinder/tested-3rdParty-drivers#What_tests_do_I_use.3F">https://wiki.openstack.org/wiki/Cinder/tested-3rdParty-drivers#What_tests_do_I_use.3F</a><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">On Mar 26, 2015, at 1:56 PM, Tom Swanson <<a href="mailto:Tom_Swanson@DELL.com">Tom_Swanson@DELL.com</a>> wrote:<o:p></o:p></p>
</div>
<p class="MsoNormal"><br>
<br>
<o:p></o:p></p>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal">You want to run the "volume" tests and not "tempest.api.volume" tests.<br>
<br>
-----Original Message-----<br>
From: Ryan Hsu [<a href="mailto:rhsu@vmware.com">mailto:rhsu@vmware.com</a>] <br>
Sent: Thursday, March 26, 2015 3:50 PM<br>
To: OpenStack Development Mailing List (not for usage questions)<br>
Subject: Re: [openstack-dev] [cinder] Deadline For Volume Drivers to Be Readded<br>
<br>
Hi Mike,<br>
<br>
We (VMware CI) run "testr run tempest.api.volume" for our Cinder CI and this runs about ~240 tests for us. I'm guessing that the rest of the ~60 tests are not being run due to skips and disabled features. For example, here is a sampling of tests that are skipped
in a recent run (note that this is using tempest.conf with no explicit disabling of Cinder services):<br>
<br>
tempest.api.compute.test_live_block_migration.LiveBlockMigrationTestJSON.test_iscsi_volume ... SKIPPED: Block Live migration not available setUpClass (tempest.api.orchestration.stacks.test_volumes.CinderResourcesTest) ... SKIPPED: Heat support is required setUpClass
(tempest.api.volume.admin.test_multi_backend.VolumeMultiBackendV2Test) ... SKIPPED: Cinder multi-backend feature disabled tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume ... SKIPPED: SSH required for this test
setUpClass (tempest.api.volume.admin.test_volumes_backup.VolumesBackupsV1Test) ... SKIPPED: Cinder backup feature disabled setUpClass (tempest.api.volume.admin.test_volumes_backup.VolumesBackupsV2Test) ... SKIPPED: Cinder backup feature disabled setUpClass
(tempest.api.volume.admin.test_multi_backend.VolumeMultiBackendV1Test) ... SKIPPED: Cinder multi-backend feature disabled tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern<br>
... SKIPPED: Skipped until Bug: 1373513 is resolved.<br>
tempest.scenario.test_stamp_pattern.TestStampPattern.test_stamp_pattern ... SKIPPED: Skipped until Bug: 1205344 is resolved.<br>
setUpClass (tempest.thirdparty.boto.test_ec2_instance_run.InstanceRunTest) ... SKIPPED: The EC2 API is not available setUpClass (tempest.thirdparty.boto.test_ec2_volumes.EC2VolumesTest) ... SKIPPED: The EC2 API is not available tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern
... SKIPPED: Skipped until Bug: 1373513 is resolved.<br>
<br>
As we are actually running the volume suite according to the FAQ and the above skipped tests are documented by our CI, would it be possible to add an exception to the rule? I'm sure these numbers will be different for all CIs and as long as people are not
abusing and hiding skipped tests, I don't see this as a problem.<br>
<br>
Thanks,<br>
Ryan<br>
<br>
On Mar 26, 2015, at 9:39 AM, Mike Perez <<a href="mailto:thingee@gmail.com">thingee@gmail.com</a>> wrote:<br>
<br>
<br>
<o:p></o:p></p>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal">As discussed in the last Cinder meeting [1], in order to have your
<br>
volume driver readded into the Kilo release, you must have a CI <br>
reporting and stable for five days prior to 4/6.<br>
<br>
This includes:<br>
<br>
1) Providing logs to screen sessions, etc configs, tempest output [2].<br>
2) You should be running around 304 tests if you're following instructions from<br>
the Cinder third party wiki [3]. If you're running less than that, your CI<br>
will be *NOT* be considered satisfactory for skipping tests.<br>
<br>
I will also be emailing individuals who have already asked for <br>
exceptions, just to make sure communication was clear.<br>
<br>
<br>
[1] - <br>
<a href="http://eavesdrop.openstack.org/meetings/cinder/2015/cinder.2015-03-25-">http://eavesdrop.openstack.org/meetings/cinder/2015/cinder.2015-03-25-</a><br>
16.00.log.html#l-173 [2] - <br>
<a href="http://ci.openstack.org/third_party.html#requirements">http://ci.openstack.org/third_party.html#requirements</a><br>
[3] - <br>
<a href="https://wiki.openstack.org/wiki/Cinder/tested-3rdParty-drivers#What_te">https://wiki.openstack.org/wiki/Cinder/tested-3rdParty-drivers#What_te</a><br>
sts_do_I_use.3F<br>
<br>
--<br>
Mike Perez<br>
<br>
______________________________________________________________________<br>
____ OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <br>
<a href="mailto:OpenStack-dev-request@lists.openstack.org?subject:unsubscribe">OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><o:p></o:p></p>
</blockquote>
<p class="MsoNormal"><br>
<br>
__________________________________________________________________________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="mailto:OpenStack-dev-request@lists.openstack.org">OpenStack-dev-request@lists.openstack.org</a>?subject:unsubscribe<br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
<br>
__________________________________________________________________________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="mailto:OpenStack-dev-request@lists.openstack.org?subject:unsubscribe">
OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><o:p></o:p></p>
</blockquote>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</div>
</div>
</div>
</body>
</html>