<html><body>
<p><font size="2" face="sans-serif">Examining the newly implemented test UUIDs, I found that there are 496 test cases that have multiple test cases associated with same UUIDs. These can be categorized into 2 groups:</font>
<ol type="1" style="padding-left: 18pt">
<li>
<li><font size="2" face="sans-serif">A single UUID is associated to multiple test cases for different API versions. Since we can only test one API version at a time, this will not be an issue for Refstack. Example:</font>
<ul type="disc" style="padding-left: 18pt">
<li><font size="2" face="sans-serif">tempest.api.volume.admin.test_volume_types_negative.VolumeTypesNegativeV2Test.test_create_with_nonexistent_volume_type[gate,id-b48c98f2-e662-4885-9b71-032256906314]</font>
<li><font size="2" face="sans-serif">tempest.api.volume.admin.test_volume_types_negative.VolumeTypesNegativeV1Test.test_create_with_nonexistent_volume_type[gate,id-b48c98f2-e662-4885-9b71-032256906314]<br>
</font></ul>
<li><font size="2" face="sans-serif">A single UUID associates to multiple test cases for different features, protocols (IPv4 vs IPv6) ... In this case, it is very possible that we could invoke all tests on the same test run. Should these tests have different UUIDs? The issue is DefCore will define must-pass tests using test UUID. In the example below since all 3 test cases have the same UUID, which would be the test cases that must pass? all 3? or just one of the 3? </font>
<ul type="disc" style="padding-left: 18pt">
<li><font size="2" face="sans-serif">tempest.api.network.test_networks.NetworksTestJSON.test_list_networks_fields[gate,id-6ae6d24f-9194-4869-9c85-c313cb20e080,smoke]</font>
<li><font size="2" face="sans-serif">tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks_fields[gate,id-6ae6d24f-9194-4869-9c85-c313cb20e080,smoke]</font>
<li><font size="2" face="sans-serif">tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks_fields[gate,id-6ae6d24f-9194-4869-9c85-c313cb20e080,smoke]<br>
</font></ul>
</ol>
<font size="2" face="sans-serif">A complete list of the 496 test cases can be found in </font><a href="https://docs.google.com/spreadsheets/d/1mXeDNsJJJl93juzlNG9ccxSdO9ywqIeM-E2EJdvNImk/edit#gid=1273407686"><font size="2" face="sans-serif">https://docs.google.com/spreadsheets/d/1mXeDNsJJJl93juzlNG9ccxSdO9ywqIeM-E2EJdvNImk/edit#gid=1273407686</font></a><br>
<br>
<font size="2" face="sans-serif">Catherine Cuong Diep<br>
High Performance On Demand Solutions<br>
IBM Silicon Valley Laboratory, San Jose, California 95141<br>
cdiep@us.ibm.com, Tel: (408) 463-4352 T/L: 543-4352</font></body></html>