<div dir="ltr"><div>Hi designate team,</div><div><br></div><div>I'm reaching out because we have encountered a problem with one of the tests [1]. We track the following name [2]:<br></div><div><code class="gmail-code-inner"><span class="gmail-nt">designate_tempest_plugin.tests.api.v2.test_recordset.RecordsetsTest.test_create_all_recordset_types</span></code><br></div><div><br></div><div>That test name is actually incorrect due to the ddt and the real name of the test is created dynamically based on the test data passed via ddt.</div><div><br></div><div>We have a consistency check which is supposed to verify that the test names tracked in our guidelines match the ones in Tempest/tempest plugins, however, there was a bug - we are fixing that by [3].</div><div><br></div><div>The question is, should interop track all the permutations of the test? See [4].<br></div><div><br></div><div>[1] <a href="https://opendev.org/openstack/designate-tempest-plugin/src/commit/da27a70ae2b39695ef6f03bbefb55afeacf1cdf3/designate_tempest_plugin/tests/api/v2/test_recordset.py#L87">https://opendev.org/openstack/designate-tempest-plugin/src/commit/da27a70ae2b39695ef6f03bbefb55afeacf1cdf3/designate_tempest_plugin/tests/api/v2/test_recordset.py#L87</a></div><div>[2] <a href="https://opendev.org/osf/interop/src/commit/d8eac71fa507c68e9c1f83a19dd77af8483d01b6/add-ons/guidelines/dns.2020.11.json#L116-L117">https://opendev.org/osf/interop/src/commit/d8eac71fa507c68e9c1f83a19dd77af8483d01b6/add-ons/guidelines/dns.2020.11.json#L116-L117</a></div><div>[3] <a href="https://review.opendev.org/c/osf/interop/+/806598">https://review.opendev.org/c/osf/interop/+/806598</a></div><div>[4] <a href="https://review.opendev.org/c/osf/interop/+/807586">https://review.opendev.org/c/osf/interop/+/807586</a></div><div><br></div><div>Thank you,<br></div><div>-- <br><div dir="ltr" data-smartmail="gmail_signature"><div dir="ltr"><div><font size="2">Martin Kopec</font><br><font size="2"><span>Senior Software Quality Engineer</span></font><br><font size="2"><span>Red Hat <span>EMEA</span></span></font></div><div><br></div><div><br></div><div><br></div></div></div></div></div>