Hey Martin,

Apologies my message was confusing. I'm aware of the latest guidelines, but I was referring to the Procedures around the Guidelines that haven't been updated: https://opendev.org/osf/interop/src/branch/master/2016.08/procedure.rst My understanding is the instructions differ there from the latest tests and it's where we point people from openstack.org/interop. Is there a different place we should be pointing? Thank you, Jimmy

On May 25 2021, at 8:56 am, Martin Kopec mkopec@redhat.com wrote:

Hi Jimmy,

there are newer guidelines, see:

• the latest one: https://opendev.org/osf/interop/src/branch/master/2020.11.json
• the one before: https://opendev.org/osf/interop/src/branch/master/2020.06.json

and etc ...

They aren't in a directory as they were until 2016. I can't tell you why the format change happened, I wasn't around at that time.

Anyway, new guidelines are still created approx twice a year. Add-ons guidelines have been recently added as well, which refstack server presents too (see OpenStack Marketing Programs list): https://refstack.openstack.org/#/

Currently there is an ongoing effort to make sure that we track all the relevant tests. We have also reached out to the teams during the Xena PTG and were asking if there are any new tests worth being included in the next guideline.

On Mon, 24 May 2021 at 19:01, Jimmy McArthur <jimmy@openstack.org (mailto:jimmy@openstack.org)> wrote:

...

Hi all -

I noticed that the most recent testing guidelines [1] are from 2016. Is there a plan to update those to the 2020 guidelines? They still mention Chris Hoge, who is no longer in the community, and I'm assuming the guidelines there are outdated as well. Cheers, Jimmy

https://opendev.org/osf/interop/src/branch/master/2016.08/procedure.rst

-- Martin Kopec Senior Software Quality Engineer Red Hat EMEA

Jimmy, Maybe you are looking at old location. We had moved repo to opendev with all others. Thanks, Arkady

From: Kanevsky, Arkady Sent: Thursday, May 27, 2021 4:14 PM To: Jimmy McArthur; Martin Kopec Cc: openstack-discuss Subject: RE: [interop] Interop Testing Guidelines

We are reorganizing where guidelines are see https://review.opendev.org/c/osf/interop/+/792883. And also we will update https://wiki.openstack.org/wiki/Governance/InteropWG so it points to current guideline and directory for all previous ones.

From: Jimmy McArthur <jimmy@openstack.orgmailto:jimmy@openstack.org> Sent: Tuesday, May 25, 2021 11:22 AM To: Martin Kopec Cc: openstack-discuss Subject: Re: [interop] Interop Testing Guidelines

[EXTERNAL EMAIL] Hey Martin,

Apologies my message was confusing. I'm aware of the latest guidelines, but I was referring to the Procedures around the Guidelines that haven't been updated: https://opendev.org/osf/interop/src/branch/master/2016.08/procedure.rst [opendev.org]https://urldefense.com/v3/__https:/opendev.org/osf/interop/src/branch/master/2016.08/procedure.rst__;!!LpKI!39E8EqeP2EJco5bXwObEa9z-XszAk_bszfvXBnnGG6jucRRUFyNLCm3vz2_MB9vIvTO-$ My understanding is the instructions differ there from the latest tests and it's where we point people from openstack.org/interop. Is there a different place we should be pointing?

Thank you, Jimmy

On May 25 2021, at 8:56 am, Martin Kopec <mkopec@redhat.commailto:mkopec@redhat.com> wrote: Hi Jimmy,

there are newer guidelines, see: * the latest one: https://opendev.org/osf/interop/src/branch/master/2020.11.json [opendev.org]https://urldefense.com/v3/__https:/opendev.org/osf/interop/src/branch/master/2020.11.json__;!!LpKI!39E8EqeP2EJco5bXwObEa9z-XszAk_bszfvXBnnGG6jucRRUFyNLCm3vz2_MB0WUsTKQ$ * the one before: https://opendev.org/osf/interop/src/branch/master/2020.06.json [opendev.org]https://urldefense.com/v3/__https:/opendev.org/osf/interop/src/branch/master/2020.06.json__;!!LpKI!39E8EqeP2EJco5bXwObEa9z-XszAk_bszfvXBnnGG6jucRRUFyNLCm3vz2_MB1NmCvhu$ and etc ...

They aren't in a directory as they were until 2016. I can't tell you why the format change happened, I wasn't around at that time.

Anyway, new guidelines are still created approx twice a year. Add-ons guidelines have been recently added as well, which refstack server presents too (see OpenStack Marketing Programs list): https://refstack.openstack.org/#/ [refstack.openstack.org]https://urldefense.com/v3/__https:/refstack.openstack.org/*/__;Iw!!LpKI!39E8EqeP2EJco5bXwObEa9z-XszAk_bszfvXBnnGG6jucRRUFyNLCm3vz2_MB2qXwOEl$

Currently there is an ongoing effort to make sure that we track all the relevant tests. We have also reached out to the teams during the Xena PTG and were asking if there are any new tests worth being included in the next guideline.

On Mon, 24 May 2021 at 19:01, Jimmy McArthur <jimmy@openstack.orgmailto:jimmy@openstack.org> wrote: Hi all -

I noticed that the most recent testing guidelines [1] are from 2016. Is there a plan to update those to the 2020 guidelines? They still mention Chris Hoge, who is no longer in the community, and I'm assuming the guidelines there are outdated as well.

Cheers, Jimmy

https://opendev.org/osf/interop/src/branch/master/2016.08/procedure.rst [opendev.org]https://urldefense.com/v3/__https:/opendev.org/osf/interop/src/branch/master/2016.08/procedure.rst__;!!LpKI!39E8EqeP2EJco5bXwObEa9z-XszAk_bszfvXBnnGG6jucRRUFyNLCm3vz2_MB9vIvTO-$

-- Martin Kopec Senior Software Quality Engineer Red Hat EMEA

After reading the 2016.08/procedure.rst file, some of the info there is true and some of it is outdated. I don't know why later guidelines don't contain the procedure.rst, I wasn't around when that decision was made. I would propose to update the linked procedure.rst file and move it outside of the specific guideline directory. The procedure doesn't usually change with newer guidelines, so it's ok to have just one. I'll make a note in the agenda so that this can be brought up during the next team meeting: https://etherpad.opendev.org/p/interop

On Thu, 27 May 2021 at 23:32, Jeremy Stanley fungi@yuggoth.org wrote:

On 2021-05-27 21:17:48 +0000 (+0000), Kanevsky, Arkady wrote:

...

Maybe you are looking at old location. We had moved repo to opendev with all others.

[...]

That's where he linked to in his message, if you read it carefully. What he's pointing out, and I can easily confirm as well, is that there's no procedure.rst file for later guideline versions. Perhaps that's intentional? Is the old procedure.rst in the 2016.08 directory meant to apply to later versions of the guidelines as well? If so, that's not obvious. -- Jeremy Stanley

As far .rst guidelines these are human-readable format of .json form. Json is the primary one. The tooling for conversion from json to rst is lacking behind. There is tooling that was developed many years ago and it was for schema 1.0. For last several years and guidelines were using schema 2.0 and we are looking for extending jsantorst tool to schema 2.0 and support for add-on guidelines.

From: Martin Kopec mkopec@redhat.com Sent: Friday, May 28, 2021 3:05 AM To: openstack-discuss Subject: Re: [interop] Interop Testing Guidelines

[EXTERNAL EMAIL] After reading the 2016.08/procedure.rst file, some of the info there is true and some of it is outdated. I don't know why later guidelines don't contain the procedure.rst, I wasn't around when that decision was made. I would propose to update the linked procedure.rst file and move it outside of the specific guideline directory. The procedure doesn't usually change with newer guidelines, so it's ok to have just one. I'll make a note in the agenda so that this can be brought up during the next team meeting: https://etherpad.opendev.org/p/interop [etherpad.opendev.org]https://urldefense.com/v3/__https:/etherpad.opendev.org/p/interop__;!!LpKI!2TrmHazspAlN8FySo7lDvQaX73p8WvH0rLj8B2uwwp2K8dWbNX1Mf0frysQwV3xlcNUF$

On Thu, 27 May 2021 at 23:32, Jeremy Stanley <fungi@yuggoth.orgmailto:fungi@yuggoth.org> wrote: On 2021-05-27 21:17:48 +0000 (+0000), Kanevsky, Arkady wrote:

Maybe you are looking at old location. We had moved repo to opendev with all others.

[...]

That's where he linked to in his message, if you read it carefully. What he's pointing out, and I can easily confirm as well, is that there's no procedure.rst file for later guideline versions. Perhaps that's intentional? Is the old procedure.rst in the 2016.08 directory meant to apply to later versions of the guidelines as well? If so, that's not obvious. -- Jeremy Stanley

-- Martin