[openstack-dev] [PTG][QA] QA PTG Rocky Summary

Ghanshyam Mann gmann at ghanshyammann.com
Wed Mar 7 13:32:40 UTC 2018

Hi All,

First of all, thanks for joining Rocky PTG and making it really productive
and successful. I am writing the QA PTG summary. Wwe started the 'owner'
for each working item so that we have single point of contact to track
those. That will help to make each priority item to complete on time.

1. Queens Retrospective
We discussed the Queens Retrospective at start the PTG. We went through 1.
what went well and 2. what needs to improve and gather some concrete action

Action Items:
- chandankumar: Use newly tempest plugin jobs for stable branches for other
- felipemonteiro: stable branches jobs needs to be done for Patrole for
in-repo zuul gate.
- masayukig: Mail to ML to abandon no active patches, then put a comment
and record the list, then abandon them
- gmann: will start the some etherpad and ML to notify the projects using
plugins for best practice and improve the interfaces used by them.
- gmann: will check with SamP on progress on destructive HA testing.
- mguiney: will start to put some unit tests for CLIs

We will be tracking the above AI in our QA meeting so that we really work
on mentioned AI and do not forget these as PTG finished.
Owner: gmann
Etherpad link: https://etherpad.openstack.org/p/qa-queens-retrospective

2. Zuul v3 native jobs
andreaf explained about the devstack and tempest base jobs and migration of
jobs. That was really helpful and good learning sessions. Basic idea to
finish the devstack and tempest base jobs to make them available for
projects specific jobs.

We decided to have only 2 devstack base jobs, 1. base abstract job 2. base
job for single and multinode jobs. Inherited jobs can adjust single and
multinode setup with nodeset var.

Action Items:
    - andreaf to merge current hierarchy of devstack jobs to make a single
job for single node and multinode jobs.
Owner: andreaf
Etherpad link:

3. Cold upgrades capabilities (Rocky community goal)
This is not Rocky goal now but we did talk on this little bit. We discussed
about preparation for grenade plugins developments. Masayuki will check
whether we have enough documentation and process written for implementing
the plugins.

Action Items:
    - masayukig to check the current documentation about grenade plugins
whether it is enough for projects to implement plugins.
Owner: masayukig
Etherpad link:

4. Interop test for adds-on project
I sent separate detailed mail on this and outcomes with action items.
please refer  -

5. Remove Deprecated APIs tests from Tempest
We talked about the testing of Deprecated APIs in tempest and on stable
branches. We concluded to tests all Deprecated APIs on master as well on
all stable branch. Till they are being removed we should tests APIs even
they are in any state. There are few APIs like glance v1 and keystone admin
v2 which are being skipped now So we are going to enable these APIs tests
on each corresponding stable and master branch.

Volume APIs testing will be little different way. We will tests v3 as
default in all jobs with all existing tests. v2 APIs will be tested with
new job running all current tests with v2 endpoints on tempest and cinder

Action Items:
    - gmann to make all glance v2 tests to run on all job
    - gmann to make keystone v2 admin tests in all jobs
    - gmann to make volume tests testing v3 as default and setup  v2 new
job on tempest and cinder
Owner: gmann
Etherpad link:

6. Backlogs from Queens Cycle
We went through the backlogs items of queens release which we discussed in
Denver PTG but did not completed.
We picked up the items which we still wanted to do but need volunteers to
take those items. I will publish those items to ML and find out some
volunteer if I can.

Action Items:
    - gmann to send the backlogs items to ML to find the volunteers.
Owner: Need Volunteer to pickup the items
Etherpad link: https://etherpad.openstack.org/p/qa-rocky-ptg-queens-backlogs

7. Consuming Kolla tempest container source image in CI
The tempest kolla image contains tempest as well as container. We can use
that to tests image and process of creating the image.
For that we can add a job on tempest and kolla CI to use of kolla Tempest
image and run few or more tempest test.

Action Items:
   - chandankumar to add job in tempest as non-voting with creating the
image dynamicaly with current proposed patches using kolla-ansible
-run tempest tests
-check sanity things only for tempest plugin
- chandankumar to add  the same job on kolla CI but with precreated image.
Owner: chandankumar
Etherpad link:

We talked about QA SIG and further steps on this. QA SIG is not meant to
replace the QA Program. It is meant for OpenStack users, operators -
including other communities interested in OpenStack / cross-community

Our next step is to get more feedback from various stack holders and start
the wiki page and governance proposal patch.

Action Items:
- andreaf: reach out to OpenLab team to see if they are interested
- andreaf: send out a doodle for meeting time for an initial meeting to
discuss scope of QA SIG
- andreaf: review formal process for SIG creation. SIG wiki, Governance
patch etc
- georgk will bring it up in the OPNFV test WG and other OPNFV fora
- chandankumar to reachout Tripleo HA team to participate in SIG
Owner: andreaf, QA Team
Etherpad link: https://etherpad.openstack.org/p/qa-rocky-ptg-qa-sig

9. Future of OpenStack-Health
OpenStack health is a still useful tool/dashboard to understand the status
of upstream development and useful for downstream development too. We
discussed about issues and challenges in health dashboard.
- Graph library is hard to be created and modified without (deep)
Javascript knowledge
- Diffifcult to keep npm libraries updates
- lack of number of developers

Action Items:
- masayukig and mtreinish and other developers keep working on current
working items.
Owner: masayukig, mtreinish

10. QA Rocky Priority:
In the last, we discussed the priority items for Rocky and listed the items
and owner of each items in below etherpads. Zuulv3 jobs are main priority
for QA team along with Bug Triage, Deprecated API testing, interop adss-on
program testing etc.
We will be tracking each item weekly and try to keep the good progress on

Etherpad link: https://etherpad.openstack.org/p/qa-rocky-ptg-rocky-priority

Let's work closely as team and finish the mentioned item in time.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20180307/2206b409/attachment-0001.html>

More information about the OpenStack-dev mailing list