[openstack-dev] [infra][tripleo] initial discussion for a new periodic pipeline

Wesley Hayutin whayutin at redhat.com
Tue Mar 7 15:12:58 UTC 2017


Greetings,

The TripleO team would like to initiate a conversation about the
possibility of creating a new pipeline in Openstack Infra to allow a set of
jobs to run periodically every four hours [2].
The background and context of why such a pipeline is required is as
follows.  TripleO CI executes installs of Openstack with rpm packages from
a tool called delorean [1].  Every commit from upstream is built into a
rpm several times each hour of the day.  These freshly built packages need
to be validated before they are allowed to be used in the TripleO check
gates to ensure we have stable and consistent CI results.  Currently the
validation of the new rpms is done every 24 hours via a periodic pipeline.
In practice this periodic validation finds a working set of rpms roughly
once maybe twice a week depending on the time in the release, they happen
much more often at the beginning and end of each cycle.

There is often a window of time where an upstream fix has been merged and
the set of rpms will pass this validation and when a new issue/bug is
introduced into the latest set of rpms.  Validating the set of rpms only
every 24 hours does not intersect with that "working window" often enough.
It's good practice to always be testing with the latest merged code in CI
and that is what we hope to improve on in TripleO by increasing the cadence
of this validation.   A suggestion was made at the last PTG in Atlanta to
create a new pipeline to accommodate an increased cadence hopefully to
every four hours.

I suspect there will be roughly 4-6 jobs kicked off in this pipeline.  The
exact jobs that will be used is not final but will probably include [3]

I am hoping to kick off the conversation regarding how to properly proceed
with this task here, and to generally notify the community of our
intentions.

Thank you for reading through this and considering the requirement.
Wes


[1]
https://blogs.rdoproject.org/7834/delorean-openstack-packages-from-the-future
[2]
https://blueprints.launchpad.net/tripleo/+spec/increase-cadence-of-tripleo-promotions
[3]
gate-tripleo-ci-centos-7-scenario001-multinode
gate-tripleo-ci-centos-7-scenario002-multinode
gate-tripleo-ci-centos-7-scenario003-multinode
gate-tripleo-ci-centos-7-scenario004-multinode
gate-tripleo-ci-centos-7-multinode-upgrades-nv
gate-tripleo-ci-centos-7-ovb-ha-ipv6
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-dev/attachments/20170307/98eb6c76/attachment.html>


More information about the OpenStack-dev mailing list