Open Stack

Patrole has also started migration to Zuul v3 native with: https://review.openstack.org/#/c/547820/

Thanks,

Felipe

> -----Original Message-----
> From: Michael Johnson [mailto:johnsomor at gmail.com]
> Sent: Wednesday, February 21, 2018 11:35 AM
> To: OpenStack Development Mailing List (not for usage questions)
> <openstack-dev at lists.openstack.org>
> Subject: Re: [openstack-dev] [QA][all] Migration of Tempest / Grenade jobs
> to Zuul v3 native
> 
> FYI, Octavia has started to use the new devstack-tempest parent here:
> https://urldefense.proofpoint.com/v2/url?u=https-
> 3A__review.openstack.org_-
> 23_c_543034_17_zuul.d_jobs.yaml&d=DwIGaQ&c=LFYZ-
> o9_HUMeMTSQicvjIg&r=GL712YbQ1dO5c4PRjp-
> cePgOMxie8Iw1Rm6vREW7qaI&m=H7JhB2wyLMo_XoBYdgZGwOfTHS2dW5
> Y9_N3SF6xAKLk&s=YJByaMybmEINehssnk52zVCM_4dNVjqWsVAweWDo_1Y
> &e=
> There is a lot of work still left to do on our tempest-plugin but we
> are making progress.
> 
> Thanks for the communication out!
> 
> Michael
> 
> 
> On Tue, Feb 20, 2018 at 1:22 PM, Andrea Frittoli
> <andrea.frittoli at gmail.com> wrote:
> > Dear all,
> >
> > updates:
> >
> > - host/group vars: zuul now supports declaring host and group vars in the
> > job definition [0][1] - thanks corvus and infra team!
> >   This is a great help towards writing the devstack and tempest base
> > multinode jobs [2][3]
> >   * NOTE: zuul merges dict variables through job inheritance. Variables in
> > host/group_vars override global ones. I will write some examples further
> > clarify this.
> >
> > - stable/pike: devstack ansible changes have been backported to
> stable/pike,
> > so we can now run zuulv3 jobs against stable/pike too - thank you tosky!
> >   next change in progress related to pike is to provide tempest-full-pike
> > for branchless repositories [4]
> >
> > - documentation: devstack now publishes documentation on its ansible
> roles
> > [5].
> >   More devstack documentation patches are in progress to provide jobs
> > reference, examples and a job migration how-to [6].
> >
> >
> > Andrea Frittoli (andreaf)
> >
> > [0]
> > https://urldefense.proofpoint.com/v2/url?u=https-
> 3A__docs.openstack.org_infra_zuul_user_config.html-23attr-2Djob.host-
> 5Fvars&d=DwIGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=GL712YbQ1dO5c4PRjp-
> cePgOMxie8Iw1Rm6vREW7qaI&m=H7JhB2wyLMo_XoBYdgZGwOfTHS2dW5
> Y9_N3SF6xAKLk&s=CosTB1Amrpom-
> Num7uRT76rcbUKLEtEtsy3wUAQ6cUw&e=
> > [1]
> > https://urldefense.proofpoint.com/v2/url?u=https-
> 3A__docs.openstack.org_infra_zuul_user_config.html-23attr-2Djob.group-
> 5Fvars&d=DwIGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=GL712YbQ1dO5c4PRjp-
> cePgOMxie8Iw1Rm6vREW7qaI&m=H7JhB2wyLMo_XoBYdgZGwOfTHS2dW5
> Y9_N3SF6xAKLk&s=pRDPJ8v49Gv5-
> CbLE151Mo3gKCbns2PvYjqGodo_JOU&e=
> > [2] https://urldefense.proofpoint.com/v2/url?u=https-
> 3A__review.openstack.org_-23_c_545696_&d=DwIGaQ&c=LFYZ-
> o9_HUMeMTSQicvjIg&r=GL712YbQ1dO5c4PRjp-
> cePgOMxie8Iw1Rm6vREW7qaI&m=H7JhB2wyLMo_XoBYdgZGwOfTHS2dW5
> Y9_N3SF6xAKLk&s=huCs3ubYx5iKKmPZUyeI11cUpnsIPq99RQPspDyB-Ng&e=
> > [3] https://urldefense.proofpoint.com/v2/url?u=https-
> 3A__review.openstack.org_-23_c_545724_&d=DwIGaQ&c=LFYZ-
> o9_HUMeMTSQicvjIg&r=GL712YbQ1dO5c4PRjp-
> cePgOMxie8Iw1Rm6vREW7qaI&m=H7JhB2wyLMo_XoBYdgZGwOfTHS2dW5
> Y9_N3SF6xAKLk&s=RN0hTSHYSxXIBtGhcRXOO4BRV9OTrrvj-aUnhyFdf6c&e=
> > [4] https://urldefense.proofpoint.com/v2/url?u=https-
> 3A__review.openstack.org_-23_c_546196_&d=DwIGaQ&c=LFYZ-
> o9_HUMeMTSQicvjIg&r=GL712YbQ1dO5c4PRjp-
> cePgOMxie8Iw1Rm6vREW7qaI&m=H7JhB2wyLMo_XoBYdgZGwOfTHS2dW5
> Y9_N3SF6xAKLk&s=84M8P63oHq8oodoI2Oufe-
> XM07YQl6beCfve0GWU6uI&e=
> > [5] https://urldefense.proofpoint.com/v2/url?u=https-
> 3A__docs.openstack.org_devstack_latest_roles.html&d=DwIGaQ&c=LFYZ-
> o9_HUMeMTSQicvjIg&r=GL712YbQ1dO5c4PRjp-
> cePgOMxie8Iw1Rm6vREW7qaI&m=H7JhB2wyLMo_XoBYdgZGwOfTHS2dW5
> Y9_N3SF6xAKLk&s=jwdCu8h63MicciUk_uoI_2M3iCI02g3Ou1kz8SoA840&e=
> > [6] https://urldefense.proofpoint.com/v2/url?u=https-
> 3A__review.openstack.org_-23_c_545992_&d=DwIGaQ&c=LFYZ-
> o9_HUMeMTSQicvjIg&r=GL712YbQ1dO5c4PRjp-
> cePgOMxie8Iw1Rm6vREW7qaI&m=H7JhB2wyLMo_XoBYdgZGwOfTHS2dW5
> Y9_N3SF6xAKLk&s=lnpEoAuvoAC5rJS-PyRsGjoJkvQqIR68ZO5uUnL4XGs&e=
> >
> >
> > On Mon, Feb 19, 2018 at 2:46 PM Andrea Frittoli
> <andrea.frittoli at gmail.com>
> > wrote:
> >>
> >> Dear all,
> >>
> >> updates:
> >> - tempest-full-queens and tempest-full-py3-queens are now available for
> >> testing of branchless repositories [0]. They are used for tempest and
> >> devstack-gate. If you own a tempest plugin in a branchless repo, you may
> >> consider adding similar jobs to your plugin if you use it for tests on
> >> stable/queen as well.
> >> - if you have migrated jobs based on devstack-tempest please let me
> know,
> >> I'm building reference docs and I'd like to include as many examples as
> >> possible
> >> - work on multi-node is in progress, but not ready still - you can follow
> >> the patches in the multinode branch [1]
> >> - updates on some of the points from my previous email are inline below
> >>
> >> Andrea Frittoli (andreaf)
> >>
> >> [0] https://urldefense.proofpoint.com/v2/url?u=http-
> 3A__git.openstack.org_cgit_openstack_tempest_tree_.zuul.yaml-
> 23n73&d=DwIGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=GL712YbQ1dO5c4PRjp-
> cePgOMxie8Iw1Rm6vREW7qaI&m=H7JhB2wyLMo_XoBYdgZGwOfTHS2dW5
> Y9_N3SF6xAKLk&s=AJSVcf8OfdJvORTXJkaX0icEunv-JHuNrTRptvPYQ2Y&e=
> >> [1]
> >> https://urldefense.proofpoint.com/v2/url?u=https-
> 3A__review.openstack.org_-23_q_status-3Aopen-2B-2Bbranch-3Amaster-
> 2Btopic-3Amultinode&d=DwIGaQ&c=LFYZ-
> o9_HUMeMTSQicvjIg&r=GL712YbQ1dO5c4PRjp-
> cePgOMxie8Iw1Rm6vREW7qaI&m=H7JhB2wyLMo_XoBYdgZGwOfTHS2dW5
> Y9_N3SF6xAKLk&s=2xPznmETr17tXPzZs5nG1gPoMp-VJtjK-x8FAp4j4Sw&e=
> >>
> >>
> >> On Thu, Feb 15, 2018 at 11:31 PM Andrea Frittoli
> >> <andrea.frittoli at gmail.com> wrote:
> >>>
> >>> Dear all,
> >>>
> >>> this is the first or a series of ~regular updates on the migration of
> >>> Tempest / Grenade jobs to  Zuul v3 native.
> >>>
> >>> The QA team together with the infra team are working on providing the
> >>> OpenStack community with a set of base Tempest / Grenade jobs that
> can be
> >>> used as a basis to write new CI jobs / migrate existing legacy ones with a
> >>> minimal effort and very little or no Ansible knowledge as a precondition.
> >>>
> >>> The effort is tracked in an etherpad [0]; I'm trying to keep the etherpad
> >>> up to date but it may not always be a source of truth.
> >>>
> >>> Useful jobs available so far:
> >>> - devstack-tempest [0] is a simple tempest/devstack job that runs
> >>> keystone glance nova cinder neutron swift and tempest *smoke* filter
> >>> - tempest-full [1] is similar but runs a full test run - it replaces the
> >>> legacy tempest-dsvm-neutron-full from the integrated gate
> >>> - tempest-full-py3 [2] runs a full test run on python3 - it replaces the
> >>> legacy tempest-dsvm-py35
> >>
> >>
> >> Some more details on this topic: what I did not mention in my previous
> >> email is that the autogenerated Tempest / Grenade CI jobs (legacy-*
> >> playbooks) are not meant to be used as a basis for Zuul V3 native jobs. To
> >> create Zuul V3 Tempest / Grenade native jobs for your projects you need
> to
> >> through away the legacy playbooks and defined new jobs in .zuul.yaml, as
> >> documented in the zuul v3 docs [2].
> >> The parent job for a single node Tempest job will usually be
> >> devstack-tempest. Example migrated jobs are avilable, for instance: [3]
> [4].
> >>
> >> [2]
> >> https://urldefense.proofpoint.com/v2/url?u=https-
> 3A__docs.openstack.org_infra_manual_zuulv3.html-23howto-2Dupdate-
> 2Dlegacy-2Djobs&d=DwIGaQ&c=LFYZ-
> o9_HUMeMTSQicvjIg&r=GL712YbQ1dO5c4PRjp-
> cePgOMxie8Iw1Rm6vREW7qaI&m=H7JhB2wyLMo_XoBYdgZGwOfTHS2dW5
> Y9_N3SF6xAKLk&s=rDi-IqrYMnGm8V88nG0JdH1ejomqU6kZTPg8BSfkajw&e=
> >> [3]
> >> https://urldefense.proofpoint.com/v2/url?u=http-
> 3A__git.openstack.org_cgit_openstack_sahara-2Dtests_tree_.zuul.yaml-
> 23n21&d=DwIGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=GL712YbQ1dO5c4PRjp-
> cePgOMxie8Iw1Rm6vREW7qaI&m=H7JhB2wyLMo_XoBYdgZGwOfTHS2dW5
> Y9_N3SF6xAKLk&s=XI4c3uIrY_iUIG3HaF3FWjqTchQJ0ZfihkB4ophJ_eg&e=
> >> [4] https://urldefense.proofpoint.com/v2/url?u=https-
> 3A__review.openstack.org_-23_c_543048_5&d=DwIGaQ&c=LFYZ-
> o9_HUMeMTSQicvjIg&r=GL712YbQ1dO5c4PRjp-
> cePgOMxie8Iw1Rm6vREW7qaI&m=H7JhB2wyLMo_XoBYdgZGwOfTHS2dW5
> Y9_N3SF6xAKLk&s=i8Q7IeOXLXGLVqjN09OSJ3QZDQDKIhhTYl7qTSycXUI&e=
> >>
> >>>
> >>>
> >>> Both tempest-full and tempest-full-py3 are part of integrated-gate
> >>> templates, starting from stable/queens on.
> >>> The other stable branches still run the legacy jobs, since devstack
> >>> ansible changes have not been backported (yet). If we do backport it will
> be
> >>> up to pike maximum.
> >>>
> >>> Those jobs work in single node mode only at the moment. Enabling
> >>> multinode via job configuration only require a new Zuul feature [4][5]
> that
> >>> should be available soon; the new feature allows defining host/group
> >>> variables in the job definition, which means setting variables which are
> >>> specific to one host or a group of hosts.
> >>> Multinode DVR and Ironic jobs will require migration of the ovs-* roles
> >>> form devstack-gate to devstack as well.
> >>>
> >>> Grenade jobs (single and multinode) are still legacy, even if the
> >>> *legacy* word has been removed from the name.
> >>> They are currently temporarily hosted in the neutron repository. They
> are
> >>> going to be implemented as Zuul v3 native in the grenade repository.
> >>>
> >>> Roles are documented, and a couple of migration tips for
> DEVSTACK_GATE
> >>> flags is available in the etherpad [0]; more comprehensive examples /
> docs
> >>> will be available as soon as possible.
> >>>
> >>> Please let me know if you find this update useful and / or if you would
> >>> like to see different information in it.
> >>> I will send further updates as soon as significant changes / new features
> >>> become available.
> >>>
> >>> Andrea Frittoli (andreaf)
> >>>
> >>> [0] https://urldefense.proofpoint.com/v2/url?u=https-
> 3A__etherpad.openstack.org_p_zuulv3-2Dnative-2Ddevstack-2Dtempest-
> 2Djobs&d=DwIGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=GL712YbQ1dO5c4PRjp-
> cePgOMxie8Iw1Rm6vREW7qaI&m=H7JhB2wyLMo_XoBYdgZGwOfTHS2dW5
> Y9_N3SF6xAKLk&s=Ewtex0vw5RLTBex7QJNQ6eUbmHUdh5MhcCtoPHk0uG0
> &e=
> >>> [1] https://urldefense.proofpoint.com/v2/url?u=http-
> 3A__git.openstack.org_cgit_openstack_tempest_tree_.zuul.yaml-
> 23n1&d=DwIGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=GL712YbQ1dO5c4PRjp-
> cePgOMxie8Iw1Rm6vREW7qaI&m=H7JhB2wyLMo_XoBYdgZGwOfTHS2dW5
> Y9_N3SF6xAKLk&s=5g4anU3EjRcmzbcxn-Akok3rTbPkBP0uV0O5zhY-3WE&e=
> >>> [2] https://urldefense.proofpoint.com/v2/url?u=http-
> 3A__git.openstack.org_cgit_openstack_tempest_tree_.zuul.yaml-
> 23n29&d=DwIGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=GL712YbQ1dO5c4PRjp-
> cePgOMxie8Iw1Rm6vREW7qaI&m=H7JhB2wyLMo_XoBYdgZGwOfTHS2dW5
> Y9_N3SF6xAKLk&s=zkppFgApyxdVFnXMTN-kRfMKZy9rTn8cU6lXE8aJevo&e=
> >>> [3] https://urldefense.proofpoint.com/v2/url?u=http-
> 3A__git.openstack.org_cgit_openstack_tempest_tree_.zuul.yaml-
> 23n47&d=DwIGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=GL712YbQ1dO5c4PRjp-
> cePgOMxie8Iw1Rm6vREW7qaI&m=H7JhB2wyLMo_XoBYdgZGwOfTHS2dW5
> Y9_N3SF6xAKLk&s=n_RaCD-NgwJWUDALLwdnKNA-
> PUgYvmKBfTLyuv8nDJY&e=
> >>> [4] https://urldefense.proofpoint.com/v2/url?u=https-
> 3A__etherpad.openstack.org_p_zuulv3-2Dgroup-
> 2Dvariables&d=DwIGaQ&c=LFYZ-
> o9_HUMeMTSQicvjIg&r=GL712YbQ1dO5c4PRjp-
> cePgOMxie8Iw1Rm6vREW7qaI&m=H7JhB2wyLMo_XoBYdgZGwOfTHS2dW5
> Y9_N3SF6xAKLk&s=fhD2S9eRhLbnlJuVgIuhAjKrDeQTQXkC9nGWmquPbfA&e=
> >>> [5] https://urldefense.proofpoint.com/v2/url?u=https-
> 3A__review.openstack.org_-23_c_544562_&d=DwIGaQ&c=LFYZ-
> o9_HUMeMTSQicvjIg&r=GL712YbQ1dO5c4PRjp-
> cePgOMxie8Iw1Rm6vREW7qaI&m=H7JhB2wyLMo_XoBYdgZGwOfTHS2dW5
> Y9_N3SF6xAKLk&s=J0wFJqOGHJK80Nu2oP-JCJK2XScK4oB5ZelxXZMjZU8&e=
> >
> >
> >
> ______________________________________________________________
> ____________
> > OpenStack Development Mailing List (not for usage questions)
> > Unsubscribe: OpenStack-dev-
> request at lists.openstack.org?subject:unsubscribe
> > https://urldefense.proofpoint.com/v2/url?u=http-
> 3A__lists.openstack.org_cgi-2Dbin_mailman_listinfo_openstack-
> 2Ddev&d=DwIGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=GL712YbQ1dO5c4PRjp-
> cePgOMxie8Iw1Rm6vREW7qaI&m=H7JhB2wyLMo_XoBYdgZGwOfTHS2dW5
> Y9_N3SF6xAKLk&s=4sL5HYcNUCX9D6E6Y5NllrEurvUzu9J6eawI9WjQ26g&e=
> >
> 
> ______________________________________________________________
> ____________
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: OpenStack-dev-
> request at lists.openstack.org?subject:unsubscribe
> https://urldefense.proofpoint.com/v2/url?u=http-
> 3A__lists.openstack.org_cgi-2Dbin_mailman_listinfo_openstack-
> 2Ddev&d=DwIGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=GL712YbQ1dO5c4PRjp-
> cePgOMxie8Iw1Rm6vREW7qaI&m=H7JhB2wyLMo_XoBYdgZGwOfTHS2dW5
> Y9_N3SF6xAKLk&s=4sL5HYcNUCX9D6E6Y5NllrEurvUzu9J6eawI9WjQ26g&e=