<div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div id="gmail-magicdomid2" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">Hey teams,</span></div><div id="gmail-magicdomid3" class="gmail-ace-line"><br></div><div id="gmail-magicdomid4" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">## Summary</span></div><div id="gmail-magicdomid5" class="gmail-ace-line"><br></div><div id="gmail-magicdomid6" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">The main goal of this thread is to coordinate teams to adopt the oslo realease migrator tools and raise prior on this topics.</span></div><div id="gmail-magicdomid7" class="gmail-ace-line"><br></div><div id="gmail-magicdomid267" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">## History</span></div><div id="gmail-magicdomid268" class="gmail-ace-line"><br></div><div id="gmail-magicdomid105" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">During the openstack submit in 2017 at Sydney a team from the Fujitsu company propose a talk about how to </span></div><div id="gmail-magicdomid10" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">make fast forward upgrade from an openstack release to an another, and present the state of art of the configuration migrator</span></div><div id="gmail-magicdomid11" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">inside openstack and the tools availables to do that.</span></div><div id="gmail-magicdomid12" class="gmail-ace-line"><br></div><div id="gmail-magicdomid108" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">This team describe that for now, we have oslo.config generator tool to show deprecated options in newer release </span></div><div id="gmail-magicdomid14" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">but they are still lacking some mapping configurations.</span></div><div id="gmail-magicdomid15" class="gmail-ace-line"><br></div><div id="gmail-magicdomid16" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">After that the same team propose oslo.config specifications to improve migrators.</span></div><div id="gmail-magicdomid17" class="gmail-ace-line"><br></div><div id="gmail-magicdomid1736" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">Where specifications was designed by the following reviews:</span></div><div id="gmail-magicdomid19" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">- </span><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z gmail-url"><a href="https://review.openstack.org/#/c/520043/">https://review.openstack.org/#/c/520043/</a></span></div><div id="gmail-magicdomid20" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">- </span><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z gmail-url"><a href="https://review.openstack.org/#/c/526314/">https://review.openstack.org/#/c/526314/</a></span></div><div id="gmail-magicdomid21" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">- </span><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z gmail-url"><a href="https://review.openstack.org/#/c/526261/">https://review.openstack.org/#/c/526261/</a></span></div><div id="gmail-magicdomid22" class="gmail-ace-line"><br></div><div id="gmail-magicdomid1740" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">The main goal of the proposed changes in these specs is to handle configuration changes over releases:</span></div><div id="gmail-magicdomid115" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">- </span><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z gmail-url"><a href="https://specs.openstack.org/openstack/oslo-specs/specs/rocky/handle-config-changes.html">https://specs.openstack.org/openstack/oslo-specs/specs/rocky/handle-config-changes.html</a></span></div><div id="gmail-magicdomid117" class="gmail-ace-line"><br></div><div id="gmail-magicdomid174" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">These specifications describe that there should be some helper in oslo.config for automatically adopt </span></div><div id="gmail-magicdomid176" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">new changes and help users manage their configuration files easily.</span></div><div id="gmail-magicdomid177" class="gmail-ace-line"><br></div><div id="gmail-magicdomid119" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">Scenario:</span></div><div id="gmail-magicdomid266" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">Below is the proposed workflow that users can perform on old system to generate new configuration for preparing upgrading to new release:</span></div><div id="gmail-magicdomid187" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">    </span></div><div id="gmail-magicdomid208" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">                                            +--------------+</span></div><div id="gmail-magicdomid239" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">Old configuration  +-------->                  |</span></div><div id="gmail-magicdomid237" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z"> (N-1 release)                    |     Oslo      |</span></div><div id="gmail-magicdomid233" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">                                            |    Config    +-------> New configuration</span></div><div id="gmail-magicdomid241" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">      Namespaces  +-------->   Migrator |            (N release)</span></div><div id="gmail-magicdomid249" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">                                             |                  |</span></div><div id="gmail-magicdomid255" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">                                            +--------------+</span></div><div id="gmail-magicdomid264" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">                               Running on new environment</span></div><div id="gmail-magicdomid25" class="gmail-ace-line"><br></div><div id="gmail-magicdomid26" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">Since these specifications was validated, some patches was submitted by the Fujitsu team to implement them:</span></div><div id="gmail-magicdomid27" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z gmail-url"><a href="https://review.openstack.org/#/q/status:open+project:openstack/oslo.config+branch:master+topic:migrator">https://review.openstack.org/#/q/status:open+project:openstack/oslo.config+branch:master+topic:migrator</a></span></div><div id="gmail-magicdomid28" class="gmail-ace-line"><br></div><div id="gmail-magicdomid29" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">Details:</span></div><div id="gmail-magicdomid65" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">    - handle config mapping changes ( </span><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z gmail-url"><a href="https://review.openstack.org/526314">https://review.openstack.org/526314</a></span><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z"> )</span></div><div id="gmail-magicdomid64" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">    - update valid value in choice list for the opt ( </span><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z gmail-url"><a href="https://review.openstack.org/603060">https://review.openstack.org/603060</a></span><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z"> )</span></div><div id="gmail-magicdomid63" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">    - update 'sample_default' instead of 'default' when migrating ( </span><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z gmail-url"><a href="https://review.openstack.org/606211">https://review.openstack.org/606211</a></span><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z"> )</span></div><div id="gmail-magicdomid62" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">    - use difflib to report mismatches in migrator tests ( </span><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z gmail-url"><a href="https://review.openstack.org/606210">https://review.openstack.org/606210</a></span><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z"> )</span></div><div id="gmail-magicdomid81" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">    - replace loop with dictionary lookup ( </span><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z gmail-url"><a href="https://review.openstack.org/606209">https://review.openstack.org/606209</a></span><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z"> )</span></div><div id="gmail-magicdomid92" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">    - replace 'upgrade_value' with 'convert_on_upgrade' ( </span><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z gmail-url"><a href="https://review.openstack.org/606207">https://review.openstack.org/606207</a></span><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z"> )</span></div><div id="gmail-magicdomid37" class="gmail-ace-line"><br></div><div id="gmail-magicdomid1745" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">Since these changes was proposed some peoples from the Fujitsu seems to left the company and also seems to abandon this topic.</span></div><div id="gmail-magicdomid382" class="gmail-ace-line"><br></div><div id="gmail-magicdomid1750" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">During the last oslo meeting I had added this topic to the meeting agenda to bring up this topic and to help us to move forward on it.</span></div><div id="gmail-magicdomid537" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z gmail-url"><a href="http://eavesdrop.openstack.org/meetings/oslo/2018/oslo.2018-12-17-15.00.log.html">http://eavesdrop.openstack.org/meetings/oslo/2018/oslo.2018-12-17-15.00.log.html</a></span></div><div id="gmail-magicdomid539" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z gmail-url"><a href="http://lists.openstack.org/pipermail/openstack-discuss/2018-December/000856.html">http://lists.openstack.org/pipermail/openstack-discuss/2018-December/000856.html</a></span></div><div id="gmail-magicdomid540" class="gmail-ace-line"><br></div><div id="gmail-magicdomid1727" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">## Current state</span></div><div id="gmail-magicdomid559" class="gmail-ace-line"><br></div><div id="gmail-magicdomid42" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">Some reviews was validated but some others need to be recovered due to the</span></div><div id="gmail-magicdomid43" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">lack of response about the original authors.</span></div><div id="gmail-magicdomid562" class="gmail-ace-line"><br></div><div id="gmail-magicdomid1753" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">I've submit some patches on reviews to help us to move on it.</span></div><div id="gmail-magicdomid624" class="gmail-ace-line"><br></div><div id="gmail-magicdomid757" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">I've made some reviews based on the last comments and based on the asked changes but now we need someone with an deeply</span></div><div id="gmail-magicdomid792" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">knowledge on oslo.config to validate the works.</span></div><div id="gmail-magicdomid796" class="gmail-ace-line"><br></div><div id="gmail-magicdomid815" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">## Others aspects</span></div><div id="gmail-magicdomid817" class="gmail-ace-line"><br></div><div id="gmail-magicdomid1016" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">Some tools like puppet/ansible/chef etc... already in use in openstack can already handle migrators/upgrades and manage config changes.</span></div><div id="gmail-magicdomid944" class="gmail-ace-line"><br></div><div id="gmail-magicdomid1008" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">- Do we need to introduce an another tool like this one to do this job?</span></div><div id="gmail-magicdomid1106" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">- How many people are manually writing OpenStack configs in the first place?</span></div><div id="gmail-magicdomid1165" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">- Does it make sense to implement these changes?</span></div><div id="gmail-magicdomid1167" class="gmail-ace-line"><br></div><div id="gmail-magicdomid1755" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">## List of similar features on others projects</span></div><div id="gmail-magicdomid1230" class="gmail-ace-line"><br></div><div id="gmail-magicdomid1281" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">- Tripleo provide a major release upgrade mechanisme ( </span><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z gmail-url"><a href="https://docs.openstack.org/tripleo-docs/latest/upgrade/developer/upgrades/major_upgrade.html">https://docs.openstack.org/tripleo-docs/latest/upgrade/developer/upgrades/major_upgrade.html</a></span><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z"> )</span></div><div id="gmail-magicdomid1359" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">- Openstack-Ansible also provide release upgrade mechanisme ( </span><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z gmail-url"><a href="https://docs.openstack.org/openstack-ansible/latest/admin/upgrades/major-upgrades.html">https://docs.openstack.org/openstack-ansible/latest/admin/upgrades/major-upgrades.html</a></span><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z"> )</span></div><div id="gmail-magicdomid1448" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">- OpenStack fuel also propose specifications to upgrade configuration and release ( </span><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z gmail-url"><a href="https://specs.openstack.org/openstack/fuel-specs/specs/7.0/upgrade-major-openstack-environment.html">https://specs.openstack.org/openstack/fuel-specs/specs/7.0/upgrade-major-openstack-environment.html</a></span><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z"> )</span></div><div id="gmail-magicdomid1450" class="gmail-ace-line"><br></div><div id="gmail-magicdomid1563" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">This wiki can be useful to obtain the big picture of the release upgrade management in openstack ( </span><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z gmail-url"><a href="https://wiki.openstack.org/wiki/Upgrade-with-minimal-downtime">https://wiki.openstack.org/wiki/Upgrade-with-minimal-downtime</a></span><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z"> )</span></div><div id="gmail-magicdomid1565" class="gmail-ace-line"><br></div><div id="gmail-magicdomid1686" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">I surely forgot some tools and alternatives, if you see something that can be added here do not hesitate to reply to add it.</span></div><div id="gmail-magicdomid1286" class="gmail-ace-line"><br></div><div id="gmail-magicdomid1299" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">## Conclusion</span></div><div id="gmail-magicdomid1300" class="gmail-ace-line"><br></div><div id="gmail-magicdomid1806" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">I bring up this topic to open a debate so do not hesitate react on this topic by responding at this thread to help us to have a better big picture to make the best choice.</span></div><div id="gmail-magicdomid49" class="gmail-ace-line"><br></div><div id="gmail-magicdomid1807" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">Thanks folks.</span></div><div id="gmail-magicdomid1809" class="gmail-ace-line"><br></div><div id="gmail-magicdomid1821" class="gmail-ace-line"><span class="gmail-author-a-o0z122zo9qz74zz66zz69zz66zgdxz89zz75zz65z">Best regards.</span></div><div id="gmail-magicdomid51" class="gmail-ace-line"><br></div>-- <br><div dir="ltr" class="m_-2871579275694907873gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div>Hervé Beraud</div><div>Senior Software Engineer<br></div><div>Red Hat - Openstack Oslo</div><div>irc: hberaud</div><div>-----BEGIN PGP SIGNATURE-----<br><br>wsFcBAABCAAQBQJb4AwCCRAHwXRBNkGNegAALSkQAHrotwCiL3VMwDR0vcja10Q+<br>Kf31yCutl5bAlS7tOKpPQ9XN4oC0ZSThyNNFVrg8ail0SczHXsC4rOrsPblgGRN+<br>RQLoCm2eO1AkB0ubCYLaq0XqSaO+Uk81QxAPkyPCEGT6SRxXr2lhADK0T86kBnMP<br>F8RvGolu3EFjlqCVgeOZaR51PqwUlEhZXZuuNKrWZXg/oRiY4811GmnvzmUhgK5G<br>5+f8mUg74hfjDbR2VhjTeaLKp0PhskjOIKY3vqHXofLuaqFDD+WrAy/NgDGvN22g<br>glGfj472T3xyHnUzM8ILgAGSghfzZF5Skj2qEeci9cB6K3Hm3osj+PbvfsXE/7Kw<br>m/xtm+FjnaywZEv54uCmVIzQsRIm1qJscu20Qw6Q0UiPpDFqD7O6tWSRKdX11UTZ<br>hwVQTMh9AKQDBEh2W9nnFi9kzSSNu4OQ1dRMcYHWfd9BEkccezxHwUM4Xyov5Fe0<br>qnbfzTB1tYkjU78loMWFaLa00ftSxP/DtQ//iYVyfVNfcCwfDszXLOqlkvGmY1/Y<br>F1ON0ONekDZkGJsDoS6QdiUSn8RZ2mHArGEWMV00EV5DCIbCXRvywXV43ckx8Z+3<br>B8qUJhBqJ8RS2F+vTs3DTaXqcktgJ4UkhYC2c1gImcPRyGrK9VY0sCT+1iA+wp/O<br>v6rDpkeNksZ9fFSyoY2o<br>=ECSj<br>-----END PGP SIGNATURE-----<br><br></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div>