[release-announce] openstack-ansible 19.0.0 (stein)

We are chuffed to announce the release of: openstack-ansible 19.0.0: Ansible playbooks for deploying OpenStack This release is part of the stein release series. The source is available from: https://opendev.org/openstack/openstack-ansible Download the package from: https://tarballs.openstack.org/openstack-ansible/ Please report issues through: https://bugs.launchpad.net/openstack-ansible/+bugs For more details, please see below. 19.0.0 ^^^^^^ New Features ************ * The ceph_client role will now look for and configure manila services to work with ceph and cephfs. * The "os_masakari" role now covers the monitors installation and configuration, completing the full service configuration. * The override "rabbitmq_memory_high_watermark" can be used to set the maximum size of the erlang Virtual Machine before the garbage collection is triggered. The default is lowered to "0.2", from "0.4" as the garbage collection can require 2x of allocated amount during its operation. This can result in a equivalent use of "0.4", resulting in 40% of memory usage, visible to the rabbitMQ container. The original default setting of "0.4" can lead to 80% memory allocation of rabbitMQ, potentially leading to a scenario where the underlying Linux kernel is killing the process due to shortage of virtual memory. * Added 2 new varibles for all groups - *oslomsg_notify_policies* and *oslomsg_rpc_policies*. These variables contain default rabbitmq policies, which will be applied for every rabbitmq vhost. As for now they will enable [HA mode](https://www.rabbitmq.com/ha.html) for all vhosts. If you would like to disable HA mode just set these variables to empty lists inside your *user_config.yml* * The "galera_server" role now uses mariabackup in order to complete SST operations due to the fact that this is the recommended choice from MariaDB. * The "galera_server" role now ships with the latest MariaDB release of 10.3.13. Known Issues ************ * Due to a change in how backend_host is defined when using Ceph, all the Cinder volumes will restart under the same backend name. This will mean that any volumes which previously were assigned to the host or container that hosted the volume will no longer be managable. The workaround for this is to use the *cinder-manage volume update_host* command to move those volumes to the new backend host. This known issue will be resolved soon with an upgrade playbook. Upgrade Notes ************* * The rabbitMQ high watermark is set to "0.2" rather than "0.4" to prevent possible OOM situations, which limits the maximum memory usage by rabbitMQ to 40% rather than 80% of the memory visible to the rabbitMQ container. The override "rabbitmq_memory_high_watermark" can be used to alter the limit. * The default Mnesia "dump_log_write_threshold" value has changed to "300" instead of "100" for efficiency. "dump_log_write_threshold" specifies the maximum number of writes allowed to the transaction log before a new dump of the log is performed. Increasing this value can increase the performances during the queues/exchanges/bindings creation/destroying. The values should be between 100 and 1000. More detail [1]. [1] http://erlang.org/doc/man/mnesia.html#dump_log_write_threshold * The option *rabbitmq_disable_non_tls_listeners* has been removed in favor of setting the bind address and port configuration directly using a new option *rabbitmq_port_bindings*. This new option is a hash allowing for multiple bind addresses and port configurations. * The repo server no longer uses pypiserver, so it has been removed. Along with this, the following variables have also been removed. * "repo_pypiserver_port" * "repo_pypiserver_pip_packages" * "repo_pypiserver_package_path" * "repo_pypiserver_bin" * "repo_pypiserver_working_dir" * "repo_pypiserver_start_options" * "repo_pypiserver_init_overrides" * Tacker role now uses default systemd_service role. Due to this upstart is not supported anymore. Was added variable tacker_init_config_overrides, with wich deployer may override predifined options. Also variable program_override has no effect now, and tacker_service_names was removed in favor of tacker_service_name. Deprecation Notes ***************** * In the "ceph_client" role, the only valid values for "ceph_pkg_source" are now "ceph" and "distro". For Ubuntu, the Ubuntu Cloud Archive apt source is already setup by the "openstack_hosts" role, so there is no need for it to also be setup by the "ceph_client" role. * The compression option in the "galera_server" role has been removed due to the fact that it is not recommended by MariaDB anymore. This means that all the dependencies from Percona such as QPress are no longer necessary. * The following variables have been removed because they are no longer used. * "galera_percona_xtrabackup_repo" * "use_percona_upstream" * "galera_xtrabackup_compression" * "galera_server_percona_distro_packages" * The variable "galera_xtrabackup_threads" has been renamed to "galera_mariabackup_threads" to reflect the change in the SST provider. Bug Fixes ********* * ceilometer-polling services running on compute nodes did not have the polling namespace configured. Because of this they used the default value of running all pollsters from the central and compute namespaces. But the pollsters from the central namespace don't have to run on every compute node. This is fixed by only running the compute pollsters on compute nodes. * The RyuBgpDriver is no longer available and replaced by the OsKenBgpDriver of the neutron_dynamic_routing project. Changes in openstack-ansible 18.0.0.0rc1..19.0.0 ------------------------------------------------ 406d93359 Bump SHAs for stable/stein 24728a69a Restrict the number of octavia processes and threads in AIO 97e9ac1f2 Bump SHAs for stable/stein 6b9f13086 Bump SHAs for stable/stein 98093fe00 Bump SHAs for stable/stein a64fb127e Revert "Set CentOS 7 distro job to non-voting" 48f2f68dc Bootstrap host using stein RDO mirror in CI f051e434d Load extra variables correctly in wrapper 0d23f7b74 rgw keystone setup fix python interpreter bb6a1d592 Bump SHAs for stable/stein 8505173f6 Revert "Pin ARA to <1.0.0" ec9baa445 Move hosts file management toggle to all group vars b4cbd2e76 Utility container venv is missing python libs for ansible openstack modules 2e9bd836f Correct os-cinder-install task serialisation 8cb8b2de6 Use stable ARA setup interface for defining the callback location dd412f707 Pin ARA to <1.0.0 d094ebbbc Bump os_neutron SHA to pull in fixed Calico 34dad039f Fix mistral metal deploy 65f1e3e2f config: Enable OSA_CONFIG_DIR to customize configuration folder c052ba794 Bump tempest role SHA to pull in ping test fix ee5ce224c Bump SHAs for stable/stein c18affdcd Collect openstack_deploy in gate log collection script 856a6acfe Add Calico networking AIO scenario 273a4e964 Use copy-links when collecting logs a00f835a8 Prepare OSA release for Stein 0398f8f82 Add /v2 to mistral api endpoint. 5b92d28ae Fix Fwaas Dashboard URL d896ff202 Use hashes for the upgrade playbook markers b1b016436 Bump global-requirement-pins before release 9ea2e687b Make utility install playbook idempotent c0332f050 Re-add the upgrade playbook removing pip.conf 6fdb90574 Ensure that pip/setuptools/wheel python wheels are built c87d88ce3 Replace git.openstack.org with opendev.org af63d20ae Use opendev links 8024dc873 Set CentOS 7 distro job to non-voting 1d4dc430e Skip boostrap-ansible on upgrades if already run 03405f8f7 Ensure that global-requirement-pins.txt is applied ed6eb528d Create Stein 6c250c303 Add global HA policy for rabbitmq cb7524f12 OpenDev Migration Patch 0653935d9 Update Stein doc index 4171f605b debian: add job template for aio-lxc 45000f230 Rename flat-db network for trove bca5d12ea Add trove_service_net_setup to aio deploy 8b9e11f56 Ensure debian is part of the bootstrap os list e39e1d260 debian: add job template for telemetry bb0aae3da debian: add support cb17ed57e Add masakari-monitors to openstack_services 74728caec Update .gitreview for stable/stein 7941d9e79 Remove subprocess call 86f85545b Update UPPER_CONSTRAINTS_FILE for stable/stein 1cbaa1d2a gate: drop sphinxmark 33c4f9df3 Use non-broken commit for NoVNC 6520d0bb2 glance: stop using healthcheck endpoint 7a17a6b51 Add trackbranch for manila a9bd6cbf1 octavia: use br-lbaas IP for health managers 9f1eb3993 rally: add empty rally.yml.aio file 90ce23ec1 gate: cache /etc/pip.conf inside containers 14bfceb56 Track Stein when we can de92efc0f Add the manila service to OSA aad13b822 Add telemetry service bundle to AIO tests 48266cefb Add panko to integrated build b1f0ba926 metal: sync all containers to add is_metal c0db5c423 repo: stop using repo_build + pip_install c4577ab8e gate: switch all public URLs to use HTTP for metal 529f9c295 zuul: bump timeout to 3 hours cb43e60d2 barbican: run without SSL inside gate for metal jobs 574e550a1 swift: move to br-storage always 27ae5dbb7 ironic: deploy swift at the same time 566d7e48c Remove experimetal scenarios e2ffd245a Add zero-container AIO distro install jobs 1f1cca42c nova: refactor common playbook to use role instead of include_role c69080f38 Extend AIO build timeout to 2.5hrs 5eb7d01f1 Update the congress service egg name to openstack_congress d531895e8 Imported Translations from Zanata 4f9e923ee Added Openstack Masakari role for the deployment 5cc756644 Include package pins for OpenStack services 3b160216a Bump SHAs for master 9ef40798e Run a periodic openSUSE Leap 15 job 518619ad0 Remove openSUSE Leap 42.3 jobs 05ca340d8 Add track branch to master 8dad0ddc0 Replace usage of netloc filters to urlsplit ac28ad132 Automatically prune the inventory backup 08be5b267 Update ansible to 2.7.9 9fd0fdc77 Change docs build to openstackdocstheme logic ff31b374d Imported Translations from Zanata 524146d1a Imported Translations from Zanata 6f87d74b9 Imported Translations from Zanata fb4df180e Pass ceph_mons as a list of inventory hosts 21a660194 Fix connectivity between octavia and amphorae. 475d45473 Fix bashate b790a6344 Add blank line to end of log-collect.sh to fix lint check 7a1d76e20 Revert "Freeze for milestone release" d626d6456 Bump SHAs for master 84cb3ff05 Freeze for milestone release 35777b93e Add qdrouterd role for rpc messaging backend deployment 2b17af753 Port role test log collection into the integrated gate 5b9b6d4b7 Add support to deploy mistral 934f73ad3 Convert the nova playbook to use newer ansible syntax 817c95fda nova: restart instead of reloading services 1930244bd Set tempest_image_dir to /opt/cache/files in openstack CI cf4a3d96c Fix keepalive pingable_check_script d4e3e0e08 Apply the OpenStack policies in rabbit by default 0abb9e3bc Enable the tempest role ping test for AIO testing 65b1f90a9 Adding Note on SELinux for CentOS 7 c73091967 Add http proxy test scenario fdcde0dbb Update ansible to the latest stable release d9c69b872 Remove broken conditions when including playbooks 662181646 Convert include to either import_playbook or include_tasks c5260b4d5 Remove all uses of private in include_role cd45e710d add links to readme for release announce script 3c7005360 Add a known issue release note regarding inotify watch limits 71a067abf Dynamic inventory backup corruption fix 2fd7e4c7f Include package pins for glance playbook a30ce4784 Use runtime venv to determine OSA version 1858cf50b Add the deployment guide job to our standard templates d63b5610e Correct the quickstart docs for ubuntu AIO installation 9229315a1 Add option to disable container builds on specific hosts 3621ce76b Update the heat service egg name to openstack_heat 0ee07525e Use the config_template module from the dedicated repo 7e0d2e5e5 Use an env lookup to determine the OSA version c44fbcbbe Mark OSA version in the wrapper script df43c5119 [docs] Apply provider network config on per-group basis b6f7fa6c7 Remove an extra comment about Tempest settings 6f0a218ef Fix typo btrfs -> zfs 826a032a8 Bump SHAs for master e7f116234 Add release note for wrapper fix bae0da54a nspawn: use correct network range for tempest 52f37cdac nspawn: use mv-flat for host_bind_overrides 270955fe0 nspawn: fix restart-service.yml service list filtering 8de5d35d2 nspawn: add container_network config f91b88078 Make keepalived configuration future-proof ecdd3822b Define OSA clone dir in the openstack-ansible.sh script 72a87f674 Remove ANSIBLE_ROLE_FETCH_MODE 09f6b6d29 Bump SHAs for master c10a92a02 Imported Translations from Zanata 1c8448aab Add documentation for hybrid messaging configuration fd04ab82d Fix journal remote playbook 3fb15ad78 Clean-up and simplify the major upgrade 3289f62e7 Some small spelling fixes 8d9c0336e Make container_interface optional for provider network e2267e82f Remove tempest service enable vars cc58bfe34 Use yaml instead of parsing the text acf9be557 Bump pins e28433fca Spice console doesn't work on aarch64+kvm. 40f332ec8 Make OVN track master branch 8f088db5d Update inventory generator to support container gateway override 09569c30f Fixes empty metal_query c2b42d75b zuul: Add required project openstack/openstack-ansible dcf448ec8 Call ceph-facts role as required by changes to ceph-ansible 66316a0cf Update hacking version to latest bc17087ac Imported Translations from Zanata 5e11cf3b7 Imported Translations from Zanata 862b4c667 Update ansible to 2.7.5 05d9f6a03 Force force-tlsv12 only 38b61e102 Ensure that control plane hosts are also updated correctly 74fc795ea Remove the log container in the AIO config 9e6c9e2bf Refactor ceph server playbooks ab0b3abb7 Zuul: Simplify the integrated test playbooks cf69f701e netstat does not exist in all systems 2fc7aac54 [DOCS] Fix user guide to source admin openrc 8c8e21a5a Only enable OVN VIPs when ml2.ovn plugin is used ed9a605a5 Imported Translations from Zanata 879d58f86 Remove xenial from Vagrantfile ae34c2218 Add bionic to Vagrantfile 64bf985a3 Fix ansible deprecation warnings c16dcb07e Add retries for utility container distro package installs a524ec1f8 Update ansible to 2.7.4 92427a653 Fix "configure container (other services)" when statement e29bc2203 Document how to use the utility container for service setup 5b6fc9c42 bootstrap: stop creating swap d6ca5af79 Set Keepalived script_user to root ada265c84 Implement AIO changes to allow test usage by roles 9dbdf71de Include Swift AUTH_%(tenant_id)s suffix in rgw Keystone endpoint 5a6ade7eb Fix Chinese quotes 11a71e113 Ensure that a consistent mirror is used for RDO 0b2b7c99a Update doc to use chrony instead of ntp 8fdcd5fd5 Add os_octavia to the list in the deploy guide 9ef46ba5e Adds haproxy endpoints for networking-ovn support 4195f032a Update ansible to 2.7.2 ae5541f17 Use discuss ML instead of dev/operators 6ed6eaabd Update playbook to newer syntax. 56b3bd1e2 [docs] Clean up the AIO user story 74bebf5d5 Ensure AIO container_tech/install_method vars are namespaced 6bd8ee085 nspawn: correct task names e55960fe3 Remove unnecessary octavia scenario AIO bootstrap 28f71196c Add MariaDB infrastructure mirrors 9b1a9f587 Added masakari-dashboard repo to openstack_services 822127e9d [trivial] Point to the new openstack-discuss ML 9380222d1 Remove the repetition words in firewalls.rst 93831a609 Move ARA install to end of bootstrap 54fb1055e Publish readable journal files in the gate 40812a7e4 Track a stable branch, not master, for ceph-ansible 80c7c23a6 Add extra volume types to AIO cd0c3ab46 Imported Translations from Zanata f87466638 Fix blazar-nova Git field names 8fbd1cbea Adds option to enable ARA plugin install aec4b9a88 Remove Dragonflow ML2 driver 878d758ea Update ansible to 2.7.1 802fb4649 Delegate check of db connectivity during upgrade 329cdbde9 Update master index with current series status 93ce5fa10 Pin argparse for idempotent pip installs a7875b042 Add new tox doc and publishing job a6d8c79be Docs: Fix VLAN bridge interface in example setup a960e83a6 SUSE: Add support for openSUSE Leap 15 7c8c31fd3 RGW haproxy backend return code can be 200 or 405 fa662ca09 [tools] build-docs.sh: matches po files in Zanata c1e9a5f90 Restart cinder-scheduler instead of reloading df54583ca Integrate Blazar with OpenStack Ansible 93affdca7 Aodh group vars has wrong admin and internal endpoint url ed3a00954 Upgrade ceph to mimic release 406078fdd Use file module instead of shell to remove roles 0e245655e Imported Translations from Zanata d9f210952 Restore OpenSUSE voting jobs 6e00f579c Update ansible to latest stable 2.6.x 1fd9fdc6d Set an upper pin for Cython to please gnocchi 953938a29 Make system_crontab_coordination idempotent fefb377f2 zuul: SUSE: Fix scenario for ceph jobs 829d3f5f0 Use loop_var name in when clause 9f6bf94d1 Fixed ability of usage interfaces/bridges with dots (aliases) 47afa27bf Restore bionic/ceph voting jobs 2c09adcfa Ensure ceph server apt pinning is well defined 5e233dea5 Fix rgw playbook pre_tasks c3d326226 releasenotes: oslo-messaging-separate-backends add project name 340853170 fix typo in releasenotes 6716cc5dc Add one test case to the TestMergeDictUnit for same key dict merge 8d25033f7 Use the compute kit + horizon for all distros 3200de090 Fix healthcheck-hosts to work when behind a proxy a9c72408b scripts: sources-branch-updater: Make regexp for master branch stricter 8f54cd1cb Restore Bionic jobs to voting 9f7802219 Imported Translations from Zanata 208513dfa Fix for proper package name depending on base OS distribution 2792b1d9e Add stackviz directory to the list of find_log_files 180001718 Update variable migration script for Stein 49a1d8666 Fix order for restarts 138fdef0a Build translated docs in tox 43a5c874e Remove apt-cacher-ng e1aabd05b Disable nested virt and set SUSE+Bionic jobs to non-voting 42a06f1dd [trivial] docs: fix sphinx warnings unknown options 3e458a8ef Imported Translations from Zanata fefb0822e Example setup for gnocchi with ceph and redis d90e74350 Add openstackclient bash completion 0ac819c00 Add ceph-handler role b76f098c0 Imported Translations from Zanata a45467abe Remove keystone_admin-back load balancer manipulation 8440e3816 Remove glance CORS overrides ef4360488 Unfreeze networking-odl 889e05990 Remove broken uptime tests during upgrade 41d7c63d2 Fix identification of OpenSUSE Leap 15 ce26ee644 Imported Translations from Zanata 67f0790b5 Imported Translations from Zanata 63f5d0e4f Avoid using loop_var in endpoint manage c31826087 Ensure ceilometer repo gets installed with neutron cec52b199 fix tox python3 overrides 13c405da7 Change into correct path 9553e89e6 Remove non-working dynamic build of AIO scenario table e1a7ab847 Move dynamic documentation into extra directory (2/2) 86fa326a0 Move dynamic documentation into extra directory (1/2) 4a07e2612 Minimal(ist) network config for nspawn gating 9d10db61d Ensure package cache is updated for nspawn containers bfcb44aac Add xinetd config to make an AIO survive a reboot b35949b30 Move ara to scripts-library 1e8ba763e Add nspawn to experimental jobs 7af917268 ignore files on translation job 11e601fa8 Revert "Add lxc3 compatibility" d71db06bf Add LXC COPR cache e8621387b Remove obsolete instruction 6e3e63c0b playbooks: healthcheck-infrastructure: Ensure netcat is installed 8bd064eb7 Update the outdated URL 2bc1ca0c8 Bootstrap ansible virtualenv with --never-download a9d422151 Move bionic jobs to voting, add release note. 6e8904062 Update docs & upgrade scripts for Stein 1062bb7f0 Update documentation index to include Rocky b95c0e1e2 Use a common python build/install role 77f550607 Allow openstack healthcheck and tempest to co-exist c5dbad487 Gather facts for host healthcheck cd667c588 Fix issues with infrastructure healthcheck 1c6e80974 Remove molteniron playbook mistakenly left behind 528a163ec docs: Add links to very useful Galera recovery docs 24bd4a781 Update ansible to 2.5.8 69cf1a56e scripts: Fix getting external role SHA when working on master 41fc67502 [DOC] fix some typos and fix some stuff ec5cda3dc zuul: Add ceph jobs for distribution installations ac8e91733 ansible-role-requirements: Unpin ceph-ansible role fb5a5cff7 Bind mount glance cache directory 59275230d Track master branch for tempest 1297b96a6 Update VNC path to correct one 87296d112 Enable CentOS 7 basekit jobs cad69ee25 Add missing congress_oslomsg_rpc_password d65906c48 Add aio host conf for barbican role 2a288e1b1 Make sure the branch to track is in YAML 4383ae312 Add pinned SHA for networking-ovn repo 7d061c7d2 Refactor jobs to use project-templates 703da30ed Disable verbose output of log collection 348e406d9 Fix nspawn bind mount register process c194535fd Remove bonds from AIO network config 50712078a switch documentation job to new PTI 066a5c0c1 import zuul job settings from project-config 4b0f18d87 Add test for Ubuntu Bionic 420df0153 Ensure that tests fail early if network interfaces are down 7f8ee6d2f Gather facts for openstack_openrc role af0f439ec Provides group_names for use with provider_network plugin fffc8d476 Introduce OpenStack Healthchecks 2daeba940 Remove the last remnants of get-pip.py 829b7940b Use operating system specific IP utilities 2d96bff9a Remove un-used bootstrap variables 80dfbe783 Temporarily use tempest master for all builds and fix configs 1c260fa63 Remove the duplicated word ee4344409 Use the TESTING_BRANCH env var for constraints b7b18f405 Change AIO ZFS pool to be at /pool 440c87a80 Add lxc3 compatibility e7e732818 Imported Translations from Zanata dc421891f Prepare master branch for M1 cb8230048 Update reno for stable/rocky 191e0b866 Eliminate installing pip on host/containers dc0788dab AIO: Tune down the glance uwsgi processes db7d6d440 AIO: Tune the nova scheduler workers down 8d92c1339 Bump OpenStack versions dd976c878 Add networkd prefix when creating networks 677357dd7 How to configure Telemetry for radosgw 089e1d0af Add octavia_service_region to octavia_all vars Diffstat (except docs and test files) ------------------------------------- .gitignore | 9 +- .gitreview | 4 +- README.rst | 23 +- Vagrantfile | 21 +- ansible-role-requirements.yml | 288 +- bindep.txt | 4 +- deploy-guide/source/conf.py | 22 +- deploy-guide/source/configure.rst | 16 +- deploy-guide/source/deploymenthost.rst | 5 +- deploy-guide/source/overview-requirements.rst | 2 +- deploy-guide/source/targethosts-prepare.rst | 31 +- deploy-guide/source/verify-operation.rst | 6 + .../admin/maintenance-tasks/ansible-modules.rst | 4 +- .../openstack-operations/managing-networks.rst | 4 +- .../upgrades/major-upgrades-manual-upgrade.rst | 263 -- .../admin/upgrades/major-upgrades-with-script.rst | 29 - .../{minor-updates.rst => minor-upgrades.rst} | 0 .../locale/de/LC_MESSAGES/doc-contributor.po | 2827 ++++++++++++++ .../architecture/container-networking.rst | 15 + .../reference/configuration/extending-osa.rst | 2 +- .../figures/networking-compute-nobridge.png | Bin 0 -> 186291 bytes .../figures/networking-neutronagents-nobridge.png | Bin 0 -> 221607 bytes .../reference/upgrades/reference-scripts.rst | 45 - .../upgrades/reference-upgrade-playbooks.rst | 101 - .../figures/arch-layout-provnet-groups-custom.png | Bin 0 -> 317164 bytes .../user/figures/arch-layout-provnet-groups.png | Bin 0 -> 253248 bytes .../user/figures/network-arch-multiple-bonds.png | Bin 0 -> 369583 bytes .../figures/network-arch-multiple-interfaces.png | Bin 0 -> 277647 bytes .../user/figures/network-arch-single-bond.png | Bin 0 -> 331757 bytes .../user/figures/network-arch-single-interface.png | Bin 0 -> 272200 bytes .../openstack_interface.cfg.multibond.example | 137 + .../openstack_interface.cfg.singlebond.example | 124 + .../openstack_interface.cfg.test.example | 2 +- etc/openstack_deploy/conf.d/barbican.yml.aio | 4 + etc/openstack_deploy/conf.d/blazar.yml.aio | 4 + etc/openstack_deploy/conf.d/cinder.yml.aio | 27 + etc/openstack_deploy/conf.d/etcd.yml.aio | 4 + .../conf.d/{etcd.conf.example => etcd.yml.example} | 0 etc/openstack_deploy/conf.d/manila.yml.aio | 7 + etc/openstack_deploy/conf.d/manila.yml.example | 16 + etc/openstack_deploy/conf.d/masakari.yml.aio | 4 + etc/openstack_deploy/conf.d/masakari.yml.example | 9 + etc/openstack_deploy/conf.d/mistral.yml.aio | 3 + etc/openstack_deploy/conf.d/mistral.yml.example | 8 + etc/openstack_deploy/conf.d/panko.yml.aio | 3 + etc/openstack_deploy/conf.d/panko.yml.example | 8 + etc/openstack_deploy/conf.d/qdrouterd.yml.aio | 3 + etc/openstack_deploy/conf.d/rally.yml.aio | 5 + etc/openstack_deploy/conf.d/swift.yml.aio | 4 +- etc/openstack_deploy/env.d/aio_metal.yml.example | 53 +- .../openstack_deploy/env.d/calico.yml.example | 27 +- etc/openstack_deploy/openstack_user_config.yml.aio | 2 +- .../openstack_user_config.yml.aio-nspawn.j2 | 140 + .../openstack_user_config.yml.aio.j2 | 33 +- .../openstack_user_config.yml.example | 82 +- .../openstack_user_config.yml.multibond.example | 313 ++ ...openstack_user_config.yml.provnet-group.example | 351 ++ .../openstack_user_config.yml.singlebond.example | 313 ++ etc/openstack_deploy/user_secrets.yml | 41 + etc/openstack_deploy/user_variables.yml | 12 + global-requirement-pins.txt | 21 +- inventory/dynamic_inventory.py | 2 +- inventory/env.d/blazar.yml | 39 + inventory/env.d/manila.yml | 57 + inventory/env.d/masakari.yml | 54 + inventory/env.d/mistral.yml | 46 + inventory/env.d/neutron.yml | 2 - inventory/env.d/panko.yml | 36 + .../env.d/qdrouterd.yml | 34 +- inventory/group_vars/all/all.yml | 17 +- inventory/group_vars/all/ceph-rgw.yml | 6 +- inventory/group_vars/all/ceph.yml | 13 +- inventory/group_vars/all/glance.yml | 14 - inventory/group_vars/all/infra.yml | 17 + inventory/group_vars/all/oslo-messaging.yml | 14 +- .../group_vars/all/panko.yml | 7 +- inventory/group_vars/all/ssl.yml | 2 +- inventory/group_vars/aodh_all.yml | 8 +- inventory/group_vars/barbican_all.yml | 4 - .../group_vars/{all/pip.yml => blazar_all.yml} | 11 +- inventory/group_vars/ceilometer_all.yml | 4 - inventory/group_vars/ceph-rgw.yml | 4 +- inventory/group_vars/cinder_all.yml | 4 - inventory/group_vars/congress_all.yml | 4 - inventory/group_vars/designate_all.yml | 4 - inventory/group_vars/glance_all.yml | 6 +- inventory/group_vars/gnocchi_all.yml | 4 - inventory/group_vars/haproxy/haproxy.yml | 91 +- inventory/group_vars/haproxy/keepalived.yml | 11 +- inventory/group_vars/heat_all.yml | 4 - inventory/group_vars/horizon_all.yml | 6 +- inventory/group_vars/hosts.yml | 3 - inventory/group_vars/ironic_all.yml | 4 - inventory/group_vars/keystone_all.yml | 4 - inventory/group_vars/magnum_all.yml | 4 - inventory/group_vars/manila_all.yml | 33 + inventory/group_vars/mistral_all.yml | 25 + inventory/group_vars/neutron_all.yml | 4 - inventory/group_vars/nova_all.yml | 7 +- inventory/group_vars/octavia_all.yml | 5 +- inventory/group_vars/panko_all.yml | 24 + inventory/group_vars/rabbitmq_all.yml | 1 + inventory/group_vars/repo_all.yml | 60 +- inventory/group_vars/sahara_all.yml | 4 - inventory/group_vars/swift_all.yml | 4 - inventory/group_vars/tacker_all.yml | 4 - inventory/group_vars/trove_all.yml | 4 - inventory/group_vars/utility_all.yml | 29 +- inventory/inventory.ini | 37 + osa_toolkit/filesystem.py | 22 +- osa_toolkit/generate.py | 29 +- playbooks/ceph-install.yml | 134 +- playbooks/ceph-rgw-install.yml | 21 +- playbooks/ceph-rgw-keystone-setup.yml | 153 +- playbooks/common-playbooks/cinder.yml | 22 +- playbooks/common-playbooks/glance.yml | 16 +- playbooks/common-playbooks/neutron.yml | 16 +- playbooks/common-playbooks/nova.yml | 63 +- playbooks/common-tasks/ceph-server.yml | 84 + playbooks/common-tasks/dynamic-address-fact.yml | 2 +- playbooks/common-tasks/haproxy-endpoint-manage.yml | 4 +- playbooks/common-tasks/os-lxc-container-setup.yml | 8 +- .../common-tasks/os-nspawn-container-setup.yml | 9 +- playbooks/common-tasks/package-cache-proxy.yml | 48 +- playbooks/common-tasks/restart-service.yml | 2 +- playbooks/common-tasks/rsyslog-client.yml | 1 - playbooks/common-tasks/set-pip-vars.yml | 111 - playbooks/containers-deploy.yml | 8 +- playbooks/containers-lxc-create.yml | 4 +- playbooks/containers-lxc-host.yml | 2 - playbooks/containers-nspawn-create.yml | 77 +- playbooks/defaults/distro_install.yml | 6 - playbooks/defaults/healthchecks-vars.yml | 107 + playbooks/defaults/repo_packages/gnocchi.yml | 3 +- playbooks/defaults/repo_packages/nova_consoles.yml | 10 +- .../defaults/repo_packages/openstack_services.yml | 272 +- playbooks/defaults/source_install.yml | 29 +- playbooks/etcd-install.yml | 6 +- playbooks/galera-install.yml | 10 +- playbooks/haproxy-install.yml | 8 +- playbooks/healthcheck-hosts.yml | 7 +- playbooks/healthcheck-infrastructure.yml | 45 +- playbooks/healthcheck-openstack.yml | 552 +++ playbooks/infra-journal-remote.yml | 48 +- playbooks/memcached-install.yml | 8 +- playbooks/openstack-hosts-setup.yml | 12 +- playbooks/os-aodh-install.yml | 9 +- playbooks/os-barbican-install.yml | 9 +- playbooks/os-blazar-install.yml | 56 + playbooks/os-ceilometer-install.yml | 9 +- playbooks/os-cinder-install.yml | 12 +- playbooks/os-congress-install.yml | 11 +- playbooks/os-designate-install.yml | 9 +- playbooks/os-gnocchi-install.yml | 19 +- playbooks/os-heat-install.yml | 8 +- playbooks/os-horizon-install.yml | 9 +- playbooks/os-ironic-install.yml | 7 +- playbooks/os-keystone-install.yml | 43 +- playbooks/os-magnum-install.yml | 9 +- playbooks/os-manila-install.yml | 89 + playbooks/os-masakari-install.yml | 70 + playbooks/os-mistral-install.yml | 56 + playbooks/os-molteniron-install.yml | 56 - playbooks/os-nova-install.yml | 23 +- playbooks/os-octavia-install.yml | 9 +- playbooks/os-panko-install.yml | 42 + playbooks/os-rally-install.yml | 4 +- playbooks/os-sahara-install.yml | 9 +- playbooks/os-swift-install.yml | 9 +- playbooks/os-swift-sync.yml | 1 + playbooks/os-tacker-install.yml | 6 +- playbooks/os-tempest-install.yml | 7 + playbooks/os-trove-install.yml | 9 +- playbooks/qdrouterd-install.yml | 53 + playbooks/rabbitmq-install.yml | 6 +- playbooks/repo-build.yml | 86 - playbooks/repo-install.yml | 50 +- playbooks/repo-server.yml | 73 - playbooks/repo-use.yml | 33 - .../templates/crontab.j2 | 2 +- playbooks/rsyslog-install.yml | 6 +- playbooks/setup-everything.yml | 6 +- playbooks/setup-hosts.yml | 6 +- playbooks/setup-infrastructure.yml | 29 +- playbooks/setup-openstack.yml | 57 +- playbooks/unbound-install.yml | 8 +- playbooks/utility-install.yml | 106 +- .../notes/add-bionic-support-999217a9f7f213cc.yaml | 13 + .../notes/add-cors-config-6326223fe7fa7423.yaml | 5 + ...-manila-dashboard-support-4fcddedffb83bc28.yaml | 5 + .../add-masakari-to-repo-40cce14de6f39670.yaml | 5 + .../add-mistral-to-repo-deddfe1034291765.yaml | 5 + .../notes/add-nested-virt-1db2270e73d1b34.yaml | 7 + .../notes/add-nfs-support-5aacc81dbf3c2270.yaml | 5 + .../notes/add-random-devices-38671b23cb1319b8.yaml | 2 +- .../add-support-for-distro-89611067ce74fc2c.yaml | 11 + .../aodh-service-setup-host-d28f6974160fd939.yaml | 17 + .../backup-driver-rename-ca4424a0814ee8af.yaml | 12 + ...rbican-service-setup-host-a5da4ed51d164fb5.yaml | 17 + .../notes/blacklist-format-26c6097cf4e813c9.yaml | 12 + .../blazar-horizon-panel-d5ba19273b21d7aa.yaml | 9 + ...ometer-service-setup-host-18179a1f9b71fb14.yaml | 25 + .../ceph-backend-host-change-968edfbc15b59b0a.yaml | 9 + .../ceph-pkg-src-remove-uca-4ef147673821ed9b.yaml | 7 + .../ceph-rgw-swift-account-93350d92f0f33b20.yaml | 30 + ...hrony-ntp-server-defaults-7cd2e3a80723e0bd.yaml | 6 + ...chrony-ntp-server-options-f8f87225a5282e1a.yaml | 4 + .../notes/chrony-rtc-sync-f46b9a526aec0889.yaml | 4 + ...cinder-service-setup-host-712ca5e7b7b9d578.yaml | 17 + .../cloudkitty-horizon-panel-c3b616273b21d7aa.yaml | 9 + .../config-template-move-a0f08aff8e54f62f.yaml | 7 + ...gurable-scheduler-filters-17ea2ed9d4aa0708.yaml | 25 + ...figure-polling-namespaces-226573c37a44b5a6.yaml | 8 + .../custom-pip-package-add-4c17638c6e5b3373.yaml | 6 + .../notes/default-lxd-pool-1aa179bd77868cb0.yaml | 11 + ...e-ansible-role-fetch-mode-281d9fcb7389e163.yaml | 9 + .../deprecated-iscsi_helper-98fd2aebfd72fdf6.yaml | 5 + .../designate-1604-support-d397681dd302eda9.yaml | 1 + ...ignate-service-setup-host-78466665a752dadd.yaml | 17 + releasenotes/notes/diffmode-e8f9a041f662a2ef.yaml | 6 + .../disable-compression-e4074dcef9f85c36.yaml | 15 + .../notes/dragonflow-removed-6285225b5525cd50.yaml | 6 + .../notes/drop-custom-themes-724c40e5cd69b8e2.yaml | 10 + ...nable-tempestconf-support-0bd13c8393c9450b.yaml | 9 + ...agent-ha-keepalive-helper-5f1f82c437c8a430.yaml | 3 + releasenotes/notes/fix_quota-e3d4bf0b896dc393.yaml | 12 + .../fixes_sec_grp_rule_quota-2755da6c2c2ab434.yaml | 8 + .../galera-client-gpg-keys-8b674cee476885d0.yaml | 12 + .../notes/galera-gpg-keys-96ed45fd1ec4cb14.yaml | 12 + .../notes/get-nested-removed-779b8d2648d2e8b4.yaml | 5 + .../notes/glance-cache-4d5f8036c5e8f5b1.yaml | 11 + ...glance-service-setup-host-b0e71be408de074b.yaml | 17 + ...nocchi-service-setup-host-ef418b0e709ae796.yaml | 17 + .../heat-service-setup-host-e15eb9aa40414697.yaml | 17 + ...orizon-service-setup-host-9728b772d2514dd9.yaml | 17 + .../http-access-horizon-94c27a0aadb9f1b4.yaml | 22 + .../notes/inotify-exhaustion-77f7ecab13358c4c.yaml | 16 + .../notes/install-local-019edab04ffc8347.yaml | 2 +- ...ironic-service-setup-host-658842e1875ea7bf.yaml | 17 + .../notes/journal-log-ccba504642b49612.yaml | 5 + .../notes/journal-log-ccbb504642b49611.yaml | 9 + .../notes/journal-log-ccbb504642b49614.yaml | 5 + .../notes/journal-log-cwbr504hd9b59612.yaml | 5 + .../notes/journal-log-cwbr789hd9b59612.yaml | 5 + .../notes/journal-log-cxcb512642b49617.yaml | 9 + .../notes/journal-log-xcba504642b49619.yaml | 6 + .../notes/journal-log-ycba504642b47619.yaml | 5 + ...one-init-config-overrides-1857d5e5bc5a905f.yaml | 2 +- ...ystone-service-setup-host-cd3ee3346af823e6.yaml | 17 + ...tworking-convert-networkd-5b514e604df7c429.yaml | 2 +- ...encrypt-ssl-certification-129a80cb88d8e6ff.yaml | 10 + ...t-inventory-backkups.yaml-c96577e9de284cf2.yaml | 7 + .../lxc-host-machine-vars-5d11b1f269167fd3.yaml | 15 + ...magnum-service-setup-host-ea285f161e625980.yaml | 22 + releasenotes/notes/manila-63e49e98c888385d.yaml | 4 + .../masakari-horizon-panel-c058881e1268b3b7.yaml | 9 + ...ari_monitors_installation-bbed280cbed6fd49.yaml | 5 + .../notes/mysqlcheck-options-60fae226d8d4f3ca.yaml | 8 + ...-opendaylight-sfc-support-8b249b8f8efbc087.yaml | 29 + ...tron-opendaylight-support-453dc9324eafaae7.yaml | 2 +- ...on-ovs-interface-mappings-789902128b82e721.yaml | 22 + ...eutron-service-setup-host-895ececec99d7a51.yaml | 17 + .../notes/neutron-sriov-50c0099554574d01.yaml | 2 +- .../neutron-vpnaas-dashboard-19f4ef09faae1f70.yaml | 9 + ...bgp_speaker_driver-update-789404b846221290.yaml | 5 + ...tmq_memory_high_watermark-1d12effe59153605.yaml | 19 + .../no_containers_option-39034d48825e8966.yaml | 18 + .../notes/nova-cpu-model-006da20048168842.yaml | 18 + ...ova-init-config-overrides-ffce7e419061c4da.yaml | 2 +- .../nova-service-setup-host-f62d2eaede77d23c.yaml | 17 + ...ctavia-service-setup-host-d57533fdea394394.yaml | 25 + ...ack-distribution-packages-bbec587237b8bc80.yaml | 7 + ...ack-distribution-packages-f5d3174b96fc2372.yaml | 7 + ...ack-distribution-packages-fcb6220fdeb3668c.yaml | 7 + ...stone-remove-service-user-f2100fa3127c7c2e.yaml | 7 + ...inder-private-volume-type-9b2cc92c6c74c277.yaml | 5 + .../osa-wrapper-path-fix-91e8c56b72c968b0.yaml | 12 + .../oslo-messaging-backends-65287400dba86fce.yaml | 21 + ...ssaging-separate-backends-06a1b30ffb228f22.yaml | 3 +- ...ssaging-separate-backends-1fbdb77e93e29542.yaml | 3 +- ...ssaging-separate-backends-3b2dac9462595b31.yaml | 3 +- ...ssaging-separate-backends-401c97b4c48a9b31.yaml | 21 + ...ssaging-separate-backends-4491e7c099bee4f5.yaml | 3 +- ...ssaging-separate-backends-60f81dae397b1c96.yaml | 16 + ...ssaging-separate-backends-61d279ded1bc999e.yaml | 3 +- ...ssaging-separate-backends-652f63d5c21b1884.yaml | 21 + ...ssaging-separate-backends-702d7b33fda7a9f5.yaml | 3 +- ...ssaging-separate-backends-87f2d1a15c202f73.yaml | 21 + ...ssaging-separate-backends-9b3fcaaa21a0d9f4.yaml | 3 +- ...ssaging-separate-backends-a3af6957a984ac51.yaml | 21 + ...ssaging-separate-backends-e68c98d4f9d9a79c.yaml | 3 +- ...ssaging-separate-backends-e82ea3162d2d383f.yaml | 16 + ...ssaging-separate-backends-e8a0b6857f2a9749.yaml | 21 + .../notes/oslomsg_policies-7ac27a5c2a7fbed2.yaml | 9 + ...container-user-remote-tmp-0efec059fd04eae2.yaml | 6 + ...k-container-interface-opt-80263aebc5b8e7c3.yaml | 6 + .../notes/pypi-cache-removed-c03a9a0658c9d89f.yaml | 10 + .../notes/rabbitmq-gpg-keys-042a47164265ea40.yaml | 12 + ...rabbitmq-server-ha-policy-d4e9b46cb5922032.yaml | 8 + ...rabbitmq-server-mnesia-io-d9067e226c7cb19c.yaml | 12 + ..._non_tls_listeners-remove-54e04c51021ff301.yaml | 6 + .../remove-ceilometer-api-2bada67ecc58e18b.yaml | 2 +- ...ve-machinectl-workarounds-d67a4739f6385f54.yaml | 7 + .../notes/remove-pkg-cache-afba3577138dc0a0.yaml | 22 + .../remove-proxy-no-cache-9b514030c87e7d1b.yaml | 14 + .../notes/remove-pypiserver-baa6476999104ea4.yaml | 13 + ...e-tempest-image-dir-owner-ec10dfa5bb9f87f1.yaml | 5 + .../notes/remove-v1-api-4c66f43c4f8404b6.yaml | 6 + .../remove_oslomsg_server-6b5c19e03a001e85.yaml | 6 + .../repo-build-venv-removed-80686a21b693b0cd.yaml | 21 + ...-server-required-packages-9a5b1a5c1236030f.yaml | 5 + ...sahara-service-setup-host-18f57fbc1671adfc.yaml | 17 + .../notes/smart-sources-59cd0811dcf1ae49.yaml | 16 + .../sso-callback-template-cf720ab7f6fc2461.yaml | 5 + ...ift-init-config-overrides-822ec734e02a0dd1.yaml | 2 +- .../swift-service-setup-host-b3d0aca53522a887.yaml | 17 + .../notes/systemd_service-d564b5464d854fa7.yaml | 8 + .../tacker-horizon-panel-c3x916273c21d70a.yaml | 9 + ...empest-service-setup-host-da08c1d4775ea0d1.yaml | 25 + .../tempest-test-blacklist-4ec6cc32798874ce.yaml | 6 + .../notes/tls12-only-08825fd013f0a244.yaml | 6 + .../notes/tls12-only-2025a08207fd562e.yaml | 7 + .../notes/tls12-only-40fea49efdb9d4dd.yaml | 7 + .../notes/tls12-only-75222cbe8c32ad57.yaml | 7 + .../notes/tls12-only-9b74e96cfd47a634.yaml | 7 + .../notes/tls12-only-a22d5f3f8198617f.yaml | 7 + .../notes/tls12-only-d7221a33188dc7a0.yaml | 7 + .../notes/top_ini_section-c28d7acadf5fe836.yaml | 5 + .../trove-service-setup-host-5bb64b2356ca81e2.yaml | 17 + .../update-mariadb-to-10.2-a70764ae400aadf6.yaml | 4 + .../update-mariadb-to-10.2-b99a87ed0bb60b37.yaml | 4 + .../notes/use-mariabackup-46ae988b43abda06.yaml | 5 + .../use-mariadb-10.3.13-7801fd46c5c9ce89.yaml | 4 + .../use_vendored_gpg_keys-f268bd4f4cb7d105.yaml | 16 + .../watcher-horizon-panel-c3b616273c21d70a.yaml | 9 + .../notes/zun-horizon-panel-c3b616283b21d9ba.yaml | 9 + releasenotes/source/conf.py | 2 +- releasenotes/source/index.rst | 1 + releasenotes/source/rocky.rst | 6 + requirements.txt | 2 +- scripts/bootstrap-aio.sh | 29 +- scripts/bootstrap-ansible.sh | 49 +- scripts/gate-check-commit.sh | 81 +- scripts/get-ansible-role-requirements.yml | 10 +- scripts/keepalived_haproxy_check.sh | 16 + scripts/keepalived_pingable_check.sh | 16 + scripts/log-collect.sh | 280 ++ scripts/openstack-ansible.rc | 10 +- scripts/openstack-ansible.sh | 18 +- scripts/rabbitmq-test.py | 2 +- scripts/run-upgrade.sh | 102 +- scripts/scripts-library.sh | 136 +- scripts/sources-branch-updater-lib.sh | 16 +- scripts/sources-branch-updater.sh | 2 +- .../upgrade-utilities/deploy-config-changes.yml | 97 + .../galera-cluster-rolling-restart.yml | 4 +- .../{playbooks => }/pip-conf-removal.yml | 3 +- .../playbooks/ceph-galaxy-removal.yml | 31 - .../playbooks/deploy-config-changes.yml | 89 - .../playbooks/memcached-flush.yml | 34 - .../playbooks/user-secrets-adjustment.yml | 84 - .../upgrade-utilities/scripts/make_rst_table.py | 45 - .../scripts/migrate_openstack_vars.py | 70 - .../scripts/test_migrate_openstack_vars.py | 86 - setup.cfg | 2 +- test-requirements.txt | 2 +- .../bootstrap-host/tasks/check-requirements.yml | 29 +- .../bootstrap-host/tasks/prepare_aio_config.yml | 82 +- .../bootstrap-host/tasks/prepare_data_disk.yml | 8 +- .../bootstrap-host/tasks/prepare_hostname.yml | 14 +- .../tasks/prepare_loopback_manila.yml | 77 + .../bootstrap-host/tasks/prepare_networking.yml | 155 +- .../roles/bootstrap-host/tasks/prepare_octavia.yml | 80 - .../templates/user_variables.aio.yml.j2 | 106 +- .../templates/user_variables_barbican.yml.j2 | 22 + .../templates/user_variables_calico.yml.j2 | 33 + .../templates/user_variables_manila.yml.j2 | 47 + .../templates/user_variables_translations.yml.j2 | 7 + .../bootstrap-host/vars/{ubuntu.yml => debian.yml} | 0 tox.ini | 27 +- zuul.d/jobs.yaml | 266 +- zuul.d/playbooks/post.yml | 26 +- zuul.d/playbooks/run.yml | 24 +- zuul.d/project-templates.yaml | 157 + zuul.d/project.yaml | 69 +- 442 files changed, 28984 insertions(+), 4089 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 0787567de..3064f4781 100644 --- a/requirements.txt +++ b/requirements.txt @@ -26 +26 @@ python-openstackclient>=3.14.2 -shade>=1.17.0 # Apache-2.0 +openstacksdk>=0.14.0 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index 20122f76d..84b3e0c3e 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -6 +6 @@ -hacking<0.11,>=0.10.0 +hacking>=1.1.0,<1.2.0 # Apache-2.0