We are satisfied to announce the release of: openstack-ansible 17.0.0: Ansible playbooks for deploying OpenStack This release is part of the queens release series. The source is available from: https://git.openstack.org/cgit/openstack/openstack-ansible Download the package from: https://tarballs.openstack.org/openstack-ansible/ For more details, please see below. 17.0.0 ^^^^^^ New Features ************ * Deployers of CentOS 7 environments can use the "openstack_hosts_enable_yum_fastestmirror" variable to enable or disable yum's fastestmirror plugin. The default setting of "yes" ensures that fastestmirror is enabled. * The extra packages percona packages used by the ppc64le are now downloaded by the Ansible deployment host by default, as opposed to the target hosts. Once downloaded the packages are pushed up to the target hosts. This behaviour may be adjusted by setting "galera_server_extra_package_downloader" to "target-host". The packages are downloaded to the path set in "galera_server_extra_package_path". * An option to disable the "machinectl" quota system has been added. The variable "lxc_host_machine_quota_disabled" is a Boolean with a default of **true**. When this option is set to **true** it will disable the "machinectl" quota system. Upgrade Notes ************* * Any tooling using the Designate v1 API needs to be reworked to use the v2 API * The variable "lxc_host_machine_volume_size" now accepts any valid size modifier acceptable by "truncate -s" and "machinectl set- limit". prior to this change the option assumed an integer was set for some value in gigabytes. All acceptable values can be seen within the documentation for machinectl (https://www.freedesktop.org/software/systemd/man/machinectl.html #set-limit%20%5BNAME%5D%20BYTES) Deprecation Notes ***************** * The following variables have been removed as they no longer serve any purpose. * "galera_package_arch" * "percona_package_download_validate_certs" * "percona_package_url" * "percona_package_fallback_url" * "percona_package_sha256" * "percona_package_path" * "qpress_package_download_validate_certs" * "qpress_package_url" * "qpress_package_fallback_url" * "qpress_package_sha256" * "qpress_package_path" The functionality previously using these variables has been transitioned to using a simpler data structure. Critical Issues *************** * The Designate V1 API has been removed, and cannot be enabled. Other Notes *********** * The *max_fail_percentage* playbook option has been used with the default playbooks since the first release of the playbooks back in **Icehouse**. While the intention was to allow large-scale deployments to succeed in cases where a single node fails due to transient issues, this option has produced more problems that it solves. If a failure occurs that is transient in nature but is under the set failure percentage the playbook will report a success, which can cause silent failures depending on where the failure happened. If a deployer finds themselves in this situation the problems are are then compounded because the tools will report there are no known issues. To ensure deployers have the best deployment experience and the most accurate information a change has been made to remove the *max_fail_percentage* option from all of the default playbooks. The removal of this option has the side effect of requiring the deploy to skip specific hosts should one need to be omitted from a run, but has the benefit of eliminating silent, hard to track down, failures. To skip a failing host for a given playbook run use the *--limit '!$HOSTNAME'* CLI switch for the specific run. Once the issues have been resolved for the failing host rerun the specific playbook without the *--limit* option to ensure everything is in sync. * The variable "lxc_host_machine_volume_size" is used to set the size of the default sparse file as well as define a limit within the "machinectl" quota system. When the "machinectl" quota system is enabled deployers should appropriately set this value to the size of the container volume, even when not using a sparse file. * The container image cache within machinectl has been set to "64G" by default. Changes in openstack-ansible 16.0.0.0rc1..17.0.0 ------------------------------------------------ d1b90b6 Set timeouts on uri tasks 9ad2f0e Clean-up gate code to use mirror_info 9a115b5 Bump A-R-R before first queens release 319a8fd Replace meta job map for aio->aio_lxc with simpler mechanism 28c7098 Use aio_basekit scenario for OpenSUSE 3453c64 CentOS 7 integrated gate optimization 931e8b0 Add base kit scenario 54870ed Update all SHAs for first Queens release 3e84d1e Remove the "max_fail_percentage" option 9613d6a tests: roles: bootstrap-host: SUSE: fix dbus package name 2eb32e4 Update os_neutron SHA to unblock gate c645f1f Increase Ansible SSH connection retries 06f167f Remove pip_lock_to_internal_repo variable 6c6bce5 Update Queens doc index 575db0d Remove periodic translations job b218ab9 Ensure that constraints are used for AIO bootstrap e054c44 Fix ARA/log data collection and reporting b80e361 Remove pycrypto from requirements.txt b10f825 Point to Queens instead of master e9559aa Update UPPER_CONSTRAINTS_FILE for stable/queens 9fc8ac8 Update .gitreview for stable/queens f391d52 Bump upstream SHAs e245766 Reinstate ubuntu ceph gating 68fa3f4 Update all SHAs for 17.0.0 9892a73 Allow neutron_provider_networks to be user defined aad0945 bootstrap-host: Create swap without using a failed task baceca8 l3_agent should only appear in computes when dvr e09216a Implement a scenario with no containers aec24fb Use native packages to deploy keepalived 8c09796 Move setup-utility before other plays 604e821 Remove placement_database related options/code 6c50146 Add defaults for lxc container_tech d46712b Fix ansible pipelining 34424fb Update ansible to the latest stable 3ce9383 Ensure neutron agents & rabbitmq do not restart when upgrading 0aeab78 Remove impossible tests 9685202 Update CentOS quickstart doc 785cf44 Zuul: Remove project name 7466aae Update default scenarios from aio to aio_lxc d270234 add networking-bgpvpn into openstack services b2a5482 [DOC]: admin: troubleshooting: Fix code-block statements d586000 Add scaffolding for multiple container techs 0005234 Add SELinux python support to ansible-runtime venv c776ee7 Add user agent for haproxy health checks 8f50c67 Unfreeze roles after milestone 3 e0cc078 Vagrantfile: Use rsync to copy working directory to VM ee6ff67 Update all SHAs for 17.0.0.0b3 4b93ca2 Add experimental tests of new ansible versions 21e27fd Fix keepalived warnings add6ba1 Enable Heat in Horizon if Heat is installed 2198b93 Simplify memcached servers 15e2d85 Fix logic to check for insecure Keystone 7cd9fec Remove default_bind_mount_logs from config changes. 8a3dfc0 container_host can be replaced by physical_host on is_metal 1fca341 Updated from global requirements 7f192b1 Cleanup the gate-check-commit dstat part f0d8ffd Add a return code check to the osa wrapper 81e1f8d Include P-Q changes into the upgrade script 59bc83b Updated from global requirements 03d2f66 Force ansible to ignore plugins when bootstrapping 92958b5 Only configure a service for haproxy when appropriate 7d580a1 Remove virtualenv-tools in the examples. e8abf19 Fix sources-branch-updater and add docs a9f5b9f Allow check experimental jobs to gather logs 78ed749 Stable keepalived priorities f8da4b7 Define GATE_EXIT_RUN_DSTAT before use 15754e3 [DOCS] Add limit parameter to adding a new compute section 427f974 [DOC] Update development cycle checklist 2e712b1 Update all SHAs for Queens 2017-12-19 4b75279 Reorder cinder service installs b40fddb Remove galera_address from playbook vars cf9dcbc Revert "Freeze all SHAs for 17.0.0.0b2" b654034 playbooks: inventory: ceph: Use distribution packages for SUSE c5551f2 Move inventory files to folder in root of repo 4338a64 Revert "Async clone for git roles" ef130bf Only whitelist internal network for placement api b8dfac4 designate variables for neutron integration 01501f3 ceph: Switch to central ceph-ansible repository c170e0c Add networking-sfc repo to repo_packages 3850e3d Fix automatic log copying in Zuul runs a8e99d2 make include tasks dynamic when there is rescue 3e0ef28 Remove symlinked git cache functionality 6071ae2 correct ha proxy configuration for opendaylight af0632b Workaround ansible lint failure b5079c1 Add pip config to lxc_hosts 330dcd3 Converge neutron agents onto Baremetal a591adc Fix roles variable name d98afec Skip ansible-lint test against roles 503ba6a Update test tooling for manual testing def5292 Remove is_metal from playbooks 7c46d95 Use correct name for networking-odl git group 850d8f2 Update existing container_networks ba6a3ed Use Ansible 2.4 7b3aac2 Change the galera health check for better cluster health 1034627 Do not apply varstest to all scenarios 0baa0f4 Update variable scopes 91cf1e8 Freeze all SHAs for 17.0.0.0b2 03a57d6 Set the default pip index dynamically 923f3c3 Update overview-osa for new supported Operating Systems dc78aff [DOCS] Add alternative URL for cloning repo ffbb232 [DOCS] Update links from pointing to developer-docs 98d1b58 Avoid using 'roles' reserved variable c4d12eb Fix crontab errors on CentOS/SUSE e795415 Reduce console output in gate jobs 45f9ff8 Change opendaylight default port 2a8aab4 Adapt to openstack_hosts/pip_install changes ea32c3d Avoid retrieving IP from a missing bridge 35d1415 Allow disabling container restarts 13ed290 Add the ability to trigger the integrated build 0f521b5 Override galera_monitoring_allowed_source a777dc8 Remove jinja2 delimiters in when f959acf Harden the xinetd security c2402a0 Disable offloading in test by default d5773de [Docs] Clarify ceph production example. 50595ac Update the documentation link 746330c Define swift_proxy_port for trove 6e1f3ca Extend tests vars overrides 4b63ebf Allow pip_install to run in repo-server playbook ebfd9ab Do not force using the remote "origin" when testing upgrades 2044f5b Lighter ceph gates 656fd47 Allow the haproxy configuration to run with limited groups dbe09dd Create variable override tests fe9a338 Do not implement reload for novnc/spice service 078c89b scripts: scripts-library.sh: Use pgrep -f to find the dstat process fdf3390 Add dynamic table for our tested Scenarios 33836d3 [DOCS] Correct secret uuid in Ceph example a40b253 Retry apt cache update f688775 Remove setting of version/release from releasenotes c6064d1 ansible-role-requirements: Switch ODL git repo to the github mirror e47163c zuul: project.yaml: Move openSUSE Ceph job to 'check' queue cbd552e Updated from global requirements f3dccff Use tests repo for all lint tests e9f9578 Make pw-token-gen.py more random d78e63a Use 'PermitRootLogin 'without-password'' 21ec475 Fix port config in haproxy to avoid conflict adc0b1e Fix the doc url in README 057bb30 [DOCS] Add ceph production example configuration 4c92d37 PermitRootLogin for hosts group 6f991b9 Fix cinder_backup for horizon dashboard and heat bbfb9d3 Using --option ARGUMENT ba5c17f Updated role maturity matrix edc3476 Add infra healthchecks ef3ad45 Vagrantfile: Remove openSUSE Leap 42.2 f3dc082 Zuul: add file extension to playbook path 609ea1f Update docs config for linters 4bdc86e Fix Ceilometer deployments 0405ec9 Update aio job to use become and fix environment 1c1ec38 Add Neutron variables shared with Octavia c3ce038 docs: add a decision help bf1835b [Docs] Use latest instead of draft 62545e9 [Docs] After-install network configuration 2af6d90 Use zuul v3 src location to install ARA 2a1f1cc [Docs] Fix links to inventory docs dbd96cd Update zuul jobs with the per branch data f17540a [Docs] Replace draft with latest 485fa7e Fix link to examples conf.d files 19304e8 Revert "Set OpenStack-Ansible release to 17.0.0.0b1" 08b700a Add proxy environment vars to boostrap-aio.yml a86cfab Install hacking first and let it pull in right linter versions 3ce37a3 Correct regex for disk size 184eab7 Fixes a var dependency between Neutron and Octavia 21463a3 Convert the AIO from using overlayfs to machinectl 81cfe69 Fix typo 342a090 Add python as an install step 151d8c5 Initial integrated zuulv3 jobs 1200ee1 Hyper-converge our container usage c1bcb9e Move dynamic grouping conditional bc3e2b6 Remove jinja from failed_when 0620efa Set OpenStack-Ansible release to 17.0.0.0b1 182dca9 Include the Ansible version variable when installing ara 3fcadbf Update all SHAs 2622a2c [Docs] add a refresh fact step on new compute 24b505b Shallow clone roles 7a1e46b Async clone for git roles 64608d4 Avoid using gather_facts as a variable a27be7f Do not source openstack-ansible.rc when pulling roles 67bea88 Updated repo cloner for zuulv3 1938df4 playbooks: os-lxc-container-setup: Only stop the container if it's running 03ace7a Only build ARA report when test fails 84a7f64 Disable ceph-ansible NFS gateway by default 44570a7 Fix adminurl/adminuri typo 4e58576 [Docs] Clarify role development cycle 069a39e [Docs] Add the bump of the upstream repo ce07654 Run the ceph-mons deploy in serial bbb0001 SUSE: Add OpenStack cloud repository when bootstrapping the host a955c0b SUSE: Remove lxc-1.X.X workarounds 1377af3 Fix zuul clonemap 4e7e1c5 scripts: bootstrap-ansible.sh: Do not error on 'alternatives' command 8de63d6 Fix warning in upgrade cc22dee scripts: sources-branch-updater-lib: Always fetch SHAs when working on master dd99af8 Load nova_console_port from a nova_console inventory item af28cf0 Run dstat in gate tests 74acdd5 Fix Aodh's health checks 87ffd71 Ensure container facts are set on container create 8fdf433 Fix cinder_service_region undefined a46a72a working example of QNAP cinder integration 505a54e adding opendaylight services into ha proxy 54f02e0 Closes-Bug: 1717506 85501cb Limit group_vars scoping 718f790 Move resolvconf JIT execution to common tasks cefc9e7 Gather ceph-mon facts using delegation c22850e Adds Neutron FWaaS Dashboard to Repo e524f70 Update Pike status to released in doc index f828133 Fix variable def. 0debf5b Revert "Install dnf on CentOS hosts" a53f1ae Add ceph-ansible v3 support 7ba5bed Delete not needed designate variables. 7dcc048 Updated from global requirements f4cbb21 Set ceph_mons in group_vars eea033f Fix lxc_image_cache_server_mirrors string concat 5b3e5a7 Upgrade ceph release to Luminous d03f39c Run ARA only if enabled 7967623 Update and replace http with https for doc links 7b8d650 Set the LXC download mirror properly ede56e0 Update variable migration script for Queens 9ba94a0 Updated from global requirements 3ddd01e Modify tacker port in haproxy config be2c81b Fix release-yaml-file-prep.py to include ansible-hardening 7401ddd Install dnf on CentOS hosts b95eafb Skip host pip installs for ansible bootstrap 07d1621 Use RDO Pike repository 353694a Remove urllib3/requests from requirements fc05a47 Fix tacker bug in haproxy 3c235fd Add haproxy_endpoints role to Galera 6648266 Make pkg_locations overridable easier a28026b Adding guards around tracepath/tracepath6 commands b3300e8 scripts: scripts-library.sh: Fix tracepath logging d32bb25 roles: bootstrap-host: Remove useless 'break' command from case statement 74f70c6 SHA Bump on master dbc9598 roles: bootstrap-host: Fix typo in postup/postdown options for SUSE 20a9d7a Add ansible_python_interpreter to Ceph playbook c40827d Suppress curl warning w/shell module 55c3dfb [DOC] Add openSUSE Leap references 61a7570 [DOC} Add openSUSE to Software requirements 59a062b Remove remaining service_name properties 22e5675 Enable verbose logging when fetching roles via git-clone 64bd12a Use /var/lib rather than /tmp 2f3196e Adding serial console support 38e674c Fix LXC container start order 90acf0a Correct zuul-cloner cloning of pinned SHA's 9ef8dd5 [DOC] Check Galera/Rabbitmq versions during cycle 111331c Correct cinder online migrations command ae96fb1 Update documentation redirects 2364fb1 Fix to use "." to source script files 2acccc1 Fix os-cmd cross-distro compatibility c646f17 Declare openSUSE Leap 42.X support as WIP 5eb2c00 tests: bootstrap-host: Add SUSE support in the RedHat network scripts 76e1d61 playbooks: os-lxc-container-setup: Force kill a container on openSUSE if it takes too long to stop e82f84a Set serial to 100% for nova_compute cffc9d1 SHA Bump for master upstream roles 836703a scripts: scripts-library.sh: Fix location for log directory aaf7465 playbooks: os-swift-install: Use correct group name on openSUSE f70ca23 playbooks: utility-install.yml: Update package cache on openSUSE 1a3b11f group_vars: all: Replace spaces with underscores in distro repository d224430 tests: bootstrap-host: Refresh repositories on SUSE 18374fb tests: bootstrap-aio: Add sftp subsystem option for SUSE 19d04fc tests: bootstrap-host: Add ability to configure networking on SUSE 3bb0aac tests: bootstrap-host: Add SUSE variables file 56fc048 tests: bootstrap-host: Use btrfs tools to determine available disk space 83ab078 scripts: bootstrap-ansible: Add required packages on openSUSE Leap b5441ed Adds a constraint file to the pip install for Octavia scenario 85d2427 Fixes python3 non-compatible import of urlparse 4d4482e scripts: scripts-library.sh: Add support for openSUSE 956e829 Update docs/tooling for Queens c5b317d scripts: scripts-library.sh: Do not use the '-m' option on tracepath 95f89f4 Reduce CentOS AIO bootstrap pkg list bd79f07 Add tacker installation aeb7f57 Test containerised cinder-volume 2af9fbf scripts: scripts-library.sh: Hide 'which' command output 2603e5a Vagrantfile: Add openSUSE support 15c4202 Vagrantfile: Increase VM memory size to 12G 52b1b17 Update reno for stable/pike 1450119 Add support for OpenDaylight deployment in neutron e1a997a Updated from global requirements 321dd30 [DOCS] Add reference to Tunable Overrides 303e4e8 Remove repeated pip_install role execution 9c186e2 Unpin role SHA's to move towards Queens development 9c64c2d ansible-role-requirements: Bump sha for os_neutron role 18464e4 Fix import of osa_toolkit in inventory-manage.py e2bf8b9 Add tip for destroying containers 7049ffa Bootstrap Ansible fails if partial keypair exists bb48a1a Fix Barbican's health checks eb81d64 Update the playbook serial settings 2ab98d9 trivialfix 4cba47c Revert "Reduce container counts for cinder, ironic and trove" 774f6d0 Add breakout groups for hypervisor types Diffstat (except docs and test files) ------------------------------------- .gitreview | 2 +- README.rst | 6 +- Vagrantfile | 23 +- ansible-role-requirements.yml | 138 +++--- bindep.txt | 31 +- .../source/app-advanced-config-options.rst | 2 +- .../source/app-advanced-config-override.rst | 6 +- deploy-guide/source/app-ceph.rst | 4 +- deploy-guide/source/app-config-prod-ceph.rst | 133 ++++++ deploy-guide/source/app-custom-layouts.rst | 2 +- deploy-guide/source/app-limited-connectivity.rst | 2 +- deploy-guide/source/app-networking.rst | 2 +- deploy-guide/source/app-resources.rst | 2 +- deploy-guide/source/app-security.rst | 2 +- deploy-guide/source/app.rst | 1 + deploy-guide/source/conf.py | 12 +- deploy-guide/source/configure.rst | 10 +- deploy-guide/source/deploymenthost.rst | 36 +- .../source/figures/arch-layout-production-ceph.png | Bin 0 -> 167033 bytes .../source/figures/arch-layout-production-ceph.svg | 3 + deploy-guide/source/figures/arch-layout.graffle | Bin 6161 -> 8655 bytes deploy-guide/source/overview-osa.rst | 37 +- deploy-guide/source/overview-requirements.rst | 6 + deploy-guide/source/targethosts-prepare.rst | 48 +- .../admin/maintenance-tasks/network-maintain.rst | 4 +- .../admin/maintenance-tasks/scale-environment.rst | 44 +- .../openstack-operations/managing-instances.rst | 2 +- .../admin/openstack-operations/network-service.rst | 10 + .../admin/openstack-operations/verify-deploy.rst | 2 +- etc/openstack_deploy/conf.d/ceilometer.yml.example | 2 +- etc/openstack_deploy/conf.d/haproxy.yml.aio | 4 + etc/openstack_deploy/conf.d/swift.yml.example | 6 +- etc/openstack_deploy/conf.d/tacker.yml.aio | 4 + etc/openstack_deploy/env.d/aio_metal.yml.example | 158 +++++++ .../env.d/extra_container.yml.example | 24 +- .../openstack_user_config.yml.aio.j2 | 4 - .../openstack_user_config.yml.example | 22 + .../openstack_user_config.yml.prod-ceph.example | 162 +++++++ etc/openstack_deploy/user_secrets.yml | 6 +- etc/openstack_deploy/user_variables.yml | 18 +- .../user_variables.yml.prod-ceph.example | 40 ++ global-requirement-pins.txt | 4 +- group_vars/all/all.yml | 119 ----- group_vars/all/aodh.yml | 21 - group_vars/all/ceilometer.yml | 26 -- group_vars/all/ceph.yml | 30 -- group_vars/all/cinder.yml | 43 -- group_vars/all/glance.yml | 51 --- group_vars/all/haproxy.yml | 278 ------------ group_vars/all/heat.yml | 34 -- group_vars/all/infra.yml | 31 -- group_vars/all/ironic.yml | 29 -- group_vars/all/keepalived.yml | 69 --- group_vars/all/keystone.yml | 59 --- group_vars/all/magnum.yml | 23 - group_vars/all/neutron.yml | 50 --- group_vars/all/nova.yml | 60 --- group_vars/all/octavia.yml | 31 -- group_vars/all/pip.yml | 26 -- group_vars/all/sahara.yml | 34 -- group_vars/all/ssl.yml | 21 - group_vars/all/swift.yml | 29 -- group_vars/all_containers.yml | 31 -- group_vars/aodh_all.yml | 24 - group_vars/barbican_all.yml | 33 -- group_vars/ceilometer_all.yml | 36 -- group_vars/ceph_all.yml | 19 - group_vars/cinder_all.yml | 50 --- group_vars/cinder_volume.yml | 22 - group_vars/designate_all.yml | 59 --- group_vars/galera_all.yml | 28 -- group_vars/glance_all.yml | 38 -- group_vars/gnocchi_all.yml | 40 -- group_vars/haproxy_all.yml | 37 -- group_vars/heat_all.yml | 28 -- group_vars/horizon_all.yml | 41 -- group_vars/hosts.yml | 29 -- group_vars/ironic_all.yml | 25 -- group_vars/ironic_compute.yml | 16 - group_vars/keystone_all.yml | 39 -- group_vars/magnum_all.yml | 32 -- group_vars/memcached.yml | 23 - group_vars/neutron_agent.yml | 28 -- group_vars/neutron_all.yml | 30 -- group_vars/neutron_calico_dhcp_agent.yml | 107 ----- group_vars/nova_all.yml | 46 -- group_vars/octavia_all.yml | 19 - group_vars/rabbitmq_all.yml | 22 - group_vars/repo_all.yml | 68 --- group_vars/rsyslog.yml | 19 - group_vars/sahara_all.yml | 21 - group_vars/swift_all.yml | 31 -- group_vars/trove_all.yml | 46 -- group_vars/utility_all.yml | 71 --- host_vars/.placeholder | 0 inventory/dynamic_inventory.py | 81 ++++ inventory/env.d/aodh.yml | 32 ++ inventory/env.d/barbican.yml | 34 ++ inventory/env.d/ceilometer.yml | 40 ++ inventory/env.d/ceph.yml | 50 +++ inventory/env.d/cinder.yml | 66 +++ inventory/env.d/designate.yml | 54 +++ inventory/env.d/etcd.yml | 34 ++ inventory/env.d/galera.yml | 37 ++ inventory/env.d/glance.yml | 43 ++ inventory/env.d/gnocchi.yml | 39 ++ inventory/env.d/haproxy.yml | 37 ++ inventory/env.d/heat.yml | 45 ++ inventory/env.d/horizon.yml | 37 ++ inventory/env.d/ironic.yml | 78 ++++ inventory/env.d/keystone.yml | 36 ++ inventory/env.d/magnum.yml | 37 ++ inventory/env.d/memcache.yml | 37 ++ inventory/env.d/molteniron.yml | 35 ++ inventory/env.d/neutron.yml | 86 ++++ inventory/env.d/nova.yml | 104 +++++ inventory/env.d/octavia.yml | 47 ++ inventory/env.d/os-infra.yml | 22 + inventory/env.d/pkg_repo.yml | 36 ++ inventory/env.d/rabbitmq.yml | 37 ++ inventory/env.d/rsyslog.yml | 36 ++ inventory/env.d/sahara.yml | 36 ++ inventory/env.d/shared-infra.yml | 22 + inventory/env.d/swift-remote.yml | 38 ++ inventory/env.d/swift.yml | 72 +++ inventory/env.d/tacker.yml | 36 ++ inventory/env.d/trove.yml | 47 ++ inventory/env.d/unbound.yml | 34 ++ inventory/env.d/utility.yml | 37 ++ inventory/group_vars/all/all.yml | 115 +++++ inventory/group_vars/all/ceph.yml | 38 ++ inventory/group_vars/all/cinder.yml | 18 + inventory/group_vars/all/designate.yml | 29 ++ inventory/group_vars/all/glance.yml | 27 ++ inventory/group_vars/all/infra.yml | 30 ++ inventory/group_vars/all/keystone.yml | 54 +++ inventory/group_vars/all/neutron.yml | 35 ++ inventory/group_vars/all/nova.yml | 24 + inventory/group_vars/all/octavia.yml | 22 + inventory/group_vars/all/pip.yml | 33 ++ inventory/group_vars/all/ssl.yml | 21 + inventory/group_vars/all_containers.yml | 31 ++ inventory/group_vars/aodh_all.yml | 31 ++ inventory/group_vars/barbican_all.yml | 33 ++ inventory/group_vars/ceilometer_all.yml | 54 +++ inventory/group_vars/ceph_all.yml | 24 + inventory/group_vars/cinder_all.yml | 77 ++++ inventory/group_vars/cinder_volume.yml | 22 + inventory/group_vars/designate_all.yml | 46 ++ inventory/group_vars/galera_all.yml | 37 ++ inventory/group_vars/glance_all.yml | 63 +++ inventory/group_vars/gnocchi_all.yml | 40 ++ inventory/group_vars/haproxy_all/haproxy.yml | 357 +++++++++++++++ inventory/group_vars/haproxy_all/keepalived.yml | 71 +++ inventory/group_vars/heat_all.yml | 48 ++ inventory/group_vars/horizon_all.yml | 42 ++ inventory/group_vars/hosts.yml | 32 ++ inventory/group_vars/ironic-compute_hosts.yml | 16 + inventory/group_vars/ironic_all.yml | 40 ++ inventory/group_vars/ironic_compute.yml | 1 + inventory/group_vars/keystone_all.yml | 61 +++ inventory/group_vars/kvm-compute_hosts.yml | 16 + inventory/group_vars/lxd-compute_hosts.yml | 16 + inventory/group_vars/magnum_all.yml | 42 ++ inventory/group_vars/memcached.yml | 23 + inventory/group_vars/network_hosts.yml | 3 + inventory/group_vars/neutron_agent.yml | 28 ++ inventory/group_vars/neutron_all.yml | 47 ++ inventory/group_vars/neutron_calico_dhcp_agent.yml | 107 +++++ inventory/group_vars/nova_all.yml | 88 ++++ inventory/group_vars/octavia_all.yml | 30 ++ inventory/group_vars/powervm-compute_hosts.yml | 16 + inventory/group_vars/qemu-compute_hosts.yml | 16 + inventory/group_vars/rabbitmq_all.yml | 22 + inventory/group_vars/repo_all.yml | 85 ++++ inventory/group_vars/rsyslog.yml | 19 + inventory/group_vars/sahara_all.yml | 41 ++ inventory/group_vars/swift_all.yml | 50 +++ inventory/group_vars/tacker_all.yml | 46 ++ inventory/group_vars/trove_all.yml | 48 ++ inventory/group_vars/utility_all.yml | 74 ++++ inventory/host_vars/localhost/ceilometer.yml | 17 + inventory/host_vars/localhost/cinder.yml | 18 + inventory/host_vars/localhost/neutron.yml | 20 + inventory/host_vars/localhost/nova.yml | 17 + inventory/host_vars/localhost/swift.yml | 20 + inventory/host_vars/localhost/unbound.yml | 22 + inventory/localhost | 2 + osa_toolkit/generate.py | 36 +- osa_toolkit/manage.py | 2 +- playbooks/ceph-install.yml | 83 ++-- playbooks/common-playbooks/cinder.yml | 14 +- playbooks/common-playbooks/glance.yml | 11 +- playbooks/common-playbooks/neutron.yml | 15 +- playbooks/common-playbooks/nova.yml | 15 +- playbooks/common-playbooks/unbound-clients.yml | 77 ---- playbooks/common-tasks/dynamic-address-fact.yml | 2 +- playbooks/common-tasks/dynamic-grouping.yml | 4 +- playbooks/common-tasks/os-lxc-container-setup.yml | 16 +- playbooks/common-tasks/restart-service.yml | 2 + playbooks/common-tasks/set-pip-upstream-url.yml | 3 + playbooks/common-tasks/set-upper-constraints.yml | 18 + playbooks/common-tasks/unbound-clients.yml | 65 +++ playbooks/containers-deploy.yml | 17 + playbooks/containers-lxc-create.yml | 53 +++ playbooks/containers-lxc-destroy.yml | 63 +++ playbooks/containers-lxc-host.yml | 57 +++ playbooks/defaults/repo_packages/gnocchi.yml | 2 +- playbooks/defaults/repo_packages/nova_consoles.yml | 4 +- .../defaults/repo_packages/openstack_services.yml | 96 ++-- .../defaults/repo_packages/openstack_testing.yml | 4 +- playbooks/etcd-install.yml | 17 +- playbooks/galera-install.yml | 35 +- playbooks/haproxy-install.yml | 21 +- playbooks/healthcheck-infrastructure.yml | 193 ++++++++ playbooks/inventory/dynamic_inventory.py | 81 ---- playbooks/inventory/env.d/aodh.yml | 32 -- playbooks/inventory/env.d/barbican.yml | 34 -- playbooks/inventory/env.d/ceilometer.yml | 40 -- playbooks/inventory/env.d/ceph.yml | 50 --- playbooks/inventory/env.d/cinder.yml | 66 --- playbooks/inventory/env.d/designate.yml | 54 --- playbooks/inventory/env.d/etcd.yml | 34 -- playbooks/inventory/env.d/galera.yml | 37 -- playbooks/inventory/env.d/glance.yml | 43 -- playbooks/inventory/env.d/gnocchi.yml | 39 -- playbooks/inventory/env.d/haproxy.yml | 37 -- playbooks/inventory/env.d/heat.yml | 54 --- playbooks/inventory/env.d/horizon.yml | 37 -- playbooks/inventory/env.d/ironic.yml | 65 --- playbooks/inventory/env.d/keystone.yml | 36 -- playbooks/inventory/env.d/magnum.yml | 37 -- playbooks/inventory/env.d/memcache.yml | 37 -- playbooks/inventory/env.d/molteniron.yml | 35 -- playbooks/inventory/env.d/neutron.yml | 79 ---- playbooks/inventory/env.d/nova.yml | 101 ----- playbooks/inventory/env.d/octavia.yml | 47 -- playbooks/inventory/env.d/os-infra.yml | 22 - playbooks/inventory/env.d/pkg_repo.yml | 36 -- playbooks/inventory/env.d/rabbitmq.yml | 37 -- playbooks/inventory/env.d/rsyslog.yml | 36 -- playbooks/inventory/env.d/sahara.yml | 36 -- playbooks/inventory/env.d/shared-infra.yml | 22 - playbooks/inventory/env.d/swift-remote.yml | 38 -- playbooks/inventory/env.d/swift.yml | 72 --- playbooks/inventory/env.d/trove.yml | 45 -- playbooks/inventory/env.d/unbound.yml | 34 -- playbooks/inventory/env.d/utility.yml | 37 -- playbooks/lxc-containers-create.yml | 39 +- playbooks/lxc-containers-destroy.yml | 65 +-- playbooks/lxc-hosts-setup.yml | 61 +-- playbooks/memcached-install.yml | 17 +- playbooks/openstack-hosts-setup.yml | 14 +- playbooks/os-aodh-install.yml | 16 +- playbooks/os-barbican-install.yml | 17 +- playbooks/os-ceilometer-install.yml | 17 +- playbooks/os-cinder-install.yml | 43 +- playbooks/os-designate-install.yml | 16 +- playbooks/os-glance-install.yml | 7 - playbooks/os-gnocchi-install.yml | 16 +- playbooks/os-heat-install.yml | 16 +- playbooks/os-horizon-install.yml | 16 +- playbooks/os-ironic-install.yml | 15 +- playbooks/os-keystone-install.yml | 23 +- playbooks/os-magnum-install.yml | 15 +- playbooks/os-molteniron-install.yml | 18 +- playbooks/os-neutron-install.yml | 15 +- playbooks/os-nova-install.yml | 43 +- playbooks/os-octavia-install.yml | 16 +- playbooks/os-rally-install.yml | 12 +- playbooks/os-sahara-install.yml | 16 +- playbooks/os-swift-install.yml | 24 +- playbooks/os-swift-sync.yml | 5 +- playbooks/os-tacker-install.yml | 61 +++ playbooks/os-tempest-install.yml | 5 +- playbooks/os-trove-install.yml | 16 +- playbooks/rabbitmq-install.yml | 24 +- playbooks/repo-build.yml | 52 +-- playbooks/repo-server.yml | 38 +- playbooks/repo-use.yml | 29 ++ .../system_crontab_coordination/tasks/main.yml | 2 + playbooks/rsyslog-install.yml | 19 +- playbooks/security-hardening.yml | 2 +- playbooks/setup-hosts.yml | 3 +- playbooks/setup-infrastructure.yml | 6 +- playbooks/setup-openstack.yml | 1 + playbooks/unbound-install.yml | 22 +- playbooks/utility-install.yml | 23 +- ...tavia-V2-(standalone)-API-d644b92ad374f2cf.yaml | 7 + .../PermitRootLogin-chages-7ce97df6d612223e.yaml | 7 + ...-container-restart-option-acf4cd9a20ef61e4.yaml | 15 + .../add-opensuse-support-a8ec3f54188e5f01.yaml | 14 + .../add-security-headers-e46c205b42b9598b.yaml | 8 + .../cache-packages-override-e89847687abddf34.yaml | 4 + ...-local-lxc-package-mirror-843e1ceac2469547.yaml | 16 + ...entos-mirror-url-variable-c072a6ab21054093.yaml | 5 + ...entos-mirror-url-variable-eea9f226b5611b40.yaml | 5 + .../notes/ceph-ansible-v3-a570cf4477c77860.yaml | 15 + .../notes/ceph-galaxy-roles-1a0a13be026e45d8.yaml | 8 + .../notes/ceph-luminous-d1ff5c08452a9887.yaml | 9 + .../notes/clustecheck-9311d05fb32f13b3.yaml | 7 + ...m_eventstreamer_queue_url-a1dcd1f6769816c5.yaml | 17 + ...rcona-xtrabackup-repo-url-95614d0672f4bcb0.yaml | 6 + ...-and-backend-caching-vars-88c48117b232b37e.yaml | 6 + ...ed-symlink-for-repo-cache-449b84e281ff9907.yaml | 12 + ...kage-checksums-by-default-3543840512c348d6.yaml | 7 + .../notes/disable-ksm-670aeb175826b7ca.yaml | 5 + .../disable-list-extend-3a9547de9034f9ba.yaml | 4 +- .../dnsmasq-lxc-conflict-fix-c8968f6a16d033c6.yaml | 10 + .../drop-ceilometer-api-b6d87ceddf34af81.yaml | 5 + ...nsuse-mirror-url-variable-fa2df9eee6399938.yaml | 5 + ...ity-groups-always-applied-eb6e3bdc7b77f022.yaml | 13 + .../notes/extra-headers-e54a672d3a78dd89.yaml | 15 + ...astestmirror-configurable-08e075f8602164e5.yaml | 7 + .../notes/fedora-26-support-70a304f9c97d1b37.yaml | 5 + .../notes/fwaasv2-added-ab9ba18c8b98a83e.yaml | 4 + ...inder-system-user-support-f69b87b4876c0dd8.yaml | 5 + ...nce-init-config-overrides-d1c8c3dcc50c109a.yaml | 2 +- .../notes/glance-v2-api-only-0d4a61b0d4dade18.yaml | 22 + .../notes/global-ntp-servers-155c1daef3680025.yaml | 6 + .../horizon-arbitrary-config-8a36e4bd6818afe1.yaml | 2 +- .../notes/hypervisor-groups-9c9fb1d44b602af0.yaml | 9 + ...instance-defaults-support-533844543082b2f4.yaml | 2 +- .../notes/lbaasv2-options-ae992286abfa689f.yaml | 5 + .../lxc-cache-prep-timeout-97dc18882f7b1e76.yaml | 7 + .../notes/lxc-container-tech-2a24afbef5a7bf6e.yaml | 5 + .../lxc-machinectl-template-9e65779a94cb767f.yaml | 11 + ...c_container_backing_store-e0a77c48da3a57b2.yaml | 21 + .../lxc_image_cache_server-f14701a7f8f4b8ca.yaml | 14 + ...workmanager-compatibility-87c7c1c121469714.yaml | 10 + .../neutron-agent-baremetal-c229e65c77e615fa.yaml | 16 + .../notes/neutron-bgp-552e6e1f6d37f38d.yaml | 2 +- .../notes/neutron-fwaas-5c7c6508f2cc05c3.yaml | 4 +- ...ron-init-config-overrides-9d1d2b3b908705ed.yaml | 2 +- ...tron-opendaylight-support-453dc9324eafaae7.yaml | 7 + .../notes/neutron-vpnaas-5c7c6508f2cc05c5.yaml | 4 +- .../notes/new_default_quotas-154f76dd7f2f568f.yaml | 6 + .../notes/new_healthcheck-9e559565745defd0.yaml | 7 + .../ng-instance-management-f9134fc283aa289c.yaml | 2 +- .../non_inventory_hosts-c0fa4c185a01e78b.yaml | 6 + .../nova-placement-database-a8735a1df0c4566f.yaml | 15 + ...nsuse-mirror-url-variable-6660f16c3e9bf1ff.yaml | 10 + ...nsuse-mirror-url-variable-74d22825e808211e.yaml | 10 + ...nsuse-mirror-url-variable-865a97abb4c61430.yaml | 6 + .../openvswitch-nsh-support-a9f86a929e072cea.yaml | 6 + ...ize-centos-erlang-install-bafd1c376ffca35e.yaml | 15 + .../notes/os-tempest-roles-cead45b2cd38811f.yaml | 5 + .../permitrootlogin_options-a62e33ccc4a69657.yaml | 8 + ...rsistend-systemd-journals-c1874b52ad666744.yaml | 10 + .../notes/pike_deprecations-39034d48825e8966.yaml | 8 + .../ppc64le-var-changes-84aa4f3f9bb0ef52.yaml | 31 ++ .../pypiserver-pypi-cache-216e9e087f6d3f24.yaml | 9 + ...rval-configuration-option-884d64aa259ecc3c.yaml | 6 + ...emove-duplicated-download-99a9ec5bfe4ba749.yaml | 37 ++ .../notes/remove-fax-fail-5038b4b6eb4951b3.yaml | 21 + .../remove-haproxy-repo-vars-051a47bbfaf6d1da.yaml | 8 + .../notes/remove-v1-api-4fda1ee243203fe5.yaml | 5 + .../notes/remove-v72181-e29b9f5d9c971541.yaml | 6 + .../notes/remove_use_neutron-76135a385ef1345d.yaml | 3 + .../removed-vars-plugin-0f9fb96e8b2c430d.yaml | 6 + .../rhel7-stig-v1r3-update-c533ed40ba609ccf.yaml | 15 + ...elinux-neutron-bare-metal-c89174daf6f8b273.yaml | 6 + .../notes/set-limit-disabled-25998f1f12987c12.yaml | 20 + ...skip-sysctl-when-disabled-b32eca48df5b1437.yaml | 10 + ...l_modules_with_group_vars-8d169f564ffd450c.yaml | 25 ++ ...ot-login-without-password-948ec79c6508c19b.yaml | 6 + .../static_uca_filename-849a6f491acae9c5.yaml | 11 + .../notes/support-ksm-fe6993158768a14e.yaml | 5 + ...t-centos-opensuse-running-0be396c60a513562.yaml | 8 + .../notes/systemd-nfs-setup-5c35c23eda4443be.yaml | 11 + ...ove-init-config-overrides-a78ed428a32adef8.yaml | 2 +- .../ulimit-increased-65536-50b418d8e8ca4eef.yaml | 5 + ...able-file-search-optional-7420269230a0e22f.yaml | 7 + releasenotes/source/conf.py | 18 +- releasenotes/source/index.rst | 7 +- releasenotes/source/pike.rst | 6 + requirements.txt | 13 +- scripts/ansible-role-requirements-editor.py | 2 +- scripts/bootstrap-ansible.sh | 116 ++++- scripts/gate-check-commit.sh | 112 ++--- scripts/gen-config.py | 2 +- scripts/get-pypi-pkg-version.py | 2 +- scripts/inventory-manage.py | 11 +- scripts/openstack-ansible.rc | 6 +- scripts/os-cmd | 2 +- scripts/pw-token-gen.py | 5 +- scripts/rabbitmq-test.py | 47 ++ scripts/release-yaml-file-prep.py | 11 +- scripts/run-upgrade.sh | 33 +- scripts/scripts-library.sh | 132 +++++- scripts/sources-branch-updater-lib.sh | 103 +++-- scripts/sources-branch-updater.sh | 43 +- .../playbooks/ceph-galaxy-removal.yml | 31 ++ .../playbooks/deploy-config-changes.yml | 8 +- .../playbooks/user-secrets-adjustment.yml | 3 +- .../scripts/migrate_openstack_vars.py | 2 +- test-requirements.txt | 22 +- .../bootstrap-host/tasks/check-requirements.yml | 15 +- .../bootstrap-host/tasks/install_packages.yml | 81 +--- .../bootstrap-host/tasks/prepare_aio_config.yml | 111 +++-- .../bootstrap-host/tasks/prepare_hostname.yml | 34 ++ .../bootstrap-host/tasks/prepare_loopback_swap.yml | 84 ++-- .../bootstrap-host/tasks/prepare_networking.yml | 47 +- .../roles/bootstrap-host/tasks/prepare_octavia.yml | 19 +- .../bootstrap-host/templates/apt-sources.list.j2 | 16 - .../templates/redhat_interface_default.cfg.j2 | 1 + .../templates/redhat_interface_ifdown-post.cfg.j2 | 19 - .../templates/redhat_interface_ifup-post.cfg.j2 | 25 -- .../templates/rpm_interface_ifdown-post.cfg.j2 | 29 ++ .../templates/rpm_interface_ifup-post.cfg.j2 | 35 ++ .../templates/suse_interface_default.cfg.j2 | 9 + .../templates/user_variables.aio.yml.j2 | 38 +- .../templates/user_variables_ceph.yml.j2 | 2 +- tox.ini | 117 +++-- zuul.d/jobs.yaml | 168 +++++++ zuul.d/playbooks/post.yml | 64 +++ zuul.d/playbooks/run.yml | 25 ++ zuul.d/project.yaml | 51 +++ 453 files changed, 9354 insertions(+), 5900 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index ed8d1a9..54d032a 100644 --- a/requirements.txt +++ b/requirements.txt @@ -4,3 +4,2 @@ -pyasn1!=0.2.3 # BSD -pyOpenSSL>=0.14 # Apache-2.0 -requests>=2.14.2 # Apache-2.0 +pyasn1!=0.2.3,>=0.1.8 # BSD +pyOpenSSL>=16.2.0 # Apache-2.0 @@ -8 +7 @@ ndg-httpsclient>=0.4.2;python_version<'3.0' # BSD -netaddr!=0.7.16,>=0.7.13 # BSD +netaddr>=0.7.18 # BSD @@ -10 +8,0 @@ PrettyTable<0.8,>=0.7.1 # BSD -pycrypto>=2.6 # Public Domain @@ -12,3 +10,2 @@ python-memcached>=1.56 # PSF -PyYAML>=3.10.0 # MIT -urllib3>=1.21.1 # MIT -virtualenv>=13.1.0 # MIT +PyYAML>=3.10 # MIT +virtualenv>=14.0.6 # MIT diff --git a/test-requirements.txt b/test-requirements.txt index 78145f7..3b4da26 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -4,3 +4,2 @@ -bashate>=0.2 # Apache-2.0 -coverage!=4.4,>=4.0 # Apache-2.0 -flake8<2.6.0,>=2.5.4 # MIT + +# Keep hacking first, it pulls in the right versions of flake8, mccabe and pyflakes @@ -8,5 +7,4 @@ hacking<0.11,>=0.10.0 -mccabe==0.2.1 # MIT License -mock>=2.0 # BSD -pep8==1.5.7 # MIT -pyflakes==0.8.1 # MIT -virtualenv>=13.1.0 # MIT +bashate>=0.5.1 # Apache-2.0 +coverage!=4.4,>=4.0 # Apache-2.0 +mock>=2.0.0 # BSD +virtualenv>=14.0.6 # MIT @@ -15,4 +13,4 @@ virtualenv>=13.1.0 # MIT -sphinx>=1.6.2 # BSD -openstackdocstheme>=1.16.0 # Apache-2.0 -doc8 # Apache-2.0 -reno!=2.3.1,>=1.8.0 # Apache-2.0 +sphinx!=1.6.6,>=1.6.2 # BSD +openstackdocstheme>=1.18.1 # Apache-2.0 +doc8>=0.6.0 # Apache-2.0 +reno>=2.5.0 # Apache-2.0