We are gleeful to announce the release of: kolla 8.0.0: Kolla OpenStack Deployment This release is part of the stein release series. The source is available from: https://opendev.org/openstack/kolla Download the package from: https://tarballs.openstack.org/kolla/ Please report issues through: https://bugs.launchpad.net/kolla/+bugs For more details, please see below. 8.0.0 ^^^^^ New Features ************ * Adds configration option "use_dumb_init", with default value of "True". This can be use to avoid the of "dumb-init" as the container entrypoint, using "kolla_start" directly instead. This option can also be disabled via the "kolla-build --nouse-dumb-init" CLI argument. Upgrade Notes ************* * Moves the "ENTRYPOINT" statement outside of the "dumb_init_installation" Jinja block in the base image. Overriding this block to install "dumb-init" by another method no longer requires repeating the "ENTRYPOINT" statement. Users wishing to avoid the use of "dumb-init" altogether can now use the "use_dumb_init" configuration option. Changes in kolla 7.0.0.0rc1..8.0.0 ---------------------------------- ae53af692 CI: set the same gate queue for kolla and kolla-ansible e930fb35a Fixes ceph-osd deploys with loop devices. ac66f5869 Extract CI vars for use in kolla-ansible jobs 6fd4b0217 Update versions: ./tools/version-check.py cce6d6804 Clean up test process 09226a598 Run nova api_db sync before db sync f13852289 Fix deployment of ceph-nfs container failing due to wrong USER 4edaf8a70 Move back to CentOS StorageSIG repos for Ceph and Ganesha ac8609c0f Add sha256 in ceph fetch keys 6acca35f5 Fix ownership of ironic inspector DHCP hostsdir 588c1076c Use td-agent-gem to install fluentd monasca plugin on ubuntu 1fe505ffe [neutron] Do not migrate all subprojects 45ae94f9a Fix issues with Percona in Zuul and clean up a little bit b8c6dd6ab Debian/Ubuntu: allow to use unsigned repositories 7a23046b2 Fix lower-constraints test fail due to failing dep build df6f1fb3c Bump service versions for Stein b71f2be43 Debian/Ubuntu: more python3 packages for binary c5d2e9683 Switch to RDO Stein release on CentOS & Oracle 78f862b0d Ceph: Update to Nautilus on CentOS and OracleLinux ad4435618 Install iputils package in neutron containers c7e0f0db6 Bump Monasca Fluentd plugin version eb4ad1674 Add CI trigger for ceph jobs 877df152d Fix multiple mon deployment failures 2b2218448 Fix bandit failure B105 in keystone fernet 81c325048 Add sqlite package to manila-share c56ee10d2 Drop systemd support from PAM 20161582e Improve doc of kolla-build '--docker-dir' option 2648c12c8 Reuse /var/lib/tempest symlink for rpm also 3e9b4406a Install udevadm in ironic-conductor image 10f0e55fd Remove oschecks installation e0137e7df Pin kafka java version to 8 on ubuntu 47e93f054 OpenDev Migration Patch 8371ecb2a Fix the problem that the crush map is changed f958a9d36 Bump Bifrost version to 6.0.1 6e010e25e Write hash after compressing horizon static assets ea14e33bc Fix the problem of osd initialization failed 3b4de28cb Bump Monasca Notification to fix container 666d800b0 Add config option use_dumb_init to add it to container images 0cfe0d74f Fix ubuntu binary deploys 7db2c4706 Version check: update using project name or tarball name 2c634a548 Bump versions for OpenStack Stein release 36778963b Install "procps(-ng)" in the base image 77e174504 Update UPPER_CONSTRAINTS_FILE for stable/stein 1b93d589f Update .gitreview for stable/stein 61d42b5a0 Use Stein release for all OpenStack projects 5f8395514 Fix Zookeeper builds 7b0f9dd75 Add kolla-ansible upgrade jobs to check pipeline 2399c42d9 Tidy up release notes for Stein 8.0.0 release 83e8be4f0 Set requirements branch in version-check.py 8dfc0ae0d Fix:kafka package not found by kafka package url 265f64329 Add cyborg to kolla 0c732805b Add boto3 python dependencies into gnocchi-base image a21ab86ca build: handle template syntax errors better fdd2fb35c Remove unused scripts 04c5cfb59 Install trousers to get user tss for nova_libvirt d74df2fc1 Replace openstack.org git:// URLs with https:// 3c9c72bad MariaDB upgrade: specify host and port 81ef659f9 Make tripleo-build-containers-centos-7 voting 1ff012d2c Bump skydive version to 0.22.0 95f38fb0f cleanup in base for yum install entries 91c5453cc Fixup whitespace issue in chaining cd307fb1a refactor to pull out rpm_security_update macro dd2250082 Move top package installed in every *-base container to openstack-base 2b8986892 install ncurses explicitly for tput for rpm distro 32ea1aab4 monasca, tempest: install librdkafka-dev to get it built for non-x86/source c0a2ac1ee Sahara: install also the split plugins 3075685d0 Fix MariaDB 10.3 upgrade 828209713 Properly set debian_arch for ppc64el hardware 4058c8e29 Pin sensu mailer and slack plugins d17025689 Introduce clean_package_cache cf5b5b69a Install qemu-system in nova-libvirt on ubuntu cdcd5610e Fix lower-constraints and kolla CI jobs 6d58f7b3a Add some irrelevant files to build jobs b21b19105 Update programming language mentioned in setup.cfg 4d31ca695 Move to Debian 'buster' 87eec8b00 Drop redundant rpms from nova-base package list 3f2b3187f base: more strict pin of Ceph/Luminous for Ubuntu 0e2fc8a3b Do not explictly specify mysql related RPMS b13e8ec31 Use virtual package for ansible c8f8b3012 Separate placement DB sync and data migrations ba730c029 Fix the permission issue of placement-api log 33d45a034 Drop tcp_wrappers package requirement 78c819d62 Add distro_package_manager configuration 3e5d8e265 Add python3 packages for RHEL systems 71148046f Remove distro_python3 release note 8df6eb011 replace 'distro_python3' variable with 'distro_python_version' 5eec015ca Run jobs on bionic instead of xenial ef83ff13f Introduce 'get_pip' macro 4c914512c [docker/prometheus] Bump openstack-exporter version. 1545fa694 Drop python2-pika_pool rpm 13d930701 helm-repository: drop unused os_client_config variable e13abc347 openstack-base: drop pika-pool 8c99d5300 Copy placement database migration script 7c1940240 Add Google mtail for generating metrics from logs f96433b03 Move project templates from ubuntu.yaml to project.yaml 041fb7b87 Fix Octavia-API extend_start.sh 5e1ac34c6 drop some of the xll related packages 43b74ccc1 debian/ubuntu: make use of Python3 based packages 4991607b2 nova: Remove bridge_utils from base package f3568a1ba Drop py35 jobs 1558875ee add python 3.7 unit test job in Kolla deliverable f8fd56056 base: update to dumb-init 1.2.2 92d35e9e8 Switch to stestr 4d189ab98 Change some repos from xenial to bionic bac8fd368 Added elasticsearch exporter image for prometheus 1b8890945 Simplify package list from openstack-base image cbcd2efe7 nova: Only install OVMF on EL 7 when installing from source c50df6904 Use overlay2 in tools/setup_Redhat.sh 95bce55e2 pypi package msgpack-python is deprecated, drop explicit install 2c75a2429 Install packages into octavia-api image to support wsgi ba6d7540f debian/ubuntu: drop mysql compat stuff, unify on openssl 1.1 ab679adcb debian/ubuntu: introduce 'debian_arch' variable 1d208580b gnocchi rpm naming cleanup 7e05deafb nova: Only install OVMF packages on RHEL 7 a490eef0d Fix py36 gate job 5e89fbd3b Bump up Prometheus and components versions 195a7e296 Change rfc3986>=1.1.0 to rfc3986>=1.2.0 baa611e55 Pin rabbitmq-server for ubuntu 31444571b Add missing directory info ab9213cc6 remove pep8 from lower-constraints.txt b6f6663ba Drop python2-crypto as not needed in openstack-base cfbcf830f Pin rabbitmq-server to 3.7.10 63e5e4d65 build: exit if there is no Docker connection ab942509e Allow running more commands dockerless 79ad39382 Fix broken xtrabackup and monasca-grafana images 534e02999 remove python-beaker from openstack-base rpm list b2822c785 remove test dependencies from openstack-base fd78c1ff1 Revert "Update kafka version to 2.1.0" 1f53ed6fc Utilize already existing block for rabbitmq plugin install 819924a8e Guard adding contentdir RUN in base template 95fd9b17f [prometheus] Bump openstack-exporter version. e1ee85a56 Increase gather_facts timeout e9f7fc33c Update kafka version to 2.1.0 d78144fbd Fix magnum logic for rhel 8344c8ea2 Make set_config.py compatible with both Py2 and Py3 ae1322ec1 Use base_package_type 584da2532 [collectd] add collectd-rabbitmq-monitoring fca732b81 Add base_package_type 3410a6165 Add distro_python3 option ba2a69644 Ensure /run_command is readable by all users abbebb035 Run Zun job on kuryr's changes 5f0b33f52 Bump CI post-run timeout to 2 hours c2397e62d Add python2-sqlalchemy-collectd 8d0f2df13 [prometheus] Added openstack-exporter base image. a48b01634 Copy missing heat_policy.json file 96cb18bd0 Update the remain hacking version for lower-constraints ae8834402 Fix grafana repo 411348335 Add support rabbitmq promethues plugin 8acba6ff5 Update hacking version f8d86969d Ignore undefined values in customizable filter bb9bf4643 Update docs for building ovs-dpdk images 6cf71f5df Use template for lower-constraints 2f657085c Split placement-api from nova 6c7445786 Adding cron-job link to README e261e8919 Add nfast group to barbican images 93a4ea65c Remove dependencies from kolla ansible jobs 4fa93a614 Run Zun job on chnage of Zun's docker files 55a31ee2b [Configuration] Add missing py37 and corrected default envlist. 0c4238da7 Use infra mirrors for ODL and percona repos de5c8b1f7 Bump up Skydive version 8a157cbe0 Install numactl package for Zun images d8d7281ab Fix mkdir instruction of tools/setup_Debian.sh 4ed611a0b Add neutron-rootwrap-daemon to neutron_sudoers 6258a920f Clear ENTRYPOINT configuration for Bifrost 8e1682708 Run Bifrost deploy job when Dockerfiles change 41aa8f9a8 Fix tox dependencies for release note generation 4492fb059 Complete removal of vitrage-collector service. a8eafa803 Add contrib/ dir to setup.cfg 388813490 Deprecate crane image 32beb0a64 Required changes for mariadb 10.3 433e28413 Clean up vpnaas remained 65296e27e Fix Oraclelinux build, disable collectd in gate 13e91fd47 Add missing footer block to mistral base image 3d9bcb93f Change openstack-dev to openstack-discuss 3f6a2c889 Added missing link for Sensu and Redis Sentinel 8504a2060 No need to use dict_object.keys() 531d3dc0c Use the base OS image for tripleoclient base 24c993a05 Fix the parameter order of assertEqual f8747a864 Add Percona XtraBackup link in README f077a25e4 Add management and monitoring utilities for qdrouterd 3d4f69f57 Bump storage available to Docker in CI to 25G 0984836aa base/debian: add Percona repo key 464844eeb base: tell gnupg to not use TTY when we import APT keys b2f8605f3 Fix kafka build b06d8387f Use dumb-init with --single-child 9c9a7f430 Suppress log copy output in gates 67448358b Replacing the HTTP protocal with HTTPS . e79da48e1 Add tripleo container build job cf2b2b55b Update Zaqar image 5d2f953a6 change version from 1.6 to 2.0 0cdfa0c8c base debian/ubuntu: drop not needed APT keys 36d3c5b23 Fix documentation for Kolla image-building guide 74d8e6504 Do not load dm-multipath module from the container 6d405cc9a Do not load ip_vs module from the container b4a7bcae6 Do not load iscsi_tcp from within a container. 126665616 Add python 3.6 unit test job 3da653faf Add Monasca Grafana image 9753e81a2 Update the docker storage drivers link 25de6deb4 Introduce Percona XtraBackup image 72945b092 Remove path work around for kibana 8aac00972 Copy vitrage app.wsgi when deploy install_type binary 0c9ddb42f Fix location of "upgrage-to-mariadb-10.1.20-for-redhat-family" release note 49ff6d054 Drop deprecated image neutron-sfc-agent 7eae23440 Update min tox version to 2.0 919bb29d0 Disable init lastlog and faillog database for created user 74b70d944 utils: be Python 2 compatible when squashing is enabled 96b6e4e1d ceph-base/dind: switch to btrfs-progs package e457d0704 Update the links to https b5a2be218 Update the monasca link to docs 6a87e5bbd Fix naming of override template 5792c1d7b build: remove link to failed log before creating 8e2906a59 mariadb: make security_reset.expect's timeout configurable 600093398 Install UEFI related package for nova image 441064147 neutron-base: remove bashisms 11611c67e Build and install Fluentd Monasca plugin 232cc372c neutron-base: unify Debian/Ubuntu part 81e551bde heat-all: mark as not available for Debian 646e7de71 ceph-nfs: Debian got nfs-ganesha in backports - use them 1b0f4197f Document Kolla image API 901e8d0d8 Improve pep8 checking along with hacking 5ade3f6a8 Fixed file modes in toolbox:/usr/share/ansible b18b6a6d1 Add ironic-staging-drivers to ironic-conductor for RHEL family binary and source based builds. cc7ab30b8 [prometheus] Add blackbox exporter. a13b4fbfc Fix potential Monasca-thresh start failure 2743931fe Add Monasca template override file 840fa07f1 Use rabbitmq package from OS distro for Bifrost 0c8d3f058 Add user 'zun' to group 'docker' 570a6120b Add /var/lib/kolla/venv/bin to Zun exec_dirs 43e902164 Remove '.. end' comments 1367a1f35 grafana: on aarch64 use 5.2.4 version from upstream 57c0b23b5 base: remove pinning of dh-python for ubuntu 7826ba298 ceph: stick to luminous on Ubuntu (in proper way) 6d6e1c85a fix tox python3 overrides 0cf2c5345 Downgrade Logstash for Monasca 3eb3d744d DO not install ceilometer from git in n-server-opendaylight 71d8fb478 Disable debug logs for image builds 4f9ee9f13 Add crane docker image 78001f06a Fix ceph version in ubuntu f12b702ca Add monasca user to Monasca thresh container ae8ce78e5 Use alembic migrations to deploy Monasca DB 327527461 Fix epel mirror replacement in gates fc7eb5a9c Test Fix ceilometer source builds 3b264a919 Ingore monasca-thresh in version-check.py f5c2f3d97 openvswitch: make ovs-tcpdump usable a063bee28 base: use bionic version of UCA on non-x86 b90589276 Spec: Kolla-managed backup (and restore) for MariaDB e08da5f98 Handle role properly when it is changed in kolla_keystone_user module 31c958db5 Move to the latest rabbitmq d965ddf25 Run zun-api with 'root' user 27bab7909 Download binaries more securely d585aa75a [collectd] Add many plugins to collectd dockerfile 444e9e7dc Pin ODL java version to 8 on ubuntu 451d0fc02 Increase CI image publish job to 1.5 hours e1b37f544 Add a tripleoclient container d66b3ba28 Fix Ubuntu binary aodh-base 170be6d17 Add support to deploy manila-api with Apache/wsgi f6c506df0 Revert "Use rocky tag for openstack service rather than master package" 966b0b1e3 Update reno for stable/rocky 5730d90c8 add python 3.6 unit test job 19ebea25c switch documentation job to new PTI 41720b51b Fix doc8 failures 452f9d503 import zuul job settings from project-config 75c300381 help: added dot at the end of base-arch description 0f14b3d7e Fix bluestore disk naming format in kolla 0b2682e48 Configure sudoers for zun containers a708c7cbb Add networking-generic-switch to neutron-server 863f565b0 horizon: regenerate compressed javascript and css on configuration changes e4b371fbe Update kubernetes-entrypoint v0.1.1 to 0.3.0 065651a3f Revert the patch set "Apply Swift rolling upgrade" 1fdef7d23 Update Kubernetes v1.9.4 to v1.11.1 Diffstat (except docs and test files) ------------------------------------- .gitignore | 2 +- .gitreview | 3 +- .stestr.conf | 2 + .testr.conf | 7 - .zuul.d/base.yaml | 17 +- .zuul.d/centos.yaml | 34 +- .zuul.d/oraclelinux.yaml | 12 +- .zuul.d/project.yaml | 15 +- .zuul.d/ubuntu.yaml | 20 +- README.rst | 26 +- .../monasca-template-overrides.j2 | 3 + deliverables.yaml | 2 +- .../template-override/opendaylight-source.rst | 3 - .../barbican-keystone-listener/Dockerfile.j2 | 4 +- .../ceilometer-notification/Dockerfile.j2 | 4 +- .../cloudkitty/cloudkitty-processor/Dockerfile.j2 | 4 +- .../designate-backend-bind9/Dockerfile.j2 | 6 +- .../designate/designate-pool-manager/Dockerfile.j2 | 8 +- .../keystone-fernet/fetch_fernet_tokens.py | 3 +- .../ironic-neutron-agent/Dockerfile.j2 | 15 +- .../neutron-linuxbridge-agent/Dockerfile.j2 | 4 +- .../neutron-metadata-agent-ovn/Dockerfile.j2 | 12 +- .../neutron/neutron-metadata-agent/Dockerfile.j2 | 2 +- .../neutron/neutron-metering-agent/Dockerfile.j2 | 4 +- .../neutron-openvswitch-agent/Dockerfile.j2 | 4 +- .../neutron-server-opendaylight/Dockerfile.j2 | 41 ++- .../neutron/neutron-vpnaas-agent/extend_start.sh | 8 - .../octavia/octavia-health-manager/Dockerfile.j2 | 4 +- .../prometheus-alertmanager/Dockerfile.j2 | 4 +- .../prometheus-blackbox-exporter/Dockerfile.j2 | 20 ++ .../prometheus/prometheus-cadvisor/Dockerfile.j2 | 4 +- .../Dockerfile.j2 | 20 ++ .../prometheus-haproxy-exporter/Dockerfile.j2 | 4 +- .../prometheus-memcached-exporter/Dockerfile.j2 | 4 +- .../prometheus-mysqld-exporter/Dockerfile.j2 | 4 +- .../prometheus-node-exporter/Dockerfile.j2 | 4 +- .../prometheus-openstack-exporter/Dockerfile.j2 | 20 ++ kolla/cmd/build.py | 23 +- kolla/common/config.py | 343 ++++++++++++--------- kolla/common/utils.py | 2 +- kolla/hacking/checks.py | 35 +++ kolla/image/build.py | 101 +++++- kolla/template/filters.py | 7 + kolla/template/methods.py | 7 +- lower-constraints.txt | 11 +- ...o_python_version-variable-3688288558f4e586.yaml | 7 + .../notes/add-cyborg-images-cab2b3a24a071c38.yaml | 4 + .../add-debian_arch-variable-9559ac31809afaca.yaml | 7 + ...i-httpd-packages-and-conf-1bea1364037cd64e.yaml | 8 + .../add-monasca-grafana-868f1dd95725a030.yaml | 6 + releasenotes/notes/add-mtail-b806e87da3ae950d.yaml | 5 + .../add-tripleoclient-image-0341fb72fe27ba14.yaml | 5 + ...e-dumb-init-config-option-26b47f6d97d7585c.yaml | 15 + .../notes/apache-image-serve-89942346ff89f767.yaml | 6 + .../notes/base-package-type-bf53d8d63611b5ac.yaml | 7 + .../clean_package_cache-fa08d1808a2f2b49.yaml | 6 + .../notes/debian-buster-7bd8be7ec4ce0d13.yaml | 6 + .../distro-package-manager-49634f537be63036.yaml | 7 + .../do-not-load-modules-9b651e40d3479c39.yaml | 4 + .../notes/get_pip-macro-906a78462b216049.yaml | 4 + .../notes/mariadb-dumb-init-b23949398fd44021.yaml | 7 + .../remove-neutron-sfc-agent-181ec5dbc52ac1da.yaml | 5 + .../remove-vitrage-collector-ed76366b9bb6e8e8.yaml | 5 + .../rhel-python3-support-1078f829dc42c4d6.yaml | 5 + .../sahara-split-plugins-66e31717b7c24472.yaml | 11 + ...split-placement-from-nova-27b7ea2359c2d3ae.yaml | 8 + .../notes/stein-prelude-92e47ccd60c76325.yaml | 7 + ...-monasca-api-from-fluentd-1b653db78a8644e7.yaml | 5 + .../update-zaqar-images-95a5909b48893698.yaml | 5 + ...10.3.10-for-redhat-family-93df8bf63da25659.yaml | 5 + releasenotes/source/index.rst | 1 + releasenotes/source/rocky.rst | 6 + ...10.1.20-for-redhat-family-93df8bf63da25659.yaml | 4 - requirements.txt | 3 +- roles/collect-collectd/tasks/main.yml | 4 + setup.cfg | 6 +- specs/high-availability.rst | 2 +- specs/kolla-ceph-bluestore.rst | 4 +- specs/mariadb-backup-recovery.rst | 201 ++++++++++++ test-requirements.txt | 4 +- tools/deploy_aio.sh | 48 --- tools/dump_info.sh | 2 +- tools/gate_run.sh | 16 - tools/publisher.sh | 64 ---- tools/setup_Debian.sh | 2 +- tools/setup_RedHat.sh | 52 +--- tools/setup_gate.sh | 15 - tools/version-check.py | 63 ++-- tox.ini | 176 +++-------- 365 files changed, 4434 insertions(+), 2232 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index f201b5b68..3c88d2d07 100644 --- a/requirements.txt +++ b/requirements.txt @@ -6 +5,0 @@ docker>=2.4.2 # Apache-2.0 -cryptography>=1.9 # BSD/Apache-2.0 @@ -12 +11 @@ oslo.utils>=3.33.0 # Apache-2.0 -setuptools!=24.0.0,!=34.0.0,!=34.0.1,!=34.0.2,!=34.0.3,!=34.1.0,!=34.1.1,!=34.2.0,!=34.3.0,!=34.3.1,!=34.3.2,!=36.2.0,>=16.0 # PSF/ZPL +setuptools!=24.0.0,!=34.0.0,!=34.0.1,!=34.0.2,!=34.0.3,!=34.1.0,!=34.1.1,!=34.2.0,!=34.3.0,!=34.3.1,!=34.3.2,!=36.2.0,>=21.0 # PSF/ZPL diff --git a/test-requirements.txt b/test-requirements.txt index 9c57027b1..fffd0c820 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -11 +11 @@ graphviz!=0.5.0,>=0.4 # MIT License -hacking!=0.13.0,<0.14,>=0.12.0 # Apache-2.0 +hacking>=1.1.0,<1.2.0 # Apache-2.0 @@ -22 +22 @@ pytz>=2013.6 # MIT -testrepository>=0.0.18 # Apache-2.0/BSD +stestr>=2.2.0 # Apache-2.0