We contentedly announce the release of: kolla-ansible 16.3.0: Ansible Deployment of Kolla containers This release is part of the antelope release series. The source is available from: https://opendev.org/openstack/kolla-ansible Download the package from: https://tarballs.openstack.org/kolla-ansible/ Please report issues through: https://bugs.launchpad.net/kolla-ansible/+bugs For more details, please see below. 16.3.0 ^^^^^^ New Features ************ * The new command "kolla-ansible rabbitmq-reset-state" has been added. It force-resets the state of RabbitMQ. This is primarily designed to be used when enabling HA queues, see docs: https://docs.openstack.org/kolla-ansible/latest/reference/message- queues/rabbitmq.html#high-availability * Updates apache grok pattern to match the size of response in bytes, time taken to serve the request and user agent. * You can now enable the usage of quorum queues in RabbitMQ for all services by setting the variable "om_enable_rabbitmq_quorum_queues" to "true". Notice that you can't use quorum queues and high availability at the same time. This is caught by a precheck. * Set a log retention policy for OpenSearch via Index State Management (ISM). Documentation. * Adds new "restart_policy" called "oneshot" that does not create systemd units and is used for bootstrap tasks. Upgrade Notes ************* * Added log retention in OpenSearch, previously handled by Elasticsearch Curator. By default the soft and hard retention periods are 30 and 60 days respectively. If you are upgrading from Elasticsearch, and have previously configured "elasticsearch_curator_soft_retention_period_days" or "elasticsearch_curator_hard_retention_period_days", those variables will be used instead of the defaults. You should migrate your configuration to use the new variable names before the Caracal release. * "restart_policy: no" will now create systemd units, but with "Restart" property set to "no". Bug Fixes ********* * Fix MariaDB backup if enable_proxysql is enable * Fixes 504 timeout when scraping openstack exporter. Ensures that HAProxy server timeout is the same as the scrape timeout for the openstack exporter backend. LP#2006051 * Fixes non-persistent Neutron agent state data. LP2009884 * Fix issue with octavia security group rules creation when using IPv6 configuration for octavia management network. See LP#2023502 for more details. * Fixes glance-api failed to start privsep daemon when cinder_backend_ceph is set to true. See LP#2024541 for more details. * Fixes 2024554. Adds host and "mariadb_port" to the wsrep sync status check. This is so none standard ports can be used for mariadb deployments. LP#2024554 * Starting with ansible-core 2.13, list concatenation format is changed which resulted in inability to override horizon policy files. See LP#2045660 for more details. * Fixes long service restarts while using systemd LP#2048130. * Fixes an issue with high CPU usage of the cAdvisor container by setting the per-container housekeeping interval to the same value as the Prometheus scrape interval. LP#2048223 * Fixes glance image import LP#2048525. * Fixes an issue where Prometheus would fail to scrape the OpenStack exporter when using internal TLS with an FQDN. LP#2008208 * Fixes Docker health check for the "sahara_engine" container. LP#2046268 * Fixes an issue where Fluentd was parsing Horizon WSGI application logs incorrectly. Horizon error logs are now written to "horizon- error.log" instead of "horizon.log". See LP#1898174 * Added log retention in OpenSearch, previously handled by Elasticsearch Curator, now using Index State Management (ISM) OpenSearch bundled plugin. LP#2047037. * Fixes an issue where Prometheus scraping of Etcd metrics would fail if Etcd TLS is enabled. LP#2036950 Changes in kolla-ansible 16.2.0..16.3.0 --------------------------------------- c1226615c CI: Test Nova server resize functionality 106be6dff Enable glance proxying behaviour 3858e945b cadvisor: Set housekeeping interval to Prometheus scrape interval 09ca4bdcf Fix long service restarts while using systemd b52b1dc9e Remove nova cell sync comment 128d7d9c1 Make designate bind9 cmdline configurable 3ce2fa84f Persist Neutron agent state files in volume 2801ff6a1 Fix wsrep sync status task while switched to TCP/IP 2c3ece156 Set a log retention policy for OpenSearch 9beb92628 Add nova conf for cyborg 92c8ef029 quorum: add missing octavia and masakari 0b0967253 provide a flag to enable quorum queues e7dd090b9 Fix Docker health check for sahara_engine aa860978a Fix broken list concatenation in horizon role 458d285e7 CI: Fail on fluentd log parsing errors ccd04bde6 Fix Horizon WSGI application log parsing 376529124 Remove Glance and Neutron TLS proxies from fluentd input config 58c6fdf80 keystone: do not report changed on tasks that list 5bce054a6 Adding mariadb_port to wsrep sync status so alterative ports can be used 7db47c18e Move [oslo_policy] back inside Jinja if block 1b1ada1e1 Fix proxysql get mariadb_backup_database_password dbacd038f Change regex for the multiline parser at the fluentd rabbitmq input 2a516bde4 Fix glance-api failed to start privsep daemon 10e5b2900 Set HAProxy server timeout for openstack exporter d3fc4d68c Fix issue with octavia security group rules creation 035c573f9 Add command to force reset the state of RabbitMQ 785a750f0 ovn: Fix wording in limit check 8a4de2a11 Fix OpenStack exporter scrape with internal TLS & FQDN 70e75a7d0 Adds condition to handle QoS extension in sriov_agent.ini template 232ab5ad7 Introduce oneshot docker_restart_policy 6806e0bb1 Improve grok pattern matching for apache logs c1321e230 prometheus: Fix etcd scrape when etcd uses TLS 26ba31ae0 kolla_address: check correct error return value Diffstat (except docs and test files) ------------------------------------- ansible/group_vars/all.yml | 2 + ansible/library/kolla_docker.py | 2 + ansible/module_utils/kolla_docker_worker.py | 6 +- ansible/module_utils/kolla_systemd_worker.py | 1 + ansible/rabbitmq-reset-state.yml | 10 ++++ ansible/roles/aodh/tasks/bootstrap_service.yml | 2 +- ansible/roles/aodh/templates/aodh.conf.j2 | 3 + ansible/roles/barbican/tasks/bootstrap_service.yml | 2 +- ansible/roles/barbican/templates/barbican.conf.j2 | 3 + ansible/roles/blazar/tasks/bootstrap_service.yml | 2 +- ansible/roles/blazar/templates/blazar.conf.j2 | 3 + .../roles/ceilometer/tasks/bootstrap_service.yml | 2 +- .../roles/ceilometer/templates/ceilometer.conf.j2 | 3 + ansible/roles/cinder/tasks/bootstrap_service.yml | 2 +- ansible/roles/cinder/tasks/upgrade.yml | 2 +- ansible/roles/cinder/templates/cinder.conf.j2 | 3 + .../roles/cloudkitty/tasks/bootstrap_service.yml | 2 +- .../roles/cloudkitty/templates/cloudkitty.conf.j2 | 3 + ansible/roles/common/defaults/main.yml | 4 -- .../templates/conf/format/apache_access.conf.j2 | 2 +- .../templates/conf/input/03-rabbitmq.conf.j2 | 4 +- ansible/roles/cyborg/tasks/bootstrap_service.yml | 2 +- ansible/roles/cyborg/templates/cyborg.conf.j2 | 15 +++++ ansible/roles/designate/defaults/main.yml | 1 + .../roles/designate/tasks/bootstrap_service.yml | 2 +- .../templates/designate-backend-bind9.json.j2 | 2 +- .../roles/designate/templates/designate.conf.j2 | 3 + ansible/roles/freezer/tasks/bootstrap_service.yml | 2 +- ansible/roles/glance/defaults/main.yml | 2 +- ansible/roles/glance/tasks/bootstrap_service.yml | 2 +- ansible/roles/glance/tasks/rolling_upgrade.yml | 6 +- ansible/roles/glance/templates/glance-api.conf.j2 | 5 ++ ansible/roles/gnocchi/tasks/bootstrap_service.yml | 2 +- ansible/roles/heat/tasks/bootstrap_service.yml | 2 +- ansible/roles/heat/templates/heat.conf.j2 | 3 + ansible/roles/horizon/tasks/bootstrap_service.yml | 2 +- ansible/roles/horizon/tasks/policy_item.yml | 2 +- ansible/roles/horizon/templates/horizon.conf.j2 | 3 +- ansible/roles/ironic/tasks/bootstrap_service.yml | 6 +- ansible/roles/ironic/tasks/rolling_upgrade.yml | 2 +- .../ironic/templates/ironic-inspector.conf.j2 | 3 + ansible/roles/ironic/templates/ironic.conf.j2 | 3 + ansible/roles/keystone/handlers/main.yml | 4 +- ansible/roles/keystone/tasks/bootstrap_service.yml | 4 +- .../keystone/tasks/register_identity_providers.yml | 2 + ansible/roles/keystone/templates/keystone.conf.j2 | 3 + ansible/roles/magnum/tasks/bootstrap_service.yml | 2 +- ansible/roles/magnum/templates/magnum.conf.j2 | 3 + ansible/roles/manila/tasks/bootstrap_service.yml | 2 +- ansible/roles/manila/templates/manila.conf.j2 | 3 + ansible/roles/mariadb/handlers/main.yml | 2 +- ansible/roles/mariadb/tasks/backup.yml | 2 +- ansible/roles/mariadb/tasks/bootstrap_cluster.yml | 2 +- ansible/roles/mariadb/tasks/post-upgrade.yml | 2 +- ansible/roles/mariadb/tasks/precheck.yml | 2 +- ansible/roles/mariadb/tasks/recover_cluster.yml | 4 +- ansible/roles/mariadb/tasks/restart_services.yml | 1 + ansible/roles/masakari/tasks/bootstrap_service.yml | 2 +- ansible/roles/masakari/templates/masakari.conf.j2 | 3 + ansible/roles/mistral/tasks/bootstrap_service.yml | 2 +- ansible/roles/mistral/templates/mistral.conf.j2 | 3 + ansible/roles/murano/tasks/bootstrap_service.yml | 2 +- ansible/roles/murano/templates/murano.conf.j2 | 3 + ansible/roles/neutron/tasks/bootstrap_service.yml | 2 +- ansible/roles/neutron/tasks/rolling_upgrade.yml | 4 +- ansible/roles/neutron/templates/neutron.conf.j2 | 8 +-- ansible/roles/neutron/templates/sriov_agent.ini.j2 | 5 ++ .../roles/nova-cell/tasks/bootstrap_service.yml | 2 +- ansible/roles/nova-cell/tasks/create_cells.yml | 4 +- .../roles/nova-cell/tasks/get_cell_settings.yml | 2 +- .../nova-cell/tasks/online_data_migrations.yml | 2 +- ansible/roles/nova-cell/templates/nova.conf.j2 | 3 + ansible/roles/nova/tasks/bootstrap_service.yml | 4 +- ansible/roles/nova/tasks/map_cell0.yml | 2 +- .../roles/nova/tasks/online_data_migrations.yml | 2 +- ansible/roles/nova/tasks/upgrade.yml | 2 +- ansible/roles/nova/templates/nova.conf.j2 | 5 +- ansible/roles/octavia/defaults/main.yml | 6 +- ansible/roles/octavia/tasks/bootstrap_service.yml | 2 +- ansible/roles/octavia/tasks/prepare.yml | 18 ++++++ ansible/roles/octavia/templates/octavia.conf.j2 | 3 + ansible/roles/opensearch/defaults/main.yml | 48 ++++++++++++++++ ansible/roles/opensearch/tasks/deploy.yml | 3 + ansible/roles/opensearch/tasks/post-config.yml | 65 ++++++++++++++++++++++ ansible/roles/opensearch/tasks/upgrade.yml | 3 + ansible/roles/ovn-db/tasks/lookup_cluster.yml | 14 +++-- .../roles/placement/tasks/bootstrap_service.yml | 2 +- ansible/roles/placement/tasks/upgrade.yml | 2 +- ansible/roles/prechecks/tasks/service_checks.yml | 8 +++ ansible/roles/prometheus/defaults/main.yml | 6 +- .../roles/prometheus/templates/prometheus.yml.j2 | 5 +- ansible/roles/rabbitmq/tasks/bootstrap.yml | 2 +- ansible/roles/rabbitmq/tasks/reset-state.yml | 16 ++++++ ansible/roles/sahara/defaults/main.yml | 2 +- ansible/roles/sahara/tasks/bootstrap_service.yml | 2 +- ansible/roles/sahara/templates/sahara.conf.j2 | 3 + ansible/roles/senlin/tasks/bootstrap_service.yml | 2 +- ansible/roles/senlin/templates/senlin.conf.j2 | 3 + ansible/roles/skyline/tasks/bootstrap_service.yml | 2 +- ansible/roles/solum/tasks/bootstrap_service.yml | 2 +- ansible/roles/solum/templates/solum.conf.j2 | 3 + ansible/roles/tacker/tasks/bootstrap_service.yml | 2 +- ansible/roles/tacker/templates/tacker.conf.j2 | 3 + ansible/roles/trove/tasks/bootstrap_service.yml | 2 +- ansible/roles/trove/templates/trove.conf.j2 | 3 + ansible/roles/vitrage/tasks/bootstrap_service.yml | 2 +- ansible/roles/vitrage/templates/vitrage.conf.j2 | 3 + ansible/roles/watcher/tasks/bootstrap_service.yml | 2 +- ansible/roles/watcher/templates/watcher.conf.j2 | 3 + ansible/roles/zun/tasks/bootstrap_service.yml | 2 +- ansible/roles/zun/templates/zun.conf.j2 | 3 + .../central-logging-guide.rst | 44 +++++++++++++++ kolla_ansible/database_shards.py | 1 + kolla_ansible/kolla_address.py | 2 +- ...-backup-database-password-54f43ecf102fb897.yaml | 4 ++ .../notes/bug-2006051-135bd20d5c465517.yaml | 7 +++ .../notes/bug-2009884-a13cd185a29faf9a.yaml | 5 ++ .../notes/bug-2023502-68acc8637510cb22.yaml | 7 +++ .../notes/bug-2024541-98c2864f16f8eb59.yaml | 7 +++ .../notes/bug-2024554-6eb811364536f1e8.yaml | 7 +++ ...ride-horizon-policy-files-c405906a9faf8f3b.yaml | 7 +++ .../notes/bug-2048130-23b8174396bd3c69.yaml | 5 ++ .../notes/bug-2048223-bb66fa11c6b36c5e.yaml | 7 +++ .../notes/bug-2048525-53ac0711f2c8ae4b.yaml | 5 ++ ...orce-reset-rabbitmq-state-7ec4414fd2a63d16.yaml | 7 +++ .../fix-prom-os-exp-fqdn-efb67c364b653bd9.yaml | 6 ++ ...sahara-engine-healthcheck-cfc635de9e4f56bc.yaml | 5 ++ .../notes/horizon-log-bugfix-b89f502c2f3ccaf9.yaml | 8 +++ ...prove-apache-grok-pattern-47b0bcd90f464d60.yaml | 5 ++ ...make-quorum-queues-usable-552bfb2e8975f83f.yaml | 7 +++ .../opensearch-log-retention-598c3389456a67e6.yaml | 20 +++++++ .../prometheus-etcd-tls-313e7cf454f6763a.yaml | 6 ++ .../restart-policy-oneshot-8dc9aa2f79cbfa19.yaml | 9 +++ tools/init-runonce | 1 + tools/kolla-ansible | 6 ++ 141 files changed, 679 insertions(+), 116 deletions(-)