We are happy to announce the release of: kolla-ansible 14.11.0: Ansible Deployment of Kolla containers This release is part of the yoga stable release series. The source is available from: https://opendev.org/openstack/kolla-ansible Download the package from: https://tarballs.openstack.org/kolla-ansible/ Please report issues through: https://bugs.launchpad.net/kolla-ansible/+bugs For more details, please see below. 14.11.0 ^^^^^^^ New Features ************ * Adds warning and support for automatic pruning of stale Kibana indices during OpenSearch migration by running "kolla-ansible opensearch-migration" with "--prune-kibana-indices" parameter. * The new command "kolla-ansible rabbitmq-reset-state" has been added. It force-resets the state of RabbitMQ. This is primarily designed to be used when enabling HA queues, see docs: https://docs.openstack.org/kolla-ansible/latest/reference/message- queues/rabbitmq.html#high-availability * Updates apache grok pattern to match the size of response in bytes, time taken to serve the request and user agent. * Masakari coordination backend can now be configured via masakari_coordination_backend variable. Coordination is optional and can now be set to either redis or etcd. * Set a log retention policy for OpenSearch via Index State Management (ISM). Documentation. * Adds the ability to configure rabbitmq via "rabbitmq_extra_config" which can be overriden in globals.yml. * In the configuration template of the Senlin service the "cafile" parameter is now set by default in the "authentication" section. This way the use of self-signed certificates on the internal Keystone endpoint is also usable in the Senlin service. Upgrade Notes ************* * Added log retention in OpenSearch, previously handled by Elasticsearch Curator. By default the soft and hard retention periods are 30 and 60 days respectively. If you are upgrading from Elasticsearch, and have previously configured "elasticsearch_curator_soft_retention_period_days" or "elasticsearch_curator_hard_retention_period_days", those variables will be used instead of the defaults. You should migrate your configuration to use the new variable names before the Caracal release. Bug Fixes ********* * Fixes 504 timeout when scraping openstack exporter. Ensures that HAProxy server timeout is the same as the scrape timeout for the openstack exporter backend. LP#2006051 * Fixes non-persistent Neutron agent state data. LP2009884 * Fixes glance-api failed to start privsep daemon when cinder_backend_ceph is set to true. See LP#2024541 for more details. * Fixes 2024554. Adds mariadb_port to the wsrep sync status check. This is so none standard ports can be used for mariadb deployments. LP#2024554 * Fixes glance image import LP#2048525. * Fixes an issue where Prometheus would fail to scrape the OpenStack exporter when using internal TLS with an FQDN. LP#2008208 * Fixes Docker health check for the "sahara_engine" container. LP#2046268 * Fixes an issue where Fluentd was parsing Horizon WSGI application logs incorrectly. Horizon error logs are now written to "horizon- error.log" instead of "horizon.log". See LP#1898174 * Added log retention in OpenSearch, previously handled by Elasticsearch Curator, now using Index State Management (ISM) OpenSearch bundled plugin. LP#2047037. * Fixes an issue where Prometheus scraping of Etcd metrics would fail if Etcd TLS is enabled. LP#2036950 Changes in kolla-ansible 14.10.0..14.11.0 ----------------------------------------- 738f7761a CI: Test Nova server resize functionality d56f46874 Enable glance proxying behaviour 46b1d5771 fluentd: remove deprecated parameter ff13ac6fc Remove nova cell sync comment 1636e432e Make designate bind9 cmdline configurable 83ad92727 [yoga-only] opensearch: remove kolla_container_engine 3e2f6b856 Persist Neutron agent state files in volume 0a7ad80a0 Set a log retention policy for OpenSearch f1e57644d Add nova conf for cyborg 77d4a4060 CI: treat ansible-lint warnings as errors 8c9cc9696 Fix Docker health check for sahara_engine 69e8f94a7 Adding mariadb_port to wsrep sync status so alterative ports can be used f03d2bc04 Change regex for the multiline parser at the fluentd rabbitmq input da5d7c4b4 Fix Horizon WSGI application log parsing 0cedba519 Remove Glance and Neutron TLS proxies from fluentd input config 6d645a5a9 keystone: do not report changed on tasks that list fd3299b9b Fix kolla_container_engine since not exist in Yoga 64ef9451f Fix glance-api failed to start privsep daemon e0434021e doc: Add Jammy to Yoga docs a552843f6 Set HAProxy server timeout for openstack exporter f4422e58f Configure coordination in default for masakari-api 689a7c7f0 Add ability to configure rabbitmq c33f8defb Add command to force reset the state of RabbitMQ eaaa30ee5 Fix OpenStack exporter scrape with internal TLS & FQDN 8408abf3e ovn: Fix wording in limit check b05d7780a Adds condition to handle QoS extension in sriov_agent.ini template 2a21ff6f3 Improve grok pattern matching for apache logs 4c41d32c8 OpenSearch migration - prune old Kibana indices 52d2c9ea0 opensearch migration: run common role 12979e7df prometheus: Fix etcd scrape when etcd uses TLS 4ff451d6b senlin: add missing cafile parameter Diffstat (except docs and test files) ------------------------------------- .ansible-lint | 1 + ansible/group_vars/all.yml | 1 + ansible/opensearch-migration.yml | 75 ++++++++++++++++++++-- ansible/rabbitmq-reset-state.yml | 10 +++ ansible/roles/common/defaults/main.yml | 4 -- .../templates/conf/format/apache_access.conf.j2 | 2 +- .../common/templates/conf/input/00-global.conf.j2 | 14 ++-- .../common/templates/conf/input/01-syslog.conf.j2 | 5 +- .../common/templates/conf/input/02-mariadb.conf.j2 | 22 ++++--- .../templates/conf/input/03-rabbitmq.conf.j2 | 8 ++- .../templates/conf/input/04-openstack-wsgi.conf.j2 | 5 +- .../common/templates/conf/input/05-libvirt.conf.j2 | 9 ++- .../templates/conf/input/06-zookeeper.conf.j2 | 10 +-- .../common/templates/conf/input/07-kafka.conf.j2 | 10 +-- .../common/templates/conf/input/09-monasca.conf.j2 | 10 +-- .../templates/conf/input/10-openvswitch.conf.j2 | 24 ++++--- .../common/templates/conf/output/00-local.conf.j2 | 2 +- .../common/templates/conf/output/01-es.conf.j2 | 2 +- ansible/roles/cyborg/templates/cyborg.conf.j2 | 12 ++++ ansible/roles/designate/defaults/main.yml | 1 + .../templates/designate-backend-bind9.json.j2 | 2 +- ansible/roles/glance/defaults/main.yml | 2 +- ansible/roles/glance/templates/glance-api.conf.j2 | 2 + ansible/roles/horizon/templates/horizon.conf.j2 | 3 +- .../keystone/tasks/register_identity_providers.yml | 2 + ansible/roles/mariadb/tasks/precheck.yml | 2 +- ansible/roles/mariadb/tasks/restart_services.yml | 2 +- ansible/roles/masakari/templates/masakari.conf.j2 | 9 +++ ansible/roles/neutron/templates/neutron.conf.j2 | 5 +- ansible/roles/neutron/templates/sriov_agent.ini.j2 | 5 ++ ansible/roles/nova/tasks/bootstrap_service.yml | 2 - ansible/roles/opensearch/defaults/main.yml | 48 ++++++++++++++ ansible/roles/opensearch/tasks/deploy.yml | 3 + ansible/roles/opensearch/tasks/post-config.yml | 61 ++++++++++++++++++ ansible/roles/opensearch/tasks/upgrade.yml | 3 + ansible/roles/ovn-db/tasks/lookup_cluster.yml | 14 ++-- ansible/roles/prometheus/defaults/main.yml | 2 + .../roles/prometheus/templates/prometheus.yml.j2 | 5 +- ansible/roles/rabbitmq/defaults/main.yml | 1 + ansible/roles/rabbitmq/tasks/reset-state.yml | 16 +++++ ansible/roles/rabbitmq/templates/rabbitmq.conf.j2 | 3 + ansible/roles/sahara/defaults/main.yml | 2 +- ansible/roles/senlin/templates/senlin.conf.j2 | 1 + .../central-logging-guide-opensearch.rst | 55 +++++++++++++++- ...nsearch-migration-reindex-f2679bd4dd8dfb18.yaml | 7 ++ .../notes/bug-2006051-135bd20d5c465517.yaml | 7 ++ .../notes/bug-2009884-a13cd185a29faf9a.yaml | 5 ++ .../notes/bug-2024541-98c2864f16f8eb59.yaml | 7 ++ .../notes/bug-2024554-6eb811364536f1e8.yaml | 7 ++ .../notes/bug-2048525-53ac0711f2c8ae4b.yaml | 5 ++ ...orce-reset-rabbitmq-state-7ec4414fd2a63d16.yaml | 7 ++ .../fix-prom-os-exp-fqdn-efb67c364b653bd9.yaml | 6 ++ ...sahara-engine-healthcheck-cfc635de9e4f56bc.yaml | 5 ++ .../notes/horizon-log-bugfix-b89f502c2f3ccaf9.yaml | 8 +++ ...prove-apache-grok-pattern-47b0bcd90f464d60.yaml | 5 ++ ...kari-coordination-backend-d3b742315a07aabc.yaml | 6 ++ .../opensearch-log-retention-598c3389456a67e6.yaml | 20 ++++++ .../prometheus-etcd-tls-313e7cf454f6763a.yaml | 6 ++ .../rabbitmq-configuration-6b100a390734dc29.yaml | 5 ++ ...lin-authentication-cafile-4fe5e2f79769c872.yaml | 7 ++ tools/init-runonce | 1 + tools/kolla-ansible | 15 ++++- 66 files changed, 595 insertions(+), 91 deletions(-)