We are overjoyed to announce the release of: kolla-ansible 7.1.1: Ansible Deployment of Kolla containers This release is part of the rocky stable release series. The source is available from: https://opendev.org/openstack/kolla-ansible Download the package from: https://tarballs.openstack.org/kolla-ansible/ Please report issues through: https://bugs.launchpad.net/kolla-ansible/+bugs For more details, please see below. 7.1.1 ^^^^^ New Features * Add support for deploying the Monasca fork of Grafana, which includes Keystone integration. * Add the Monasca Log Metrics service. This service is responsible for generating metrics from log files. * Add support for deploying the Monasca Notification service. The Notification service is responsible for notifiying users when an alert, as defined via the Monasca API, is generated by the Monasca Thresh topology. * Add support for deploying the Monasca Persister process. The Persister is responsible for reading metrics, alarms and events from Kafka and storing them in a variety of backends. * Add support for deploying the Monasca thresh service, an Apache Storm topology for alerting. * Add the Monasca Agent which provides host and application specific monitoring data collection and forwarding. * Docker logs are no longer allowed to grow unbounded and have been limited to a fixed size per container. Two new variables have been added, *docker_log_max_file* and *docker_log_max_size* which default to 5 and 50MB respectively. This means that for each container, there should be no more than 250MB of Docker logs. Changes in kolla-ansible 7.1.0..7.1.1 ------------------------------------- 153ce503f nova: Fix DBNotAllowed during compute startup 5998650bc Fix bifrost tests (Rocky) ccd9bb837 Pin ARA to <1.0.0 and use stable setup interface to find callback plugin 2ee13e179 Set log message field name in Monasca Fluentd plugin 1ed54bab9 Fix format file message field 354aa1d19 Constrain the size of Docker logs ce533592e Fix kolla-docker possible undefined variable 2d4c3dec9 CI Test: Support being source of a Ceph upgrade 20b7e39d4 Fix issues obtaining Keystone token with Monasca Grafana 47580bde5 update the event_connection to connection for panko 7cdc4e55f Find Monasca agent plugins locally dcbbe92c2 Call Grafana APIs only once 42b95ea6f Enable Kibana if Monasca enabled 7ccda50a6 Update log metrics config for Logstash downgrade d838be86b Make monasca notification templates optional 86a17c736 Parse Monasca Log API timestamps correctly 3180e735b Make Kafka maintenance easier 76b2a48e4 Automate Monasca documentation for configuring Kafka c905df48e Automatically configure Monasca Grafana datasource 54e87a438 Add documentation for Monasca standalone deployment fad05dd00 Add support for deploying Monasca Grafana ffd53bd8a Add missing HAProxy port checks for Monasca e4eae799f Add missing project name for Monasca c941e6622 Monasca specific config for Fluentd 884d8cb7e Support deploying the Monasca Agent 10fe8e47a Add initial documentation for Monasca 36bd647f3 Don't set recurse on config folders 5b687716f Forward system logs to Monasca Log API 8087e7fa0 Support using binary Logstash image 62f08e4c2 Update Monasca Log Transformer config 0cff413da Update Monasca Log Persister config 35294d768 Increase maximum payload size for Monasca Log API ba25dbc0d Prevent Monasca Notification using YAML mode d9c55e9d3 Support custom monasca-notification templates 3c4ba68f6 Disable InfluxDB reporting d2486b94d Improve registration of Monasca InfluxDB database ffd3a89cf Add region to Monasca Log API eeb04c76f Support configuring Monasca Persister performance 646919fc6 Add missing Monasca persister and notification dimensions 0e62bd7b9 Support deploying Monasca Persister 84cdd5468 Add some missing parameters for Monasca Notification f816100c8 Support deploying Monasca Notification engine 65c1e5b0d Support deploying Monasca Thresh 212f4c51b Support deploying an Apache Storm cluster 0d2c348e1 Improve scalability of Kafka 00f782095 Support deploying Monasca Log Metrics 5ab6ec8e8 Support configuring Monasca log pipeline performance b3b25f786 Remove Kafka partitions config option 9310955cd Use alembic migrations to bootstrap Monasca database 1d86b9a0b Check if glance_upgrading is defined before using it 1f655ed9c Increase retries numbers of grafana check task c418f7458 Set external web URL for Prometheus services 75dc31d92 Revert "Load configfs kernel module for iscsid" eb42bd286 OpenDev Migration Patch 4e8977c46 Load configfs kernel module for iscsid dd231570b Add customizable gnocchi volume c9ed94a58 Fix command connect to replica set primary d19a4c921 add version to OPENSTACK_KEYSTONE_URL 3203d19c3 Don't use easy_install on Ubuntu 18+ b8cd3a06e Change heat bootstrap to use internal API interface a47870032 Use database_address and database_port var for mariadb check dc1319420 Check configuration file permissions in CI fc9384117 Fix up config file permissions on the host Diffstat (except docs and test files) ------------------------------------- .gitreview | 2 +- ansible/group_vars/all.yml | 33 ++- ansible/inventory/all-in-one | 41 ++++ ansible/inventory/multinode | 41 ++++ ansible/library/kolla_docker.py | 3 +- ansible/roles/baremetal/defaults/main.yml | 7 + ansible/roles/baremetal/tasks/install.yml | 5 +- ansible/roles/baremetal/tasks/post-install.yml | 1 + .../baremetal/templates/docker_systemd_service.j2 | 2 +- ansible/roles/ceilometer/tasks/config.yml | 4 +- ansible/roles/ceph/tasks/start_mdss.yml | 2 +- ansible/roles/ceph/tasks/start_mgrs.yml | 2 +- ansible/roles/cinder/tasks/config.yml | 3 + ansible/roles/common/tasks/config.yml | 30 ++- .../conf/filter/00-record_transformer.conf.j2 | 22 ++ .../templates/conf/format/apache_access.conf.j2 | 2 +- .../templates/conf/format/wsgi_access.conf.j2 | 2 +- .../templates/conf/format/wsgi_python.conf.j2 | 2 +- .../common/templates/conf/output/00-local.conf.j2 | 32 ++- .../templates/conf/output/02-monasca.conf.j2 | 14 ++ .../common/templates/cron-logrotate-storm.conf.j2 | 3 + ansible/roles/common/templates/cron.json.j2 | 1 + ansible/roles/designate/tasks/backend_external.yml | 2 + ansible/roles/designate/tasks/config.yml | 2 +- ansible/roles/destroy/tasks/cleanup_host.yml | 1 + ansible/roles/freezer/tasks/config.yml | 2 +- ansible/roles/glance/handlers/main.yml | 2 +- ansible/roles/gnocchi/defaults/main.yml | 6 +- ansible/roles/gnocchi/tasks/ceph.yml | 1 + ansible/roles/gnocchi/tasks/config.yml | 1 + ansible/roles/gnocchi/tasks/external_ceph.yml | 2 + ansible/roles/grafana/tasks/config.yml | 1 + ansible/roles/grafana/tasks/post_config.yml | 2 +- ansible/roles/haproxy/tasks/precheck.yml | 81 +++++++ ansible/roles/haproxy/templates/haproxy.cfg.j2 | 26 +++ ansible/roles/heat/tasks/bootstrap_service.yml | 1 + ansible/roles/heat/tasks/config.yml | 1 - ansible/roles/horizon/defaults/main.yml | 2 +- ansible/roles/influxdb/templates/influxdb.conf.j2 | 2 +- ansible/roles/ironic/tasks/config.yml | 2 +- ansible/roles/kafka/defaults/main.yml | 1 + ansible/roles/kafka/tasks/config.yml | 1 - .../kafka/templates/kafka.server.properties.j2 | 15 +- ansible/roles/keystone/tasks/config.yml | 1 + ansible/roles/manila/tasks/config.yml | 1 + ansible/roles/mariadb/tasks/check.yml | 2 +- ansible/roles/mariadb/tasks/recover_cluster.yml | 13 +- ansible/roles/monasca/defaults/main.yml | 168 +++++++++++++- ansible/roles/monasca/handlers/main.yml | 173 +++++++++++++++ ansible/roles/monasca/tasks/bootstrap.yml | 29 ++- ansible/roles/monasca/tasks/bootstrap_service.yml | 5 - ansible/roles/monasca/tasks/config.yml | 244 ++++++++++++++++++++- ansible/roles/monasca/tasks/deploy.yml | 28 ++- ansible/roles/monasca/tasks/post_config.yml | 94 ++++++++ ansible/roles/monasca/tasks/precheck.yml | 33 +++ ansible/roles/monasca/tasks/register.yml | 12 + .../monasca-agent-collector/agent-collector.yml.j2 | 9 + .../monasca-agent-collector.json.j2 | 24 ++ .../monasca-agent-collector/plugins/cpu.yaml | 5 + .../monasca-agent-collector/plugins/disk.yaml | 7 + .../monasca-agent-collector/plugins/memory.yaml | 5 + .../monasca-agent-collector/plugins/network.yaml | 6 + .../monasca-agent-forwarder/agent-forwarder.yml.j2 | 26 +++ .../monasca-agent-forwarder.json.j2 | 18 ++ .../monasca-agent-statsd/agent-statsd.yml.j2 | 12 + .../monasca-agent-statsd.json.j2 | 18 ++ .../monasca/templates/monasca-api/api.conf.j2 | 1 - .../templates/monasca-grafana/grafana.ini.j2 | 55 +++++ .../monasca-grafana/monasca-grafana.json.j2 | 23 ++ .../templates/monasca-log-api/log-api.conf.j2 | 5 + .../monasca-log-metrics/log-metrics.conf.j2 | 76 +++++++ .../monasca-log-metrics.json.j2 | 18 ++ .../monasca-log-persister/log-persister.conf.j2 | 4 +- .../monasca-log-persister.json.j2 | 4 +- .../log-transformer.conf.j2 | 24 +- .../monasca-log-transformer.json.j2 | 2 +- .../monasca-notification.json.j2 | 25 +++ .../monasca-notification/notification.conf.j2 | 25 +++ .../monasca-persister/monasca-persister.json.j2 | 18 ++ .../templates/monasca-persister/persister.conf.j2 | 23 ++ .../monasca-thresh/monasca-thresh.json.j2 | 29 +++ .../monasca/templates/monasca-thresh/storm.yml.j2 | 9 + .../templates/monasca-thresh/thresh-config.yml.j2 | 132 +++++++++++ ansible/roles/neutron/tasks/config.yml | 8 +- ansible/roles/nova/tasks/config-nova-fake.yml | 2 +- ansible/roles/nova/tasks/config.yml | 5 +- ansible/roles/nova/templates/nova.conf.j2 | 2 + ansible/roles/octavia/tasks/config.yml | 2 + ansible/roles/opendaylight/tasks/config.yml | 1 + ansible/roles/openvswitch/tasks/config.yml | 4 +- ansible/roles/ovs-dpdk/tasks/config.yml | 3 +- ansible/roles/panko/tasks/bootstrap.yml | 2 +- ansible/roles/panko/templates/panko.conf.j2 | 4 +- ansible/roles/prometheus/tasks/config.yml | 4 + .../templates/prometheus-alertmanager.json.j2 | 2 +- .../prometheus/templates/prometheus-server.json.j2 | 2 +- ansible/roles/rabbitmq/tasks/config.yml | 4 +- ansible/roles/storm/defaults/main.yml | 47 ++++ ansible/roles/storm/handlers/main.yml | 44 ++++ ansible/roles/storm/meta/main.yml | 3 + ansible/roles/storm/tasks/check.yml | 1 + ansible/roles/storm/tasks/config.yml | 83 +++++++ ansible/roles/storm/tasks/deploy.yml | 5 + ansible/roles/storm/tasks/main.yml | 2 + ansible/roles/storm/tasks/precheck.yml | 41 ++++ ansible/roles/storm/tasks/pull.yml | 10 + ansible/roles/storm/tasks/reconfigure.yml | 2 + ansible/roles/storm/tasks/upgrade.yml | 2 + ansible/roles/storm/templates/storm-nimbus.json.j2 | 23 ++ ansible/roles/storm/templates/storm-worker.json.j2 | 23 ++ ansible/roles/storm/templates/storm.yml.j2 | 14 ++ ansible/roles/swift/tasks/config.yml | 1 + ansible/roles/trove/tasks/config.yml | 1 + ansible/roles/watcher/tasks/config.yml | 1 + ansible/roles/zookeeper/tasks/config.yml | 1 - ansible/site.yml | 12 +- etc/kolla/globals.yml | 1 + etc/kolla/passwords.yml | 2 + .../add-monasca-grafana-c31d4407c33939e4.yaml | 5 + .../add-monasca-log-metrics-370846df015ff96a.yaml | 5 + .../add-monasca-notification-03283c42a8df3d71.yaml | 7 + .../add-monasca-persister-c8fdd3d127b2438e.yaml | 6 + .../notes/add-monasca-thresh-f7a860ce996684f9.yaml | 5 + .../notes/add_monasca_agent-2b3b2f484a9e7168.yaml | 4 + .../limit-docker-log-size-33133da03b232ece.yaml | 8 + tools/cleanup-host | 5 + tools/setup_gate.sh | 55 ++++- zuul.d/base.yaml | 2 +- 134 files changed, 2514 insertions(+), 97 deletions(-)