We are happy to announce the release of: watcher 14.0.0 This release is part of the epoxy release series. The source is available from: https://opendev.org/openstack/watcher Download the package from: https://tarballs.openstack.org/watcher/ Please report issues through: https://bugs.launchpad.net/watcher/+bugs For more details, please see below. Changes in watcher 13.0.0..14.0.0 --------------------------------- bbf5c41c Add epoxy prelude df3d67a4 Replace deprecated abc.abstractproperty 82f1c720 Drop implicit test dependency on iso8601 342fe888 Enable prometheus datasource in watcher-prometheus-integration job 7fcca0cc Enable prometheus and node_exporter from devstack-plugin-prometheus 977f014c Deprecate Monasca data source 753c44b0 Further database refactoring dd0082c3 pre-commit: Integrate bandit 5f6fbaea Remove unused os-api-ref from test requirements 6b81b34b Drop import fallback for Python 2 136e5d92 Add support for instance metrics to prometheus datasource 1968334b Drop bandit B320 profile to fix tox -e bandit interface 56b8c121 Add Tempest test for Prometheus integration 3f26dc47 Add prometheus data source for watcher decision engine 1b6f723c Imported Translations from Zanata da23fdc6 Remove ceilometer datasource 2ab27c0d X-Project-Name key in test code was duplicated fbb290b2 Fix create_continuous_audit_with_wrong_interval test assert c80c940a Update gate jobs as per the 2025.1 cycle testing runtime f07694ba Fix incompatiablity between apscheduler and eventlet 9abec18c [pre-commit] enforce pre-commit checks in ci 1f8d06e0 [docs] apply sphinx-lint to docs 29c94c10 Replace deprecated configure_auth_token_middleware 3f3e6603 reno: Update master for unmaintained/2023.1 2eefaeed Remove default override for config options policy_file 5fadd0de [pre-commit] Fix execute and shebang lines c5edad22 [eventlet] Ensure unit tests are monkey patched 405bb930 [tox] update tox.ini to enable debugging 5f79ab87 [pre-commit] fix typos and configure codespell 6adaedf6 Update python versions, drop py3.8 f3ff65f2 Update master for stable/2024.2 b5e45b43 Drop unnecessary 'x' bit from doc config file 38288dd9 Run watcher-db-manage in grenade testing from venv 9d8b990f [pre-commit] Add initial pre-commit config 2c4fb7a9 tox: Drop envdir 61a7dd85 Replace deprecated datetime.utcnow() a7dd5139 Remove workaround for eventlet < 0.27.0 a47cedec Convert CRLF to LF 566a830f Bump hacking 5c627a3a Replace deprecated LegacyEngineFacade 2bc49149 reno: Update master for unmaintained/zed f0935fb3 Update master for stable/2024.1 762686e9 reno: Update master for unmaintained/xena 0f0527ab reno: Update master for unmaintained/wallaby 6e26e415 reno: Update master for unmaintained/victoria 954fc282 reno: Update master for unmaintained/yoga Diffstat (except docs and test files) ------------------------------------- .pre-commit-config.yaml | 62 ++ .zuul.yaml | 193 +++++-- .../samples/audit-list-detailed-response.json | 2 +- .../source/samples/datamodel-list-response.json | 8 +- api-ref/source/watcher-api-v1-goals.inc | 4 +- devstack/lib/watcher | 20 +- devstack/plugin.sh | 2 - devstack/upgrade/from_rocky/upgrade-watcher | 2 - devstack/upgrade/upgrade.sh | 2 +- playbooks/generate_prometheus_config.yml | 9 + playbooks/templates/prometheus.yml.j2 | 13 + rally-jobs/README.rst | 3 +- .../notes/2025.1-prelude-8be97eece4e1d1ff.yaml | 33 ++ ...-to-prometheus-datasource-9fba8c174ff845e1.yaml | 6 + .../notes/add-scoring-module-fa00d013ed2d614e.yaml | 2 +- .../notes/api-call-retry-fef741ac684c58dd.yaml | 2 +- .../api-microversioning-7999a3ee8073bf32.yaml | 2 +- .../deprecate-monasca-ds-9065f4d4bee09ab2.yaml | 5 + .../drop-python38-support-eeb19a0bc0160sw1.yaml | 6 + ...ecision-engine-threadpool-0711b23abfc9d409.yaml | 2 +- ...mprove-compute-data-model-b427c85e4ed2b6fb.yaml | 2 +- .../prometheus-datasource-e56f2f7b8f3427c2.yaml | 8 + ...ove-ceilometer-datasource-8d9ab7d64d61e405.yaml | 6 + .../notes/stale-action-plan-b6a6b08df873c128.yaml | 2 +- ...watcher-notifications-ovo-7b44d52ef6400dd0.yaml | 2 +- .../watcher-service-list-7b2f4b64f71e9b89.yaml | 2 +- releasenotes/source/2023.1.rst | 2 +- releasenotes/source/2024.1.rst | 6 + releasenotes/source/2024.2.rst | 6 + releasenotes/source/conf.py | 100 ++-- releasenotes/source/index.rst | 2 + .../locale/en_GB/LC_MESSAGES/releasenotes.po | 42 +- .../source/locale/fr/LC_MESSAGES/releasenotes.po | 33 -- releasenotes/source/victoria.rst | 2 +- releasenotes/source/wallaby.rst | 2 +- releasenotes/source/xena.rst | 2 +- releasenotes/source/yoga.rst | 2 +- releasenotes/source/zed.rst | 2 +- requirements.txt | 13 +- setup.cfg | 9 +- test-requirements.txt | 10 +- tox.ini | 29 +- watcher/api/controllers/v1/action.py | 10 +- watcher/api/controllers/v1/action_plan.py | 9 +- watcher/api/controllers/v1/audit.py | 23 +- watcher/api/controllers/v1/audit_template.py | 10 +- watcher/api/controllers/v1/data_model.py | 1 + watcher/api/controllers/v1/goal.py | 5 +- watcher/api/controllers/v1/scoring_engine.py | 1 + watcher/api/controllers/v1/service.py | 3 +- watcher/api/controllers/v1/strategy.py | 3 +- watcher/api/controllers/v1/types.py | 1 + watcher/api/controllers/v1/webhooks.py | 1 + watcher/api/hooks.py | 1 + watcher/api/middleware/auth_token.py | 1 + watcher/applier/actions/base.py | 3 +- watcher/applier/default.py | 0 watcher/applier/workflow_engine/default.py | 1 + watcher/cmd/__init__.py | 22 +- watcher/common/cinder_helper.py | 4 +- watcher/common/clients.py | 25 - watcher/common/context.py | 3 + watcher/common/exception.py | 4 + watcher/common/keystone_helper.py | 4 +- watcher/common/nova_helper.py | 17 +- watcher/common/policy.py | 8 - watcher/common/scheduling.py | 29 +- watcher/common/service.py | 3 +- watcher/common/service_manager.py | 21 +- watcher/conf/__init__.py | 4 +- watcher/conf/applier.py | 2 +- watcher/conf/ceilometer_client.py | 63 -- watcher/conf/ironic_client.py | 0 watcher/conf/nova_client.py | 0 watcher/conf/prometheus_client.py | 62 ++ watcher/db/sqlalchemy/alembic/env.py | 4 +- watcher/db/sqlalchemy/api.py | 195 +++---- watcher/db/sqlalchemy/job_store.py | 8 +- watcher/db/sqlalchemy/migration.py | 6 +- watcher/db/sqlalchemy/models.py | 8 - watcher/decision_engine/audit/continuous.py | 15 +- watcher/decision_engine/datasources/base.py | 4 +- watcher/decision_engine/datasources/ceilometer.py | 276 --------- watcher/decision_engine/datasources/gnocchi.py | 14 +- watcher/decision_engine/datasources/grafana.py | 7 +- .../datasources/grafana_translator/influxdb.py | 8 +- watcher/decision_engine/datasources/manager.py | 40 +- watcher/decision_engine/datasources/monasca.py | 6 +- watcher/decision_engine/datasources/prometheus.py | 512 ++++++++++++++++ .../decision_engine/goal/efficacy/indicators.py | 3 +- watcher/decision_engine/model/collector/base.py | 9 +- watcher/decision_engine/model/collector/cinder.py | 1 + watcher/decision_engine/model/collector/ironic.py | 1 + watcher/decision_engine/model/collector/nova.py | 6 +- watcher/decision_engine/model/element/base.py | 2 +- watcher/decision_engine/model/model_root.py | 2 +- watcher/decision_engine/model/notification/base.py | 3 +- watcher/decision_engine/solution/base.py | 3 +- .../decision_engine/strategy/selection/default.py | 4 +- .../decision_engine/strategy/strategies/base.py | 0 .../strategy/strategies/host_maintenance.py | 2 +- .../strategy/strategies/noisy_neighbor.py | 4 +- .../strategy/strategies/uniform_airflow.py | 2 +- .../strategy/strategies/zone_migration.py | 6 +- watcher/decision_engine/threading.py | 4 +- watcher/eventlet.py | 41 ++ watcher/hacking/checks.py | 10 +- watcher/objects/action_plan.py | 10 +- .../action_plan/test_default_action_handler.py | 0 .../decision_engine/audit/test_audit_handlers.py | 17 +- .../decision_engine/datasources/test_manager.py | 10 +- .../datasources/test_prometheus_helper.py | 643 +++++++++++++++++++++ .../decision_engine/model/ceilometer_metrics.py | 319 ---------- .../model/faker_cluster_and_metrics.py | 4 +- .../notification/test_cinder_notifications.py | 4 +- .../decision_engine/planner/test_weight_planner.py | 6 +- .../planner/test_workload_stabilization_planner.py | 6 +- .../strategy/strategies/test_base.py | 8 +- .../strategies/test_basic_consolidation.py | 4 - .../strategy/strategies/test_host_maintenance.py | 0 .../strategy/strategies/test_noisy_neighbor.py | 6 +- .../strategies/test_outlet_temp_control.py | 4 - .../strategy/strategies/test_uniform_airflow.py | 4 - .../strategies/test_vm_workload_consolidation.py | 4 - .../strategy/strategies/test_workload_balance.py | 4 - .../strategies/test_workload_stabilization.py | 4 - .../strategy/strategies/test_zone_migration.py | 6 +- .../notifications/test_service_notifications.py | 4 +- 170 files changed, 2663 insertions(+), 1565 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index dac6e9c9..ae53ed09 100644 --- a/requirements.txt +++ b/requirements.txt @@ -1,4 +1,3 @@ -# The order of packages is significant, because pip processes them in the order -# of appearance. Changing the order has an impact on the overall integration -# process, which may cause wedges in the gate later. - +# Requirements lower bounds listed here are our best effort to keep them up to +# date but we do not test them so no guarantee of having them all correct. If +# you find any incorrect lower bounds, let us know or propose a fix. @@ -5,0 +5 @@ apscheduler>=3.5.1 # MIT License +eventlet>=0.27.0 # MIT @@ -21 +21 @@ oslo.messaging>=14.1.0 # Apache-2.0 -oslo.policy>=3.6.0 # Apache-2.0 +oslo.policy>=4.5.0 # Apache-2.0 @@ -26 +26 @@ oslo.upgradecheck>=1.3.0 # Apache-2.0 -oslo.utils>=3.36.0 # Apache-2.0 +oslo.utils>=7.0.0 # Apache-2.0 @@ -38,0 +39 @@ python-novaclient>=14.1.0 # Apache-2.0 +python-observabilityclient>=0.3.0 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index 72adc68f..4b261e60 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -1,4 +0,0 @@ -# The order of packages is significant, because pip processes them in the order -# of appearance. Changing the order has an impact on the overall integration -# process, which may cause wedges in the gate later. - @@ -6 +1,0 @@ coverage>=4.5.1 # Apache-2.0 -doc8>=0.8.0 # Apache-2.0 @@ -8 +2,0 @@ freezegun>=0.3.10 # Apache-2.0 -hacking>=3.0.1,<3.1.0 # Apache-2.0 @@ -13,3 +7 @@ stestr>=2.0.0 # Apache-2.0 -os-api-ref>=1.4.0 # Apache-2.0 -bandit>=1.6.0 # Apache-2.0 -WebTest>=2.0.27 # MIT \ No newline at end of file +WebTest>=2.0.27 # MIT