We joyfully announce the release of: python-watcher 1.7.0: OpenStack Watcher provides a flexible and scalable resource optimization service for multi-tenant OpenStack- based clouds. This release is part of the queens release series. The source is available from: https://github.com/openstack/watcher Download the package from: https://tarballs.openstack.org/watcher/ Please report issues through launchpad: https://bugs.launchpad.net/watcher For more details, please see below. 1.7.0 ^^^^^ New Features * Adds audit scoper for storage data model, now watcher users can specify audit scope for storage CDM in the same manner as compute scope. * Adds baremetal data model in Watcher * Added a way to check state of strategy before audit's execution. Administrator can use "watcher strategy state <strategy_name>" command to get information about metrics' availability, datasource's availability and CDM's availability. * Added storage capacity balance strategy. * Added strategy "Zone migration" and it's goal "Hardware maintenance". The strategy migrates many instances and volumes efficiently with minimum downtime automatically. Changes in python-watcher 1.6.0..1.7.0 -------------------------------------- 16e7d9c Add baremetal strategy validation 0c66fe2 Strategy requirements 1dae83d Add zone migration strategy 701b258 Fix workload_stabilization unavailable nodes and instances f7fcdf1 Update unreachable link 47ba6c0 Updated from global requirements 27e8875 Fix compute api ref link 891f6bc Adapt workload_balance strategy to multiple datasource backend 5dd6817 Adapt noisy_neighbor strategy to multiple datasource backend 7cdcb47 Adapt basic_consolidation strategy to multiple datasource backend 6d03c4c check audit name length bcc129c Audit scoper for storage CDM 1a48a7f Imported Translations from Zanata 42a3886 Update link address 3430493 Fix tempest devstack error f5bcf9d Add storage capacity balance Strategy 3c8caa3 Updated from global requirements ce196b6 Adapt workload_stabilization strategy to new datasource backend 42130c4 Updated from global requirements 1a8639d Update pike install supermark to queens 1702fe1 Add the title of API Guide 354ebd3 Fix compute scope test bug 54da2a7 Add baremetal data model bd79882 Set apscheduler logs to WARN level 960c50b Fix configuration doc link 9411f85 update audit API description b4370f0 update action API description 96fa7f3 use current weighted sd as min_sd when starting to simulate migrations 070aed7 correct audit parameter typo 6f27275 Updated from global requirements 95548af Fix watcher audit list command cdc847d check actionplan state when deleting actionplan cbd6d88 TrivialFix: remove redundant import alias a8fa969 check audit state when deleting audit 80ee4b2 reset job interval when audit was updated ec0c359 Updated from global requirements 3b6bef1 Fix releasenotes build c6afa7c Update getting scoped storage CDM 9ccd17e Updated from global requirements be56441 Fix 'unable to exclude instance' 0242d33 Register default policies in code c38dc98 listen to 'compute.instance.rebuild.end' event 4ce1a90 Updated from global requirements 02163d6 bug fix remove volume migration type 'cold' d91f0bf Add and identify excluded instances in compute CDM e401cb7 Add Datasource Abstraction fa31341 'get_volume_type_by_backendname' returns a list Diffstat (except docs and test files) ------------------------------------- devstack/lib/watcher | 24 +- devstack/settings | 3 + .../watcher-policy-generator.conf | 3 + etc/watcher/policy.json | 45 - ...er-for-storage-data-model-cdccc803542d22db.yaml | 5 + ...tal-data-model-in-watcher-3023453a47b61dab.yaml | 4 + ...eck-strategy-requirements-66f9e9262412f8ec.yaml | 6 + .../storage-workload-balance-0ecabbc1791e6894.yaml | 4 + .../zone-migration-strategy-10f7656a2a01e607.yaml | 6 + releasenotes/source/conf.py | 1 - .../locale/en_GB/LC_MESSAGES/releasenotes.po | 215 ++++- .../source/locale/fr/LC_MESSAGES/releasenotes.po | 33 - requirements.txt | 14 +- setup.cfg | 10 + test-requirements.txt | 6 +- tox.ini | 4 + watcher/api/controllers/v1/action.py | 6 +- watcher/api/controllers/v1/action_plan.py | 9 + watcher/api/controllers/v1/audit.py | 36 +- watcher/api/controllers/v1/strategy.py | 22 + watcher/applier/actions/volume_migration.py | 34 +- watcher/cmd/sync.py | 2 +- watcher/common/cinder_helper.py | 31 +- watcher/common/exception.py | 24 + watcher/common/ironic_helper.py | 49 ++ watcher/common/nova_helper.py | 5 +- watcher/common/policies/__init__.py | 37 + watcher/common/policies/action.py | 57 ++ watcher/common/policies/action_plan.py | 79 ++ watcher/common/policies/audit.py | 90 ++ watcher/common/policies/audit_template.py | 90 ++ watcher/common/policies/base.py | 32 + watcher/common/policies/goal.py | 57 ++ watcher/common/policies/scoring_engine.py | 66 ++ watcher/common/policies/service.py | 57 ++ watcher/common/policies/strategy.py | 68 ++ watcher/common/policy.py | 25 +- watcher/common/service.py | 3 +- watcher/datasource/base.py | 120 +++ watcher/datasource/ceilometer.py | 93 +- watcher/datasource/gnocchi.py | 119 ++- watcher/datasource/manager.py | 78 ++ watcher/datasource/monasca.py | 95 +- .../sqlalchemy/alembic/versions/a86240e89a29_.py | 34 + watcher/decision_engine/audit/continuous.py | 23 +- watcher/decision_engine/goal/__init__.py | 5 +- .../decision_engine/goal/efficacy/indicators.py | 115 +++ watcher/decision_engine/goal/efficacy/specs.py | 83 ++ watcher/decision_engine/goal/goals.py | 25 + watcher/decision_engine/manager.py | 5 +- watcher/decision_engine/model/collector/cinder.py | 84 +- watcher/decision_engine/model/collector/ironic.py | 97 ++ watcher/decision_engine/model/collector/nova.py | 1 + watcher/decision_engine/model/element/__init__.py | 4 +- .../model/element/baremetal_resource.py | 33 + watcher/decision_engine/model/element/instance.py | 3 + watcher/decision_engine/model/element/node.py | 17 +- watcher/decision_engine/model/model_root.py | 90 +- watcher/decision_engine/model/notification/nova.py | 27 + watcher/decision_engine/rpcapi.py | 4 + watcher/decision_engine/scope/baremetal.py | 46 + watcher/decision_engine/scope/compute.py | 29 +- watcher/decision_engine/scope/storage.py | 165 ++++ .../strategy/strategies/__init__.py | 9 +- .../decision_engine/strategy/strategies/base.py | 112 ++- .../strategy/strategies/basic_consolidation.py | 132 +-- .../strategy/strategies/noisy_neighbor.py | 54 +- .../strategy/strategies/outlet_temp_control.py | 2 + .../strategies/storage_capacity_balance.py | 411 +++++++++ .../strategy/strategies/uniform_airflow.py | 2 + .../strategies/vm_workload_consolidation.py | 3 + .../strategy/strategies/workload_balance.py | 71 +- .../strategy/strategies/workload_stabilization.py | 131 +-- .../strategy/strategies/zone_migration.py | 975 +++++++++++++++++++++ watcher/locale/en_GB/LC_MESSAGES/watcher.po | 773 ++++++++++++++++ .../decision_engine/audit/test_audit_handlers.py | 34 + .../decision_engine/model/ceilometer_metrics.py | 31 +- .../model/data/ironic_scenario_1.xml | 12 + .../data/scenario_1_with_1_node_unavailable.xml | 50 ++ .../decision_engine/model/faker_cluster_state.py | 58 +- .../scenario3_legacy_instance-rebuild-end.json | 59 ++ .../notification/test_cinder_notifications.py | 6 +- .../model/notification/test_nova_notifications.py | 24 + .../strategies/test_basic_consolidation.py | 12 +- .../strategy/strategies/test_noisy_neighbor.py | 24 +- .../strategies/test_storage_capacity_balance.py | 245 ++++++ .../strategy/strategies/test_strategy_endpoint.py | 66 ++ .../strategy/strategies/test_workload_balance.py | 40 +- .../strategies/test_workload_stabilization.py | 68 +- .../strategy/strategies/test_zone_migration.py | 719 +++++++++++++++ 115 files changed, 7095 insertions(+), 701 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 909cb1f..f4337f5 100644 --- a/requirements.txt +++ b/requirements.txt @@ -13 +13 @@ croniter>=0.3.4 # MIT License -oslo.concurrency>=3.20.0 # Apache-2.0 +oslo.concurrency>=3.25.0 # Apache-2.0 @@ -19 +19 @@ oslo.i18n>=3.15.3 # Apache-2.0 -oslo.log>=3.30.0 # Apache-2.0 +oslo.log>=3.36.0 # Apache-2.0 @@ -21 +21 @@ oslo.messaging>=5.29.0 # Apache-2.0 -oslo.policy>=1.23.0 # Apache-2.0 +oslo.policy>=1.30.0 # Apache-2.0 @@ -24,2 +24,2 @@ oslo.serialization!=2.19.1,>=2.18.0 # Apache-2.0 -oslo.service>=1.24.0 # Apache-2.0 -oslo.utils>=3.31.0 # Apache-2.0 +oslo.service!=1.28.1,>=1.24.0 # Apache-2.0 +oslo.utils>=3.33.0 # Apache-2.0 @@ -34 +34 @@ python-ceilometerclient>=2.5.0 # Apache-2.0 -python-cinderclient>=3.2.0 # Apache-2.0 +python-cinderclient>=3.3.0 # Apache-2.0 @@ -45 +45 @@ stevedore>=1.20.0 # Apache-2.0 -taskflow>=2.7.0 # Apache-2.0 +taskflow>=2.16.0 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index c8bd6e4..9d4053d 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -10 +10 @@ mock>=2.0.0 # BSD -oslotest>=1.10.0 # Apache-2.0 +oslotest>=3.2.0 # Apache-2.0 @@ -17,2 +17,2 @@ testtools>=2.2.0 # MIT -openstackdocstheme>=1.17.0 # Apache-2.0 -sphinx>=1.6.2 # BSD +openstackdocstheme>=1.18.1 # Apache-2.0 +sphinx!=1.6.6,>=1.6.2 # BSD