October 2016 - OpenStack-announce

[new][telemetry] aodh 3.0.0 release (newton)
by no-reply＠openstack.org 06 Oct '16

06 Oct '16

We are glowing to announce the release of: aodh 3.0.0: OpenStack Telemetry Alarming This release is part of the newton release series. For more details, please see below. 3.0.0 ^^^^^ New Features ************ * Enable aodh services, including aodh-evaluator, aodh-listener and aodh-notifier to run in multiple worker mode. New options are introduced corresponsively as [evaluator]workers, [listener]workers and [notifier]workers. They all default to 1. * Add support for batch processing of messages from queue. This will allow the aodh-listener to grab multiple event messages per thread to enable more efficient processing. * A new option “rest_notifier_ca_bundle_certificate_path” has been added in the configuration file, set None as default value. If this option is present and SSL is used for alarm action the certificate path provided will be used as value of verify parameter in action request. * Allow to extends the alarm evaluation windows to to compensate the reporting/ingestion lag. An new option is introduced additional_ingestion_lag defaulted to 0. It represents the number of seconds of the window extension. * Add support for batch processing of messages from queue. This will allow the aodh-notifier to grab multiple messages per thread to enable more efficient processing. Upgrade Notes ************* * Add a tool for migrating alarm and alarm history data from NoSQL storage to SQL storage. The migration tool has been tested OK in devstack environment, but users need to be cautious with this, because the data migration between storage backends is a bit dangerous. * batch_size and batch_timeout configuration options are added to [listener] section of configuration. The batch_size controls the number of messages to grab before processing. Similarly, the batch_timeout defines the wait time before processing. * batch_size and batch_timeout configuration options are added to [notifier] section of configuration. The batch_size controls the number of messages to grab before processing. Similarly, the batch_timeout defines the wait time before processing. * Add a tool for converting combination alarms to composite alarms, since we have deprecated the combination alarm support and recommend to use composite alarm to perform multiple conditions alarming. Deprecation Notes ***************** * The combination alarms are officially deprecated and disabled by default. Set api.enable_combination_alarms to True to enable them. Existing alarms will still be evaluated, but access to them via the API is linked to whether that configuration option is turned on or off. It's advised to use composite alarms instead. Bug Fixes ********* * [bug 1582131 (https://bugs.launchpad.net/aodh/+bug/1582131) Fix an issue with adding CA_BUNDLE certificate parth as value of "verify" parameter in SSL requests. * [bug 1575530 (https://bugs.launchpad.net/aodh/+bug/1575530) Patch was added to fix and improve the partition coordinator, make sure the input tasks can be correctly distributed to partition members. Other Notes *********** * Alarm name unique constraint for each project has been removed. Changes in aodh 2.0.0..3.0.0 ---------------------------- 9ee22bc Add pre-signed support for zaqar notifier a0d9500 Imported Translations from Zanata 624197b standardize release note page ordering 3e1ed2e devstack: set correct port number for aodh-api 28b7804 aodh-notifier: fix the launch bug 3990c5b devstack: fix aodh-api launch 25d53a9 inmemory: add % parameter to formating string 5f30cc0 add url in setup.cfg ffdcc99 Clean imports in code 0f39887 Revert "Fix config group for SSL in tempest test" 64011bb remove default=None for config options 3d3ad69 Fix config group for SSL in tempest test b468632 Remove unnecessary confirm prompt 1a21cfc Limit Happybase to < 1.0.0 5a3e03c Fix tempest.conf generation c67367f Fix French locale build 74775fa Use proper international logging message a0bf3c3 fix the %{} when string formating 31c9b03 Imported Translations from Zanata 8907676 Trival: Remove unused logging import 4aa1bce Delete openstack/common from the exclude list of flake8 in tox b3874c4 Allow to extends the evaluator lookback window 893a0cd Remove Nadya Privalova from core reviewers 417c0af Add Python 3.5 classifiers for Aodh b2020a8 update .gitignore for install-guide/build f3c6ccc Imported Translations from Zanata b11d936 gnocchi: always set needed_overlap for aggregation 3b312fd Remove unused LOG object c41e111 Record the state transition reason in alarm's history data when evaluating ddedc4b use Cotyledon lib 735fb21 Add __ne__ built-in function 1c3e146 Add install-guide for aodh d18125a Replace raw_input with input to make PY3 compatible 7b82364 sqlalchemy: allow to upgrade schema from Ceilometer Liberty fa1ed2e Make help string more accurate for rest notifier 352ec64 Correct the order when sorting by "severity" 472c286 Fixing ordering of 'severity' in alarms 2e3a24f doc: remove leftover from docbookrestapi 86e94d9 Correct concurrency of gabbi tests for gabbi 1.22.0 ff3d24e Fix trust notifier 2a1a6ad Use "topics" instead of "topic" in Notifier initialization d296996 Clean deprecated "rpc_backend" in tests 050a7dc Support combination alarms to composite alarms conversion 5810cd1 Imported Translations from Zanata 8e66fed Imported Translations from Zanata 788403b Add ca_bundle path in ssl request 816bed7 Add indexs of alarm.enabled and alarm.type 9c5df84 Catch DriverLoadFailure for get_transport optional cb91079 Bump the oslo.messaging version 5617d03 gabbi: fail test if no backend configured b28a724 Imported Translations from Zanata 467a041 Replace overtest by pifpaf ef96e68 Make some tests more like Aodh tests e756b33 skip test_create_delete_alarm_with_combination_rule 4f5e47a tests/functional: enable Gabbi for all backends fdc4cf7 Imported Translations from Zanata bb7d87f fix typos in our doc, comment and releasenotes 67b607f Use pbr wsgi_scripts to build aodh-api be48208 Add pagination support for Aodh a096e57 Add a tool for migrating alarms data from NoSQL to SQL 20abf3b api: deprecate and disable combination alarms 3f3697e Update the home-page with developer documentation f5be40f Clean unrelated error of two tests cab9c36 Remove unused option `host' 06409df Remove the unused dict_to_keyval and its test e7c1108 gnocchi: log on warning level, not exception 1ada34e Don't notify alarm on each refresh 413f83d remove alarm name unique constraint in each project 8e72117 Update to hacking 0.11.0 821f0dd generate latest sample config file along with document 229d35a move aodh-config-generator.conf to etc/aodh dir 3daed76 [Trivial] Remove an unused exception definition 09ec847 Trival fix bug in docs a87f0f3 service: fix typo in option help for listener workers 56f24bd Add batch listener support for event evaluator d13f01f [Trivial] Remove two unused methods of PartitionCoordinator 9a0148f Add missing Python 3 classifiers 94c4c52 log alarm rest notifier response dd06bf9 Fix and improve the partition coordinator 520425f support batch listener for aodh-notifier 2f5cfb6 Enable aodh service to be multi-processes 1c5bd9e [Trivial] Improve alarm reason text 9b1eea8 [Trivial] Use local conf instead of global conf 3c1b8db [Trivial] Remove api bin unit test 4b163ea [Trivial] Add zaqar options to list_opts 85c207f [Trivial] Remove AODH_API_LOG_DIR option for devstack 267ecbb Update the default log levels d03403b Replace logging with oslo_log a4e900f Remove the notify_alarm method and refactor related tests ba275d3 Add documentation about event alarm 8122ee7 promote log level to warning for invalid event 17d71aa remove unused file pylintrc 9a307a8 remove todo for OS_TEST_PATH aed9a3d remove local hacking check for oslo namespace and log debug c8773d1 rm functions.sh 0e001fc remove deprecated auth type password-aodh-legacy 073a15a update document 9230658 Clean and reorganize the API config options 5200ec7 replace eventlet timer with thread manner b3a03e5 Imported Translations from Zanata 51b2667 use thread safe fnmatch 1c2582e use static timestamps for api samples ed4b2b0 add tempest to test requirement 90d373d document how to enable aodh stable branch in devstack 4b6114f remove deprecated option alarm_connection 832f088 add default value to functional test environment variables dd72bad fix some message string ed7c3b9 Remove an unrelated comment b286652 remove store_events option in devstack/plugin.sh 450bdc1 install aodhclient instead of ceilometerclient bc1a2e2 Imported Translations from Zanata 99bc365 fix release note link in README.rst 3f58e0c Fix doc build if git is absent fb8c8e4 Fix dependency from tempest-lib to os-testr f85cb4d use default option for notification topics 73cb322 Remove oslo.context dependency c07b0ca Clean deprecations from old "alarm" group 18dc462 Fix Aodh-alarm-evaluator recreates deleted alarms in some cases dd4c0f6 Remove the deprecated RPC IPC code 66714f6 remove non ascii character in doc 9d71ae4 api: rename _alarm to _enforce_rbac 819c0b5 api: stop relying on side-effect of _alarm() 9e0a6b3 Raise Error when query history of an alarm that are not existed 0d6ba3c Update reno for stable/mitaka 3859b9a add missing hbase requirement 3315341 devstack: allow uwsgi deployments f31a20c It is easy to understand to use words no numbers Diffstat (except docs and test files) ------------------------------------- .gitignore | 6 +- .testr.conf | 2 +- HACKING.rst | 2 - MAINTAINERS | 1 - aodh-config-generator.conf | 12 - aodh/__init__.py | 2 - aodh/api/__init__.py | 25 +- aodh/api/app.py | 39 +-- aodh/api/app.wsgi | 6 +- aodh/api/controllers/v2/alarm_rules/combination.py | 2 +- aodh/api/controllers/v2/alarm_rules/gnocchi.py | 9 +- aodh/api/controllers/v2/alarms.py | 111 ++++--- aodh/api/controllers/v2/base.py | 8 - aodh/api/controllers/v2/capabilities.py | 2 +- aodh/api/controllers/v2/query.py | 8 +- aodh/api/controllers/v2/utils.py | 24 ++ aodh/api/hooks.py | 4 +- aodh/api/middleware.py | 4 +- aodh/cmd/alarm.py | 17 +- aodh/cmd/alarm_conversion.py | 140 +++++++++ aodh/cmd/api.py | 24 -- aodh/cmd/data_migration.py | 162 ++++++++++ aodh/cmd/storage.py | 4 +- aodh/coordination.py | 105 +++++-- aodh/evaluator/__init__.py | 139 ++++---- aodh/evaluator/combination.py | 4 +- aodh/evaluator/composite.py | 4 +- aodh/evaluator/event.py | 17 +- aodh/evaluator/gnocchi.py | 44 +-- aodh/evaluator/threshold.py | 20 +- aodh/event.py | 43 +-- aodh/hacking/__init__.py | 0 aodh/hacking/checks.py | 69 ---- aodh/keystone_client.py | 113 ++----- aodh/locale/aodh-log-error.pot | 60 ---- aodh/locale/aodh-log-info.pot | 47 --- aodh/locale/aodh-log-warning.pot | 30 -- aodh/locale/aodh.pot | 332 -------------------- aodh/locale/de/LC_MESSAGES/aodh.po | 175 +++++++++++ aodh/locale/en_GB/LC_MESSAGES/aodh-log-error.po | 137 ++++++++ aodh/locale/en_GB/LC_MESSAGES/aodh-log-info.po | 115 +++++++ aodh/locale/en_GB/LC_MESSAGES/aodh-log-warning.po | 78 +++++ aodh/locale/en_GB/LC_MESSAGES/aodh.po | 230 ++++++++++++++ aodh/locale/es/LC_MESSAGES/aodh-log-info.po | 17 +- aodh/locale/es/LC_MESSAGES/aodh-log-warning.po | 33 -- aodh/locale/es/LC_MESSAGES/aodh.po | 177 +++++++++++ aodh/locale/fr/LC_MESSAGES/aodh.po | 177 +++++++++++ aodh/locale/it/LC_MESSAGES/aodh.po | 176 +++++++++++ aodh/locale/ja/LC_MESSAGES/aodh.po | 178 +++++++++++ aodh/locale/ko_KR/LC_MESSAGES/aodh.po | 168 ++++++++++ aodh/locale/pt/LC_MESSAGES/aodh-log-info.po | 16 +- aodh/locale/pt/LC_MESSAGES/aodh-log-warning.po | 34 -- aodh/locale/pt/LC_MESSAGES/aodh.po | 112 +------ aodh/locale/pt_BR/LC_MESSAGES/aodh.po | 175 +++++++++++ aodh/locale/ru/LC_MESSAGES/aodh-log-info.po | 17 +- aodh/locale/ru/LC_MESSAGES/aodh-log-warning.po | 35 --- aodh/locale/ru/LC_MESSAGES/aodh.po | 117 +------ aodh/locale/zh_CN/LC_MESSAGES/aodh-log-info.po | 46 +++ aodh/locale/zh_CN/LC_MESSAGES/aodh.po | 171 ++++++++++ aodh/locale/zh_TW/LC_MESSAGES/aodh.po | 162 ++++++++++ aodh/messaging.py | 31 +- aodh/notifier/__init__.py | 214 ++++++------- aodh/notifier/rest.py | 31 +- aodh/notifier/trust.py | 2 +- aodh/notifier/zaqar.py | 80 +++-- aodh/opts.py | 37 +-- aodh/queue.py | 2 +- aodh/rpc.py | 60 ---- aodh/service.py | 41 ++- aodh/storage/__init__.py | 22 +- aodh/storage/base.py | 34 +- aodh/storage/hbase/inmemory.py | 2 +- aodh/storage/hbase/utils.py | 9 +- aodh/storage/impl_hbase.py | 21 +- aodh/storage/impl_log.py | 3 +- aodh/storage/impl_mongodb.py | 4 - aodh/storage/impl_sqlalchemy.py | 74 ++++- aodh/storage/models.py | 12 + aodh/storage/mongo/utils.py | 8 +- aodh/storage/pymongo_base.py | 29 +- .../f8c31b1ffe11_add_index_for_enabled_and_type.py | 37 +++ aodh/storage/sqlalchemy/models.py | 2 + aodh/storage/sqlalchemy/utils.py | 12 +- .../functional/api/v2/test_alarm_scenarios.py | 349 +++++++++++++++++---- .../api/v2/test_complex_query_scenarios.py | 34 +- .../functional/storage/test_data_migration.py | 112 +++++++ .../functional/storage/test_storage_scenarios.py | 15 +- devstack/README.rst | 10 + devstack/plugin.sh | 93 ++++-- devstack/settings | 14 +- etc/aodh/aodh-config-generator.conf | 11 + functions.sh | 24 -- install-guide/source/conf.py | 300 ++++++++++++++++++ install-guide/source/configure-common.rst | 86 +++++ install-guide/source/get_started.rst | 28 ++ install-guide/source/index.rst | 15 + install-guide/source/install-obs.rst | 51 +++ install-guide/source/install-rdo.rst | 51 +++ install-guide/source/install-ubuntu.rst | 53 ++++ install-guide/source/next-steps.rst | 9 + install-guide/source/prereq-common.rst | 137 ++++++++ install-guide/source/verify.rst | 8 + pylintrc | 48 --- ...add-a-data-migration-tool-daa14b0cb5d4cc62.yaml | 7 + ...recate-combination-alarms-7ff26b73b61a0e59.yaml | 7 + ...h-service-multi-processes-67ed9a0b7fac69aa.yaml | 7 + ...nt-listener-batch-support-04e6ff159ef34d8c.yaml | 12 + .../notes/fix-ssl-request-8107616b6a85a217.yaml | 13 + .../notes/ingestion-lag-2317725887287fbc.yaml | 7 + .../notifier-batch-listener-01796e2cb06344dd.yaml | 12 + ...n-coordinator-improvement-ff1c257f69f120ac.yaml | 6 + ...rm-name-unique-constraint-4fb0b14f3ad46f0b.yaml | 3 + ...n-to-composite-conversion-3e688a6b7d01a57e.yaml | 6 + releasenotes/source/index.rst | 3 +- .../locale/en_GB/LC_MESSAGES/releasenotes.po | 315 +++++++++++++++++++ releasenotes/source/mitaka.rst | 6 + requirements.txt | 12 +- setup.cfg | 28 +- tox.ini | 37 ++- 157 files changed, 5742 insertions(+), 2501 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 233ab89..e29b1ac 100644 --- a/requirements.txt +++ b/requirements.txt @@ -6,0 +7,2 @@ croniter>=0.3.4 # MIT License +futures>=3.0;python_version=='2.7' or python_version=='2.6' # BSD +futurist>=0.11.0 # Apache-2.0 @@ -11 +12,0 @@ lxml>=2.3 -oslo.context>=0.2.0 # Apache-2.0 @@ -17 +17,0 @@ oslo.policy>=0.5.0 # Apache-2.0 -oslo.service>=0.1.0 # Apache-2.0 @@ -21 +21 @@ pecan>=0.8.0 -oslo.messaging>2.6.1,!=2.8.0 # Apache-2.0 +oslo.messaging>=5.2.0 # Apache-2.0 @@ -24 +24 @@ oslo.serialization>=1.4.0 # Apache-2.0 -oslo.utils>=1.9.0 # Apache-2.0 +oslo.utils>=3.5.0 # Apache-2.0 @@ -31,2 +31 @@ stevedore>=1.5.0 # Apache-2.0 -tooz>=0.16.0 # Apache-2.0 -Werkzeug>=0.7 # BSD License +tooz>=1.28.0 # Apache-2.0 @@ -34,0 +34 @@ WSME>=0.8 +cotyledon

1 0

[new][neutron] neutron-dynamic-routing 9.0.0 release (newton)
by no-reply＠openstack.org 06 Oct '16

06 Oct '16

We are psyched to announce the release of: neutron-dynamic-routing 9.0.0: Neutron Dynamic Routing This release is part of the newton release series. For more details, please see below. Changes in neutron-dynamic-routing 9.0.0.0rc1..9.0.0 ---------------------------------------------------- 2b27679 Switch upper-constraints and tox_install.sh to stable/newton c4f1ee9 Update .gitreview for stable/newton 62b4c20 Updated from global requirements ceac1a9 Stop using _create_or_update_agent Diffstat (except docs and test files) ------------------------------------- .gitreview | 1 + requirements.txt | 4 +-- tools/tox_install.sh | 2 +- tox.ini | 7 +++-- 5 files changed, 24 insertions(+), 22 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 0fa81a5..df55525 100644 --- a/requirements.txt +++ b/requirements.txt @@ -8 +8 @@ httplib2>=0.7.5 # MIT -netaddr!=0.7.16,>=0.7.12 # BSD +netaddr!=0.7.16,>=0.7.13 # BSD @@ -14 +14 @@ oslo.config>=3.14.0 # Apache-2.0 -oslo.db>=4.10.0 # Apache-2.0 +oslo.db!=4.13.1,!=4.13.2,>=4.10.0 # Apache-2.0

1 0

[new][freezer] freezer-web-ui 3.0.0 release (newton)
by no-reply＠openstack.org 06 Oct '16

06 Oct '16

We are grateful to announce the release of: freezer-web-ui 3.0.0: Freezer - Backup as a Service User Interface This release is part of the newton release series. For more details, please see below. Changes in freezer-web-ui 1.2.0..3.0.0 -------------------------------------- ddd7867 Updated from global requirements 3fce7f5 Imported Translations from Zanata 6613c04 Retry data not being saved by UI d91aff5 Updated tox.ini to support new test environment ddc6321 Adds help text and fixes dropdown displays 12d82d9 Remove the unused url_path 783b4b9 Fix hardcoded static path 4fe2ed3 Fix jenkins failed d246ec1 Fixed Catch errors in horizon tables aa6e9a3 Imported Translations from Zanata 94bf56a Point icon set to font-awesome 6ec918b Enable edition of job actions c141d3c Remove workaround for web page refresh c7d2cc6 i18n translation support a1541e6 UX improvements 1d3e973 Fixed freezer-web-ui directory when install c66c23e Use correct parameter when handling exceptions 2d0e1bd fixed incorrect directory install freezer-web-ui 9cc4126 Fixed importError urlresolvers 40df86f Improve success messages when it takes time to display the action ea51d7d This is incorrect url in example doc and conf e74af2a fixed compilemessages error when install use devstack a04a1a1 Liberty guidelines for freezer web ui 7dbb52e Actions for a job no longer shows irrelevant actions for specific cases 1333614 Sync job status between scheduler and ui 37f3b7c Fix misleading labeling for filters 496b3ad Add SSL support for freezer-web-ui 4c5ee4c Add Sphinx doc build da9cbb1 Using a smarter way to get freezer-api URL Diffstat (except docs and test files) ------------------------------------- .gitignore | 4 + README.rst | 12 +- _50_freezer.py.example | 10 - babel-django.cfg | 6 + babel-djangojs.cfg | 14 + devstack/README.rst | 2 +- devstack/files/_5050_freezer.py.template | 10 + devstack/files/_50_freezer.py.template | 28 - devstack/lib/freezer-web-ui | 16 +- devstack/local.conf.example | 2 +- devstack/plugin.sh | 3 +- devstack/settings | 9 +- disaster_recovery/actions/tables.py | 13 +- .../actions/templates/actions/_action.html | 16 + .../actions/templates/actions/_advanced.html | 11 + .../actions/templates/actions/_rules.html | 16 + .../actions/templates/actions/_snapshot.html | 13 + disaster_recovery/actions/workflows/action.py | 22 +- disaster_recovery/api/api.py | 72 +- disaster_recovery/backups/tables.py | 14 +- disaster_recovery/clients/tables.py | 6 +- disaster_recovery/enabled/_5050_freezer.py | 10 + .../enabled/_7050_freezer_remove_panel_.py | 5 + disaster_recovery/enabled/__init__.py | 0 disaster_recovery/jobs/tables.py | 21 +- disaster_recovery/jobs/templates/jobs/_action.html | 15 - .../jobs/templates/jobs/_advanced.html | 11 - disaster_recovery/jobs/templates/jobs/_info.html | 10 +- disaster_recovery/jobs/templates/jobs/_rules.html | 11 - .../jobs/templates/jobs/_scheduling.html | 24 - .../jobs/templates/jobs/_snapshot.html | 12 - .../jobs/_workflow_step_update_members.html | 61 -- disaster_recovery/jobs/workflows/create.py | 14 +- disaster_recovery/jobs/workflows/update_actions.py | 3 +- disaster_recovery/jobs/workflows/update_job.py | 6 +- .../locale/en_GB/LC_MESSAGES/django.po | 788 +++++++++++++++++++++ .../locale/zh_CN/LC_MESSAGES/django.po | 664 +++++++++++++++++ disaster_recovery/sessions/tables.py | 10 +- .../sessions/templates/sessions/_info.html | 9 +- disaster_recovery/sessions/workflows/attach.py | 4 +- disaster_recovery/sessions/workflows/create.py | 20 +- .../freezer/css/bootstrap-datetimepicker.min.css | 373 ++++++++++ .../static/freezer/js/freezer.actions.action.js | 91 +-- .../static/freezer/js/freezer.actions.advanced.js | 11 +- .../static/freezer/js/freezer.common.js | 8 +- .../static/freezer/js/freezer.datetimepicker.js | 39 +- disaster_recovery/utils.py | 27 +- disaster_recovery/version.py | 15 + manage.py | 23 + requirements.txt | 5 +- setup.cfg | 10 +- setup.py | 21 +- test-requirements.txt | 42 +- tools/install_venv.py | 58 ++ tools/install_venv_common.py | 165 +++++ tools/with_venv.sh | 7 + tox.ini | 42 +- 69 files changed, 3480 insertions(+), 565 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 9f81784..65c06ef 100644 --- a/requirements.txt +++ b/requirements.txt @@ -1 +1,4 @@ -Django>=1.8,<1.9 +# The order of packages is significant, because pip processes them in the order +# of appearance. Changing the order has an impact on the overall integration +# process, which may cause wedges in the gate later. +Django<1.9,>=1.8 # BSD diff --git a/test-requirements.txt b/test-requirements.txt index c2281ea..6a2db8d 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -4,19 +4,23 @@ -astroid<1.4.0 # breaks pylint 1.4.4 -hacking>=0.10.2,<0.11 -coverage>=3.6 -discover -python-subunit>=0.0.18 -sphinx>=1.1.2,!=1.2.0,!=1.3b1,<1.3 -oslosphinx>=2.5.0 # Apache-2.0 -oslotest>=1.10.0 # Apache-2.0 -testrepository>=0.0.18 -testscenarios>=0.4 -testtools>=1.4.0 -pbr>=1.6 -flake8>=2.2.4,<=2.4.1 -pytest -pytest-cov -pytest-xdist -pylint==1.4.4 # GNU GPL v2 -testresources>=0.2.4 -mock>=1.2 +hacking<0.12,>=0.11.0 # Apache-2.0 + +coverage>=3.6 # Apache-2.0 +mock>=2.0 # BSD +mox>=0.5.3 # Apache-2.0 +mox3>=0.7.0 # Apache-2.0 +oslo.config>=3.14.0 # Apache-2.0 +pylint==1.4.5 # GPLv2 +testrepository>=0.0.18 # Apache-2.0/BSD +testtools>=1.4.0 # MIT +unittest2 # BSD +sphinx!=1.3b1,<1.3,>=1.2.1 # BSD +oslosphinx!=3.4.0,>=2.5.0 # Apache-2.0 +nose # LGPL +nosehtmloutput>=0.0.3 # Apache-2.0 +openstack.nose-plugin>=0.7 # Apache-2.0 +django-nose>=1.4.4 # BSD +nosexcover # BSD + +# Horizon requirements +Django<1.9,>=1.8 # BSD +django-compressor>=2.0 # MIT +django-openstack-auth>=2.4.0 # Apache-2.0

1 0

[new][neutron] neutron-vpnaas 9.0.0 release (newton)
by no-reply＠openstack.org 06 Oct '16

06 Oct '16

We are eager to announce the release of: neutron-vpnaas 9.0.0: OpenStack Networking VPN as a Service This release is part of the newton release series. For more details, please see below. 9.0.0 ^^^^^ Neutron VPNaaS is integrated with Guru Meditation Reports library. New Features ************ * Neutron VPNaaS services should respond to SIGUSR2 signal by dumping valuable debug information to standard error output. Changes in neutron-vpnaas 8.0.0.0rc1..9.0.0 ------------------------------------------- 89dac51 Switch upper-constraints and tox_install.sh to stable/newton 7c3e5b8 Update .gitreview for stable/newton 3c93dc6 Updated from global requirements a473bde Tag the alembic migration revisions for Newton 44f6465 Make tests resilient to new project_id field in API 892599a Updated from global requirements c21d3ac Use model_base from neutron-lib 0002c57 Readd tox_install NEUTRON_DIR 97cc8fc Add debug output to tox_install.sh 0720a85 Add support for Guru Meditation Reports for VPNaaS agents c26a4f6 Use temporary directory for neutron install af6649b Move service plugin aliases from neutron to neutron-vpnaas 26f9003 Updated from global requirements 453dbf4 Fix DeprecationWarnings part II 5813874 Adding tests for endpoint-group api. a000db3 TrivialFix: Add validation for tenant_id c8b9c6a TrivialFix: Cleanup imports in code fce8fea Revert "Update disable_ssl_certificate_validation reference" 34f0f98 Update disable_ssl_certificate_validation reference 41805f1 Strongswan: Fix incorrect strongswan auth algorithm sha256 symbol 2941611 Constrain remaining tox targets 3ca00bd Updated from global requirements a70f163 Remove temporary local HasProject 482785e Fix DeprecationWarnings part I 6017a35 Enable DeprecationWarning in test environments 65667c8 Add connection API cases 9cce0ee Updated from global requirements 06c8c0b Update imports (common.config -> conf.common) 6de03ab Updated from global requirements 113c39a Fix API Tests ea91ff8 Add Libreswan installation guide in devstack.rst bd724e6 Drop Newton tag from DB migration cc8b3f1 Rename DB columns: tenant -> project b6f8c40 Add migrations testing to VPNaaS functional jobs. e0ebc7d remove unused LOG 2da398d Updated from global requirements a79c232 Updated from global requirements 903def7 Updated from global requirements 50be42d Fix VPNaaS functional tests a75c641 Use tempest.lib tenants_client 0a82097 Replace tempest-lib to tempest in test-requirements.txt 7f79293 Updated from global requirements b9eeecb Updated from global requirements cb935c3 Updated from global requirements c9ee514 Updated from global requirements d47d569 Updated from global requirements c98d9bc Updated from global requirements 894af39 Use strongswan piddir as bind mount dir beff6e9 Copy/remove the strongswan.d config as root ccc0302 Updated from global requirements 764344f Updated from global requirements 5a7883b Updated from global requirements 8cddec3 Fix grenade plugin a65310b Add grenade upgrade hooks to stop agent 3086f02 Set path for neutron conf dir in devstack if missing 7cf4ef6 Support local_id configuration 393d4c6 Switch to using hacking checks from neutron-lib e10adef Strongswan: complete the ipsec.conf 814e3f0 Openswan/Libreswan: Check config changes before restart e69e003 Updated from global requirements 4dc32fd Updated from global requirements 40ca087 Don't use zuul-cloner for venv env, for periodic jobs b73e100 Openswan/Libreswan: support sha256 for auth algorithm 6c38daf Fix doc build if git is absent 3aeae7a Ensure that PK values don't default to NULL 21dedd8 Updated from global requirements 19172b3 OpenSwan: handle disconnect properly for multiple subnets a1b1260 Constraint requirements using mitaka upper-constraints.txt file 0067e26 VPNaaS returns 500 INTERNAL error with long names, descriptions fd28fdd Update devstack plugin for dependent packages 0101b01 Update devstack plugin for dependent packages bd41271 Update reno for stable/mitaka 0c7a5a6 Update .gitreview for stable/mitaka Diffstat (except docs and test files) ------------------------------------- .gitreview | 1 + devstack/plugin.sh | 1 + devstack/settings | 1 + devstack/upgrade/resources.sh | 14 + devstack/upgrade/settings | 1 + devstack/upgrade/shutdown.sh | 36 + devstack/upgrade/upgrade.sh | 14 + etc/neutron/rootwrap.d/vpnaas.filters | 2 + neutron_vpnaas/cmd/__init__.py | 26 + .../db/migration/alembic_migrations/env.py | 2 +- .../alembic_migrations/versions/CONTRACT_HEAD | 2 +- .../alembic_migrations/versions/EXPAND_HEAD | 2 +- .../contract/56893333aa52_fix_identifier_map_fk.py | 2 +- .../b6a2519ab7dc_rename_tenant_to_project.py | 143 ++++ .../newton/expand/52783a36bd67_support_local_id.py | 42 + .../newton/expand/fe637dc3f042_support_sha256.py | 39 + neutron_vpnaas/db/vpn/vpn_db.py | 6 +- neutron_vpnaas/db/vpn/vpn_models.py | 27 +- neutron_vpnaas/db/vpn/vpn_validator.py | 8 +- neutron_vpnaas/extensions/vpn_endpoint_groups.py | 4 +- neutron_vpnaas/extensions/vpnaas.py | 56 +- .../services/vpn/device_drivers/ipsec.py | 83 +- .../vpn/device_drivers/strongswan_ipsec.py | 22 +- .../template/openswan/ipsec.conf.template | 2 +- .../template/openswan/ipsec.secret.template | 2 +- .../template/strongswan/ipsec.conf.template | 14 +- .../template/strongswan/ipsec.secret.template | 2 +- .../services/vpn/service_drivers/base_ipsec.py | 5 + .../services/vpn/service_drivers/cisco_csr_db.py | 2 +- .../functional/common/test_migrations_sync.py | 28 +- .../functional/openswan/test_openswan_driver.py | 40 + .../strongswan/test_strongswan_driver.py | 78 ++ .../unit/extensions/test_vpn_endpoint_groups.py | 5 +- .../unit/services/vpn/device_drivers/test_ipsec.py | 106 ++- .../services/vpn/service_drivers/test_ipsec.py | 6 + .../notes/oslo-reports-3059c2e10e1b35b5.yaml | 6 + releasenotes/source/index.rst | 1 + releasenotes/source/mitaka.rst | 6 + requirements.txt | 21 +- setup.cfg | 5 + test-requirements.txt | 16 +- tools/tox_install.sh | 40 +- tox.ini | 27 +- 64 files changed, 2404 insertions(+), 860 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index f2a94de..6a4163c 100644 --- a/requirements.txt +++ b/requirements.txt @@ -6 +6 @@ pbr>=1.6 # Apache-2.0 -requests!=2.9.0,>=2.8.1 # Apache-2.0 +requests>=2.10.0 # Apache-2.0 @@ -8 +8 @@ Jinja2>=2.8 # BSD License (3 clause) -netaddr!=0.7.16,>=0.7.12 # BSD +netaddr!=0.7.16,>=0.7.13 # BSD @@ -10 +10 @@ SQLAlchemy<1.1.0,>=1.0.10 # MIT -alembic>=0.8.0 # MIT +alembic>=0.8.4 # MIT @@ -12,4 +12,4 @@ six>=1.9.0 # MIT -neutron-lib>=0.0.1 # Apache-2.0 -oslo.concurrency>=3.5.0 # Apache-2.0 -oslo.config>=3.7.0 # Apache-2.0 -oslo.db>=4.1.0 # Apache-2.0 +neutron-lib>=0.4.0 # Apache-2.0 +oslo.concurrency>=3.8.0 # Apache-2.0 +oslo.config>=3.14.0 # Apache-2.0 +oslo.db!=4.13.1,!=4.13.2,>=4.10.0 # Apache-2.0 @@ -17 +17,2 @@ oslo.log>=1.14.0 # Apache-2.0 -oslo.messaging>=4.0.0 # Apache-2.0 +oslo.messaging>=5.2.0 # Apache-2.0 +oslo.reports>=0.6.0 # Apache-2.0 @@ -19,2 +20,2 @@ oslo.serialization>=1.10.0 # Apache-2.0 -oslo.service>=1.0.0 # Apache-2.0 -oslo.utils>=3.5.0 # Apache-2.0 +oslo.service>=1.10.0 # Apache-2.0 +oslo.utils>=3.16.0 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index b8beb57..4f2cba8 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -6 +6 @@ hacking<0.11,>=0.10.0 -astroid<1.4.0 # LGPL # breaks pylint 1.4.4 +astroid<1.4.0 # LGPLv2.1 # breaks pylint 1.4.4 @@ -8,3 +8,3 @@ coverage>=3.6 # Apache-2.0 -fixtures>=1.3.1 # Apache-2.0/BSD -mock>=1.2 # BSD -pylint==1.4.5 # GNU GPL v2 +fixtures>=3.0.0 # Apache-2.0/BSD +mock>=2.0 # BSD +pylint==1.4.5 # GPLv2 @@ -12,2 +12,2 @@ python-subunit>=0.0.18 # Apache-2.0/BSD -requests-mock>=0.7.0 # Apache-2.0 -sphinx!=1.2.0,!=1.3b1,<1.3,>=1.1.2 # BSD +requests-mock>=1.0 # Apache-2.0 +sphinx!=1.3b1,<1.3,>=1.2.1 # BSD @@ -16 +16 @@ testrepository>=0.0.18 # Apache-2.0/BSD -tempest-lib>=0.14.0 # Apache-2.0 +tempest>=12.1.0 # Apache-2.0 @@ -23 +23 @@ oslotest>=1.10.0 # Apache-2.0 -reno>=0.1.1 # Apache2 +reno>=1.8.0 # Apache2

1 0

[new][congress] congress 4.0.0 release (newton)
by no-reply＠openstack.org 06 Oct '16

06 Oct '16

We are grateful to announce the release of: congress 4.0.0: Congress: The open policy framework for the cloud. This release is part of the newton release series. For more details, please see below. 4.0.0 ^^^^^ Congress now supports high-availability and high-query-throughput deployments with load-balanced policy engines and warm-standby data- source drivers. New Features ************ * Added lazy_tables flag in OpenStack datasource drivers, which enables datasource drivers to postpone pulling data from real datasource services until policy rules refer to the specified tables. * Added support for replicated (load-balanced) policy engines for high-availability and high-query-throughput deployments. See HA- Overview and HA-Deployment documentation for more information. * Added support for warm-standby data-source drivers managed by Pacemaker. See HA-Overview and HA-Deployment documentation for more information. * Congress now supports multi-node deployment where different components (policy engine, API server, and datasource drivers) may be deployed in separate processes on separate hosts. See deployment documentation for more information. Known Issues ************ * Ceilometer driver experiences error when retrieving the list of alarms. The impact is that the some ceilometer data may not be updated in Congress. We are currently working with the ceilometer team to find a resolution. Expect a resolution in the next minor release. * The specialized policy engine for VM placement (previously released as experimental) is not available in this release. Expect it to be available again in a future release. Upgrade Notes ************* * Added a new database table dstabledata to persist pushed data from a datasource. Necessary migration scripts are included in congress/db/migration/ Changes in congress 3.0.0.0rc1..4.0.0 ------------------------------------- fcccfb2 Critical newton fix: Use new db session for table locking c411ca2 Update release notes for Newton release 6b8288d Update haht docs 98c522b Disable subtransactions in table locking transaction 5ed837b Specify text-length for MySQL only c1829a8 Fix rule sync for head-only rules 46ae7ec Disallow duplicated policy name in DB 50e3325 Mark distributed_architecture config as DEPRECATED d32cb5a control_bus service has only 1 heartbeat thread c9bfcdd Remove the traceback added by oslo-messaging RPC 5485d0b Fixes to synchronize_policies 102967a Default to single process in devstack 740ad70 Devstack to support CONGRESS_REPLICATED flag 960cf73 Remove outdated changes in docs 558c561 Use keystone session in keystone_driver 7ed1413 Make policy rule requests gives 404 (not 400) when policy not found 0559c4e Some updations in congress docs 5dd613f Modified to use Identity v2.0 15d3666 Update reno for stable/newton 59571ff Update .gitreview for stable/newton 7c6d7c5 Use only strings in paste.deploy.loadapp global_conf 1d4e784 haht release notes f8ca2a7 Editing pass over docs dc8e2db Updated from global requirements 1e4a353 Fix standalon install manual in README 38d3aa4 Replace retrying with tenacity ee441fe Raise BadRequest while pushing data to non-push ds f717711 give correct http error on getting non-existent policy 9327576 Adds a releasenote of lazy datasource 83fdc8f Fix issues raised while starting multiple PE's a64ce3b Keystone CLI is removed and so replaced with openstack CLI 36e7ab2 Add support to synchronize one policy 5e9319c Added Monasca and OPNFV Doctor to section 3 cdca8bd Fix objects_translator fails to pull data 9d0ead0 Fix alarms_translator fails to pull data 204a5c6 Use Reno for release note 4b0023b Clean imports in code 9c00962 remove new_arch in tox 5e9fbeb Remove distributed_architecture flag dfdfc6a Use assertIn(A, B) instead of assertTrue(A in B ) 9d09fb5 trivial typo fix 417ad2e Support lazy tables in openstack drivers d7a81b9 Instantiating datasource service by synchronizer ba39592 Remove old synchronizer code. 77e845b Resolve gate: reduce ds sync period in devstack 17c82c4 Restore the DSE opt group d7729f3 DSE2 - resubscribe if update missing for too long 05b0714 Remove deepsix reference in datasource drivers 7a1c65b Sync datasources only on datasource node 1f76d0a Add __ne__ built-in function 6b76b0b Merge Dse2Runtime and DseRuntime class 9338f3f Clean up old dse codes in Policy Engine c942d89 use - instead of _ in cli opts eb77bd1 Added Congress HA Overview guide 9cfa297 Updated from global requirements 71ac0a1 Replace raw_input with input to make PY3 compatible 0bd9de0 Modify existing HA tempest test c81cd05 Clean imports in code 6bc2bd7 TrivialFix: Remove logging import unused 4ecf62c Updated from global requirements b67a728 dist_arch flag removed from devstack d76e639 Fix tempest.conf generation 903cba8 Correct reraising of exception 603e14d Updated from global requirements 97a15ab Remove white space between print and () b76877d Improve logging in dse_node.py f8a3395 Introduce 'lazy_tables' flag to nova datasource driver 796d160 Remove an unnecessary assignment 409fd5e Updated from global requirements e9b9d61 Added oslo-messaging exchange 'congress' 6f06bdf Cleanup old dse code in API models (part-2) 9a10a90 HAHT - datasource synchronizer use UUID not name 2881245 Fix launching devstack failure in gate 8b299e4 HAHT - Mitigate missed action during DSD failover bcf4a48 HAHT - persist pushed data df3ce26 Add required api_version argument in ironic 551d59c Updated from global requirements cb58abf Updated from global requirements a9851e5 Race-free synchronize policies 6f60b0f Replaced e.message with str(e) fd6600c Disable old DSE code 63d9616 Updated from global requirements fb921a8 Fix string interpolation at logging call 07e925c Implement horizon plugin model a254051 Scrap testHA:test_datasource_db_sync_remove 82f06ed Correct reraising of exception 942c722 Fix an argument order of assertTrue 1808c12 Enable devstack to start congress services seperately 0549534 Fix misuse of assertTrue b4dd5f9 Updated from global requirements a5013cd Add Python 3.5 classifier and venv 4a3c01d Updated from global requirements bcb7683 Fix Gate HA test Failure 830825b Updated from global requirements 10475c5 Exit if datasource could not be loaded f072427 modify the home-page info with the developer documentation ea51bc9 Updated from global requirements 1b606a0 API routing to intranode PE eb7ab43 Deployment guide of Resource Agent 0c6aafe Migrate synchronizer to DSE2 87f6d5c Use auth_url from horizon settings d526bdc Removed extra dashes in title lines 2e9f698 remove unused log d85fbf3 Thread-safety review cfb7a62 Adds custom ocf for HA of DataSource Node 8d8bf28 Updated from global requirements 1086f36 Remove unused LOG to keep code clean 0e681e5 WIP:Update description field for datasources 1b40706 Update to fix minor grammar 5775492 ExecutionDriver handles exec requests from replicated PEs 5c0d66b Move dse_opts to default group 0c2f1f9 Remove policy_engine dependency while starting API f4ecb98 Updated from global requirements 126e124 Stop import datasource manager in plexxi driver and harness cee1006 Removed duplicate oslo-concurrency requirement c58d1d8 Fix test_webservice.py for py35 f3170e8 Adds execute(self, action, action_args) to PlexxiDriver c451d0e TestPolicyExecute no longer inherits from TestCongress 4cea8ba Add keystone v3 datasource 77b3d0e Enable different deployment configurations for HA 863679f Updated from global requirements bb23203 Prevent a new datasource from deleted in creation 95e5776 Updated from global requirements dfff845 Start and Stop DatasourceDriver in new architecture 1737e33 Updated from global requirements 57411fe Fix wrong usage of novaclient dd58927 Fix gate failure db1af67 Add congress to service_available group d7e5461 Add support to both v2 and v3 auth_urls 88f4a87 Remove use of deprecated network_resources module 00f8968 Updated from global requirements 38d4b75 Updated from global requirements 3bee42d Add configuration options description to docs c6c8035 Updated from global requirements 6d49963 List 'node_id' as part of [dse] section in conf d8a00b6 dse2 sequenced, differential pub-sub e62e70f Updated from global requirements 8af9331 Add reference to configuration options in Upgrade instructions 3f14dd5 Make the messaging driver configurable 0fd23cb Working Hot Stanby HA on any driver of oslo.messaging 78ac4d1 Use right method to get admin credential cd29dc0 Updated from global requirements c6f35f3 Tempest for Push Type Driver 1f9e982 Load rules after service start 3fe1aca Add Upgrade instructions to README c0c6fcc Fix logging in dse2 a9fc5b5 Migrate test-congress to dse2 cef95a2 Remove unnecessary executable permissions c8f6465 Updated from global requirements 5c648aa Updated from global requirements e0e8527 Loads persited policy rules during launcing PolicyEngine 2541bb0 Changed assertTrue(isinstance()) to assertIsInstance() fb95a9a Updated from global requirements ceafc4d Updated from global requirements 6c80f45 Support datasource names in API e2f786e Updated from global requirements d457160 remove verbose option in devstack plugin 8adcb0a Launch Congress with distributed_architecture flag is true e75bbf1 Fix row-order-sensitivity in test_congress 069b38e Adds Doctor Driver a72d4d0 Loads configured datasource driver b295150 Updated from global requirements fbd1f06 [Trivial] Remove unnecessary executable privilege 955642a Fix gate failure 9fc3b5b Add dse_opts to the conf file 320b081 (un)subhandler for DSE2 77c8801 Node id for devstack install fd18c63 Use test_data_service in tests2 2354bf4 Migrate harness to DSE2 d027009 Add keystoneauth1 to requirements.txt 5c92ba5 Clarify and correct tests/helper.retry_check_no_subscribers 7b0cae5 Fix subscriber_list has no return value 855ef7c Updated from global requirements 1e78c54 Resolve Gate failure 211a4e3 Switch to Ceilometer tempest plugin b20ce47 Avoid re-starting service rpc_server 592bdea Updated from global requirements 8c65d2b Fixes Tempest error caused by tempest's changes 200ff82 Remove version from setup.cfg fc664f2 Define context.roles with base class b9b1ba7 Updated from global requirements b933c51 keystone session touch-up 33bbacc Use keystone session in murano_driver 9248b6f Use keystone sessions to authenticate 9068acc Fix typo in congress 4d48915 Use keystone sessions to authenticate b692284 Use keystone session in murano_driver d554770 Update standalone setup instructions e20bcc4 Also package congress_tempest_tests 68cefa3 Add Push driver b4d05f3 Also package congress_tempest_tests cf8c8b5 Fix for broken antlr3 in stand-alone install 8ed5b84 Build docs using tox 464bd66 Enable Murano tempest tests fc9143a Update standalone setup instructions cf09349 Minor updates to standalone install c895084 Build docs using tox c12fcbf Minor updates to standalone install b799d37 Remove cloudfoundry from congress.conf instructions f2350cc Update .gitreview for stable/mitaka 88b0ef4 Remove cloudfoundry from congress.conf instructions c90410f Fix for broken antlr3 in stand-alone install d44b0b5 Cleanup unused Oslo Incubator code and references Diffstat (except docs and test files) ------------------------------------- .gitreview | 1 + .testr.conf | 7 + .testr.conf.new | 7 - .testr.conf.old | 7 - README.rst | 259 +++++-- antlr3runtime/Python/antlr3 | 1 + antlr3runtime/Python3/antlr3 | 1 + congress/api/action_model.py | 16 +- congress/api/api_utils.py | 15 +- congress/api/application.py | 5 +- congress/api/base.py | 36 +- congress/api/datasource_model.py | 84 ++- congress/api/error_codes.py | 2 +- congress/api/policy_model.py | 37 +- congress/api/row_model.py | 63 +- congress/api/rule_model.py | 31 +- congress/api/schema_model.py | 24 +- congress/api/status_model.py | 21 +- congress/api/system/driver_model.py | 30 +- congress/api/table_model.py | 36 +- congress/api/webservice.py | 25 +- congress/common/config.py | 53 +- congress/common/eventlet_server.py | 57 +- congress/context.py | 5 +- congress/datalog/base.py | 10 + congress/datalog/compile.py | 6 +- congress/datalog/factset.py | 4 +- congress/datalog/nonrecursive.py | 4 +- congress/datalog/unify.py | 9 + congress/datasources/ceilometer_driver.py | 89 +-- congress/datasources/cinder_driver.py | 52 +- congress/datasources/cloudfoundryv2_driver.py | 11 +- congress/datasources/datasource_driver.py | 264 +++++-- congress/datasources/datasource_utils.py | 35 +- congress/datasources/doctor_driver.py | 105 +++ congress/datasources/glancev2_driver.py | 105 +-- congress/datasources/heatv1_driver.py | 58 +- congress/datasources/ironic_driver.py | 103 ++- congress/datasources/keystone_driver.py | 35 +- congress/datasources/keystonev3_driver.py | 171 +++++ congress/datasources/monasca_driver.py | 80 +-- congress/datasources/murano_driver.py | 33 +- congress/datasources/neutron_driver.py | 109 +-- congress/datasources/neutronv2_driver.py | 53 +- congress/datasources/nova_driver.py | 60 +- congress/datasources/plexxi_driver.py | 28 +- congress/datasources/push_driver.py | 79 +++ congress/datasources/swift_driver.py | 40 +- congress/datasources/vCenter_driver.py | 13 +- congress/db/api.py | 7 +- congress/db/datasources.py | 21 +- congress/db/db_ds_table_data.py | 90 +++ congress/db/db_policy_rules.py | 51 +- congress/db/migration/README | 4 +- ...01e78af70b91_add_datasource_data_persistence.py | 50 ++ congress/dse/d6cage.py | 2 +- congress/dse/deepsix.py | 11 +- congress/dse2/README.rst | 2 +- congress/dse2/control_bus.py | 36 +- congress/dse2/data_service.py | 311 +++++++- congress/dse2/deepsix2.py | 7 +- congress/dse2/dse_node.py | 542 ++++++++++---- congress/dse2/test_control_bus.py | 8 +- congress/dse2/test_data_service.py | 94 --- congress/exception.py | 8 +- congress/harness.py | 343 ++++----- congress/managers/__init__.py | 0 congress/managers/datasource.py | 403 ----------- congress/openstack/__init__.py | 0 congress/openstack/common/__init__.py | 0 congress/opts.py | 2 + congress/policy_engines/agnostic.py | 707 +++++++++++++------ congress/server/congress_server.py | 103 ++- congress/service.py | 34 +- congress/synchronizer.py | 296 -------- .../datasources/performance_datasource_driver.py | 35 +- .../policy_engines/disabled_test_vmplacement.py | 779 +++++++++++++++++++++ .../policy_engines/test_agnostic_performance.py | 53 +- congress/utils.py | 22 +- congress_dashboard/README.md | 25 + congress_dashboard/__init__.py | 0 congress_dashboard/api/__init__.py | 0 congress_dashboard/api/congress.py | 299 ++++++++ congress_dashboard/datasources/__init__.py | 0 congress_dashboard/datasources/panel.py | 26 + congress_dashboard/datasources/tables.py | 89 +++ .../templates/datasources/_detail_overview.html | 14 + .../datasources/templates/datasources/detail.html | 14 + .../datasources/templates/datasources/index.html | 19 + congress_dashboard/datasources/urls.py | 34 + congress_dashboard/datasources/utils.py | 187 +++++ congress_dashboard/datasources/views.py | 272 +++++++ congress_dashboard/enabled/_50_policy.py | 3 + congress_dashboard/enabled/_60_policies.py | 9 + congress_dashboard/enabled/_70_datasources.py | 5 + congress_dashboard/policies/__init__.py | 0 congress_dashboard/policies/forms.py | 69 ++ congress_dashboard/policies/panel.py | 26 + congress_dashboard/policies/rules/__init__.py | 0 congress_dashboard/policies/rules/tables.py | 111 +++ congress_dashboard/policies/rules/views.py | 36 + congress_dashboard/policies/rules/workflows.py | 441 ++++++++++++ congress_dashboard/policies/tables.py | 94 +++ .../policies/templates/policies/_create.html | 22 + .../templates/policies/_detail_overview.html | 18 + .../policies/templates/policies/create.html | 11 + .../policies/templates/policies/detail.html | 17 + .../policies/templates/policies/index.html | 13 + .../policies/rules/_create_conditions.html | 174 +++++ .../templates/policies/rules/_create_output.html | 65 ++ .../templates/policies/rules/_mapping_row.html | 21 + .../policies/templates/policies/rules/create.html | 24 + congress_dashboard/policies/urls.py | 32 + congress_dashboard/policies/views.py | 133 ++++ congress_dashboard/static/admin/css/policies.css | 134 ++++ congress_dashboard/static/admin/js/policies.js | 288 ++++++++ congress_dashboard/templates/admin/_scripts.html | 5 + congress_dashboard/templates/admin/base.html | 14 + .../services/policy/policy_client.py | 16 +- .../congress_datasources/test_ceilometer.py | 6 +- .../scenario/congress_datasources/test_cinder.py | 4 +- .../scenario/congress_datasources/test_doctor.py | 88 +++ .../scenario/congress_datasources/test_glancev2.py | 4 +- .../congress_datasources/test_keystonev2.py | 4 +- .../scenario/congress_datasources/test_murano.py | 27 +- .../congress_datasources/test_neutronv2.py | 4 +- .../scenario/congress_datasources/test_nova.py | 4 +- contrib/horizon/_50_policy.py | 3 - contrib/horizon/_60_policies.py | 4 - contrib/horizon/_70_datasources.py | 5 - contrib/horizon/congress.py | 296 -------- contrib/horizon/datasources/__init__.py | 0 contrib/horizon/datasources/panel.py | 26 - contrib/horizon/datasources/tables.py | 89 --- .../templates/datasources/_detail_overview.html | 14 - .../datasources/templates/datasources/detail.html | 14 - .../datasources/templates/datasources/index.html | 19 - contrib/horizon/datasources/urls.py | 33 - contrib/horizon/datasources/utils.py | 187 ----- contrib/horizon/datasources/views.py | 272 ------- contrib/horizon/policies/__init__.py | 0 contrib/horizon/policies/forms.py | 67 -- contrib/horizon/policies/panel.py | 26 - contrib/horizon/policies/rules/__init__.py | 0 contrib/horizon/policies/rules/tables.py | 110 --- contrib/horizon/policies/rules/views.py | 36 - contrib/horizon/policies/rules/workflows.py | 441 ------------ contrib/horizon/policies/tables.py | 93 --- .../policies/templates/policies/_create.html | 22 - .../templates/policies/_detail_overview.html | 18 - .../policies/templates/policies/create.html | 11 - .../policies/templates/policies/detail.html | 17 - .../horizon/policies/templates/policies/index.html | 13 - .../policies/rules/_create_conditions.html | 174 ----- .../templates/policies/rules/_create_output.html | 65 -- .../templates/policies/rules/_mapping_row.html | 21 - .../policies/templates/policies/rules/create.html | 24 - contrib/horizon/policies/urls.py | 32 - contrib/horizon/policies/views.py | 135 ---- contrib/horizon/static/admin/css/policies.css | 134 ---- contrib/horizon/static/admin/js/policies.js | 288 -------- contrib/horizon/templates/admin/_scripts.html | 5 - contrib/horizon/templates/admin/base.html | 15 - contrib/nova/congress.py | 4 +- devstack/plugin.sh | 42 +- devstack/settings | 13 +- etc/congress-config-generator.conf | 1 + openstack-common.conf | 6 - releasenotes/notes/.placeholder | 0 .../notes/bp-lazy-datasource-6cc39bee817548de.yaml | 5 + .../notes/haht-replicated-pe-affb7dcf83effd68.yaml | 15 + .../notes/newton-other-notes-c885979502f3f540.yaml | 14 + releasenotes/source/_static/.placeholder | 0 releasenotes/source/_templates/.placeholder | 0 releasenotes/source/conf.py | 270 +++++++ releasenotes/source/index.rst | 18 + releasenotes/source/newton.rst | 6 + releasenotes/source/unreleased.rst | 5 + requirements.txt | 42 +- scripts/ocf/congress-datasource | 313 +++++++++ setup.cfg | 9 +- test-requirements.txt | 14 +- .../antlr3-antlr-3.5/runtime/Python/antlr3/main.py | 2 +- tools/check_dot_testr_conf.sh | 8 - tox.ini | 31 +- 269 files changed, 11578 insertions(+), 10302 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 8040feb..2121a79 100644 --- a/requirements.txt +++ b/requirements.txt @@ -5 +5 @@ -Babel>=1.3 # BSD +Babel>=2.3.4 # BSD @@ -8 +8,2 @@ PuLP>=1.0.4 # MIT -keystonemiddleware!=4.1.0,>=4.0.0 # Apache-2.0 +keystoneauth1>=2.10.0 # Apache-2.0 +keystonemiddleware!=4.1.0,!=4.5.0,>=4.0.0 # Apache-2.0 @@ -12,2 +13,2 @@ pbr>=1.6 # Apache-2.0 -python-keystoneclient!=1.8.0,!=2.1.0,>=1.6.0 # Apache-2.0 -python-heatclient>=0.6.0 # Apache-2.0 +python-keystoneclient!=2.1.0,>=2.0.0 # Apache-2.0 +python-heatclient>=1.4.0 # Apache-2.0 @@ -16,3 +17,3 @@ python-novaclient!=2.33.0,>=2.29.0 # Apache-2.0 -python-neutronclient!=4.1.0,>=2.6.0 # Apache-2.0 -python-ceilometerclient>=2.2.1 # Apache-2.0 -python-cinderclient>=1.3.1 # Apache-2.0 +python-neutronclient>=5.1.0 # Apache-2.0 +python-ceilometerclient>=2.5.0 # Apache-2.0 +python-cinderclient!=1.7.0,!=1.7.1,>=1.6.0 # Apache-2.0 @@ -20,2 +21,2 @@ python-swiftclient>=2.2.0 # Apache-2.0 -python-ironicclient>=1.1.0 # Apache-2.0 -alembic>=0.8.0 # MIT +python-ironicclient>=1.6.0 # Apache-2.0 +alembic>=0.8.4 # MIT @@ -23,3 +24,3 @@ python-dateutil>=2.4.2 # BSD -python-glanceclient>=2.0.0 # Apache-2.0 -Routes!=2.0,!=2.1,>=1.12.3;python_version=='2.7' # MIT -Routes!=2.0,>=1.12.3;python_version!='2.7' # MIT +python-glanceclient!=2.4.0,>=2.3.0 # Apache-2.0 +Routes!=2.0,!=2.1,!=2.3.0,>=1.12.3;python_version=='2.7' # MIT +Routes!=2.0,!=2.3.0,>=1.12.3;python_version!='2.7' # MIT @@ -27,5 +28,6 @@ six>=1.9.0 # MIT -oslo.config>=3.7.0 # Apache-2.0 -oslo.context>=0.2.0 # Apache-2.0 -oslo.db>=4.1.0 # Apache-2.0 -oslo.messaging>=4.0.0 # Apache-2.0 -oslo.policy>=0.5.0 # Apache-2.0 +oslo.concurrency>=3.8.0 # Apache-2.0 +oslo.config>=3.14.0 # Apache-2.0 +oslo.context>=2.9.0 # Apache-2.0 +oslo.db!=4.13.1,!=4.13.2,>=4.10.0 # Apache-2.0 +oslo.messaging>=5.2.0 # Apache-2.0 +oslo.policy>=1.9.0 # Apache-2.0 @@ -33,2 +35,2 @@ oslo.serialization>=1.10.0 # Apache-2.0 -oslo.service>=1.0.0 # Apache-2.0 -oslo.utils>=3.5.0 # Apache-2.0 +oslo.service>=1.10.0 # Apache-2.0 +oslo.utils>=3.16.0 # Apache-2.0 @@ -36 +38 @@ oslo.middleware>=3.0.0 # Apache-2.0 -oslo.vmware>=1.16.0 # Apache-2.0 +oslo.vmware>=2.11.0 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index 58237e5..fae3138 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -7,2 +7,2 @@ coverage>=3.6 # Apache-2.0 -fixtures>=1.3.1 # Apache-2.0/BSD -mock>=1.2 # BSD +fixtures>=3.0.0 # Apache-2.0/BSD +mock>=2.0 # BSD @@ -10,2 +10 @@ mox3>=0.7.0 # Apache-2.0 -requests-mock>=0.7.0 # Apache-2.0 -oslo.concurrency>=3.5.0 # Apache-2.0 +requests-mock>=1.0 # Apache-2.0 @@ -16 +15 @@ testtools>=1.4.0 # MIT -retrying!=1.3.0,>=1.2.3 # Apache-2.0 +tenacity>=3.0.0 # Apache-2.0 @@ -19 +18 @@ retrying!=1.3.0,>=1.2.3 # Apache-2.0 -sphinx!=1.2.0,!=1.3b1,<1.3,>=1.1.2 # BSD +sphinx!=1.3b1,<1.3,>=1.2.1 # BSD @@ -20,0 +20,3 @@ oslosphinx!=3.4.0,>=2.5.0 # Apache-2.0 + +# release note requirements +reno>=1.8.0 # Apache2

1 0

[new][telemetry] ceilometer 7.0.0 release (newton)
by no-reply＠openstack.org 06 Oct '16

06 Oct '16

We are stoked to announce the release of: ceilometer 7.0.0: OpenStack Telemetry This release is part of the newton release series. For more details, please see below. 7.0.0 ^^^^^ Ceilometer backends are no more only databases but also REST API like Gnocchi. So ceilometer-dbsync binary name doesn't make a lot of sense and have been renamed ceilometer-upgrade. The new binary handles database schema upgrade like ceilometer-dbsync does, but it also handle any changes needed in configured ceilometer backends like Gnocchi. New Features ************ * Added support for magnum bay CRUD events, event_type is 'magnum.bay.*'. * In the [dispatcher_http] section of ceilometer.conf, verify_ssl can be set to True to use system-installed certificates (default value) or False to ignore certificate verification (use in development only!). verify_ssl can also be set to the location of a certificate file e.g. /some/path/cert.crt (use for self-signed certs) or to a directory of certificates. The value is passed as the 'verify' option to the underlying requests method, which is documented at http://docs.python- requests.org/en/master/user/advanced/#ssl-cert- verification * Add two new meters, including memory.bandwidth.total and memory.bandwidth.local, to get memory bandwidth statistics based on Intel CMT feature. * Add four new meters, including perf.cpu.cycles for the number of cpu cycles one instruction needs, perf.instructions for the count of instructions, perf.cache_references for the count of cache hits and cache_misses for the count of caches misses. * Add support of batch recording metering data to mongodb backend, since the pymongo support *insert_many* interface which can be used to batch record items, in "big-data" scenarios, this change can improve the performance of metering data recording. * Since the Glance v1 APIs won't be maintained any more, this change add the support of glance v2 in images pollsters. Upgrade Notes ************* * Batching is enabled by default now when coordinated workers are enabled. Depending on load, it is recommended to scale out the number of *pipeline_processing_queues* to improve distribution. *batch_size* should also be configured accordingly. * The option >>`<<glance_page_size' has been removed because it's not actually needed. <SYSTEM MESSAGE: <string>:28: (WARNING/2) Inline interpreted text or phrase reference start-string without end-string.> Deprecation Notes ***************** * The event database dispatcher is now deprecated. It has been moved to a new project, alongside the Ceilometer API for /v2/events, called Panko. * The Kwapi pollsters are deprecated and will be removed in the next major version of Ceilometer. * For backward compatibility reason we temporary keep ceilometer- dbsync, at least for one major version to ensure deployer have time update their tooling. Bug Fixes ********* * [bug 1578128 (https://bugs.launchpad.net/ceilometer/+bug/1578128) Add a tool that allow users to drop the legacy alarm and alarm_history tables. * [bug 1597618 (https://bugs.launchpad.net/ceilometer/+bug/1597618) Add the full support of snmp v3 user security model. * Fix to improve handling messages in environments heavily backed up. Previously, notification handlers greedily grabbed messages from queues which could cause ordering issues. A fix was applied to sequentially process messages in a single thread to prevent ordering issues. Changes in ceilometer 6.0.0.0rc1..7.0.0 --------------------------------------- 8c1e536 Fix problem when using wsgi script to start 6fc6341 Remove left over from old ceilometer-api binary 78be95b Move oslo.db to hard requirements list 43cbac3 Update .gitreview for stable/newton 92f30ac agentbase: remove flaky test 7a40bf4 add note regarding pipeline_processing_queues option f76c069 Refactor Ceilometer event API 3e4c37a Refactor Ceilometer alarm API cea2695 standardize release note page ordering a1fae3f gnocchi: enable event_dispatcher in devstack and doc 2d09bce Use pbr wsgi_scripts feature to build ceilometer-api 2c5a419 Change fnmatch.match method to fnmatch.fnmatch 56855f2 tox: Remove useless env 3e013ff Use deps extra for optional requirements 18ad1c1 Don't require gnocchiclient e0df9e3 Initialize correctly collector 790fd01 update docs to show Telemetry projects 7f8f6cc Remove store_events options 5c05c04 Remove sql-expire-samples-only as a CLI option 2feef3b Update the compute node service_credentials parameters 62f6a5f Corrected file mode settings. 5014464 Add oslo.config cli opt to skip the confirm check aaedbbe add new meters about some perf events f3ca7d8 Set a correct number of threads for polling tasks 5750fdd improve notification processing 74f6eb6 Fix string interpolation in log 84e411b correct input params in get_samples 1482731 refactor service to be less pipeline dependent 70a20d2 [api-ref] Correct response code 9e5a5c8 [api-ref] Remove temporary block in conf.py d38c580 XenAPI: correct polling on memory_usage 9709608 gnocchi: Create resource-types on upgrades a60b004 Allow to skip metering/event database upgrade 2bb81d4 Deprecate Kwapi pollsters 18c181f Rename ceilometer-dbsync in ceilometer-upgrade edbe186 make reload test more resilient fe2dec6 generalise instable API redirect assertion 5b941f9 Nit: Aligning the content. c50f0e0 Config logABug feature for Ceilometer api-ref e41adba Fix checking IP version when using IPv6. 0202c64 remove needless brackets e2cd7f3 The debug that network.incoming/outgoing.packets print is not right 0b37c28 Update readme file 96adfd5 [install] Create endpoint in one command ded35e3 [install] Add a missing stash 7d9dbfd Replace urllib.quote() with six.moves.urllib.parse.quote() abacf40 correct the meaning of direct publish transport 9558451 correct the mistake in install-guide document 7b94277 Add a publish transport in Ceilometer architecture document 1374cf7 XenAPI: failed to poll cpu_util c9fcf18 Cleanup imports in code a5c5146 add url in setup.cfg 92fe022 conversions: remove no used local variable fd7230b Add api-ref/build to .gitignore 5684aa0 Fix a warning when running `tox -e api-ref` d298fad Gnocchi dispatcher fails on skipped metric b9ce977 Get ready for os-api-ref sphinx theme change e975f10 [dev-docs] Changed location of a class 2b6fb87 Limit Happybase to < 1.0.0 f2b6064 Fix tempest.conf generation 2fca7eb Configuration of certificate verification for HTTP dispatcher bfffe35 api: redirect to Panko if enabled ed41b32 fix the %{} when string formatting 7348c15 ValueError exception when SNMP returns NoSuchObject 4a51f27 Format error message in http.py 8e870b1 HTTP Dispatcher: Post event data as JSON & improve logging 3685dcf dispatcher: deprecate event database dispatcher for Panko 87d5ac1 dispatcher/database: simplify connection retrieving 28127f2 dispatcher: split the database dispatcher f8933f4 Switch to use Glance v2 in image pollsters b72442a Fix the not found link for notification in glossary.rst 725a884 Added a link to the architecture guide. c2096fd Removed redundant phrase to increase readability b1c192d Fixed small grammar error in overview.rst d9ff460 Set the correct for image bytes_sent event 28f38cb Change keystoneclient to keystoneauth cc410d3 tests: rewrite batching test in a less racy way 5bdbea2 Remove an unused method of network pollsters' base class 2634457 Fixed a small grammar error configuration help doc ed7b6db add memory bandwidth meter 408f574 Do not limit elasticsearch to 2.0 4b3e041 tests: remove dead code with self.source_resources 6411b6f Remove Nadya Privalova from core reviewers ca31c23 Fix wrong parameter reference in periodic decorator d9d48bf Add missing %s in print message e4ece33 test: Fix wrong override value of config option interface ecd2215 Modify py3.4 to py3.5 in the py35-functional of tox 6dbbc9a Put py34 first in the env order of tox 8837801 This adds migrated API reference files a3eb0fa consumes error notif. when event are disabled 8ed2e77 publisher: make direct publisher generic e089ecc Revert "[install] Create endpoint in one command" cee262b Register the gnocchi event dispatcher a8ea360 Reduce code duplication 9da6ba2 Specify host info when using the notifier publisher 7b4e888 Add Python 3.4 and 3.5 classifiers and targets 3b14d40 Retrieval of RBD device information issue e487756 Install configuration files in etc dc254e2 Added full support of snmp v3 usm model 5cebb31 base.Resource not define __ne__() built-in function 46e0d65 Check lbaas version if call is v2 specific 80bc124 move out oslo.service 6773685 Remove unused AdvEnum class definition e6ff145 fix l3_cache definition b8cc36b throw PollsterPermenantError exception for memory usage meter 36df404 events: fix operator check in event filter bf9f484 Raise PollsterPermanentError if inspector is not implemented 9f97bf8 Remove unused LOG fc9d73d Fix get_gnocchiclient to work with python3.5 10a36ae collector: use an intermediate proxy class for event dispatcher bb35821 Replace raw_input with input to make PY3 compatible 1ab0acb pollsters: Remove eventlet timers c83e9ef Imported Translations from Zanata 67e0174 Fix the name as it was a typo c853877 devstack: prefix _drop_database 60bd9a7 start partition coordinator only when there is a group to join 0b55827 split discover into different namespaces cd2e041 devstack: disable workload_partition for compute polling 800034d Add a tool to clean the legacy alarm tables 913880b devstack: do not wait for service to start 677f967 Config: no need to set default=None 4bf0ae3 sqlalchemy: do not run upgrade on fresh install 7f603ce sqlalchemy: fix JSONEncodedDict implementation type b33f32b Add install-guide for ceilometer c940ccc gnocchi: use events to end Gnocchi resource f48a6b6 Don't generate hostname of host running build to config file 5ad613f Fixing a trivial typo. 68be6c9 Add 'task_state' attribute to meter metadata a2a04e5 add support of batch recording metering data for mongodb 23247f8 Switch to use glanceclient to get image 0936b5b Add install description for Neutron a2dbcaf add l3 cache usage meter 196d320 doc: remove left over of docbookrestapi 68064ca tests: do not override auth version to v2 f7e27a2 dispacher/gnocchi: measures sent fix logging 5976031 Copy images_client from tempest + Correct concurrency of gabbi 1.22.0 98571ed Rename gabbits with _ to have - instead 8fcbc8d Correct concurrency of gabbi tests for gabbi 1.22.0 f99cedf Use "topics" instead of "topic" in Notifier initialization c2b48d6 Clean deprecated "rpc_backend" in tests 1ccacfc Use trusts in Heat integration test 545a8b2 Remove configuration README in etc c6b0664 Imported Translations from Zanata 6c0b97b Copy images_client from tempest cf3f7c9 Add Magnum events to definitions 104dfe1 [dispatcher/gnocchi] add unit for metric a9cb9b6 Delete unused last_dup variable 9c08a89 catch DriverLoadFailure for get_transport optional d7f8ce9 catch DriverLoadFailure for get_transport optional 8ecf1fc Bump to Nova v2.1 0cf728a Fix the py34 jenkins job f6b2406 tempest: import ImagesClient as ImagesClientV2 3c1b806 fix some typos in our doc, comments and releasenotes 7951eb5 enable swift pollsters poll data for specific region 1610935 enable swift pollsters poll data for specific region 9d2864f Imported Translations from Zanata 1c0b83c tempest_plugin: drop telemetry decorator aa32401 tempest_plugin: drop telemetry decorator 9ba3c49 Updated from global requirements 9cf0397 [Trivial] Update Neutron resource status list 089f63b doc: remove database alarm capability 0718eeb replace deprecated heat command with OSC 45daf16 Update to hacking 0.11.0 ff05a0f Verify message's signature for every dispatcher 75c48c0 fix CI failure due to oslo.messaging 5.0.0 2b91096 remove log in tools/make_test_{event_}data.py 23d5c9f fix CI failure due to oslo.messaging 5.0.0 7ecbbf4 remove record_metering_data method from collector 15a424c tests: replace overtest by pifpaf dfc3452 Add log hints for partition coordinator 5a5356b fix opts.list_opts for polling options aa8c224 update help string for messaging_urls 8dd821a Drop timestamping in pollsters 615b120 Set the time point polling starts as timestamp of samples 6292e0e Fix notification listeners usage 72cc318 tox: only install hacking in pep8 target 25cd1d2 Remove unused pylintrc f3817aa devstack: remove useless policy_file setting 984e2e1 event: verify signature before recording events for all dispatchers ac5f725 tests: stop services on tests teardown b5a870f Fix oslo_service stop/start mechanism 4538921 remove floating_ip_get_all in nova_client 39f0f90 [Trivial] Refactor libvirt inspector connection & uri c898ecd Fix concurrency issue with snmp pollsters da40664 Drop the executability of http.py 6f9346a Updated from global requirements 372d70c remove deprecated auth type password-ceilometer-legacy c6022ff [Trivial] Update Neutron resource status list 54887ff [Trivial] Remove CEILOMETER_API_LOG_DIR option for devstack 90f771e Update the default log levels 3b41c49 Clean some unused method in ceilometer/keystone_client.py 8788d1a remove invalid todo in storage functional test code f41d6dd return 400 when invalid aggregation function is specified 0267193 Replace logging with oslo_log 6e415fa remove deprecated option database_connection 0a4bff7 move EventFilter to event storage namespace 68248fe remove MultipleResultsFound and NoResultFound exception eeb8cd4 Remove useless file fd6c9ae remove todo for OS_TEST_PATH be8c615 add tempest to test-requirements.txt dcfe070 Improve the docstring for Swift pollsters ed9a697 add log decorator for neutron_client public method e4f19c0 add debtcollector to requirements 394f4e2 Remove direct dependency on babel de82727 Imported Translations from Zanata c262389 Refactor floatingip pollster to use discovery 726b2d4 Fix notification listeners usage 24f75da notification: Remove eventlet timers 72687f5 use static timestamps for api samples d59f099 refactor DefinitionException classes 3766f21 collector: Don't use eventlet thread 196a747 fix openstack cli command in doc manual 9aac316 Add release note link 5ccbea9 switch to openstack cli instead of keystone cli 0b65c21 Updated from global requirements 7d455d5 libvirt: fix missing python-libvirt issue 9e44701 Add status in Ceilometer VPN connection sample 0958f16 document how to enable ceilometer stable branch in devstack b26c1e1 remove python-ceilometerclient from requirements 9009c10 Imported Translations from Zanata 5e31807 Updated from global requirements caa6f91 Imported Translations from Zanata 64e6536 Ignore the filter_service_activity option if gnocchi project not found 4a35a4f Fix Ceilometer tests config options 1ec0b61 Updated from global requirements 1fea0f5 Fix doc build if git is absent 6df47f7 Replace tempest-lib by os-testr 8e7940a Add notes on moving to Gnocchi 7fe87e9 delete verbose/redundant/deprecated text d526651 replace fnmatch with oslo.utils.fnmatch 5676fe0 add ceilometer to gnocchi configuration notes 123fa26 Updated from global requirements 97f65ad Imported Translations from Zanata 7a4eca2 remove complex capabilities for meter, resource and statistics 4a451fa gnocchi: batch measurements fcaec56 change keystone to openstack cli 182b4bd re-org existing manually install notes 2e3f792 messaging: remove RequestContextSerializer 36a5d1b Remove unused context object in vpnaas test dba353e Remove unused object from lbaas_v2 test 4eae319 Remove unused context object lbaas test 2d1e390 test: remove unused context object in FWaaS tests a02f35b Remove unused context objects in Glance tests 3e45352 Remove unused context object in test 10cb9f6 Remove a useless usage of oslo.context in meters API 9ad61b1 Remove the deprecated DB2 driver aa012cd Update the Administrator Guide links 9bf2d37 mongo: remove unused function e6005df Updated from global requirements c2b7246 Imported Translations from Zanata 8599ec5 drop magnetodb support 8ee9fc1 Simplify chained comparison 3459bc5 Enhancing Retry logic to Coordination when joining partitioning grp 5d850f9 publisher: clean out context usage 4c491b5 Disable ceilometer-aipmi by default for devstack b2549ae Remove useless context object usage 1266e56 Imported Translations from Zanata 333104d Imported Translations from Zanata 2444399 collector: never allow to lose data bb6032f 'ceilometer-polling' should fail with no valid pollsters acd1faf Imported Translations from Zanata 3fb6df9 Fix typos in comments and config strings. 78fac6e Updated from global requirements 19e751c abort alarms URLs when Aodh is unavailable b934520 abort alarms URLs when Aodh is unavailable cd2ebc6 fix minor typo in test_generic.py 7ee29aa Imported Translations from Zanata 7156e9d Add the functional tests for getting events 40684da collector: never allow to lose data 55337c5 devstack Fix unprocess measure path 621916b Imported Translations from Zanata 59f90f5 devstack: allow ceilometer-api and keystone to run on different hosts 49a204e Devstack: install coordination backend for compute agent ef88a0a remove dns and trove from entry_points 1a935cd correct docstring in storage module da805ef Imported Translations from Zanata 6563e6b Remove gabbi tests that check content-location c634b5f Add http publisher bc720bf remove dns and trove from entry_points 3026e98 Imported Translations from Zanata f8b5be7 Imported Translations from Zanata 5922a1c Update reno for stable/mitaka 1f91372 Update .gitreview for stable/mitaka 639b947 Remove gabbi tests that check content-location c569fcd remove unused field 'triggers' defined in sample event_pipeline.yaml 337cd3c remove SERVICE_TENANT_NAME from devstack plugin 7cae725 clean devstack plugin d036d7a Fix SDR file parsing for Intel Node Manager 44d5769 unquote resource id to support slash in it Diffstat (except docs and test files) ------------------------------------- .gitignore | 5 +- .gitreview | 1 + .testr.conf | 2 +- MAINTAINERS | 1 - README.rst | 31 +- api-ref/source/alarms.inc | 336 +++++++++ api-ref/source/capabilities.inc | 92 +++ api-ref/source/conf.py | 274 ++++++++ api-ref/source/events.inc | 93 +++ api-ref/source/index.rst | 8 + api-ref/source/meters.inc | 386 +++++++++++ api-ref/source/parameters.yaml | 757 +++++++++++++++++++++ api-ref/source/resources.inc | 95 +++ api-ref/source/samples.inc | 111 +++ api-ref/source/samples/alarm-show-response.json | 24 + api-ref/source/samples/alarm-show-response.xml | 25 + api-ref/source/samples/alarms-list-response.json | 26 + api-ref/source/samples/alarms-list-response.xml | 27 + .../source/samples/capabilities-list-response.json | 40 ++ .../source/samples/capabilities-list-response.xml | 131 ++++ api-ref/source/samples/event-show-response.json | 18 + api-ref/source/samples/events-list-response.json | 20 + api-ref/source/samples/meters-list-response.json | 12 + api-ref/source/samples/meters-list-response.xml | 13 + api-ref/source/samples/resource-show-response.json | 20 + api-ref/source/samples/resource-show-response.xml | 27 + .../source/samples/resources-list-response.json | 22 + api-ref/source/samples/resources-list-response.xml | 29 + api-ref/source/samples/sample-create-request.json | 17 + api-ref/source/samples/sample-create-request.xml | 23 + api-ref/source/samples/sample-show-response.json | 17 + api-ref/source/samples/sample-show-response.xml | 24 + api-ref/source/samples/samples-list-response.json | 19 + api-ref/source/samples/samples-list-response.xml | 26 + .../source/samples/statistics-list-response.json | 16 + .../source/samples/statistics-list-response.xml | 17 + ceilometer/agent/discovery/endpoint.py | 3 +- ceilometer/agent/manager.py | 141 ++-- ceilometer/agent/plugin_base.py | 21 +- ceilometer/api/__init__.py | 36 - ceilometer/api/app.py | 41 +- ceilometer/api/controllers/v2/base.py | 25 - ceilometer/api/controllers/v2/capabilities.py | 9 +- ceilometer/api/controllers/v2/events.py | 20 +- ceilometer/api/controllers/v2/meters.py | 23 +- ceilometer/api/controllers/v2/resources.py | 7 +- ceilometer/api/controllers/v2/root.py | 72 +- ceilometer/api/controllers/v2/samples.py | 5 +- ceilometer/cmd/agent_notification.py | 9 +- ceilometer/cmd/api.py | 23 - ceilometer/cmd/collector.py | 7 +- ceilometer/cmd/polling.py | 13 +- ceilometer/cmd/sample.py | 3 +- ceilometer/cmd/storage.py | 124 +++- ceilometer/collector.py | 115 ++-- ceilometer/compute/pollsters/__init__.py | 16 + ceilometer/compute/pollsters/cpu.py | 39 ++ ceilometer/compute/pollsters/disk.py | 40 +- ceilometer/compute/pollsters/memory.py | 97 ++- ceilometer/compute/pollsters/net.py | 21 +- ceilometer/compute/pollsters/perf.py | 128 ++++ ceilometer/compute/pollsters/util.py | 3 +- ceilometer/compute/virt/inspector.py | 62 +- ceilometer/compute/virt/libvirt/inspector.py | 137 +++- ceilometer/compute/virt/xenapi/inspector.py | 40 +- ceilometer/coordination.py | 50 +- ceilometer/declarative.py | 17 +- ceilometer/dispatcher/__init__.py | 4 +- ceilometer/dispatcher/database.py | 121 ++-- ceilometer/dispatcher/gnocchi.py | 325 ++++++--- ceilometer/dispatcher/http.py | 96 +-- ceilometer/energy/kwapi.py | 6 - ceilometer/event/converter.py | 17 +- ceilometer/event/endpoint.py | 9 +- ceilometer/event/storage/__init__.py | 57 ++ ceilometer/event/storage/impl_db2.py | 69 -- ceilometer/event/storage/impl_sqlalchemy.py | 15 +- ceilometer/event/storage/pymongo_base.py | 4 +- ceilometer/exchange_control.py | 3 - ceilometer/gnocchi_client.py | 129 ++++ ceilometer/hardware/discovery.py | 51 +- ceilometer/hardware/inspector/base.py | 3 - ceilometer/hardware/inspector/snmp.py | 81 ++- ceilometer/hardware/pollsters/generic.py | 22 +- ceilometer/hardware/pollsters/util.py | 6 - ceilometer/image/discovery.py | 43 ++ ceilometer/image/glance.py | 108 +-- ceilometer/ipmi/platform/intel_node_manager.py | 31 +- ceilometer/ipmi/pollsters/node.py | 5 +- ceilometer/ipmi/pollsters/sensor.py | 5 +- ceilometer/keystone_client.py | 97 --- ceilometer/locale/ceilometer-log-error.pot | 181 ----- ceilometer/locale/ceilometer-log-info.pot | 163 ----- ceilometer/locale/ceilometer-log-warning.pot | 164 ----- ceilometer/locale/ceilometer.pot | 566 --------------- .../locale/de/LC_MESSAGES/ceilometer-log-error.po | 31 +- .../locale/de/LC_MESSAGES/ceilometer-log-info.po | 18 +- .../de/LC_MESSAGES/ceilometer-log-warning.po | 22 +- ceilometer/locale/de/LC_MESSAGES/ceilometer.po | 42 +- .../locale/es/LC_MESSAGES/ceilometer-log-error.po | 15 +- .../locale/es/LC_MESSAGES/ceilometer-log-info.po | 6 +- ceilometer/locale/es/LC_MESSAGES/ceilometer.po | 99 ++- ceilometer/locale/fr/LC_MESSAGES/ceilometer.po | 36 +- ceilometer/locale/it/LC_MESSAGES/ceilometer.po | 127 +++- ceilometer/locale/ja/LC_MESSAGES/ceilometer.po | 86 ++- .../ko_KR/LC_MESSAGES/ceilometer-log-error.po | 135 ++++ .../ko_KR/LC_MESSAGES/ceilometer-log-info.po | 128 ++++ .../ko_KR/LC_MESSAGES/ceilometer-log-warning.po | 155 +++++ ceilometer/locale/ko_KR/LC_MESSAGES/ceilometer.po | 119 +++- ceilometer/locale/pt_BR/LC_MESSAGES/ceilometer.po | 119 +++- ceilometer/locale/ru/LC_MESSAGES/ceilometer.po | 26 +- ceilometer/locale/zh_CN/LC_MESSAGES/ceilometer.po | 29 +- ceilometer/locale/zh_TW/LC_MESSAGES/ceilometer.po | 28 +- ceilometer/messaging.py | 31 +- ceilometer/meter/data/meters.yaml | 28 - ceilometer/meter/notifications.py | 26 +- ceilometer/network/floatingip.py | 46 +- ceilometer/network/services/base.py | 11 +- ceilometer/network/services/discovery.py | 7 + ceilometer/network/services/fwaas.py | 3 - ceilometer/network/services/lbaas.py | 9 - ceilometer/network/services/vpnaas.py | 4 +- ceilometer/network/statistics/__init__.py | 3 +- .../network/statistics/opencontrail/driver.py | 4 +- .../network/statistics/opendaylight/client.py | 2 +- .../network/statistics/opendaylight/driver.py | 9 +- ceilometer/neutron_client.py | 34 +- ceilometer/notification.py | 244 ++++--- ceilometer/nova_client.py | 37 +- ceilometer/objectstore/rgw.py | 7 - ceilometer/objectstore/swift.py | 24 +- ceilometer/opts.py | 19 +- ceilometer/pipeline.py | 220 +++--- ceilometer/publisher/__init__.py | 4 +- ceilometer/publisher/direct.py | 83 ++- ceilometer/publisher/file.py | 6 +- ceilometer/publisher/http.py | 137 ++++ ceilometer/publisher/kafka_broker.py | 2 +- ceilometer/publisher/messaging.py | 41 +- ceilometer/publisher/test.py | 6 +- ceilometer/publisher/udp.py | 25 +- ceilometer/sample.py | 18 +- ceilometer/service.py | 16 +- ceilometer/service_base.py | 100 +-- ceilometer/storage/__init__.py | 79 +-- ceilometer/storage/base.py | 27 +- ceilometer/storage/hbase/utils.py | 4 +- ceilometer/storage/impl_db2.py | 419 ------------ ceilometer/storage/impl_hbase.py | 4 +- ceilometer/storage/impl_log.py | 2 +- ceilometer/storage/impl_mongodb.py | 145 ++-- ceilometer/storage/impl_sqlalchemy.py | 28 +- ceilometer/storage/mongo/utils.py | 11 +- ceilometer/storage/pymongo_base.py | 8 +- ceilometer/storage/sqlalchemy/models.py | 26 +- ceilometer/storage/sqlalchemy/utils.py | 2 +- .../api/v2/test_complex_query_scenarios.py | 3 - .../functional/api/v2/test_event_scenarios.py | 65 +- .../api/v2/test_list_resources_scenarios.py | 26 + .../functional/api/v2/test_statistics_scenarios.py | 8 +- .../gabbi/gabbits/api-events-no-data.yaml | 210 ++++++ .../gabbi/gabbits/api-events-with-data.yaml | 242 +++++++ .../gabbi/gabbits/api_events_no_data.yaml | 218 ------ .../gabbi/gabbits/api_events_with_data.yaml | 254 ------- .../gabbi/gabbits_prefix/api_events_with_data.yaml | 17 - .../functional/storage/test_impl_sqlalchemy.py | 9 +- .../functional/storage/test_storage_scenarios.py | 172 +++-- .../gabbi/gabbits-live/create_stack.json | 9 +- .../gabbi/gabbits-live/update_stack.json | 9 +- .../tempest/api/test_telemetry_notification_api.py | 2 +- .../test_object_storage_telemetry_middleware.py | 4 +- .../tempest/service/images/v1/images_client.py | 254 +++++++ .../tempest/service/images/v2/images_client.py | 245 +++++++ .../unit/compute/virt/libvirt/test_inspector.py | 108 ++- .../unit/compute/virt/xenapi/test_inspector.py | 67 +- .../unit/hardware/inspector/test_inspector.py | 2 - .../unit/ipmi/platform/test_intel_node_manager.py | 24 + .../network/statistics/opencontrail/test_driver.py | 30 +- .../network/statistics/opendaylight/test_driver.py | 1 - .../unit/network/statistics/test_statistics.py | 62 +- .../unit/publisher/test_kafka_broker_publisher.py | 24 +- .../unit/publisher/test_messaging_publisher.py | 78 ++- ceilometer/transformer/__init__.py | 11 +- ceilometer/transformer/accumulator.py | 4 +- ceilometer/transformer/arithmetic.py | 4 +- ceilometer/transformer/conversions.py | 18 +- ceilometer/utils.py | 52 +- devstack/README.rst | 10 + devstack/plugin.sh | 84 +-- devstack/settings | 8 +- devstack/upgrade/upgrade.sh | 4 +- etc/ceilometer/README-ceilometer.conf.txt | 4 - etc/ceilometer/event_definitions.yaml | 45 +- etc/ceilometer/event_pipeline.yaml | 1 - etc/ceilometer/gnocchi_resources.yaml | 13 + functions.sh | 29 - install-guide/source/conf.py | 304 +++++++++ .../cinder/install-cinder-obs.rst | 44 ++ .../cinder/install-cinder-rdo.rst | 44 ++ .../cinder/install-cinder-ubuntu.rst | 45 ++ .../glance/install-glance-obs.rst | 44 ++ .../glance/install-glance-rdo.rst | 44 ++ .../glance/install-glance-ubuntu.rst | 45 ++ .../nova/install-nova-common.rst | 82 +++ .../configure_services/nova/install-nova-obs.rst | 32 + .../configure_services/nova/install-nova-rdo.rst | 32 + .../nova/install-nova-ubuntu.rst | 31 + .../swift/install-swift-config-common.rst | 40 ++ .../configure_services/swift/install-swift-obs.rst | 31 + .../swift/install-swift-prereq-common.rst | 36 + .../configure_services/swift/install-swift-rdo.rst | 31 + .../swift/install-swift-ubuntu.rst | 31 + .../database/environment-nosql-database-obs.rst | 78 +++ .../database/environment-nosql-database-rdo.rst | 50 ++ .../database/environment-nosql-database-ubuntu.rst | 52 ++ install-guide/source/get_started.rst | 41 ++ install-guide/source/index.rst | 31 + .../source/install-base-config-common.rst | 76 +++ install-guide/source/install-base-obs.rst | 117 ++++ .../source/install-base-prereq-common.rst | 102 +++ install-guide/source/install-base-rdo.rst | 93 +++ install-guide/source/install-base-ubuntu.rst | 110 +++ install-guide/source/next-steps.rst | 9 + install-guide/source/verify.rst | 70 ++ pylintrc | 48 -- .../add-db-legacy-clean-tool-7b3e3714f414c448.yaml | 6 + ...d-full-snmpv3-usm-support-ab540c902fa89b9d.yaml | 5 + .../notes/add-magnum-event-4c75ed0bb268d19c.yaml | 5 + .../notes/always-requeue-7a2df9243987ab67.yaml | 15 + ...nfigurable-data-collector-e247aadbffb85243.yaml | 2 +- ...se_event_dispatcher_panko-607d558c86a90f17.yaml | 4 + ...ttp-dispatcher-verify-ssl-551d639f37849c6f.yaml | 11 + .../notes/kwapi_deprecated-c92b9e72c78365f0.yaml | 4 + .../memory-bandwidth-meter-f86cf01178573671.yaml | 5 + .../notes/perf-events-meter-b06c2a915c33bfaf.yaml | 6 + .../rename-ceilometer-dbsync-eb7a1fa503085528.yaml | 13 + .../single-thread-pipelines-f9e6ac4b062747fe.yaml | 11 + .../skip-duplicate-meter-def-0420164f6a95c50c.yaml | 2 +- ...ter-batch-recording-mongo-6c2bdf4fbb9764eb.yaml | 6 + ...-timestamp-of-polled-data-fbfcff43cd2d04bc.yaml | 7 + ...nce-v2-in-image-pollsters-137a315577d5dc4c.yaml | 8 + releasenotes/source/index.rst | 3 +- releasenotes/source/mitaka.rst | 6 + requirements.txt | 18 +- setup.cfg | 52 +- test-requirements.txt | 23 +- tools/lintstack.py | 202 ------ tools/lintstack.sh | 57 -- tools/make_test_data.py | 11 - tools/make_test_data.sh | 6 +- tools/make_test_event_data.py | 11 - tools/send_test_data.py | 2 +- tox.ini | 63 +- 343 files changed, 12410 insertions(+), 6671 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 15d199a..71d9ff0 100644 --- a/requirements.txt +++ b/requirements.txt @@ -4,0 +5,4 @@ +cotyledon +futures>=3.0;python_version=='2.7' or python_version=='2.6' # BSD +futurist>=0.11.0 # Apache-2.0 +debtcollector>=1.2.0 # Apache-2.0 @@ -12,2 +15,0 @@ msgpack-python>=0.4.0 # Apache-2.0 -oslo.context>=0.2.0 # Apache-2.0 -oslo.db>=4.1.0 # Apache-2.0 @@ -15 +17,2 @@ oslo.concurrency>=3.5.0 # Apache-2.0 -oslo.config>=3.7.0 # Apache-2.0 +oslo.config>=3.9.0 # Apache-2.0 +oslo.db>=4.1.0 # Apache-2.0 @@ -21 +23,0 @@ oslo.rootwrap>=2.0.0 # Apache-2.0 -oslo.service>=1.0.0 # Apache-2.0 @@ -25 +27 @@ pecan>=1.0.0 # BSD -oslo.messaging>=4.0.0 # Apache-2.0 +oslo.messaging>=5.2.0 # Apache-2.0 @@ -30 +31,0 @@ pysnmp<5.0.0,>=4.2.3 # BSD -python-ceilometerclient>=2.2.1 # Apache-2.0 @@ -34 +35 @@ keystoneauth1>=2.1.0 # Apache-2.0 -python-neutronclient!=4.1.0,>=2.6.0 # Apache-2.0 +python-neutronclient>=4.2.0 # Apache-2.0 @@ -42 +43 @@ sqlalchemy-migrate>=0.9.6 # Apache-2.0 -stevedore>=1.5.0 # Apache-2.0 +stevedore>=1.9.0 # Apache-2.0 @@ -44 +44,0 @@ tooz>=1.28.0 # Apache-2.0 -Werkzeug>=0.7 # BSD License diff --git a/test-requirements.txt b/test-requirements.txt index 6ffbce0..422a4cb 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -5,3 +4,0 @@ -# Hacking already pins down pep8, pyflakes and flake8 -hacking<0.11,>=0.10.0 -Babel>=1.3 # BSD @@ -10,3 +7,3 @@ coverage>=3.6 # Apache-2.0 -elasticsearch<2.0,>=1.3.0 # Apache-2.0 -fixtures>=1.3.1 # Apache-2.0/BSD -happybase!=0.7,>=0.5;python_version=='2.7' # MIT +elasticsearch>=1.3.0 # Apache-2.0 +fixtures<2.0,>=1.3.1 # Apache-2.0/BSD +happybase!=0.7,>=0.5,<1.0.0;python_version=='2.7' # MIT @@ -14 +10,0 @@ mock>=1.2 # BSD -PyMySQL>=0.6.2 # MIT License @@ -17,0 +14 @@ oslo.cache>=1.5.0 # Apache-2.0 +openstackdocstheme>=1.0.3 # Apache-2.0 @@ -19 +16 @@ oslosphinx!=3.4.0,>=2.5.0 # Apache-2.0 -reno>=0.1.1 # Apache2 +reno>=1.6.2 # Apache2 @@ -22,5 +18,0 @@ oslo.vmware>=1.16.0 # Apache-2.0 -overtest>=0.10.0 # Apache-2.0 -psycopg2>=2.5 # LGPL/ZPL -pylint==1.4.5 # GNU GPL v2 -pymongo!=3.1,>=3.0.2 # Apache-2.0 -gnocchiclient>=2.1.0 # Apache-2.0 @@ -36 +28,2 @@ requests-aws>=0.1.4 # BSD License (3 clause) -tempest-lib>=0.14.0 # Apache-2.0 +os-testr>=0.4.1 # Apache-2.0 +tempest>=11.0.0 # Apache-2.0 @@ -37,0 +31,2 @@ WebTest>=2.0 # MIT +pifpaf>=0.0.11 +os-api-ref>=0.1.0 # Apache-2.0s

1 0

[new][cinder] cinder 9.0.0 release (newton)
by no-reply＠openstack.org 06 Oct '16

06 Oct '16

We are high-spirited to announce the release of: cinder 9.0.0: OpenStack Block Storage This release is part of the newton release series. For more details, please see below. 9.0.0 ^^^^^ Everything in Cinder's release notes related to the High Availability Active-Active effort -preluded with "HA A-A:"- is work in progress and should not be used in production until it has been completed and the appropriate release note has been issued stating its readiness for production. The default key manager interface in Cinder was deprecated and the Castellan key manager interface library is now used instead. For more information about Castellan, please see http://docs.openstack.org/developer/castellan/ . New Features ************ * dell_server_os option added to the Dell SC driver. This option allows the selection of the server type used when creating a server on the Dell DSM during initialize connection. This is only used if the server does not exist. Valid values are from the Dell DSM create server list. * Added support for the use of live volume in place of standard replication in the Dell SC driver. * Added replication failback support for the Dell SC driver. * Added volume driver for Zadara Storage VPSA. * Added a new config option *scheduler_weight_handler*. This is a global option which specifies how the scheduler should choose from a listed of weighted pools. By default the existing weigher is used which always chooses the highest weight. * Added a new weight handler *StochasticHostWeightHandler*. This weight handler chooses pools randomly, where the random probabilities are proportional to the weights, so higher weighted pools are chosen more frequently, but not all the time. This weight handler spreads new shares across available pools more fairly. * Allow API user to remove the consistency group name or description information. * Support for snapshot backup using the optimal path in Huawei driver. * Added REST API to update backup name and description. * Report pools in volume stats for Block Device Driver. * Updating the Datera Elastic DataFabric Storage Driver to version 2.1. This adds ACL support, Multipath support and basic IP pool support. * Changes config option default for datera_num_replicas from 1 to 3 * Support for use of 'fc_southbound_protocol' configuration setting in the Brocade FC SAN lookup service. * Added Keystone v3 support for Swift backup driver in single user mode. * Added volume backend drivers for CoprHD FC, iSCSI and Scaleio. * HA A-A: Add cluster configuration option to allow grouping hosts that share the same backend configurations and should work in Active-Active fashion. * HA A-A: Updated manage command to display cluster information on service listings. * HA A-A: Added cluster subcommand in manage command to list, remove, and rename clusters. * HA A-A: Added clusters API endpoints for cluster related operations (index, detail, show, enable/disable). Index and detail accept filtering by *name*, *binary*, *disabled*, *num_hosts*, *num_down_hosts*, and up/down status (*is_up*) as URL parameters. Also added their respective policies. * Separate create and update rules for volume metadata. * Capabilites List for Datera Volume Drivers * Extended Volume-Type Support for Datera Volume Drivers * Naming convention change for Datera Volume Drivers * Volume Manage/Unmanage support for Datera Volume Drivers * New BoolOpt "datera_debug_override_num_replicas" for Datera Volume Drivers * Added using etags in API calls to avoid the lost update problem during deleting volume metadata. * Configuration options for the DRBD driver that will be applied to DRBD resources; the default values should be okay for most installations. * Added manage/unmanage volume support for Dell Equallogic driver. * Added backend driver for FalconStor FreeStor. * Added backend driver for Huawei FusionStorage. * Introduced generic volume groups and added create/ delete/update/list/show APIs for groups. * Added create/delete APIs for group snapshots and an API to create group from source. * Added group type and group specs APIs. * Added manage/unmanage snapshot support to the HNAS NFS driver. * Add support for reporting pool disk type in Huawei driver. * Add support for hybrid aggregates to the NetApp cDOT drivers. * Volume manage/unmanage support for IBM FlashSystem FC and iSCSI drivers. * Added support for querying volumes filtered by group_id using 'group_id' optional URL parameter. For example, "volumes/detail?group_id={consistency_group_id}". * New FC Cinder volume driver for Kaminario K2 all-flash arrays. * New iSCSI Cinder volume driver for Kaminario K2 all-flash arrays. * Added the ability to list manageable volumes and snapshots via GET operation on the /v2/<project_id>/os-volume-manage and /v2/<project_id>/os-snapshot-manage URLs, respectively. * The v2 API extensions os-volume-manage and os-snapshot-manage have been mapped to the v3 resources manageable_volumes and manageable_snapshots * Added host-level (whole back end replication - v2.1) replication support to the NetApp cDOT drivers (iSCSI, FC, NFS). * Added Cinder consistency group for the NetApp NFS driver. * Added HA support for NexentaEdge iSCSI driver * Added NBD driver for NexentaEdge. * Support for force backup of in-use Cinder volumes in Nimble driver. * Add get_manageable_volumes and get_manageable_snapshots implementations for Pure Storage Volume Drivers. * The xiv_ds8k driver now supports IBM XIV, Spectrum Accelerate, FlashSystem A9000, FlashSystem A9000R and DS8000 storage systems, and was renamed to IBM Storage Driver for OpenStack. The changes include text changes, file names, names of cinder.conf flags, and names of the proxy classes. * Support for retype volumes with different encryptions including changes from unencrypted types to encrypted types and vice-versa. * Added support for manage/unmanage snapshot in the ScaleIO driver. * Added support for scaling QoS in the ScaleIO driver. The new QoS keys are maxIOPSperGB and maxBWSperGB. * Added support for oversubscription in thin provisioning in the ScaleIO driver. Volumes should have extra_specs with the key provisioning:type with value equals to either 'thick' or 'thin'. max_oversubscription_ratio can be defined by the global config or for ScaleIO specific with the config option sio_max_over_subscription_ratio. The maximum oversubscription ratio supported at the moment is 10.0. * Added v2.1 replication support to SolidFire driver. * Added consistency group support to the Huawei driver. * Added support for querying volumes filtered by glance metadata key/value using 'glance_metadata' optional URL parameter. For example, "volumes/detail?glance_metadata={"image_name":"xxx"}". * Added supported driver checks on all drivers. * Added backend driver for Synology iSCSI-supported storage. * Added support for vhd and vhdx disk-formats for volume upload-to- image. * Support for iSCSI multipathing in EMC VMAX driver. * Added oversubscription support in the VMAX driver * QoS support in EMC VMAX iSCSI and FC drivers. * Added backend driver for Violin Memory 7000 iscsi storage. * New Cinder driver based on storops library (available in pypi) for EMC VNX. * A new API to display the volumes summary. This summary API displays the total number of volumes and total volume's size in GB. * Added snapshot manage/unmanage support to the EMC XtremIO driver. * Added backend driver for ZTE iSCSI storage. Known Issues ************ * When running Nova Compute and Cinder Volume or Backup services on the same host they must use a shared lock directory to avoid rare race conditions that can cause volume operation failures (primarily attach/detach of volumes). This is done by setting the "lock_path" to the same directory in the "oslo_concurrency" section of nova.conf and cinder.conf. This issue affects all previous releases utilizing os-brick and shared operations on hosts between Nova Compute and Cinder data services. Upgrade Notes ************* * In certain environments (Kubernetes for example) indirect calls to the LVM commands result in file descriptor leak warning messages which in turn cause the process_execution method to raise and exception. To accommodate these environments, and to maintain backward compatibility in Newton we add a "lvm_suppress_fd_warnings" bool config to the LVM driver. Setting this to True will append the LVM env vars to include the variable "LVM_SUPPRESS_FD_WARNINGS=1". This is made an optional configuration because it only applies to very specific environments. If we were to make this global that would require a rootwrap/privsep update that could break compatibility when trying to do rolling upgrades of the volume service. * The 'backup_service_inithost_offload' configuration option now defaults to 'True' instead of 'False'. * If policy for update volume metadata is modified in a desired way it's needed to add a desired rule for create volume metadata. * The Cinder database can now only be upgraded from changes since the Kilo release. In order to upgrade from a version prior to that, you must now upgrade to at least Kilo first, then to Newton or later. * Any Volume Drivers configured in the DEFAULT config stanza should be moved to their own stanza and enabled via the enabled_backends config option. The older style of config with DEFAULT is deprecated and will be removed in future releases. * HNAS drivers have new configuration paths. Users should now use "cinder.volume.drivers.hitachi.hnas_nfs.HNASNFSDriver" for HNAS NFS driver and "cinder.volume.drivers.hitachi.hnas_iscsi.HNASISCSIDriver" for HNAS iSCSI driver. * HNAS drivers will now read configuration from cinder.conf. * Support for iSCSI multipath in Huawei driver. * Support iSCSI configuration in replication in Huawei driver. * The Scality driver has been marked as unsupported and is now deprecated. enable_unsupported_drivers will need to be set to True in cinder.conf to continue to use it. * While configuring NetApp cDOT back ends, new configuration options ('replication_device' and 'netapp_replication_aggregate_map') must be added in order to use the host-level failover feature. * Pure volume drivers will need 'purestorage' python module v1.6.0 or newer. Support for 1.4.x has been removed. * The XML API has been removed in Newton release. Cinder supports only JSON API request/response format now. * The ISERTgtAdm target was deprecated in the Kilo release. It has now been removed. You should now just use LVMVolumeDriver and specify iscsi_helper for the target driver you wish to use. In order to enable iser, please set iscsi_protocol=iser with lioadm or tgtadm target helpers. * The config options "scheduler_topic", "volume_topic" and "backup_topic" have been removed without a deprecation period as these had never worked correctly. * Users of the IBM Storage Driver, previously known as the IBM XIV/DS8K driver, upgrading from Mitaka or previous releases, need to reconfigure the relevant cinder.conf entries. In most cases the change is just removal of the xiv-ds8k field prefix, but for details use the driver documentation. * Deployments doing continuous live upgrades from master branch should not upgrade into Ocata before doing an upgrade which includes all the Newton's RPC API version bump commits (scheduler, volume). If you're upgrading deployment in a release-to-release manner, then you can safely ignore this note. * EMC ScaleIO driver now uses the config option san_thin_provision to determine the default provisioning type. * If using the key manager, the configuration details should be updated to reflect the Castellan-specific configuration options. * use oslo_middleware.sizelimit rather than cinder.api.middleware.sizelimit compatibility shim * The default interval for polling vCenter tasks in the VMware VMDK driver is changed to 2s. * The VMware VMDK driver supports a new config option 'vmware_host_port' to specify the port number to connect to vCenter server. * For EMC VNX backends, please upgrade to use "cinder.volume.drivers.emc.vnx.driver.EMCVNXDriver". Add config option "storage_protocol = fc" or "storage_protocol = iscsi" to the driver section to enable the FC or iSCSI driver respectively. Deprecation Notes ***************** * IntOpt "datera_num_replicas" is changed to a volume type extra spec option-- "DF:replica_count" * BoolOpt "datera_acl_allow_all" is changed to a volume type extra spec option-- "DF:acl_allow_all" * Configuring Volume Drivers in the DEFAULT config stanza is not going to be maintained and will be removed in the next release. All backends should use the enabled_backends config option with separate stanza's for each. * Deprecated the configuration option "nas_ip". Use option "nas_host" to indicate the IP address or hostname of the NAS system. * The old HNAS drivers configuration paths have been marked for deprecation. * The XML configuration file used by the HNAS drivers is now deprecated and will no longer be used in the future. Please use cinder.conf for all driver configuration. * The Scality driver has been marked as unsupported and is now deprecated. enable_unsupported_drivers will need to be set to True in cinder.conf to continue to use it. If its support status does not change it will be removed in the next release. * All barbican and keymgr config options in Cinder are now deprecated. All of these options are moved to the key_manager section for the Castellan library. * cinder.api.middleware.sizelimit was deprecated in kilo and compatability shim added to call into oslo_middleware. Using oslo_middleware.sizelimit directly will allow us to remove the compatability shim in a future release. * VMware VMDK driver deprecated the support for vCenter version 5.1 * Old VNX FC ("cinder.volume.drivers.emc.emc_cli_fc.EMCCLIFCDriver")/ iSCSI ("cinder.volume.drivers.emc.emc_cli_iscsi.EMCCLIISCSIDriver") drivers are deprecated. Please refer to upgrade section for information about the new driver. Security Issues *************** * The qemu-img tool now has resource limits applied which prevent it from using more than 1GB of address space or more than 2 seconds of CPU time. This provides protection against denial of service attacks from maliciously crafted or corrupted disk images. Bug Fixes ********* * 3PAR driver creates FC VLUN of match-set type instead of host sees. With match-set, the host will see the virtual volume on specified NSP (Node-Slot-Port). This change in vlun type fixes bug 1577993. * Projects with the admin role are now allowed to operate on the quotas of all other projects. * Volumes created on NetApp cDOT and 7mode storage systems now report 'multiattach' capability. They have always supported such a capability, but not reported it to Cinder. * NetApp cDOT block and file drivers now report replication capability at the pool level; and are hence compatible with using the "replication_enabled" extra-spec in volume types. * Fixed StorWize/SVC error causing volume deletion to get stuck in the 'deleting' state when using FlashCopy. * Fixed issue where the HNAS driver was not correctly reporting THIN provisioning and related stats. * Fixed live migration on EMC VMAX3 backends. * Fix issue with PureFCDriver where partially case sensitive comparison of connector wwpn could cause initialize_connection to fail when attempting to create duplicate Purity host. * Fixed 'No Space left' error by dd command when users set the config option "volume_clear_size" to a value larger than the size of a volume. * Fixed backup and restore of volumes in VMware VMDK driver. * Fixed the VMware VMDK driver to create volume from image in ova container. * Added support for images with vmware_adaptertype set to paraVirtual in the VMDK driver. Changes in cinder 8.0.0.0rc1..9.0.0 ----------------------------------- 199bb9c Imported Translations from Zanata 844aa0a Provide cfg to ignore lvm descriptor leak warnings e743040 XtremIO: fix migration bug c0b2021 Fix a typo in scheduler manager "filter_propterties" 42effa4 Fix request_spec conversion from o.vo to dict 8547444 Limit memory & CPU when running qemu-img info a75f862 Dell SC: Error attaching after LV-AFO 4cfaa76 Have a default OPTIONAL_FIELDS for persistent OVOs b5a1cee Include OPTIONAL_FIELDS in VolumeType OVO class 72a1c5d Fix creating typeless volumes with Mitaka's c-sch 8b36b66 Remove extra param in list_manageable_snapshots d533455 Dell SC: ISCSI initialize_connection fixes d3f3791 Imported Translations from Zanata d838c7c Update UPPER_CONSTRAINTS_FILE for stable/newton f899096 Update .gitreview for stable/newton f794629 Fixed request/response parameters in doc 7a2adc0 Add volume RPC API v3.0 8a4aecb Add scheduler RPC API v3.0 9d117a5 XtremIO: bump driver version to 1.0.8 a15459a Imported Translations from Zanata 442c8e8 Fix missing JSON response in API reference d22f815 Add xUnknownSliceID to retry list a04ef22 Use IP in Kaminario locks and add/delete loggers 3daafbf Imported Translations from Zanata 2933c33 Remove unreachable return statement 0ef3969 Dell SC: Disable connectivity failures for new servers e87ec8d Fix coerce good values in test_fields.py e7db3c2 VMAX driver - Does not honor clone volume size f0f6ca1 Updated from global requirements 5f82b06 Unit test to use vol obj instead of dictionary bec0491 Imported Translations from Zanata 74d0975 Remove few Kaminario release notes a49711f Newton release notes cleanup bc5a2d9 Use to_policy_values for enforcing policy 83bfa87 Fix logic in retype check for encryption changes ef9a8cf Added default for ScaleIO driver max_over_subscription cee739a Save volume_type/group_type uuid into db when creating group 032f30d Imported Translations from Zanata 8e62557 VMAX driver - Cleanup of Initiator group fails e91db5d Imported Translations from Zanata 42a5c8e fix the %{} when string formating 2089e4e Fixed illegal syntax error code in ScaleIO rename volume 18325ae VMware: Send additional connection info d551f4d Imported Translations from Zanata a6eca29 Remove sleep mocks in RBD unit tests 0685b4f Fix RBD timeout d1a45ba Add missing release notes 4f7074c Make sure get_backup_device result is an o.vo 09a40d4 VMAX driver - failed rollback on VMAX3 when MV issue 619d28b Remove driver interface changes from reno devref cda4dc9 Imported Translations from Zanata 6bf2d1b Cleanup Newton release notes 754900f standardize release note page ordering 73fc4c3 VMAX driver - Removal of iscsiadm from vmax cinder 4702fd5 VMAX Plugin - Target WWN change for redundancy 084e11e Orphan view and multipath issue in Kaminario driver c9148ea Imported Translations from Zanata e34bc5d Eqlx: Ignore missing snapshot on delete 623990d NetApp cDOT: Fix reporting of replication capabilities aded066 Mark Scality volume driver as unsupported 43c44c9 Trivial: Fix a trivial flake8 error d797294 Register state_path opts and add it to sample conf 8a7ef83 Imported Translations from Zanata 044a34d Updated from global requirements 31220d0 VMAX driver - Won't delete pre-existing initiator groups. 388e52c NetApp: Fix issue with busy snapshot deletion. bdb2cca Provide volume size for tempest volume creation 5197b2c Nexenta: Added use of sessions for NexentaEdge drivers 5a4ad31 Imported Translations from Zanata 8a06add RBD: Error when managing a nonexistent volume 27530c0 Fixed indentation 4fb27ce XtremIO: fix bug deleting cgsnapshot 018a9d4 Raise NotImplementedError instead of NotImplemented 143d656 Imported Translations from Zanata b11602e Support create group with group type name 4e164f1 Rename specific driver option with synology prefix b9ef6ef Remove doc for promote/reenable replica c2cb32b Imported Translations from Zanata 26d4a53 Imported Translations from Zanata 371d25b LeftHand add entry point tracing 486dfe3 Remove host assignment in Snapshot OVO a1f6436 Fix lazy loading cluster field from Service OVO b937161 Fix manage existing MissingDependencies error aeba181 Do not pass unicode to str.isspace() when disabling a service 2da1bdd Correction in log massage format syntax f37a80a EMC VMAX - multi-attach failure to VMAX3 when SLO is omitted eb6ed41 add more credentials information to check_is_admin 0d24178 VMAX driver - Retrieve volume from snapshot ebeb0bb Fix CapacityWeiger to accept None volume type b76d8c9 Imported Translations from Zanata 76d7a37 check quota per_volume_gigabytes for transfer-accept 3854939 Dell SC: Add dell_server_os configuration option a93314b Add supported driver checks to Zone Manager 859653a Fix backup unit tests imports for os-brick 9cfceac Fix backup unit test with new os-brick ca4ac3d Stop using mox in unit/api/contrib/ tests (1/2) 9c191bd Stop using mox in unit/volume/drivers/*.py 49093ae ScaleIO over subscription support 9d82ffa Fix exceed of dd action when copying with path 472ce4a Fix CapacityFilter to accept None volume type f6adf72 Fix HNAS stats reporting 975ec07 Imported Translations from Zanata 4156389 Stop using mox in unit/api/v3/ tests 54ae452 Deleting volume metadata keys with a single request 682e49d Add Castellan release note e27e450 Changes stats report for ScaleIO driver 7223af6 Remove cinder/tests/unit/test_misc.py 11e8ae7 Imported Translations from Zanata 9bb4dc7 CoprHD: Handle create volume from CG snapshot error 1732094 Performance issue for VNX attache LUN b017983 Config logABug feature for Cinder api-ref ad8cba2 Stop using mox in test_wsgi, test_nexenta, test_netapp e9c206a Remove unused source file tests/unit/db/fakes.py 2360182 Fix an invalid function call in test_consistencygroups.py 9f87e20 zfssaiscsi driver log messges need cleaned up 7d5e957 Fix typo in enable_unsupported_driver description 55156e9 Mark GlusterFS driver as deprecated 2d1242a Retype encrypted volumes 99d2170 Fix DellStorageCenter docstrings 0abf399 Fix driver interface checks for ZTE driver e7c1852 Add CI_WIKI_NAME to ZTE Driver 458f098 Add CI_WIKI_NAME to X-IO Driver b1e061a Add CI_WIKI_NAME to Synology iSCSI Driver 70b05db Create encrypted volumes from images fe17c3d Add encryptor attach/detach in utils cb94db1 XtremIO: fix the returned value of CG actions e48f6d9 Stop using mox in unit/api/contrib/ tests (2/2) 43c2286 Change assertTrue(isinstance()) with optimal assert fbe0323 Stop using mox in unit/*.py tests (1/2) a0e5de93 Use assertIn instead of assertTrue(A in B) 92891a5 Remove unused function from unit/fake_utils.py 0928f0a Imported Translations from Zanata 2246c5d Clean import in code 3ef1fad Remove unused config.CONF 23dab08 Add tempest tests for Consistency Groups 70bfb78 HNAS: Add support for manage/unmanage snapshots in NFS driver f7e87cf Reduce the runtime of drivers/ibm/test_storwize_svc efa39bf Improve TestCase.mock_object method 033284a Fix the password print in cinder-volume.log issue 3f3a0c8 VMAX Driver - Live Migration for VMAX3 8df7241 Remove self.__dict__ for formatting strings 4064697 Imported Translations from Zanata 37b333d CoprHD: Add missing key in ScaleIO driver 08f1a24 Avoid patch loopingcall in VNX 86f645a Add validation for the metadata properties f6c20ed Removed RPC topic config options 72dd51e Clean imports in code 993ba89 Replace key manager with Castellan f589c6e Cleanup api-ref 7f2131e Update api-ref path e9b4097 Nexenta: NexentaStor4 NFS driver cache capacity and use sessions c517048 Stop using /etc/cinder/cinder.conf for cmd tests 3d036a5 Use utils.validate_dictionary_string_length f4fa6c5 Stop using mox from unit/image/*.py 9771c2c Separate create and update rules for volume metadata 46af008 Updated from global requirements 05bee1c TrivialFix: remove unnecessary VERSION_COMPATIBILITY f15d9d5 When only .pyc left, the extended API can not be used. c3b33b6 Recover volume status after remove_export e71f621 Pure - warn when deleting destroyed snapshot b4b1cde Fix quota rollback on retype failure 9e9b3ec Pin RPC server's serializer to min obj version 80c2578 Driver documentation cleanup 9845a95 Host selection when creating backup fb688a7 TrivialFix: Remove cfg import unused 7d84ee9 Fix password masking result 0adde01 Let setup.py compile_catalog process all language files 5fe72f8 Dell SC: Add exclude_domain_ip option 1f7f45e Add support for force backup for Nimble Storage ccf4884 Retype issue in Kaminario Cinder drivers 3bb531e TrivialFix: Remove logging import unused 6882c8f Stop using mox in unit/volume/drivers/emc/*.py tests f239bf7 Stop using mox in unit/consistencygroup/*.py tests 7cc58b5 Stop using mox in unit/scheduler/*.py tests eeee612 Stop using mox in unit/zonemanager/*.py tests 13a6718 Stop using mox in unit/backup/drivers/*.py bdaabbe Fix incorrect parameter in create_key 7517be2 Use constraints for api-ref environment 5db6315 Dell SC: Live Volume Autofailover a227bf4 Add new supported driver checks aabca4d Tests: Fix racy volume unit test 79b3a92 vzstorage: fix create/delete snapshots c8f7e80 Sending ScaleIO volume id in attach and detach volume 0f1ea3c Cleanup upgrade-related FIXME's 70cf094 Using oslo_config's min attribute 4e92c27 Add replication failback in Kaminario K2 drivers 19544f7 Added config option to enable SSL d24fb4b Group specs: Fix exception name 2a20f1f Dell SC: Failback replications limited to 5 at a time ddabae3 VMware: Add volume name in vCenter to conn info 5568b40 NetApp: Report multiattach as enabled 7a8daa5 Attachment lost after migrating in-use volume af6879c Fix typo in the huawei_driver.py 0d894a9 Fix invalid services caused by enabled_backends 40dd1ae Updated from global requirements b04072a Change NFS driver to not throw exception without nfs shares file fff322b Datera driver 2.2 update 9f01b19 Reduce the runtime of drivers/dell/test_dellsc 37b7a20 Add release note to warn about os-brick lock dir 6ffe78f Updated from global requirements d7f793d Use min attribute from oslo_config 2dfab71 Imported Translations from Zanata 2cd599a Fix the interface to call update_server_volume 40e1429 Dell SC: Break_replication unhandled NoneType error 5242d1f Volume Manage/Unmanage Support for IBM FlashSystem f67f6b0 Imported Translations from Zanata fa5ed85 Change a typo error in the releasenote d9d2455 Fix reported driver's versions 7c8983d Use OVOs to set errors in manage volume/snapshot f5634ea Use original volume OVO instance in create flow 50e6073 Fix mysql binary comparison ce19eef VMware: Allow images in ova container 3a7686f Add CI_WIKI_NAME to driver's devref dd8bb00 Improve Hitachi HNAS volume drivers log messages 4fd42d7 Updated from global requirements f184b5f EMC VMAX - iSCSI Multipath support 0be6804 Fix typo in cinder/tests/unit/image/test_glance.py 4126397 Clean imports in code 450ac43 Imported Translations from Zanata 65531bf Enhance api_microversion doc 5d28eed Add CI_WIKI_NAME to Tegile volume driver 73d2b55 Add get_manageable_* methods to Pure drivers 66023c5 Use constraints for all tox environments 67ee229 Imported Translations from Zanata d359734 Remove the using of dict.get() in assertIsNone 5564f22 Revise Synology DSM storage driver 3db21d0 Add volumes/summary API support 09d100e Imported Translations from Zanata b521483 Ignore case when comparing wwns in Pure FC driver 389188c NetApp: Add Consistency Group Support for NFS b7dcc4a Replication, hard-coding and dict.name issues in K2 34c56b4 Update homepage with developer document page 2a8d7f8 Add CI wiki page to driver listing fe22e85 Imported Translations from Zanata 25f7c9e Refactor cinder.utils._copy_volume_with_path 3f292f0 HNAS: Deprecating XML config file 20d8ff5 Add functional-py35 to tox e38d039 Remove code duplication in enums 79994d6 Concurrency issue in K2 iSCSI and FC Cinder drivers a569e68 VMAX Driver - QoS support for the VMAX3 54a9585 Mask out passwords when tracing 169f79a Remove debug logger translations e7afd33 Imported Translations from Zanata 9abeca3 Fix volume creation with no volume type 122e7b5 Dell SC: delete_live_volume payload incorrect 2f33bf6 Dell SC: Requests async header is invalid 249197e Imported Translations from Zanata 855a0c3 Use object instead of string when reset backup 5f0f752 Prevent doc generation failure on OVO decorators 1a5de5d CI: Add CI_WIKI_NAME to all drivers 72002e5 Imported Translations from Zanata 1a94f7f Make the volume-manage doc be more general 7649b50 Add missing dependency on keystoneauth1 7c9139c Fix tox pip-missing-reqs 9982226 Revert "Remove Tegile volume driver" fcb73e4 HPE XP add entry point debug tracing 7dd5f38 Remove resource_common_manage load warning 9c5e7a0 Updated from global requirements 897dfef Huawei: Modify array LUNs naming rules 4559058 Imported Translations from Zanata 6601f5f Remove unused context parameter 8931f0c Imported Translations from Zanata 272e126 QoS support for the Coho Data Cinder driver 07ccd84 Add tracing to remotefs entry points 294ee65 NetApp cDOT: Add cheesecake replication support 93e5ed8 Don't use config option sqlite_db 7e10619 Improve snapshot handling in K2 a8e3220 Fix volume retype from SolidFire 5377ed5 EMC VMAX - Oversubscription support 53eef99 Updated from global requirements e815f56 Fix volume upload-to-image for vhd disk-format 14b07eb Imported Translations from Zanata 1a49592 Remove context object in oslo.log method 9a3c7a1 3PAR add entry point debug tracing 889947c Fail manage operations if service is down ed39bfe Support retype in K2 cinder driver 55a7de0 Remove comma from end of policy.json 95d2943 Prevent adding same OVO version twice to history a88307c Removed a dead db function register_models() 1e82047 Handle snapshot delete conflict in 3par driver 0cbb34c Imported Translations from Zanata fbd471c Specify key algorithm and size for create_key 872a46d Add functional-py34 to tox 50e1f16 Fix size exceed of dd action when clearing a volume 6c61bdd HNAS drivers refactoring 52efd1e Use volume o.vo in get_backup_volume_temp_snapshot 4b2e760 Imported Translations from Zanata 00f5662 Fix ImportError of fake_driver 4080179 Add proxy config option to google backup driver de66e8f Add stochastic weight handler to scheduler f519b8a Fix Scheduler manager masking retype fail details 5226fba fixed misspelling in synology_common.py e792506 Updated from global requirements c28cd11 Don't puke when exiting driver list 0291637 corrected the help string in coho.driver f84c6c3 Fix ImportError of fake_driver ac7641c Storwize:create_volume_from_snapshot with different size 8fd478a Imported Translations from Zanata 8d3dada Fixing pending comments for CoprHD Drivers ef587d6 Huawei: Fixed problems caused by password expiration a940f17 Add metadata length check to volume-manage fecbf75 Dell SC: Use Live Volume for replication 4373e98 Remove race condition from lvextend 294425d Switch request_spec in create volume calls to ovo f7e715f Support replication in K2 832ec71 Support manage/unmanage and extra-specs in K2 66bcfb2 Update xiv_ds8k driver name and description 39517e2 Imported Translations from Zanata 46b1498 Set VERSION in VNX cinder driver d9bd9f5 ScaleIO ignore rename of external volumes 9a8e2a4 Managed snapshot should return ceiling of size in Huawei driver 8d0633d Size in tintri driver should be converted to integer 3eafcf5 Improvement to query cg detail(Part 1) 78e7713 Fix documentation and remove dead code 50276fd VMware: Fix retype when storage policy is enabled 4c8e8af Validate name in qos-spec dced19a Replace functions 'Dict.get' and 'del' with 'Dict.pop' 31e164a Updated from global requirements 7cc95f8 NetApp: Report hybrid aggregates in volume stats 9232884 Storwize: Quote vdisk names to handle spaces 0545f55 Fixes ZFSSANFS driver f1b9919 DRBD: Disk-options for new resources e1b254d Fix mistakes introduced with QoSSpecs object c5ebe48 Add backup update function (microversion) 4e8f83c VMware: Fix upload to image with glance v2 4679d1f Remove Tegile volume driver 4739fef Quobyte volume driver should use DLM e323d9c Add functional tests for nested quotas 6f98f14 XtremIO: Implement update_migrated_volume b5a75b0 NetApp: Refactor unit tests 8148038 Add driver list to doc build 9286ab4 Move fake_driver to tests root dir 0b0000f Map volume/snapshot manage extensions to v3 1761d87 Replace OpenStack LLC with OpenStack Foundation eeab576 VMAX Driver - SnapVX licensing checks for VMAX3 697b98b LVM driver: list manageable volumes and snapshots bc31ef8 Sheepdog:fix the bug of failed to clone image 39e0c88 Move drivers unit tests to unit.volume.drivers directory b9c5c97 Docs: Correct i18n information b392f8a Fix db purge for quality_of_service_specs FK constraint fb0e8fd Fix log message when service is disabled 3c18c6f Add interface documentation to driver devref 5abd344 Docs: cleanup doc8 errors 14f378a Docs: remove todo list generation 8d9cad3 Update doc README and remove old Makefile 99c362b Imported Translations from Zanata c491c3e Handle API NotFound exceptions at WSGI level ee451e5 Add worker's DB operations 7294cf0 Add workers table 8b713e5 Modify API to include cluster related operations 62f761f Update manage with cluster related commands bc88f16 Improve cinder-manage arg parsing a5b4e34 Add cluster job distribution 625cab1 Update Versioned Objects with Cluster object 57ea696 Add cluster table and related methods b03f539 Update OVO instance on destroy method call 5880297 Fix wrong declaration in Scheduler's base driver 6cfecad Refactor sqlalchemy service methods a8edbd2 Improve api_version decorator to avoid noqa dee1658 Imported Translations from Zanata 38c2af6 Tests: mock notifier in CG tests 0ee35f6 Remove duplicated code in manage_existing_snapshot 742ebf4 Initialise oslo.privsep early in main 8762267 Imported Translations from Zanata 0273dc5 Add lock decorator to SolidFire clone_image method 5816f0d Dell: Fix docstring cut/paste error 3af88ab NetApp: Support new parameter to cDOT clone API 7d1cdba Auto sync manager's RPC_API_VERSION 7d79909 Fix CinderPersistentObject.refresh 30f963a Replace locks in remotefs and glusterfs backend drivers 948ac4a Block Device Driver: report pools in volume stats e6bfb03 Add missing test case f12b238 Updated from global requirements 69b8d83 Invalid volume state when manage operation fails 708b9be Add group snapshots - APIs 73795f4 Dell SC: Add secondary DSM support b145ac5 Fix some typos 71cf291 Remove generate_driver_list dependency on cur dir 3767c6b Huawei: Support reporting disk type of pool f5c3bb1 Fix 500 for 'qos-create' key or value > 255 characters 4a67bc8 Add group snapshots - manager 325f99a Add group snapshots - db and objects 7f44844 XtremIO: support of snapshot manage commands be821a3 Fix the group type filter b08435e Fix policy check for group types 72d2a33 Differentiate thick and thin provisioning 729d86d Remove force option from create_snapshots_in_db() 1ac4303 Set sleep time to 0 in Datera driver 8c74c74 Add generic volume groups 3eb8552 Huawei: Support backup snapshot 6cf7227 Fix assertEqual usage in test_volume_manage 51a03d5 Fix chunked backup driver interface name 052e0ec Removed unused code from cinder.utils 3c18a2e 3par driver handles concurrent host create conflict a052142 Fix typo in delete snapshot in Synology driver fcda064 Removed unused code from cinder.utils fb3a51a Fixes consistency snapshot creation 5a7fecf [doc] Fix a non-alphabetical order bug 5a9c4d9 Trivial: Use fake.VOLUME_ID instead of id 7720fce Violin Memory iSCSI storage for 7000 series AFA 24db697 update min tox version to 2.0 35c9729 Updated from global requirements ed559ab Switch _create_temp_cloned_volume in driver to VO 27a8499 NetApp: Add aggregate capacity info to scheduler bf76eb2 Add strict Boolean checking for storage pools 78d124d Add Synology DSM storage driver abf91a8 Use from_environ to load context 842d95b Use context.from_dict to determine available arguments c8dc22a Add ZTE Block Storage Driver 4240a41 iSCSI Target: remove confusing comment/log eec1214 Storwize: Fix exception ProcessExecutionError 9165406 Changing method _from_db_object to classmethod a0a04f4 Allow admin project to operate on all quotas 8319ea4 Use default provisioning type from config 348c260 Delete *.pyc files before running tox tests a7c715b Implementation for CoprHD Cinder Drivers e6fdc05 Image virtual size doesn't fit to volume size 0bd4a6c Don't apply config fixture to auth_token.CONF a2bac00 Check flashcopy mapping before deleting volume 45de850 Send scaleio id to os-brick 672120b Nexenta: Added HA support and enhance get_volume_stats() d4a61fc Fix failure with "None" volume type in Pure drivers a85522c Add backend driver for Zadara Storage VPSA 8cf9786 Add group type and group specs c8a5e7d Don't use shred for volume clearing ecfb70c Add cinder backend driver for Huawei FusionStorage f9d5285 Do not conjecture volume-id from iscsi_name 572b84c VNX: New Cinder driver in Newton 01cdd06 Return vaild reason when unknown error occur. 606dc15 Moving the OPTIONAL_FIELDS inside the OVO object b3732ee Support microversions on inherited Controllers 33e4ccd Replace use of mox with mock in test_base_filter 7cfb013 Replace 10 ** 9 with a constant units.G 2a08267 Reduce logging level of API validation messages. e2a80ea Fix manage existing volume fails after object merged 28b5c7e Add strict Boolean checking for volume manage 1913d43 Adds unit test coverage for consistencygroups.py a6f48a5 FalconStor: New Cinder driver in Newton e9c217f Move QualityOfServiceSpecs to use VersionedObject b5fca83 Snapshot object has no attribute about size 1f8be4b Add return parameter info for manage_existing_get_size b6d5948 cinder-manage db purge has issues with foreign keys 15ed23d Huawei: Use versionedObject e568189 Resolve unittest hang issue b96e3c2 Fix some typos 7a1742c Add logging when filtering returns nothing 618139e Validate extra_specs type 4547afd Just a few spelling modification. "occurred" 8d33f6b Remove white space between print and () 00bce24 Log traceback for initialize connection failure 4c6dc3a Remove unused LOG bcaa956 Use assertEqual/Less/Greater/In/IsNone a13e1db Updated from global requirements e6e2ef4 Add __ne__ built-in function 1a0dd6b Fix consisgroup V3 interfaces f63d89d Add proper scheduler_hint key to dev-ref f6aec5b check the validity of metadata when update volume d1c7cdb Remove unused __init__ a337fb3 EQLX: Extend of snapshot or clone failure 81066a0 Log terminate_connection exception with traceback d4b9738 Replace use of mox with mock in test_api_urlmap f01ae06 Add README in release notes directory afbb085 Fix broken link in HACKING.rst d6a44c1 Replace int with float to bring math.ceil into effect b2acb1d EMC ScaleIO should return ceiling of volume size 395288a Deprecate defining c-vol backends in DEFAULT b15938b Dell SC: Do not set High Availability in async mode. 79a0a5b Replace use of mox with mock in test_ibm_xiv_ds8k 9768902 Remove translation from config options 47805a0 Correct reraising of exception 221405e EMC VMAX - locking SG for concurrent threads afc9cb9 Use elevated context to query DB in VolumeNumberWeigher d32d996 Huawei: Support huawei consistency group 069fd2e Make divisible py3 compatible in nfs driver 3e15a12 Updated unit tests to use official unittest methods d70ed62 Fix raise UnableToFailover call in SolidFire bfae22b Provide Kaminario K2 all-flash array FC driver 0a3c9a2 RBD: uppercase rbd_opts for consistency 505ccfd Add strict Boolean checking for volume create 9a9b4d8 Replace use of mox with mock in test_brick_lvm 0ca43fc Replace use of mox with mock in test_lvm_driver d899d88 Remove six.iter* 4b77216 Updated from global requirements b77f388 Add validation for container name 98939fc VMware: Fix create vol from streamOptimized image 7b0e5ac Use True instead of 1 in while loop 1e3b467 Remove mock.patch.stopall call in test_smbfs 0c3960c XtremIO: fix test suite 3fa5240 Add strict Boolean checking for quota show 27116d5 Correct unavailabe to unavailable 3c36251 Huawei: Support iSCSI configuration in replication feature 70b039c Dell SC: Specify High Availability for create replication 9374dcb Increment Pure Storage Driver Versions c897d35 Refactoring Kaminario iSCSI driver c063cbd Don't reuse pep8 env in compliance tox runs 7cd0a7b Trivial Fix 4ae92b9 NetApp: Finish SSC refactor by removing dead code 45caa0f Implement unit test for HPE Lefthand driver 2f56ccf Added coverage report to tox.ini 9154022 Add strict Boolean checking for qos delete d5f1720 Add validation for type extra_specs c3193b4 Replace mock with self.override_config ea99de3 fix cinder ceph backup driver padding error 2a6fdde Replace 1024*1024*1024 with units.Gi to express more accurately f019466 Violin: resize volume if cloned lun is larger c25998e Make dict.keys() PY3 compatible 83405cb Move _validate_extra_specs to cinder/utils cf1fed5 VMware: Refactor vmdk unit tests 5ac73a4 Updated from global requirements 7aa6d9e Move _check_metadata_properties to cinder/utils b6b08eb Remove deprecaterd mapping in manager.py db0cba2 Capability lists in Cinder scheduler ebced3c Updated from global requirements ca9e590 Nexenta: Add NBD driver for NexentaEdge. de3794a Add missing coordination=True on service start 52fbd3f tempest: Add Unicode volume name test 17d7712 Adding Scaling QoS for ScaleIO driver eccf737 Updated from global requirements 0912153 Implement match-set type 3PAR FC VLUN creation 2f15954 Fix pylint error in K2 iSCSI driver 549436c Fix lock files littering working dir during tests 3452827 Fix TSM backup driver test mocks a85d950 Improve DB volume check in LVM manage volume e8a3c50 VMware: Honor vmware_cluster_name during retype d54027b Revert "Revert "use utf8 as default charset for all tables in mysql db"" bc9d737 Fix snapshot stuck in 'deleting' after reboot c-v 83a1fdb Update initialize_connection to use versionedobjects 357eaab Updated from global requirements a5746b6 NetApp: Replace SSC for cDOT block & file drivers 592d034 Revert "use utf8 as default charset for all tables in mysql db" a80119a huawei-iscsi-multipath-support dfc69e8 use utf8 as default charset for all tables in mysql db 3d34ce0 Implemented unit test cases for HPE LeftHand driver 505b838 add FIXME tag for extra argument 'topic' in scheduler rpc api ccd410b update coordination.Lock.release's docstring 36ce626 Fix permissions error when configuring nfs backend 207f5cf Use cinders test class in cloudbyte unit tests ad2e538 Correct DB modifications from compaction 1003fbf Add unit tests in cinder for HPE Lefthand driver 7f87569 Provide Kaminario K2 all-flash array iSCSI driver b9c3ea2 VMware:Persist storage policy ID in vmdk meta-data e22c244 Allow setting CG name or description to empty value dae9831 Support None value of extra_specs in cinder-scheduler filter e9b928d Fix db purge for volume_types FK constraint c9910c9 ABC Metaclass for IBM FlashSystem 8ec5562 IBM FlashSystem: Add host check for iSCSI driver fdf02a7 vzstorage: add ploop volume format support 369572f Use versionedobjects in remotefs.py ec51a68 Move test from test_glusterfs and test_quobyte to test_remotefs 81599f7 Netmask needs corersion to string 1936144 image_size_m should get ceiling of image c0cf997 Add unit tests in cinder component for 3PAR driver 87c5749 Handle quota exceed exception fa4442e Replace locks in volume manager 276bb76 Updated from global requirements 1c7b0a5 Start/Stop coordinator with Volume service c899cee Tests: Remove notification_driver config f2c2ee4 Tests: Use mock for notifier tests f0dda71 3PAR: Fix delete volume when online clone e7b4024 Add driver interface checks 61238e2 Add test type clarification to devref c68892a Backup and restore broken in zfssaiscsi driver 6309292 Windows SMBFS: fix VHD/x resize ffecc60 Remove duplicated fake drivers a8744e2 Cleanup volume_type_projects ad1ba8e Implement OVO class init mechanism a505cad Add debug level logs on OVO backports 0e1df6b Stop assuming persistent OVOs are also DictCompat 0f72ff5 Move OVO methods from CinderObject to Persistent 504b466 Remove remotable from OVOs f0d34b7 Use manifest to backport OVOs during upgrades 5730a8c Nimble: Don't query all vols from DB in do_setup() fb19ea2 Fix wrong usage of exception's attribute message 142d035 Add parameter info for manageable snapshots c06e552 Adds ACL, IP Pool, Multipath to Datera Driver 2c54480 Dell SC: Retry unhandled exception REST Gets 7a066eb Fixed _create_3par_iscsi_host(), added unit test for 3PAR f574472 Set QoS on cloned volumes 1c1d845 VMware: Deprecate vCenter version 5.1 092a01f Update manage_existing to use volume object 07b1db4 VMware: Fix constants in unit tests 32a2a67 Updated from global requirements c28a5cf EMC driver should return ceiling of volume size ed4bcc0 Use oslo_middleware sizelimit 41929d1 migrate to os-api-ref c5df007 volume upload-to-image fails for iso disk-format f79dfe2 Huawei driver should return ceiling of volume size 62b0acb Volume manage/unmanage support for Eqlx driver 6440379 NetApp: Log unexpected errors from backend c2ac7d6 Add Auth Version 3 support in Swift Backup Driver 3c7a71e Add error messages to conditional updates devref 896072a Add docstrings to CG and CG Snapshot filters 1730f2d Virtual size should get ceiling of image e1c0645 DRBD: Allow to set options for new resources f14aace SolidFire driver should return ceiling of volume size d64f5fc Clean up man page and remove version/date e62ed28 3PAR: Fix terminate_connection when failed over f0ea3cb VMware: Remove unused methods 6f63347 Fix MySQL DB error in Delete CG 3dbaa2f Nimble driver should return ceiling of volume size 2b377e7 Updated from global requirements c4b6d51 Remove locks from Pure volume drivers cf19bc1 Give more fine grained access to DriverInitiatorData 7369aae Remove IN_USE from ConsistencyGroupStatus enum 10bce4b Compact Kilo database migrations c614308 Bump to Nova v2.1 5b82638 Switch to using correct TaskFlow Failure class 9e84f1a Optimize service find in migration 0125df9 NetApp NFS Cmode: Fix NotFound exception 25f5eed Add check to limit maximum value of age_in_days 7763197 GPFS: Fix consistency group ERROR_CREATE status b47ca63 Remove the duplicated definition of _add_to_threadpool 3e83a33 Imported Translations from Zanata 39ccd83 Coho data sanity fix in the driver unittest 6cfe6e2 Dell SC: Added support for failover_host failback 253f9ea Remove API races from consistency groups e0c00c5 Minimize cost of DB exists decorator checks f43e56e Pass volume_type_id in when deleting snapshot 41b025f Add unit test case in Nimble Driver 61a63dc Fix attachment_get_by_* to return entire list 135e094 Remove API races from migrate and retype 905908d SwiftBackupDriver: Dont add project_id to authurl 44dfac1 Updated from global requirements 79f21bb Catch GlanceMetadataNotFound in creating cgsnp 52faea5 Updated from global requirements 1574ccf List manageable volumes and snapshots ad2d5e7 Updated from global requirements b449025 Add pagination support to messages b48614f gpfs: Add changed options for 'find' command in rootwrap filters bbaab25 Huawei replication should use auto recovery policy 18f1b45 Dell SC: Switched REST calls to async where available 069d2dd Move all backups related unit tests to backup directory d24d425 Move consistency groups tests to consistencygroup directory 512d7db Volume manage should parse volume size as float 3e3e7b6 Return BadRequest for invalid 4byte unicode character f028df9 NetApp: Add iterator handling to client library bf2be3d Make IBM drivers return snapshot object for cg ops ec0d8da Coho Data: Reconnect to cluster on broken pipe 6991ddb Remove mox usage from test_nexenta 1861ed5 Manage/unmanage snapshot in ScaleIO driver c7259c1 'display-name' is not used in snapshot_manage 6ab5e52 LeftHand Fix terminate_connection when failed over c5057af Storwize: terminate_connetion NPIV perf improvement c96be71 Revert "Add hacking check to prevent assert_called_once" 2ec1621 Fix 3PAR cg display name issues 8cb8cf5 DRBD: ensure_export() might not have 'provider_location' 7e634cb Fix image-volume cache to use volume object when evicting b208280 Fix retype from non-repl to repl type in Pure drivers edb829e Remove test_conf.py c4d3b7d Dell SC: Changed rename volume REST API call 9400cee Add hacking check to prevent assert_called_once f79a1bf Updated from global requirements e084a38 Huawei: Raise if no FC port found 34604c8 VMware: Increase default task poll interval c582d53 VMware: Update volume config during unmanage 44c397c Drop use of invalid assert_called_once call 9c1c545 Fix AttributeError when obtaining 'name' attribute from 'snap' d7e7e7b Handle SSL termination proxies for version list cbdd0fa Call _init_volume_driver in backup manager f78c06b Updated from global requirements 24ea17a model_update for temp volume or snapshot in backup 876d797 Add debug messages and comments for ceph backup c77ec0f Avoid ascii code error for request body strings 8a3d11c Fail on disabled_reasons with more than 255 chars e4134f5 Windows iSCSI: properly handle config option e33d6bf Remove unused logging import and LOG global var 03abe62 Fix Brcd zone driver initiator zone update 7043cc1 Add SnapshotStatus enum field 7740ad1 Tests: Fix mock imports 47000e1 NetApp: Remove type checks from manage workflow 79d2d63 ScaleIO actual volume size model update 49aef34 Capacity weigher: Pass correct arg to super() a0300df IBM Flashsystem: Add missing items to common 0497c9b Prevent Multitable conditional updates 3f12a1f Remove support for 1.x volume RPC API 54bc12a Remove inappropriate Copyright 18dd346 RBD: include cluster name in connection info 5fea670 Tests: Don't attempt connection for Coho driver init 9b24d61 3PAR Clean up VLUN deletion on detach ad9436e Remove object to dictionary translation logic 67cff3b Refactored the update method in api.py for vol obj 5ccb657 Tests: Use unique volume IDs in backup tests a8d764e Move LVM tests to test_lvm_driver.py 68d33de Move CG unit tests to test_cg.py 9158fc7 Fix an error in CG object 763dd8c Fix backup using temp snapshot code path c5992f4 IBM FlashSystem: Cleanup host resource leaking 19d7ec0 Updated from global requirements fcd7fce Add sample config file to cinder docs 5e9a76e Make api_microversion_dev more explicit 4b47b3d Use check_string_length from oslo_utils 4805958 Fix up RPC cleanup process 9a3ecb2 Add unit tests in cinder component for HPE drivers c2f2eeb Whitelist 'rm' in api-ref tox environment e671104 gpfs: remove a race in deleting volumes 202caf2 Fix taskflow parameters for manage_existing a7fba1c Correct misspelt words in msg in cinder 342be78 Implement CHAP Authentication for E-Series Driver 8659ff0 WADL to RST migration in cinder tree 7b0ae2e Properly mock out image_utils operations for tests 79abfda Dell Eqlx: Volume from snapshot now honors resize 5fa6616 Use example.com in unit tests 41981d4 Extend remove_version_from_href support 2a07124 Fix return value of _clone_image_volume 4e7624e image: don't use is_public with glance V2 API 13fcda4 Change provider_id to StringField c7c642f Add missing SnapshotUnavailable to cinder/exception.py 963e435 NetApp: Rewrite user API discovery logic 017a322 Remove unnecessary v3 VolumeController.__init__ 278715b Fix v3/volumes.py VolumeController super(...) parameters 6c5ddb1 DB: Optimize volume existence check b50907b Reorder DB API require_context decorators 8c38b6a Remove API races on extend and volume_upload_image eb1315b Manage existing volume with invalid host b0d05e7 Remove CG db access in Storwize driver 925ee61 Specify a user-agent in Pure volume drivers a802b23 Dell SC: find_volume failure in manage and retype 125a900 3PAR driver failure SR License missing in array 20152e0 Remove unnecessary created_at from ORM Message c526255 Fix uncaught NotFound exceptions 599fff6 Remove support for 1.x Backup RPC API 4b07c88 Provide consistency to "Openstack-Api-Version" header c5c5e24 Change OVOs project_id and user_id to StringField 6bc48ae Use to_utf8() instead of safe_encode() in convert_str() 7da93eb Replace manually changing CONF options 9809769 remove extra quota commit of manage snapshot dc29f02 Add replication v2.1 test cases 1058f29 Move initiator_data access to helper methods fca31fc Add ability to filter by volume_glance_metadata 01c6f68 Add Cheesecake APIs to policy.json file 3a9dc30 Add upload_image API role-based access policy 21e3368 Add snapshot_metadata operations to policy.json e2cf841 Mark the v1 API as deprecated 4649d3d Fix Lun ID 0 in HPE 3PAR driver 394ea5a Added 'volume:get_transfer' to policy.json file d0f7842 NetApp: Decouple capacity volume stats collection c53ef88 NetApp: Managing cDOT LUN by UUID fails 591d58b VMware: Use _in_use() to check for in-use volumes e4fb5aa Add devref for conditional updates da4b17e Fix gate-cinder-tox-db-functional job d060e8a Add ordering possibilities to conditional update b7ce275 Add unmanage volume for RBD driver 5291406 Updated from global requirements 93490b2 VMware: Support for paraVirtual image adapter type 6425d9a Pass default executor to os-brick cef3aa2 NetApp: E-Series driver using invalid host-types fdca451 NetApp: Use Local Cache to Copy an Available Image 616a2bd Add provider_location to cloned volume 1f0f01a Failback will enable the host that has been frozen 427f0f0 Move and rename tempest_tests to cinder/tests/tempest 8c3abfd Tests: lower case all fake uuid constants ed6d50b Tests: Fail if oslo.versionedobjects issues Invalid UUID warnings b1eddc7 Removed extra line of code 1fe4ed1 Fix uuid warnings in various api contrib unit tests 93be776 Fix snapshot test uuid warnings in api.contrib 453e4a5 Fix volume test uuid warnings in api.contrib 358f78b Fix vol type/spec uuid warnings in api.contrib 3a914ba Fix qos_manage uuid warnings in api.contrib tests be49c76 Fix CG uuid warnings in api.contrib unit tests f167681 Fix admin_actions uuid warnings in api.contrib c3cb40b Fix uuid warnings from api.contrib backup tests dacf0df Fix uuid warnings from test_db_api unit tests 53cfde4 User messages API for error cases db57966 Imported Translations from Zanata 3200dd4 Imported Translations from Zanata 7570482 Assisted snapshot: use Keystone Session with Nova Client 2482a54 Imported Translations from Zanata 30ac868 fix invalid uuid in emc extremio unit tests 4dd7cf6 fix invalid uuid warnings from test_cmd caab3d9 Fix invalid uuids in tintri unit tests 9aeeffb Fix uuid warnings from db unit tests 9662f13 Fix invalid uuids in EMC scaleio unit tests 38d7045 Tests: Fix invalid UUIDs in EMC VNX tests 0fcef18 ibm flashsystem: Fixing hardcoded attribute efac539 Fix 20 typos on devref 2b95f23 VMware: Remove TODO for port config option c042a05 Remove XML API 0b6c68a Microversion of Bootable filter in cinder list 6226272 init_host offload to default to true bb85920 Imported Translations from Zanata dff49ad Updated from global requirements 960ce5a 3PAR: Remove metadata that tracks the instance id 82620e5 Updated from global requirements 689d94e Handle TFlow short comings in SF driver 7eb9580 Add failed_over detection to SolidFire driver 3f5e040 Implement replicate_volume & failover on SolidFire 5f5eede Deprecate nas_ip and change this to nas_host b01ab1e Imported Translations from Zanata cc16c4d Implement Cluster Pairing for SolidFire Driver 8b24dc6 Fix minor typos in the migration devref ea19c4a Cleanup volume_attachment in case of reset-state attach_status ce7dedf Updated from global requirements 1bdb400 Use messaging notifications transport instead of default 1323339 Fix doc and source documentation errors and warning 677eb1c RBD: delete snapshots if missing in the backend 75a6005 Coding style issue 30d2249 Remove support for 1.x scheduler RPC API 5559c39 Launchpad Answers no longer used 8ea9f67 Fix RPC and Object version pinning on API 7efb2c6 Fix service version pinning on start e7f55be Fix doc build if git is absent 3e1f650 Updated from global requirements d6c504e Tests: Define fake_constants as constants 7bf4542 Doc: Remove incorrect run_tests.sh documentation 41e4a9b fix invalid uuid warnings from test_quota 0a2384f Fix fake uuids in NetApp ESeries unit tests 038c206 Fix invalid uuids in sheepdog unit tests 74c8f65 Use utils.convert_str to convert HTTP header values 0bc4bb4 Remove deprecated ISERTgtAdm 5a0640e Set backup import volume id to real uuid c164613 fix ConsistencyGroup volume_type_id field d5504e7 Updated from global requirements 29bc118 Storwize: Multiple management IP not raising exceptions 320eaeb Fix ExtraSpecsOpsTestCase sub unit tests 5ed77d7 check per_volume_gigabytes quota for cinder extend 4b9df44 Imported Translations from Zanata dbe761e Updated from global requirements 2513cef Make cinder-all binary deprecated b906aee Add in-tree tempest tests 85d5238 Update SolidFire driver to store cluster info 12afec1 VMware: Reduce volume creation time c6307f7 Fix typos in Cinder files e01af62 Fix driver.failover_host call in manager.py d21b934 Remove "patch mock to raise for invalid assert calls" f7a3494 Add test for checking object compatibilities ae3e892 Update the Administrator guide links 002c247 Update _usage_from_backup() method with versionedobjects 3d6f53e Dell SC: Updated to utilize provider_id b4b0c96 Updated from global requirements bac0d4e Sheepdog:make full use of all sheepdog nodes 5080405 Enable str2size() to handle long int for i386 eaeff0e Imported Translations from Zanata 437f5be Hacking: Ignore tools/ for C303 c5078ea Pylint: refactor ignored message lists 6664dac Brocade FCZM: Fix LOGOUT_PAGE reference 946d9e5 Fix volume retype failure with on-demand policy 05f39c1 Define context.roles with base class 5ab43c8 Fix invalid error message of volume create 924eb42 Stop using tpool with oslo_db 1180562 Huawei: Do not do split if replication pair abnormal 6531f39 Storwize: fix unmapped multi-attached volume failure 92be79e Cleanup DB schema after Mitaka 353127c Fix uuid warnings from api.v2 unit tests 13f9d42 Dell SC: Checking volume size in create_volume_from_snapshot e3922a8 Fix uuid warnings from api.v1 unit tests db9731a Fix api/v1 unit test inconsistencies 0e5e631 Add fake_cgsnapshot for unittest use 6cf0767 Fix typos in Cinder files c20f335 http header value must be a string 41506ab python34 tests don't run without python3-dev c8cff0a Re-enable image to volume with failure test bc73049 Dell Eqlx: Cloning volume does not honor new size 7738c33 Storwize: fix deadlock and major lock granularity issue 57bde97 Fix for NexentaEdge jsonrpc url formatting 536b039 Support oversubscription for IBM Storwize/SVC 73b9976 Huawei: Fix getting admin_metadata 2adc8bb Imported Translations from Zanata e2cf243 NexentaStor4 iSCSI: convert blocksize to str 314d4ec Conditionally restore display_name 5a3589d NexentaStor drivers: resize volume if cloned image is larger 4f1300c rtstool surrounds IPv6 addresses by brackets da28ab6 Imported Translations from Zanata ec320fd NexentaStor: Remove extra format string specifier 7641d8b Fix typos in Cinder files 9a8f9ee Imported Translations from Zanata 4dbb274 XtremIO handle errors in terminate_connection: ee4dc38 Imported Translations from Zanata 128e6ef Check hasattr before calling get in SolidFire bc0e1dc Huawei: Fix getting admin_metadata 9e72721 Remove unused utils.find_config function b4af522 Sheepdog:optimization of connection error handling f8f2f42 DRBD: extend volume if larger than snapshot 9d90a0a Imported Translations from Zanata 47d6957 Fix invalid uuids in rbd unit tests 4c81037 Dont query image metadata for empty volume list 91e4fe7 Remove entry_points from setup.cfg 11cf25e Don't suppress the path part of glance url 8a9e86c Fix meaningless quota exceeded exception info 5424566 Imported Translations from Zanata edff6fb Don't disallow quota deletion if allocated < 0 f8ce884 Added more options while uploading volume as image 55b442c VMware: Support for non-default port a9cfc46 Remove PyMySQL and psycopg2 from test-requirements.txt ae388af Imported Translations from Zanata dc70025 Provide user friendly message for FK failure ab66b7c Fix misspelled word in help text 66c6844 Datera: resize volume if cloned image is larger b550cec Fix Brcd lookup service to use defined southbound protocol e940d3d Docs: Add genconfig to devref toc ca88012 Updated doc string f9ad35a Imported Translations from Zanata c1e6472 Report 2.0 as supported version of RPC APIs 37c0556 Fix volume RPC API methods related to backups c56ace1 Report 2.0 as supported version of RPC APIs b6caf4c NexentaStor5 iscsi: resize volume if cloned image is larger 755253e Imported Translations from Zanata ae8bb95 EMC VMAX - Operations and timeout issues a6b4a84 Imported Translations from Zanata 16a1d80 Imported Translations from Zanata 8008489 Fix the format problem of LOG in failover_host 695266f Dell SC: Error results moved to json d292fe1 Dell SC: create_cgsnapshot returning wrong structure 35ffa62 Re-add policy check for get_snapshot fe0addf Enable functional test for volume creation 4e8ef51 Remove bandit.yaml in favor of defaults e150db7 NexentaEdge: resize volume if cloned image is larger 7f17efc Storwize: Set multiattach property per pool c8ba1a9 Fix volume RPC API methods related to backups 50e124e Imported Translations from Zanata d542110 Imported Translations from Zanata cf686d8 Fix race condition when toggling SP 43ec565 Dell SC: create_cgsnapshot returning wrong structure dbf7495 Hitachi drivers: resize volume if cloned image is larger 6138aca Huawei: Record and check LUN wwn c160116 Mark deprecated options correctly 691db5a SMBFS: fix parsing volume type extra specs and metadata 2c64b30 Update reno for stable/mitaka 38fc0b4 VMware: Bump driver version a3a7fa8 VMware: Bump driver version f9259e2 Imported Translations from Zanata d5d7f6e VMware: Refactor unit tests e784fcf Update .gitreview for stable/mitaka f425bd5 Huawei: Record and check LUN wwn ce26b4d VNX: Enhance migration start verification 5785c74 Fix race condition when toggling SP ecf0a4b Alter wrong comment about param filters e1775c2 XIO: refactor _send_cmd to reduce the redundant fb68584 XtremIO handle errors in terminate_connection: f9d2ba3 Fix py34 error of indexing 'dict_keys' object 3c6b224 Fix error message when running genconfig 2c083b4 typo: add a missing '}' in comment. 199162e Lazy load a project quotas's default values 4666091 SMBFS: fix parsing volume type extra specs and metadata 1787244 Run py34 tests with plain 'tox' command d3b769f Add get_volume_stats for LoggingVolumeDriver 5e1af89 SMBFS: Fix initialize connection issues caused by in-use images d7fead3 VMware: Unit test refactoring 6c27d05 Support https keystone CA checking in volume quotas db8c916 Clarify glance_api_insecure help text 845abb9 Support IP lookup of target portal DNS name 50e1a1c Changed Nexenta default chunksize from 16k to 32k 58db994 Removed unreachable code 5a35c8a Test: use assert_has_calls() instead df54190 Remove extra get_active_zoneset query from Brocade CLI 376bfea VNX: Add 'None' check in parsing provider location 3aa3238 Use the catalog to retrieve glance_api_servers a7adc35 Cleanup orphaned code from image and manager 54bc595 Cleanup orphaned code from brick LVM Diffstat (except docs and test files) ------------------------------------- .gitignore | 6 +- .gitreview | 1 + HACKING.rst | 4 +- api-ref/source/conf.py | 233 + api-ref/source/index.rst | 18 + api-ref/source/v1/index.rst | 13 + api-ref/source/v1/os-quota-sets-v1.inc | 402 + api-ref/source/v1/parameters.yaml | 642 + .../v1/samples/quotas-defaults-show-response.json | 17 + .../v1/samples/quotas-defaults-show-response.xml | 15 + .../source/v1/samples/quotas-show-response.json | 17 + api-ref/source/v1/samples/quotas-show-response.xml | 15 + .../source/v1/samples/quotas-update-request.json | 5 + .../source/v1/samples/quotas-update-request.xml | 4 + .../source/v1/samples/quotas-update-response.json | 16 + .../source/v1/samples/quotas-update-response.xml | 15 + .../source/v1/samples/snapshot-create-request.json | 8 + .../source/v1/samples/snapshot-create-request.xml | 6 + .../samples/snapshot-metadata-show-response.json | 16 + .../v1/samples/snapshot-metadata-show-response.xml | 13 + .../samples/snapshot-metadata-update-request.json | 5 + .../samples/snapshot-metadata-update-request.xml | 4 + .../samples/snapshot-metadata-update-response.json | 5 + .../samples/snapshot-metadata-update-response.xml | 4 + .../source/v1/samples/snapshot-show-response.json | 11 + .../source/v1/samples/snapshot-show-response.xml | 9 + .../source/v1/samples/snapshots-list-response.json | 26 + .../source/v1/samples/snapshots-list-response.xml | 21 + .../v1/samples/user-quotas-delete-response.json | 0 .../samples/user-quotas-show-detail-response.json | 64 + .../v1/samples/user-quotas-show-response.json | 17 + .../v1/samples/user-quotas-show-response.xml | 15 + .../v1/samples/user-quotas-update-request.json | 6 + .../v1/samples/user-quotas-update-request.xml | 5 + .../v1/samples/user-quotas-update-response.json | 16 + .../v1/samples/user-quotas-update-response.xml | 15 + .../source/v1/samples/version-show-response.json | 28 + .../source/v1/samples/versions-list-response.json | 26 + .../source/v1/samples/volume-create-request.json | 18 + .../source/v1/samples/volume-create-request.xml | 11 + .../source/v1/samples/volume-show-response.json | 27 + api-ref/source/v1/samples/volume-show-response.xml | 15 + .../v1/samples/volume-type-create-request.json | 8 + .../v1/samples/volume-type-create-request.xml | 7 + .../v1/samples/volume-type-show-response.json | 9 + .../v1/samples/volume-type-show-response.xml | 8 + .../v1/samples/volume-types-list-response.json | 16 + .../v1/samples/volume-types-list-response.xml | 11 + .../source/v1/samples/volumes-list-response.json | 41 + .../source/v1/samples/volumes-list-response.xml | 25 + api-ref/source/v1/volumes-v1-snapshots.inc | 188 + api-ref/source/v1/volumes-v1-types.inc | 218 + api-ref/source/v1/volumes-v1-versions.inc | 54 + api-ref/source/v1/volumes-v1-volumes.inc | 234 + api-ref/source/v2/api-versions.inc | 32 + api-ref/source/v2/capabilities-v2.inc | 48 + api-ref/source/v2/consistencygroups-v2.inc | 267 + api-ref/source/v2/ext-backups-actions-v2.inc | 38 + api-ref/source/v2/ext-backups.inc | 276 + api-ref/source/v2/index.rst | 28 + api-ref/source/v2/limits.inc | 57 + api-ref/source/v2/os-cgsnapshots-v2.inc | 179 + api-ref/source/v2/os-vol-image-meta-v2.inc | 46 + api-ref/source/v2/os-vol-pool-v2.inc | 50 + api-ref/source/v2/os-vol-transfer-v2.inc | 217 + api-ref/source/v2/parameters.yaml | 1620 +++ api-ref/source/v2/qos-specs-v2-qos-specs.inc | 315 + api-ref/source/v2/quota-sets.inc | 407 + .../v2/samples/backend-capabilities-response.json | 33 + .../source/v2/samples/backup-create-request.json | 9 + .../source/v2/samples/backup-create-response.json | 16 + .../v2/samples/backup-force-delete-request.json | 3 + .../v2/samples/backup-record-export-response.json | 6 + .../v2/samples/backup-record-import-request.json | 6 + .../v2/samples/backup-record-import-response.json | 16 + .../source/v2/samples/backup-restore-request.json | 6 + .../source/v2/samples/backup-restore-response.json | 6 + .../source/v2/samples/backup-show-response.json | 27 + .../v2/samples/backups-list-detailed-response.json | 54 + .../source/v2/samples/backups-list-response.json | 32 + .../v2/samples/cgsnapshots-create-request.json | 10 + .../v2/samples/cgsnapshots-create-response.json | 6 + .../cgsnapshots-list-detailed-response.json | 20 + .../v2/samples/cgsnapshots-list-response.json | 12 + .../v2/samples/cgsnapshots-show-response.json | 10 + .../consistency-group-create-from-src-request.json | 11 + .../samples/consistency-group-create-request.json | 8 + .../samples/consistency-group-create-response.json | 11 + .../samples/consistency-group-delete-request.json | 5 + .../samples/consistency-group-show-response.json | 13 + .../v2/samples/consistency-group-show-response.xml | 14 + .../samples/consistency-group-update-request.json | 8 + .../consistency-groups-list-detailed-response.json | 26 + .../consistency-groups-list-detailed-response.xml | 25 + .../samples/consistency-groups-list-response.json | 12 + .../v2/samples/extensions-list-response.json | 212 + .../source/v2/samples/extensions-list-response.xml | 165 + api-ref/source/v2/samples/host-attach-request.json | 5 + .../v2/samples/image-metadata-show-request.json | 18 + .../v2/samples/image-metadata-show-response.json | 33 + .../source/v2/samples/limits-show-response.json | 17 + api-ref/source/v2/samples/limits-show-response.xml | 17 + .../v2/samples/pools-list-detailed-response.json | 30 + api-ref/source/v2/samples/qos-create-request.json | 7 + api-ref/source/v2/samples/qos-create-request.xml | 2 + api-ref/source/v2/samples/qos-create-response.json | 21 + api-ref/source/v2/samples/qos-create-response.xml | 9 + api-ref/source/v2/samples/qos-list-response.json | 22 + api-ref/source/v2/samples/qos-list-response.xml | 19 + api-ref/source/v2/samples/qos-show-response.json | 21 + api-ref/source/v2/samples/qos-show-response.xml | 11 + api-ref/source/v2/samples/qos-unset-request.json | 5 + api-ref/source/v2/samples/qos-unset-request.xml | 4 + api-ref/source/v2/samples/qos-unset-response.json | 0 api-ref/source/v2/samples/qos-update-request.json | 5 + api-ref/source/v2/samples/qos-update-request.xml | 2 + api-ref/source/v2/samples/qos-update-response.json | 5 + api-ref/source/v2/samples/qos-update-response.xml | 4 + api-ref/source/v2/samples/qos_show_response.json | 9 + api-ref/source/v2/samples/qos_show_response.xml | 6 + .../v2/samples/quotas-defaults-show-response.xml | 15 + .../source/v2/samples/quotas-delete-response.json | 0 .../v2/samples/quotas-show-defaults-response.json | 7 + .../v2/samples/quotas-show-defaults-response.xml | 6 + .../source/v2/samples/quotas-show-response.json | 7 + api-ref/source/v2/samples/quotas-show-response.xml | 6 + .../source/v2/samples/quotas-update-request.json | 5 + .../source/v2/samples/quotas-update-request.xml | 4 + .../source/v2/samples/quotas-update-response.json | 5 + .../source/v2/samples/quotas-update-response.xml | 6 + .../quotas-user-show-detailed-response.json | 19 + .../v2/samples/quotas-user-show-response.json | 7 + .../v2/samples/quotas-user-show-response.xml | 6 + .../source/v2/samples/snapshot-create-request.json | 8 + .../source/v2/samples/snapshot-create-request.xml | 5 + .../v2/samples/snapshot-create-response.json | 12 + .../source/v2/samples/snapshot-create-response.xml | 7 + .../samples/snapshot-metadata-show-response.json | 5 + .../v2/samples/snapshot-metadata-show-response.xml | 4 + .../samples/snapshot-metadata-update-request.json | 5 + .../samples/snapshot-metadata-update-request.xml | 4 + .../samples/snapshot-metadata-update-response.json | 5 + .../samples/snapshot-metadata-update-response.xml | 4 + .../source/v2/samples/snapshot-show-response.json | 14 + .../source/v2/samples/snapshot-show-response.xml | 11 + .../source/v2/samples/snapshot-update-request.json | 6 + .../source/v2/samples/snapshot-update-request.xml | 4 + .../v2/samples/snapshot-update-response.json | 11 + .../source/v2/samples/snapshot-update-response.xml | 14 + .../samples/snapshots-list-detailed-response.json | 18 + .../samples/snapshots-list-detailed-response.xml | 16 + .../source/v2/samples/snapshots-list-response.json | 16 + .../source/v2/samples/snapshots-list-response.xml | 13 + .../v2/samples/user-quotas-show-response.json | 17 + .../v2/samples/user-quotas-show-response.xml | 15 + .../v2/samples/user-quotas-update-request.json | 6 + .../v2/samples/user-quotas-update-request.xml | 5 + .../v2/samples/user-quotas-update-response.json | 16 + .../v2/samples/user-quotas-update-response.xml | 15 + .../source/v2/samples/version-show-response.json | 33 + .../source/v2/samples/version-show-response.xml | 17 + .../v2/samples/version-v2-show-response.json | 44 + api-ref/source/v2/samples/versions-response.json | 76 + api-ref/source/v2/samples/versions-response.xml | 25 + .../source/v2/samples/volume-attach-request.json | 6 + .../source/v2/samples/volume-create-request.json | 22 + .../source/v2/samples/volume-create-request.xml | 5 + .../source/v2/samples/volume-create-response.json | 34 + .../source/v2/samples/volume-create-response.xml | 11 + .../source/v2/samples/volume-extend-request.json | 5 + .../v2/samples/volume-force-detach-request.json | 8 + .../samples/volume-image-metadata-set-request.json | 10 + .../volume-image-metadata-unset-request.json | 5 + .../source/v2/samples/volume-manage-request.json | 18 + .../source/v2/samples/volume-manage-response.json | 33 + .../v2/samples/volume-metadata-create-request.json | 5 + .../samples/volume-metadata-create-response.json | 5 + .../v2/samples/volume-metadata-show-response.json | 3 + .../v2/samples/volume-metadata-show-response.xml | 2 + .../v2/samples/volume-metadata-update-request.json | 5 + .../v2/samples/volume-metadata-update-request.xml | 4 + .../samples/volume-metadata-update-response.json | 5 + .../v2/samples/volume-metadata-update-response.xml | 4 + .../source/v2/samples/volume-show-response.json | 33 + api-ref/source/v2/samples/volume-show-response.xml | 19 + .../v2/samples/volume-status-reset-request.json | 7 + .../v2/samples/volume-transfer-accept-request.json | 5 + .../samples/volume-transfer-accept-response.json | 17 + .../v2/samples/volume-transfer-create-request.json | 6 + .../samples/volume-transfer-create-response.json | 19 + .../v2/samples/volume-transfer-show-response.json | 18 + .../volume-transfers-list-detailed-response.json | 36 + .../v2/samples/volume-transfers-list-response.json | 34 + .../v2/samples/volume-type-access-add-request.json | 5 + .../v2/samples/volume-type-access-add-request.xml | 4 + .../samples/volume-type-access-delete-request.json | 5 + .../samples/volume-type-access-delete-request.xml | 4 + .../samples/volume-type-access-list-response.json | 6 + .../v2/samples/volume-type-create-request.json | 10 + .../v2/samples/volume-type-create-request.xml | 6 + .../v2/samples/volume-type-show-request.json | 9 + .../source/v2/samples/volume-type-show-request.xml | 8 + .../v2/samples/volume-type-show-response.json | 11 + .../v2/samples/volume-type-show-response.xml | 9 + .../v2/samples/volume-type-update-request.json | 10 + .../v2/samples/volume-type-update-request.xml | 6 + .../v2/samples/volume-types-list-response.json | 16 + .../v2/samples/volume-types-list-response.xml | 11 + .../source/v2/samples/volume-unmanage-request.json | 3 + .../source/v2/samples/volume-update-request.json | 6 + .../source/v2/samples/volume-update-request.xml | 4 + .../source/v2/samples/volume-update-response.json | 36 + .../source/v2/samples/volume-update-response.xml | 13 + .../v2/samples/volumes-list-detailed-response.json | 102 + .../v2/samples/volumes-list-detailed-response.xml | 31 + .../source/v2/samples/volumes-list-response.json | 32 + .../source/v2/samples/volumes-list-response.xml | 12 + api-ref/source/v2/volume-manage.inc | 50 + api-ref/source/v2/volume-type-access.inc | 103 + api-ref/source/v2/volumes-v2-extensions.inc | 52 + api-ref/source/v2/volumes-v2-snapshots.inc | 359 + api-ref/source/v2/volumes-v2-types.inc | 273 + api-ref/source/v2/volumes-v2-versions.inc | 67 + api-ref/source/v2/volumes-v2-volumes-actions.inc | 269 + api-ref/source/v2/volumes-v2-volumes.inc | 570 + cinder/api/common.py | 98 +- cinder/api/contrib/admin_actions.py | 58 +- cinder/api/contrib/availability_zones.py | 22 - cinder/api/contrib/backups.py | 163 +- cinder/api/contrib/capabilities.py | 5 - cinder/api/contrib/cgsnapshots.py | 88 +- cinder/api/contrib/consistencygroups.py | 213 +- cinder/api/contrib/extended_services.py | 2 - cinder/api/contrib/extended_snapshot_attributes.py | 35 - cinder/api/contrib/hosts.py | 78 +- cinder/api/contrib/image_create.py | 1 - cinder/api/contrib/qos_specs_manage.py | 144 +- cinder/api/contrib/quota_classes.py | 18 - cinder/api/contrib/quotas.py | 52 +- cinder/api/contrib/resource_common_manage.py | 56 + cinder/api/contrib/scheduler_hints.py | 5 - cinder/api/contrib/scheduler_stats.py | 9 +- cinder/api/contrib/services.py | 72 +- cinder/api/contrib/snapshot_actions.py | 12 +- cinder/api/contrib/snapshot_manage.py | 95 +- cinder/api/contrib/snapshot_unmanage.py | 7 +- cinder/api/contrib/types_extra_specs.py | 59 +- cinder/api/contrib/types_manage.py | 14 +- cinder/api/contrib/used_limits.py | 1 - cinder/api/contrib/volume_actions.py | 161 +- cinder/api/contrib/volume_encryption_metadata.py | 11 - cinder/api/contrib/volume_host_attribute.py | 32 - cinder/api/contrib/volume_image_metadata.py | 75 +- cinder/api/contrib/volume_manage.py | 119 +- cinder/api/contrib/volume_mig_status_attribute.py | 32 - cinder/api/contrib/volume_tenant_attribute.py | 29 - cinder/api/contrib/volume_transfer.py | 98 +- cinder/api/contrib/volume_type_access.py | 74 +- cinder/api/contrib/volume_type_encryption.py | 27 +- cinder/api/contrib/volume_unmanage.py | 13 +- cinder/api/extensions.py | 72 +- cinder/api/middleware/auth.py | 38 +- cinder/api/middleware/sizelimit.py | 4 +- cinder/api/openstack/__init__.py | 4 +- cinder/api/openstack/api_version_request.py | 25 +- cinder/api/openstack/rest_api_version_history.rst | 162 + cinder/api/openstack/wsgi.py | 346 +- cinder/api/schemas/atom-link.rng | 141 - cinder/api/schemas/v1.1/extension.rng | 11 - cinder/api/schemas/v1.1/extensions.rng | 6 - cinder/api/schemas/v1.1/limits.rng | 28 - cinder/api/schemas/v1.1/metadata.rng | 9 - cinder/api/schemas/v1.1/qos_association.rng | 8 - cinder/api/schemas/v1.1/qos_associations.rng | 5 - cinder/api/schemas/v1.1/qos_spec.rng | 16 - cinder/api/schemas/v1.1/qos_specs.rng | 5 - cinder/api/urlmap.py | 10 +- cinder/api/v1/limits.py | 30 - cinder/api/v1/router.py | 5 - cinder/api/v1/snapshot_metadata.py | 40 +- cinder/api/v1/snapshots.py | 67 +- cinder/api/v1/types.py | 37 +- cinder/api/v1/volume_metadata.py | 40 +- cinder/api/v1/volumes.py | 170 +- cinder/api/v2/limits.py | 30 - cinder/api/v2/router.py | 5 - cinder/api/v2/snapshot_metadata.py | 40 +- cinder/api/v2/snapshots.py | 73 +- cinder/api/v2/types.py | 38 +- cinder/api/v2/views/volumes.py | 4 - cinder/api/v2/volume_metadata.py | 70 +- cinder/api/v2/volumes.py | 229 +- cinder/api/v3/backups.py | 56 + cinder/api/v3/clusters.py | 132 + cinder/api/v3/consistencygroups.py | 89 + cinder/api/v3/group_snapshots.py | 146 + cinder/api/v3/group_specs.py | 154 + cinder/api/v3/group_types.py | 269 + cinder/api/v3/groups.py | 290 + cinder/api/v3/messages.py | 112 + cinder/api/v3/router.py | 90 +- cinder/api/v3/snapshot_manage.py | 45 + cinder/api/v3/snapshots.py | 30 + cinder/api/v3/views/__init__.py | 0 cinder/api/v3/views/clusters.py | 63 + cinder/api/v3/views/group_snapshots.py | 64 + cinder/api/v3/views/group_types.py | 43 + cinder/api/v3/views/groups.py | 81 + cinder/api/v3/views/messages.py | 69 + cinder/api/v3/views/snapshots.py | 33 + cinder/api/v3/views/volumes.py | 40 + cinder/api/v3/volume_manage.py | 45 + cinder/api/v3/volume_metadata.py | 80 + cinder/api/v3/volumes.py | 247 + cinder/api/versions.py | 164 +- cinder/api/views/backups.py | 5 - cinder/api/views/cgsnapshots.py | 5 - cinder/api/views/consistencygroups.py | 5 - cinder/api/views/manageable_snapshots.py | 55 + cinder/api/views/manageable_volumes.py | 53 + cinder/api/views/qos_specs.py | 20 +- cinder/api/views/snapshots.py | 5 - cinder/api/views/transfers.py | 5 - cinder/api/xmlutil.py | 968 -- cinder/backup/api.py | 107 +- cinder/backup/chunkeddriver.py | 4 +- cinder/backup/driver.py | 42 +- cinder/backup/drivers/ceph.py | 12 +- cinder/backup/drivers/glusterfs.py | 2 + cinder/backup/drivers/google.py | 17 +- cinder/backup/drivers/nfs.py | 2 + cinder/backup/drivers/posix.py | 2 + cinder/backup/drivers/swift.py | 30 +- cinder/backup/drivers/tsm.py | 4 +- cinder/backup/manager.py | 213 +- cinder/backup/rpcapi.py | 23 +- cinder/brick/local_dev/lvm.py | 104 +- cinder/cmd/all.py | 21 +- cinder/cmd/backup.py | 3 + cinder/cmd/manage.py | 185 +- cinder/cmd/rtstool.py | 15 +- cinder/cmd/volume.py | 37 +- cinder/cmd/volume_usage_audit.py | 36 +- cinder/common/config.py | 38 +- cinder/common/constants.py | 8 + cinder/compute/nova.py | 32 +- cinder/config/cinder-config-generator.conf | 1 + cinder/config/generate_cinder_opts.py | 13 +- cinder/consistencygroup/api.py | 277 +- cinder/context.py | 55 +- cinder/coordination.py | 9 +- cinder/db/api.py | 675 +- cinder/db/migration.py | 2 +- cinder/db/sqlalchemy/api.py | 2328 +++- .../migrate_repo/versions/001_cinder_init.py | 258 - .../migrate_repo/versions/002_quota_class.py | 89 - .../migrate_repo/versions/003_glance_metadata.py | 55 - .../versions/004_volume_type_to_uuid.py | 81 - .../versions/005_add_source_volume_column.py | 25 - .../006_snapshots_add_provider_location.py | 25 - .../versions/007_add_volume_snapshot_fk.py | 27 - .../migrate_repo/versions/008_add_backup.py | 49 - .../versions/009_add_snapshot_metadata_table.py | 38 - .../versions/010_add_transfers_table.py | 41 - .../versions/011_add_bootable_column.py | 33 - .../versions/012_add_attach_host_column.py | 25 - .../versions/013_add_provider_geometry_column.py | 25 - .../migrate_repo/versions/014_add_name_id.py | 25 - .../versions/015_drop_migrations_table.py | 23 - .../migrate_repo/versions/016_drop_sm_tables.py | 29 - .../versions/017_add_encryption_information.py | 60 - .../migrate_repo/versions/018_add_qos_specs.py | 48 - .../versions/019_add_migration_status.py | 26 - .../020_add_volume_admin_metadata_table.py | 39 - .../versions/021_add_default_quota_class.py | 66 - .../versions/022_add_reason_column_to_service.py | 23 - .../versions/023_add_expire_reservations_index.py | 38 - .../versions/024_add_replication_support.py | 34 - .../versions/025_add_consistencygroup.py | 81 - .../026_add_consistencygroup_quota_class.py | 52 - .../migrate_repo/versions/027_placeholder.py | 19 - .../migrate_repo/versions/028_placeholder.py | 19 - .../migrate_repo/versions/029_placeholder.py | 19 - .../migrate_repo/versions/030_placeholder.py | 19 - .../migrate_repo/versions/031_placeholder.py | 19 - .../versions/032_add_volume_type_projects.py | 41 - .../versions/033_add_encryption_unique_key.py | 95 - .../versions/034_volume_type_add_desc_column.py | 25 - .../versions/035_add_provider_id_column.py | 25 - .../036_add_provider_id_column_to_snapshots.py | 25 - ...dd_cgsnapshot_id_column_to_consistencygroups.py | 26 - .../038_add_driver_initiator_data_table.py | 36 - .../versions/039_add_parent_id_to_backups.py | 28 - .../versions/040_add_volume_attachment.py | 88 - .../041_add_modified_at_column_to_service.py | 21 - .../migrate_repo/versions/042_placeholder.py | 22 - .../migrate_repo/versions/043_placeholder.py | 22 - .../migrate_repo/versions/044_placeholder.py | 22 - .../migrate_repo/versions/045_placeholder.py | 22 - .../migrate_repo/versions/046_cinder_init.py | 574 + .../migrate_repo/versions/046_placeholder.py | 22 - ...73_drop_available_versions_and_iscsi_targets.py | 25 + .../migrate_repo/versions/074_add_message_table.py | 41 + .../versions/075_add_cluster_and_fields.py | 58 + .../migrate_repo/versions/076_add_workers_table.py | 52 + .../077_add_group_types_and_group_specs_table.py | 75 + ...d_groups_and_group_volume_type_mapping_table.py | 97 + .../versions/079_add_group_snapshots.py | 63 + cinder/db/sqlalchemy/models.py | 344 +- cinder/exception.py | 230 +- cinder/group/__init__.py | 27 + cinder/group/api.py | 843 ++ cinder/hacking/checks.py | 29 +- cinder/image/cache.py | 8 +- cinder/image/glance.py | 86 +- cinder/image/image_utils.py | 46 +- cinder/interface/__init__.py | 37 + cinder/interface/backup_chunked_driver.py | 79 + cinder/interface/backup_driver.py | 111 + cinder/interface/backup_verify_driver.py | 38 + cinder/interface/base.py | 105 + cinder/interface/fczm_driver.py | 78 + cinder/interface/util.py | 79 + cinder/interface/volume_consistencygroup_driver.py | 231 + cinder/interface/volume_driver.py | 256 + cinder/interface/volume_management_driver.py | 92 + cinder/interface/volume_snapshot_driver.py | 57 + .../interface/volume_snapshotmanagement_driver.py | 80 + cinder/keymgr/__init__.py | 63 +- cinder/keymgr/barbican.py | 338 - cinder/keymgr/conf_key_mgr.py | 97 +- cinder/keymgr/key.py | 90 - cinder/keymgr/key_mgr.py | 113 - cinder/keymgr/not_implemented_key_mgr.py | 40 - cinder/locale/cinder-log-error.pot | 4064 ------- cinder/locale/cinder-log-info.pot | 4195 ------- cinder/locale/cinder-log-warning.pot | 2427 ---- cinder/locale/cinder.pot | 11538 ------------------ cinder/locale/cs/LC_MESSAGES/cinder-log-error.po | 235 +- cinder/locale/cs/LC_MESSAGES/cinder-log-info.po | 397 +- cinder/locale/cs/LC_MESSAGES/cinder-log-warning.po | 453 +- cinder/locale/cs/LC_MESSAGES/cinder.po | 720 +- cinder/locale/de/LC_MESSAGES/cinder.po | 4791 +++++--- cinder/locale/es/LC_MESSAGES/cinder.po | 3037 ++++- cinder/locale/fr/LC_MESSAGES/cinder.po | 3044 ++++- cinder/locale/it/LC_MESSAGES/cinder-log-error.po | 1127 +- cinder/locale/it/LC_MESSAGES/cinder-log-info.po | 3387 ++++++ cinder/locale/it/LC_MESSAGES/cinder.po | 885 +- cinder/locale/ja/LC_MESSAGES/cinder.po | 11693 +++++++++++++++++++ .../locale/ko_KR/LC_MESSAGES/cinder-log-error.po | 3263 ++++++ cinder/locale/ko_KR/LC_MESSAGES/cinder-log-info.po | 3218 +++++ cinder/locale/ko_KR/LC_MESSAGES/cinder.po | 2770 ++++- cinder/locale/pt_BR/LC_MESSAGES/cinder.po | 2867 ++++- cinder/locale/ru/LC_MESSAGES/cinder.po | 2793 ++++- .../locale/tr_TR/LC_MESSAGES/cinder-log-error.po | 184 +- cinder/locale/tr_TR/LC_MESSAGES/cinder-log-info.po | 283 +- .../locale/tr_TR/LC_MESSAGES/cinder-log-warning.po | 400 +- cinder/locale/tr_TR/LC_MESSAGES/cinder.po | 709 +- cinder/locale/zh_CN/LC_MESSAGES/cinder.po | 1811 +-- cinder/locale/zh_TW/LC_MESSAGES/cinder.po | 796 +- cinder/manager.py | 25 +- cinder/message/__init__.py | 0 cinder/message/api.py | 83 + cinder/message/defined_messages.py | 44 + cinder/message/resource_types.py | 15 + cinder/objects/__init__.py | 6 + cinder/objects/backup.py | 27 +- cinder/objects/base.py | 411 +- cinder/objects/cgsnapshot.py | 36 +- cinder/objects/cluster.py | 186 + cinder/objects/consistencygroup.py | 120 +- cinder/objects/fields.py | 72 +- cinder/objects/group.py | 197 + cinder/objects/group_snapshot.py | 152 + cinder/objects/group_type.py | 121 + cinder/objects/qos_specs.py | 202 + cinder/objects/request_spec.py | 127 + cinder/objects/service.py | 122 +- cinder/objects/snapshot.py | 82 +- cinder/objects/volume.py | 149 +- cinder/objects/volume_attachment.py | 33 +- cinder/objects/volume_type.py | 74 +- cinder/opts.py | 61 +- cinder/policy.py | 13 +- cinder/quota.py | 51 +- cinder/quota_utils.py | 151 +- cinder/replication/api.py | 4 - cinder/rpc.py | 85 +- cinder/scheduler/base_filter.py | 57 +- cinder/scheduler/driver.py | 22 +- cinder/scheduler/evaluator/evaluator.py | 2 +- cinder/scheduler/filter_scheduler.py | 244 +- cinder/scheduler/filters/affinity_filter.py | 3 - cinder/scheduler/filters/capabilities_filter.py | 37 +- cinder/scheduler/filters/capacity_filter.py | 15 +- cinder/scheduler/filters/extra_specs_ops.py | 5 + .../scheduler/filters/instance_locality_filter.py | 2 + cinder/scheduler/flows/create_volume.py | 21 +- cinder/scheduler/host_manager.py | 97 +- cinder/scheduler/manager.py | 152 +- cinder/scheduler/rpcapi.py | 165 +- cinder/scheduler/weights/__init__.py | 5 +- cinder/scheduler/weights/capacity.py | 16 +- cinder/scheduler/weights/goodness.py | 15 +- cinder/scheduler/weights/stochastic.py | 82 + cinder/scheduler/weights/volume_number.py | 5 +- cinder/service.py | 171 +- cinder/test.py | 145 +- cinder/testing/README.rst | 35 - .../tempest/api/volume/test_consistencygroups.py | 287 + .../tempest/api/volume/test_volume_placeholder.py | 25 + .../tempest/api/volume/test_volume_unicode.py | 60 + .../tempest/services/consistencygroups_client.py | 192 + .../unit/api/contrib/test_availability_zones.py | 35 +- .../unit/api/contrib/test_consistencygroups.py | 799 +- .../contrib/test_extended_snapshot_attributes.py | 42 +- .../unit/api/contrib/test_qos_specs_manage.py | 555 +- .../unit/api/contrib/test_snapshot_actions.py | 47 +- .../unit/api/contrib/test_snapshot_unmanage.py | 27 +- .../unit/api/contrib/test_types_extra_specs.py | 177 +- .../api/contrib/test_volume_encryption_metadata.py | 97 +- .../unit/api/contrib/test_volume_host_attribute.py | 62 +- .../unit/api/contrib/test_volume_image_metadata.py | 196 +- .../test_volume_migration_status_attribute.py | 78 +- .../api/contrib/test_volume_tenant_attribute.py | 56 +- .../unit/api/contrib/test_volume_type_access.py | 192 +- .../api/contrib/test_volume_type_encryption.py | 110 +- .../unit/api/openstack/test_api_version_request.py | 18 +- .../unit/backup/drivers/test_backup_driver_base.py | 424 + .../unit/backup/drivers/test_backup_google.py | 582 + .../unit/consistencygroup/fake_consistencygroup.py | 50 + .../unit/keymgr/test_not_implemented_key_mgr.py | 50 - .../scheduler/test_allocated_capacity_weigher.py | 18 +- .../scheduler/test_stochastic_weight_handler.py | 67 + .../unit/scheduler/test_volume_number_weigher.py | 29 +- .../unit/test_huawei_drivers_compatibility.py | 65 - .../unit/volume/drivers/dell/test_dellscapi.py | 7623 ++++++++++++ .../unit/volume/drivers/emc/scaleio/__init__.py | 3 +- .../emc/scaleio/test_attach_detach_volume.py | 45 + .../drivers/emc/scaleio/test_consistencygroups.py | 34 +- .../emc/scaleio/test_create_cloned_volume.py | 3 +- .../drivers/emc/scaleio/test_create_snapshot.py | 3 +- .../drivers/emc/scaleio/test_create_volume.py | 23 + .../scaleio/test_create_volume_from_snapshot.py | 2 +- .../drivers/emc/scaleio/test_delete_snapshot.py | 7 +- .../drivers/emc/scaleio/test_delete_volume.py | 3 +- .../drivers/emc/scaleio/test_extend_volume.py | 7 +- .../emc/scaleio/test_initialize_connection.py | 67 +- .../drivers/emc/scaleio/test_manage_existing.py | 31 +- .../emc/scaleio/test_manage_existing_snapshot.py | 154 + .../unit/volume/drivers/emc/scaleio/test_misc.py | 57 +- .../unit/volume/drivers/emc/test_emc_xtremio.py | 1074 ++ .../unit/volume/drivers/emc/vnx/fake_exception.py | 172 + .../unit/volume/drivers/emc/vnx/fake_storops.py | 76 + .../unit/volume/drivers/emc/vnx/mocked_cinder.yaml | 445 + .../unit/volume/drivers/emc/vnx/mocked_vnx.yaml | 2029 ++++ .../unit/volume/drivers/emc/vnx/test_adapter.py | 1315 +++ .../unit/volume/drivers/emc/vnx/test_client.py | 465 + .../unit/volume/drivers/emc/vnx/test_common.py | 297 + .../unit/volume/drivers/emc/vnx/test_driver.py | 73 + .../unit/volume/drivers/emc/vnx/test_res_mock.py | 90 + .../unit/volume/drivers/emc/vnx/test_res_mock.yaml | 59 + .../unit/volume/drivers/emc/vnx/test_taskflows.py | 181 + .../unit/volume/drivers/emc/vnx/test_utils.py | 174 + .../unit/volume/drivers/fusionstorage/__init__.py | 0 .../volume/drivers/fusionstorage/test_dsware.py | 771 ++ .../drivers/fusionstorage/test_fspythonapi.py | 447 + .../drivers/hitachi/test_hitachi_hbsd_horcm_fc.py | 1034 ++ .../drivers/hitachi/test_hitachi_hbsd_snm2_fc.py | 618 + .../hitachi/test_hitachi_hbsd_snm2_iscsi.py | 607 + .../drivers/hitachi/test_hitachi_hnas_backend.py | 877 ++ .../drivers/hitachi/test_hitachi_hnas_iscsi.py | 592 + .../drivers/hitachi/test_hitachi_hnas_nfs.py | 586 + .../drivers/hitachi/test_hitachi_hnas_utils.py | 327 + .../volume/drivers/hpe/fake_hpe_3par_client.py | 29 + .../drivers/hpe/fake_hpe_client_exceptions.py | 119 + .../volume/drivers/hpe/fake_hpe_lefthand_client.py | 29 + .../unit/volume/drivers/hpe/test_hpe_xp_fc.py | 801 ++ .../unit/volume/drivers/hpe/test_hpelefthand.py | 3236 +++++ .../volume/drivers/huawei/test_huawei_drivers.py | 4615 ++++++++ .../huawei/test_huawei_drivers_compatibility.py | 65 + .../volume/drivers/ibm/test_ibm_flashsystem.py | 1365 +++ .../drivers/ibm/test_ibm_flashsystem_iscsi.py | 421 + .../unit/volume/drivers/ibm/test_ibm_storage.py | 926 ++ .../unit/volume/drivers/ibm/test_storwize_svc.py | 5487 +++++++++ .../unit/volume/drivers/infortrend/__init__.py | 0 .../drivers/infortrend/test_infortrend_cli.py | 2309 ++++ .../drivers/infortrend/test_infortrend_common.py | 2073 ++++ .../drivers/netapp/dataontap/client/fakes.py | 550 +- .../drivers/netapp/dataontap/client/test_api.py | 62 +- .../netapp/dataontap/client/test_client_7mode.py | 56 +- .../netapp/dataontap/client/test_client_base.py | 49 + .../netapp/dataontap/client/test_client_cmode.py | 2419 +++- .../unit/volume/drivers/netapp/dataontap/fakes.py | 178 +- .../dataontap/performance/test_perf_cmode.py | 46 +- .../drivers/netapp/dataontap/test_block_7mode.py | 122 +- .../drivers/netapp/dataontap/test_block_base.py | 211 +- .../drivers/netapp/dataontap/test_block_cmode.py | 608 +- .../drivers/netapp/dataontap/test_nfs_7mode.py | 90 +- .../drivers/netapp/dataontap/test_nfs_base.py | 705 +- .../drivers/netapp/dataontap/test_nfs_cmode.py | 1270 +- .../drivers/netapp/dataontap/utils/__init__.py | 0 .../volume/drivers/netapp/dataontap/utils/fakes.py | 135 + .../netapp/dataontap/utils/test_capabilities.py | 374 + .../netapp/dataontap/utils/test_data_motion.py | 749 ++ .../netapp/dataontap/utils/test_loopingcalls.py | 63 + .../drivers/netapp/dataontap/utils/test_utils.py | 103 + .../unit/volume/drivers/netapp/eseries/fakes.py | 193 +- .../volume/drivers/netapp/eseries/test_client.py | 29 +- .../volume/drivers/netapp/eseries/test_driver.py | 13 - .../volume/drivers/netapp/eseries/test_library.py | 204 +- .../unit/volume/drivers/netapp/test_common.py | 31 +- .../unit/volume/drivers/nexenta/test_nexenta.py | 687 ++ .../volume/drivers/nexenta/test_nexenta5_iscsi.py | 397 + .../volume/drivers/nexenta/test_nexenta5_nfs.py | 172 + .../volume/drivers/nexenta/test_nexenta_edge.py | 272 + .../unit/volume/drivers/test_drbdmanagedrv.py | 707 ++ .../unit/volume/drivers/test_prophetstor_dpl.py | 771 ++ .../unit/volume/drivers/violin/fake_vmem_client.py | 67 + .../volume/drivers/violin/test_v7000_common.py | 1420 +++ .../unit/volume/drivers/violin/test_v7000_fcp.py | 577 + .../volume/drivers/vmware/test_vmware_datastore.py | 361 + .../unit/volume/drivers/vmware/test_vmware_vmdk.py | 2794 +++++ .../volume/drivers/vmware/test_vmware_volumeops.py | 1971 ++++ .../unit/volume/flows/test_create_volume_flow.py | 277 +- .../unit/volume/flows/test_manage_volume_flow.py | 104 + .../zonemanager/test_brcd_fc_san_lookup_service.py | 94 +- .../zonemanager/test_brcd_fc_zone_client_cli.py | 43 +- .../unit/zonemanager/test_brcd_fc_zone_driver.py | 8 +- .../zonemanager/test_brcd_http_fc_zone_client.py | 14 +- .../unit/zonemanager/test_cisco_fc_zone_driver.py | 4 +- cinder/transfer/api.py | 48 +- cinder/utils.py | 228 +- cinder/volume/api.py | 777 +- cinder/volume/configuration.py | 2 - cinder/volume/driver.py | 696 +- cinder/volume/driver_utils.py | 72 + cinder/volume/drivers/block_device.py | 42 +- cinder/volume/drivers/blockbridge.py | 27 +- cinder/volume/drivers/cloudbyte/cloudbyte.py | 3 + cinder/volume/drivers/coho.py | 124 +- cinder/volume/drivers/coprhd/__init__.py | 0 cinder/volume/drivers/coprhd/common.py | 1440 +++ cinder/volume/drivers/coprhd/fc.py | 226 + cinder/volume/drivers/coprhd/helpers/__init__.py | 0 .../drivers/coprhd/helpers/authentication.py | 216 + .../drivers/coprhd/helpers/commoncoprhdapi.py | 521 + .../drivers/coprhd/helpers/consistencygroup.py | 220 + .../volume/drivers/coprhd/helpers/exportgroup.py | 303 + cinder/volume/drivers/coprhd/helpers/host.py | 93 + cinder/volume/drivers/coprhd/helpers/project.py | 88 + cinder/volume/drivers/coprhd/helpers/snapshot.py | 257 + cinder/volume/drivers/coprhd/helpers/tag.py | 55 + cinder/volume/drivers/coprhd/helpers/tenant.py | 117 + cinder/volume/drivers/coprhd/helpers/urihelper.py | 82 + .../volume/drivers/coprhd/helpers/virtualarray.py | 79 + .../volume/drivers/coprhd/helpers/virtualpool.py | 77 + cinder/volume/drivers/coprhd/helpers/volume.py | 521 + cinder/volume/drivers/coprhd/iscsi.py | 177 + cinder/volume/drivers/coprhd/scaleio.py | 330 + cinder/volume/drivers/datera.py | 1002 +- .../volume/drivers/dell/dell_storagecenter_api.py | 1565 ++- .../drivers/dell/dell_storagecenter_common.py | 923 +- .../volume/drivers/dell/dell_storagecenter_fc.py | 247 +- .../drivers/dell/dell_storagecenter_iscsi.py | 221 +- cinder/volume/drivers/disco/disco.py | 5 +- cinder/volume/drivers/dothill/dothill_client.py | 7 +- cinder/volume/drivers/dothill/dothill_fc.py | 9 +- cinder/volume/drivers/dothill/dothill_iscsi.py | 5 + cinder/volume/drivers/drbdmanagedrv.py | 91 +- cinder/volume/drivers/emc/emc_cli_fc.py | 307 - cinder/volume/drivers/emc/emc_cli_iscsi.py | 286 - cinder/volume/drivers/emc/emc_vmax_common.py | 337 +- cinder/volume/drivers/emc/emc_vmax_fast.py | 29 +- cinder/volume/drivers/emc/emc_vmax_fc.py | 71 +- cinder/volume/drivers/emc/emc_vmax_iscsi.py | 189 +- cinder/volume/drivers/emc/emc_vmax_masking.py | 324 +- cinder/volume/drivers/emc/emc_vmax_provision.py | 172 +- cinder/volume/drivers/emc/emc_vmax_provision_v3.py | 280 +- cinder/volume/drivers/emc/emc_vmax_utils.py | 384 +- cinder/volume/drivers/emc/emc_vnx_cli.py | 4986 -------- cinder/volume/drivers/emc/scaleio.py | 295 +- cinder/volume/drivers/emc/vnx/__init__.py | 0 cinder/volume/drivers/emc/vnx/adapter.py | 1463 +++ cinder/volume/drivers/emc/vnx/client.py | 566 + cinder/volume/drivers/emc/vnx/common.py | 483 + cinder/volume/drivers/emc/vnx/const.py | 39 + cinder/volume/drivers/emc/vnx/driver.py | 333 + cinder/volume/drivers/emc/vnx/taskflows.py | 579 + cinder/volume/drivers/emc/vnx/utils.py | 339 + cinder/volume/drivers/emc/xtremio.py | 165 +- cinder/volume/drivers/eqlx.py | 152 +- cinder/volume/drivers/falconstor/__init__.py | 0 cinder/volume/drivers/falconstor/fc.py | 113 + cinder/volume/drivers/falconstor/fss_common.py | 399 + cinder/volume/drivers/falconstor/iscsi.py | 105 + cinder/volume/drivers/falconstor/rest_proxy.py | 1530 +++ cinder/volume/drivers/fujitsu/eternus_dx_common.py | 10 +- cinder/volume/drivers/fujitsu/eternus_dx_fc.py | 6 + cinder/volume/drivers/fujitsu/eternus_dx_iscsi.py | 6 + cinder/volume/drivers/fusionstorage/__init__.py | 0 cinder/volume/drivers/fusionstorage/dsware.py | 627 + cinder/volume/drivers/fusionstorage/fspythonapi.py | 499 + cinder/volume/drivers/glusterfs.py | 63 +- cinder/volume/drivers/hgst.py | 6 + cinder/volume/drivers/hitachi/hbsd_common.py | 30 +- cinder/volume/drivers/hitachi/hbsd_fc.py | 5 + cinder/volume/drivers/hitachi/hbsd_iscsi.py | 5 + cinder/volume/drivers/hitachi/hnas_backend.py | 1423 +-- cinder/volume/drivers/hitachi/hnas_iscsi.py | 1099 +- cinder/volume/drivers/hitachi/hnas_nfs.py | 843 +- cinder/volume/drivers/hitachi/hnas_utils.py | 339 + cinder/volume/drivers/hpe/hpe_3par_common.py | 259 +- cinder/volume/drivers/hpe/hpe_3par_fc.py | 172 +- cinder/volume/drivers/hpe/hpe_3par_iscsi.py | 79 +- cinder/volume/drivers/hpe/hpe_lefthand_iscsi.py | 72 +- cinder/volume/drivers/hpe/hpe_xp_fc.py | 21 + cinder/volume/drivers/huawei/constants.py | 15 +- cinder/volume/drivers/huawei/fc_zone_helper.py | 80 +- cinder/volume/drivers/huawei/huawei_conf.py | 47 +- cinder/volume/drivers/huawei/huawei_driver.py | 634 +- cinder/volume/drivers/huawei/huawei_utils.py | 32 +- cinder/volume/drivers/huawei/hypermetro.py | 118 +- cinder/volume/drivers/huawei/replication.py | 42 +- cinder/volume/drivers/huawei/rest_client.py | 316 +- cinder/volume/drivers/ibm/flashsystem_common.py | 141 +- cinder/volume/drivers/ibm/flashsystem_fc.py | 44 +- cinder/volume/drivers/ibm/flashsystem_iscsi.py | 68 +- cinder/volume/drivers/ibm/gpfs.py | 91 +- cinder/volume/drivers/ibm/ibm_storage.py | 292 + .../ibm/storwize_svc/storwize_svc_common.py | 327 +- .../drivers/ibm/storwize_svc/storwize_svc_fc.py | 92 +- .../drivers/ibm/storwize_svc/storwize_svc_iscsi.py | 93 +- cinder/volume/drivers/ibm/xiv_ds8k.py | 285 - .../infortrend/eonstor_ds_cli/cli_factory.py | 12 +- .../volume/drivers/infortrend/infortrend_fc_cli.py | 14 +- .../drivers/infortrend/infortrend_iscsi_cli.py | 14 +- cinder/volume/drivers/kaminario/__init__.py | 0 .../volume/drivers/kaminario/kaminario_common.py | 1151 ++ cinder/volume/drivers/kaminario/kaminario_fc.py | 198 + cinder/volume/drivers/kaminario/kaminario_iscsi.py | 142 + cinder/volume/drivers/lenovo/lenovo_fc.py | 5 + cinder/volume/drivers/lenovo/lenovo_iscsi.py | 5 + cinder/volume/drivers/lvm.py | 177 +- .../volume/drivers/netapp/dataontap/block_7mode.py | 18 +- .../volume/drivers/netapp/dataontap/block_base.py | 121 +- .../volume/drivers/netapp/dataontap/block_cmode.py | 345 +- .../volume/drivers/netapp/dataontap/client/api.py | 191 +- .../netapp/dataontap/client/client_7mode.py | 103 +- .../drivers/netapp/dataontap/client/client_base.py | 46 +- .../netapp/dataontap/client/client_cmode.py | 1307 ++- cinder/volume/drivers/netapp/dataontap/fc_7mode.py | 14 +- cinder/volume/drivers/netapp/dataontap/fc_cmode.py | 15 +- .../volume/drivers/netapp/dataontap/iscsi_7mode.py | 14 +- .../volume/drivers/netapp/dataontap/iscsi_cmode.py | 15 +- .../volume/drivers/netapp/dataontap/nfs_7mode.py | 56 +- cinder/volume/drivers/netapp/dataontap/nfs_base.py | 227 +- .../volume/drivers/netapp/dataontap/nfs_cmode.py | 542 +- .../netapp/dataontap/performance/perf_cmode.py | 13 +- .../volume/drivers/netapp/dataontap/ssc_cmode.py | 644 - .../drivers/netapp/dataontap/utils/__init__.py | 0 .../drivers/netapp/dataontap/utils/capabilities.py | 245 + .../drivers/netapp/dataontap/utils/data_motion.py | 638 + .../drivers/netapp/dataontap/utils/loopingcalls.py | 43 + .../volume/drivers/netapp/dataontap/utils/utils.py | 74 + cinder/volume/drivers/netapp/eseries/client.py | 73 +- cinder/volume/drivers/netapp/eseries/fc_driver.py | 10 +- .../volume/drivers/netapp/eseries/iscsi_driver.py | 11 +- cinder/volume/drivers/netapp/eseries/library.py | 85 +- cinder/volume/drivers/netapp/eseries/utils.py | 3 - cinder/volume/drivers/netapp/options.py | 26 + cinder/volume/drivers/netapp/utils.py | 2 +- cinder/volume/drivers/nexenta/iscsi.py | 22 +- cinder/volume/drivers/nexenta/jsonrpc.py | 31 +- cinder/volume/drivers/nexenta/nexentaedge/iscsi.py | 89 +- .../volume/drivers/nexenta/nexentaedge/jsonrpc.py | 60 +- cinder/volume/drivers/nexenta/nexentaedge/nbd.py | 349 + cinder/volume/drivers/nexenta/nfs.py | 58 +- cinder/volume/drivers/nexenta/ns5/iscsi.py | 16 +- cinder/volume/drivers/nexenta/ns5/jsonrpc.py | 6 - cinder/volume/drivers/nexenta/ns5/nfs.py | 15 +- cinder/volume/drivers/nexenta/options.py | 12 +- cinder/volume/drivers/nexenta/utils.py | 26 +- cinder/volume/drivers/nfs.py | 62 +- cinder/volume/drivers/nimble.py | 119 +- cinder/volume/drivers/prophetstor/dpl_fc.py | 2 + cinder/volume/drivers/prophetstor/dpl_iscsi.py | 2 + cinder/volume/drivers/prophetstor/dplcommon.py | 7 +- cinder/volume/drivers/pure.py | 431 +- cinder/volume/drivers/quobyte.py | 41 +- cinder/volume/drivers/rbd.py | 76 +- cinder/volume/drivers/remotefs.py | 328 +- cinder/volume/drivers/san/hp/hpmsa_fc.py | 2 + cinder/volume/drivers/san/hp/hpmsa_iscsi.py | 2 + cinder/volume/drivers/scality.py | 31 +- cinder/volume/drivers/sheepdog.py | 162 +- cinder/volume/drivers/smbfs.py | 106 +- cinder/volume/drivers/solidfire.py | 534 +- cinder/volume/drivers/synology/__init__.py | 0 cinder/volume/drivers/synology/synology_common.py | 1288 ++ cinder/volume/drivers/synology/synology_iscsi.py | 169 + cinder/volume/drivers/tegile.py | 14 +- cinder/volume/drivers/tintri.py | 11 +- cinder/volume/drivers/violin/v7000_common.py | 466 +- cinder/volume/drivers/violin/v7000_fcp.py | 18 +- cinder/volume/drivers/violin/v7000_iscsi.py | 348 + cinder/volume/drivers/vmware/datastore.py | 333 +- cinder/volume/drivers/vmware/vmdk.py | 175 +- cinder/volume/drivers/vmware/volumeops.py | 147 +- cinder/volume/drivers/vzstorage.py | 462 +- cinder/volume/drivers/windows/smbfs.py | 15 +- cinder/volume/drivers/windows/windows.py | 5 +- cinder/volume/drivers/xio.py | 44 +- cinder/volume/drivers/zadara.py | 680 ++ cinder/volume/drivers/zfssa/zfssaiscsi.py | 88 +- cinder/volume/drivers/zfssa/zfssanfs.py | 81 +- cinder/volume/drivers/zte/__init__.py | 0 cinder/volume/drivers/zte/zte_ks.py | 985 ++ cinder/volume/drivers/zte/zte_pub.py | 59 + cinder/volume/flows/api/create_volume.py | 173 +- cinder/volume/flows/api/manage_existing.py | 36 +- cinder/volume/flows/common.py | 48 +- cinder/volume/flows/manager/create_volume.py | 289 +- cinder/volume/flows/manager/manage_existing.py | 48 +- .../flows/manager/manage_existing_snapshot.py | 33 +- cinder/volume/group_types.py | 180 + cinder/volume/manager.py | 1837 ++- cinder/volume/qos_specs.py | 172 +- cinder/volume/rpcapi.py | 361 +- cinder/volume/targets/cxt.py | 2 +- cinder/volume/targets/fake.py | 3 - cinder/volume/targets/iscsi.py | 23 +- cinder/volume/targets/iser.py | 46 - cinder/volume/targets/scst.py | 27 +- cinder/volume/targets/tgt.py | 5 +- cinder/volume/utils.py | 281 +- cinder/volume/volume_types.py | 62 +- cinder/wsgi/common.py | 3 - cinder/wsgi/eventlet_server.py | 3 - .../drivers/brocade/brcd_fc_san_lookup_service.py | 112 +- .../drivers/brocade/brcd_fc_zone_client_cli.py | 145 +- .../drivers/brocade/brcd_fc_zone_driver.py | 116 +- .../drivers/brocade/brcd_http_fc_zone_client.py | 179 +- .../drivers/brocade/fc_zone_constants.py | 4 +- .../drivers/cisco/cisco_fc_san_lookup_service.py | 4 + .../drivers/cisco/cisco_fc_zone_client_cli.py | 44 +- .../drivers/cisco/cisco_fc_zone_driver.py | 5 + cinder/zonemanager/drivers/driver_utils.py | 21 +- cinder/zonemanager/drivers/fc_zone_driver.py | 60 +- cinder/zonemanager/fc_san_lookup_service.py | 12 +- cinder/zonemanager/fc_zone_manager.py | 102 +- cinder/zonemanager/utils.py | 18 +- etc/cinder/api-paste.ini | 25 +- etc/cinder/policy.json | 44 +- etc/cinder/rootwrap.d/volume.filters | 29 +- releasenotes/README.rst | 16 + ...te-fc-vlun-match-set-type-babcf2cbce1ce317.yaml | 5 + ...SC-ServerOS-Config-Option-bd0e018319758e03.yaml | 8 + .../Dell-SC-live-volume-41bacddee199ce83.yaml | 4 + ...on-failover_host-failback-a9e9cbbd6a1be6c3.yaml | 4 + .../notes/ZadaraStorage-13a5fff6f4fa1710.yaml | 3 + ...chastic-scheduling-option-99e10eae023fbcca.yaml | 11 + ...ss-lvm-fd-warnings-option.402bebc03b0a9f00.yaml | 17 + ...lume-upload-image-options-3a61a31c544fa034.yaml | 4 + ...ow-admin-quota-operations-c1c2236711224023.yaml | 4 + ...scription-for-consisgroup-408257a0a18bd530.yaml | 3 + .../apply-limits-to-qemu-img-29f722a1bf4b91f8.yaml | 7 + .../notes/backup-snapshot-6e7447db930c31f6.yaml | 4 + .../notes/backup-update-d0b0db6a7b1c2a5b.yaml | 3 + .../notes/bdd-pools-stats-afb4398daa9248de.yaml | 3 + ...-cinder-driver-update-2.1-5c6455b45563adc5.yaml | 7 + ...ookupservice_http_support-f6485b38a1feaa15.yaml | 5 + .../notes/bug-1518213-a5bf2ea0d008f329.yaml | 3 + .../notes/bug-1570845-efdb0206718f4ca4.yaml | 4 + ...h-enabled-NetApp-backends-0fbf2cb621e4747d.yaml | 5 + ...ng-replication-capability-dca29f39b9fa7651.yaml | 5 + .../cinder-coprhd-driver-11ebd149ea8610fd.yaml | 2 + .../cluster_job_distribution-f916dd2e4cce6c1b.yaml | 20 + .../create-update-rules-b46cf9c07c5a3966.yaml | 6 + .../datera-2.2-driver-update-28b97aa2aaf333b6.yaml | 12 + .../db-schema-from-kilo-e6e952744531caa2.yaml | 5 + .../notes/del_volume_with_fc-f024b9f2d6eaca0f.yaml | 4 + ...lete-volume-metadata-keys-3e19694401e13d00.yaml | 4 + ...ecate-backends-in-default-b9784a2333fe22f2.yaml | 10 + .../notes/deprecated-nas-ip-fd86a734c92f6fae.yaml | 5 + .../drbd-resource-options-88599c0a8fc5b8a3.yaml | 6 + ...lx-volume-manage-unmanage-a24ec7f0d9989df3.yaml | 3 + .../falconstor-cinder-driver-dcb61441cd7601c5.yaml | 4 + .../fix-hnas-stats-reporting-1335e582e46ff440.yaml | 4 + ...sionstorage-cinder-driver-8f3bca98f6e2065a.yaml | 3 + .../generic-volume-groups-69f998ce44f42737.yaml | 4 + .../notes/group-snapshots-36264409bbb8850c.yaml | 4 + .../group-type-group-specs-531e33ee0ae9f822.yaml | 3 + .../hnas-drivers-refactoring-9dbe297ffecced21.yaml | 7 + ...unmanage-snapshot-support-40c8888cc594a7be.yaml | 3 + .../notes/hnas_deprecate_xml-16840b5a8c25d15e.yaml | 7 + ...i-iscsi-multipath-support-a056201883909287.yaml | 3 + ...wei-pool-disktype-support-7c1f64639b42a48a.yaml | 4 + ...figuration-in-replication-7ec53737b95ffa54.yaml | 3 + ...es-in-netapp-cdot-drivers-f6afa9884cac4e86.yaml | 4 + ...ashsystem-manage-unmanage-88e56837102f838c.yaml | 4 + ...-consistency-group-detail-84a906d45383e067.yaml | 5 + ...aminario-fc-cinder-driver-8266641036281a44.yaml | 3 + ...nario-iscsi-cinder-driver-c34fadf63cd253de.yaml | 3 + .../notes/list-manageable-86c77fc39c5b2cc9.yaml | 5 + .../notes/live_migration_v3-ae98c0d00e64c954.yaml | 3 + .../manage-resources-v3-c06096f75927fd3b.yaml | 4 + .../mark-scality-unsupported-530370e034a6f488.yaml | 11 + ...ckend-replication-support-59d7537fe3d0eb05.yaml | 8 + ...consistency-group-support-83eccc2da91ee19b.yaml | 3 + .../notes/nexentaedge-iscsi-ee5d6c05d65f97af.yaml | 3 + .../notes/nexentaedge-nbd-eb48268723141f12.yaml | 2 + .../nimble-add-force-backup-539e1e5c72f84e61.yaml | 3 + .../notes/os-brick-lock-dir-35bdd8ec0c0ef46d.yaml | 9 + .../pure-custom-user-agent-dcca4cb44b69e763.yaml | 4 + .../pure-eradicate-on-delete-1e15e1440d5cd4d6.yaml | 2 +- .../notes/pure-fc-wwpn-case-c1d97f3fa7663acf.yaml | 5 + .../pure-list-mangeable-fed4a1b23212f545.yaml | 4 + ...tings-larger-than-1024MiB-30b38811da048948.yaml | 4 + .../notes/remove-xml-api-392b41f387e60eb1.yaml | 5 + .../notes/removed-isertgtadm-7ccefab5d3e89c59.yaml | 8 + ...-rpc-topic-config-options-21c2b3f0e64f884c.yaml | 6 + ...e_xiv_ds8k_to_ibm_storage-154eca69c44b3f95.yaml | 15 + .../retype-encrypted-volume-49b66d3e8e65f9a5.yaml | 4 + .../notes/rpc-apis-3.0-b745f429c11d8198.yaml | 8 + ...fault-volume-provisioning-c648118fcc8f297f.yaml | 5 + ...-manage-existing-snapshot-5bbd1818654c0776.yaml | 3 + .../scaleio-scaling-qos-50c58e43d4b54247.yaml | 4 + ...thin-provisioning-support-9c3b9203567771dd.yaml | 9 + ...olidfire-v2.1-replication-570a1f12f70e67b4.yaml | 3 + ...-huawei-consistency-group-b666f8f6c6cddd8f.yaml | 3 + ...ume-glance-metadata-query-866b9e3beda2cd55.yaml | 5 + .../notes/supported-drivers-9c95dd2378cd308d.yaml | 3 + .../synology-volume-driver-c5e0f655b04390ce.yaml | 3 + ...use-castellan-key-manager-4911c3c4908ca633.yaml | 15 + ...oslo_middleware_sizelimit-5f171cf1c44444f8.yaml | 9 + ...sk-format-upload-to-image-5851f9d35f4ee447.yaml | 3 + .../vmax-iscsi-multipath-76cc09bacf4fdfbf.yaml | 3 + .../vmax-oversubscription-d61d0e3b1df2487a.yaml | 3 + releasenotes/notes/vmax-qos-eb40ed35bd2f457d.yaml | 3 + .../vmdk_backup_restore-41f807b7bc8e0ae8.yaml | 4 + ...efault_task_poll_interval-665f032bebfca39e.yaml | 5 + .../notes/vmdk_image_ova-d3b3a0e72221110c.yaml | 5 + .../notes/vmdk_vc_51-df29eeb5fc93fbb1.yaml | 4 + .../notes/vmem-7000-iscsi-3c8683dcc1f0b9b4.yaml | 3 + .../notes/vmware-vmdk-config-eb70892e4ccf8f3c.yaml | 4 + .../vmware_vmdk_paravirtual-3d5eeef96dcbcfb7.yaml | 4 + .../notes/vnx-new-driver-7e96934c2d3a6edc.yaml | 15 + .../notes/volumes-summary-6b2485f339c88a91.yaml | 4 + .../xtremio-manage-snapshot-5737d3ad37df81d1.yaml | 3 + .../notes/zte_cinder_driver-76ba6d034e1b6f65.yaml | 4 + releasenotes/source/index.rst | 3 +- releasenotes/source/mitaka.rst | 6 + requirements.txt | 54 +- setup.cfg | 13 +- test-requirements.txt | 15 +- tools/bandit.yaml | 128 - tools/config/check_uptodate.sh | 67 +- tools/config/generate_sample.sh | 105 - tools/enable-pre-commit-hook.sh | 2 +- tools/generate_driver_list.py | 146 +- tools/lintstack.py | 79 +- tox.ini | 66 +- 1307 files changed, 240446 insertions(+), 166914 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 5c2d858..64c1c3a 100644 --- a/requirements.txt +++ b/requirements.txt @@ -6 +6 @@ pbr>=1.6 # Apache-2.0 -Babel>=1.3 # BSD +Babel>=2.3.4 # BSD @@ -12,2 +12,4 @@ httplib2>=0.7.5 # MIT -iso8601>=0.1.9 # MIT -keystonemiddleware!=4.1.0,>=4.0.0 # Apache-2.0 +iso8601>=0.1.11 # MIT +ipaddress>=1.0.7;python_version<'3.3' # PSF +keystoneauth1>=2.10.0 # Apache-2.0 +keystonemiddleware!=4.1.0,!=4.5.0,>=4.0.0 # Apache-2.0 @@ -16,4 +18,4 @@ oauth2client>=1.5.0 # Apache-2.0 -oslo.config>=3.7.0 # Apache-2.0 -oslo.concurrency>=3.5.0 # Apache-2.0 -oslo.context>=0.2.0 # Apache-2.0 -oslo.db>=4.1.0 # Apache-2.0 +oslo.config>=3.14.0 # Apache-2.0 +oslo.concurrency>=3.8.0 # Apache-2.0 +oslo.context>=2.9.0 # Apache-2.0 +oslo.db!=4.13.1,!=4.13.2,>=4.10.0 # Apache-2.0 @@ -21 +23 @@ oslo.log>=1.14.0 # Apache-2.0 -oslo.messaging>=4.0.0 # Apache-2.0 +oslo.messaging>=5.2.0 # Apache-2.0 @@ -23 +25,2 @@ oslo.middleware>=3.0.0 # Apache-2.0 -oslo.policy>=0.5.0 # Apache-2.0 +oslo.policy>=1.9.0 # Apache-2.0 +oslo.privsep>=1.9.0 # Apache-2.0 @@ -25 +28 @@ oslo.reports>=0.6.0 # Apache-2.0 -oslo.rootwrap>=2.0.0 # Apache-2.0 +oslo.rootwrap>=5.0.0 # Apache-2.0 @@ -27,5 +30,5 @@ oslo.serialization>=1.10.0 # Apache-2.0 -oslo.service>=1.0.0 # Apache-2.0 -oslo.utils>=3.5.0 # Apache-2.0 -oslo.versionedobjects>=1.5.0 # Apache-2.0 -osprofiler>=1.1.0 # Apache-2.0 -paramiko>=1.16.0 # LGPL +oslo.service>=1.10.0 # Apache-2.0 +oslo.utils>=3.16.0 # Apache-2.0 +oslo.versionedobjects>=1.13.0 # Apache-2.0 +osprofiler>=1.4.0 # Apache-2.0 +paramiko>=2.0 # LGPLv2.1+ @@ -36,3 +39,3 @@ pyparsing>=2.0.1 # MIT -python-barbicanclient>=3.3.0 # Apache-2.0 -python-glanceclient>=2.0.0 # Apache-2.0 -python-keystoneclient!=1.8.0,!=2.1.0,>=1.6.0 # Apache-2.0 +python-barbicanclient>=4.0.0 # Apache-2.0 +python-glanceclient!=2.4.0,>=2.3.0 # Apache-2.0 +python-keystoneclient!=2.1.0,>=2.0.0 # Apache-2.0 @@ -42 +45 @@ pytz>=2013.6 # MIT -requests!=2.9.0,>=2.8.1 # Apache-2.0 +requests>=2.10.0 # Apache-2.0 @@ -44,2 +47,2 @@ retrying!=1.3.0,>=1.2.3 # Apache-2.0 -Routes!=2.0,!=2.1,>=1.12.3;python_version=='2.7' # MIT -Routes!=2.0,>=1.12.3;python_version!='2.7' # MIT +Routes!=2.0,!=2.1,!=2.3.0,>=1.12.3;python_version=='2.7' # MIT +Routes!=2.0,!=2.3.0,>=1.12.3;python_version!='2.7' # MIT @@ -52,2 +55,2 @@ sqlalchemy-migrate>=0.9.6 # Apache-2.0 -stevedore>=1.5.0 # Apache-2.0 -suds-jurko>=0.6 # LGPL +stevedore>=1.16.0 # Apache-2.0 +suds-jurko>=0.6 # LGPLv3+ @@ -56,2 +59,2 @@ oslo.i18n>=2.1.0 # Apache-2.0 -oslo.vmware>=1.16.0 # Apache-2.0 -os-brick>=1.0.0 # Apache-2.0 +oslo.vmware>=2.11.0 # Apache-2.0 +os-brick>=1.6.1 # Apache-2.0 @@ -60,0 +64 @@ google-api-python-client>=1.4.2 # Apache-2.0 +castellan>=0.4.0 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index 866a3cb..7fb4e7c 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -11,2 +11,2 @@ ddt>=1.0.1 # MIT -fixtures>=1.3.1 # Apache-2.0/BSD -mock>=1.2 # BSD +fixtures>=3.0.0 # Apache-2.0/BSD +mock>=2.0 # BSD @@ -14,2 +14 @@ mox3>=0.7.0 # Apache-2.0 -PyMySQL>=0.6.2 # MIT License -psycopg2>=2.5 # LGPL/ZPL +os-api-ref>=1.0.0 # Apache-2.0 @@ -17 +16 @@ oslotest>=1.10.0 # Apache-2.0 -sphinx!=1.2.0,!=1.3b1,<1.3,>=1.1.2 # BSD +sphinx!=1.3b1,<1.3,>=1.2.1 # BSD @@ -24 +23 @@ oslosphinx!=3.4.0,>=2.5.0 # Apache-2.0 -os-testr>=0.4.1 # Apache-2.0 +os-testr>=0.7.0 # Apache-2.0 @@ -26,2 +25,2 @@ tempest-lib>=0.14.0 # Apache-2.0 -bandit>=0.17.3 # Apache-2.0 -reno>=0.1.1 # Apache2 +bandit>=1.1.0 # Apache-2.0 +reno>=1.8.0 # Apache2

1 0

[new][freezer] freezer-api 3.0.0 release (newton)
by no-reply＠openstack.org 06 Oct '16

06 Oct '16

We are happy to announce the release of: freezer-api 3.0.0: OpenStack Backup and Restore API Service This release is part of the newton release series. For more details, please see below. Changes in freezer-api 2.0.0.0rc1..3.0.0 ---------------------------------------- 61f1b37 Change default value of elasticsearch replicas 5ba9b68 Update .gitreview for stable/newton 2ff22ec Updated from global requirements 977ca7c Implemented: Installation documentation and API Ref 83041ce Updated from global requirements de7b8ec Update mappings to store current process id for each job 733bfe7 Get auth opts from appropriate getter d44c089 Fixed elasticsearch scroll problem in scan search 247694c Fix wrong option group name ce09bbf Implemented oslo.policy 0c2278c Fixed Error reporting while load freezer-api app fd98698 Project/tenant ID now optional in client_id for freezer_api 7c340ee Fix inconsistent syntax in mappings ff594fe Fix bug in README.rst 5db9ce7 Remove discover from test-requirements 338b925 Fix Rst grammar avoid to change every time when change order afe97aa freezer API document error in README.rst 57cbc5a Return an error for negative limits and offsets 10ec5e3 client_id regex now permits valid fqdn for hostname 0fef37e Listen on 127.0.0.1 in devstack 6cbd042 Add display-name to freezer-api Apache config 65cde89 Fixes 'ElastichSearch' typo -> 'ElasticSearch' in freezer-api 5847d70 Remove white space between print and () 964f6e7 Fix falcon version detection for falcon==0.1.6 1d0ecea Updated from global requirements a28be05 Fix Middleware loading for falcon >= 0.1.6 5a99029 freezer-api README.rst needs to be updated bb5ba82 fix job-stop request not accepted 3345c53 Fixed mapper_parser_error in elasticsearch when inserting documents with _version 9a46ed1 Make user_id not_analyzed 94200bc Moving to freezer-manage to create/update/delete mappings 42f1c84 [WIP] Fix tempest credentials issue a94ea3f Remove _version from the document passed to elk 57eb687 Fix RST syntax in tempest tests README 44f8639 Add oslo.middleware to requirement.txt 0657535 Remove version from setup.cfg 525c7f1 Move to Paste and Paste-deploy 562a92f fix typo in jobs.py fe2a5cf Remove version string from elk documents ab486ba Don't check for content-type in requests 0b5f4fc Fix RST error in README fc37320 Fix RST syntax in README b142479 Moving to falcon middleware 67a8bdb Remove version when creating records in elasticsearch 24bac2a Add missing api tests for the backups endpoints e67bc70 Updating freezer-api mappings adding no_incremental and overwite 213391d Add consistency_checksum parameter on backup metadata 31558ae Using oslo.context 39ac6c3 Fix documentation: There is no update endpoint for backups efe376d Fix documentation: offset instead of marker cf688c0 Fix oslo.config to load elk opts from the config file 3e95bc6 Fix refresh problem when a document gets created in elasticsearch ab84438 fix session-remove-job 4ce9a67 Remove apache config file after cleanup freezer api 131c4ae Bumping version to 2.1.0 for Newton b0735e2 Add Freezer API Tempest Tests 1532791 Adding storage, keystone_authtoken sections to sample config d4e727d Switch Freezer-api to oslo.config and oslo.log ea70bbc This is incorrect url in example doc and conf 13f0b7b Add Freezer API Version Test e38f650 Fix url from stackforge to openstack Diffstat (except docs and test files) ------------------------------------- .gitreview | 1 + .pylintrc | 2 +- README.rst | 537 +++++++++++++-------- api-ref/source/conf.py | 206 ++++++++ api-ref/source/index.rst | 20 + api-ref/source/parameters.yaml | 8 + api-ref/source/samples/versions-list-response.json | 15 + api-ref/source/versions.inc | 38 ++ config-generator/freezer-api.conf | 6 + devstack/README.rst | 2 +- devstack/files/apache-freezer-api.template | 8 +- devstack/gate_hook.sh | 1 + devstack/lib/freezer-api | 31 +- devstack/local.conf.example | 2 +- devstack/settings | 4 +- etc/freezer-api.conf | 60 --- etc/freezer/freezer-api.conf.sample | 354 ++++++++++++++ etc/freezer/freezer-paste.ini | 26 + etc/freezer/policy.json | 39 ++ freezer_api/__init__.py | 21 + freezer_api/api/common/middleware.py | 210 +++++++- freezer_api/api/common/utils.py | 56 +++ freezer_api/api/v1/actions.py | 11 +- freezer_api/api/v1/backups.py | 9 +- freezer_api/api/v1/clients.py | 13 +- freezer_api/api/v1/homedoc.py | 1 + freezer_api/api/v1/jobs.py | 37 +- freezer_api/api/v1/sessions.py | 22 +- freezer_api/cmd/api.py | 123 +++-- freezer_api/cmd/db_init.py | 26 +- freezer_api/cmd/manage.py | 353 ++++++++++++++ freezer_api/cmd/wsgi.py | 19 + freezer_api/common/config.py | 119 ++++- freezer_api/common/db_mappings.py | 145 +++--- freezer_api/common/exceptions.py | 2 +- freezer_api/common/json_schemas.py | 29 +- freezer_api/common/log.py | 62 --- freezer_api/context.py | 72 +++ freezer_api/policy.py | 42 ++ freezer_api/service.py | 56 +++ freezer_api/storage/driver.py | 85 ++-- freezer_api/storage/elastic.py | 34 +- .../services/freezer_api_client.py | 181 +++++++ install-guide/source/actions.rst | 27 ++ install-guide/source/api_documents.rst | 12 + install-guide/source/api_routes.rst | 79 +++ install-guide/source/client_structure.rst | 29 ++ install-guide/source/conf.py | 291 +++++++++++ install-guide/source/devstack_plugin.rst | 48 ++ install-guide/source/get_started.rst | 27 ++ install-guide/source/index.rst | 23 + install-guide/source/install.rst | 158 ++++++ install-guide/source/jobs.rst | 357 ++++++++++++++ install-guide/source/known_issues.rst | 22 + install-guide/source/metadata_structure.rst | 55 +++ install-guide/source/sessions.rst | 104 ++++ requirements.txt | 19 +- setup.cfg | 10 +- setup.py | 25 +- specs/Freezer-API-spec.rst | 33 +- test-requirements.txt | 21 +- tox.ini | 8 + 90 files changed, 5554 insertions(+), 919 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index e7900ce..3562212 100644 --- a/requirements.txt +++ b/requirements.txt @@ -1 +1,4 @@ -elasticsearch>=1.3.0,<2.0 # Apache-2.0 +# The order of packages is significant, because pip processes them in the order +# of appearance. Changing the order has an impact on the overall integration +# process, which may cause wedges in the gate later. +elasticsearch<=3.0.0,>=2.0.0 # Apache-2.0 @@ -3,4 +6,10 @@ falcon>=0.1.6 # Apache-2.0 -jsonschema>=2.0.0,<3.0.0,!=2.5.0 # MIT -keystonemiddleware>=4.0.0 # Apache-2.0 -oslo.config>=3.2.0 # Apache-2.0 -oslo.i18n>=1.5.0 # Apache-2.0 +jsonschema!=2.5.0,<3.0.0,>=2.0.0 # MIT +keystonemiddleware!=4.1.0,!=4.5.0,>=4.0.0 # Apache-2.0 +Paste # MIT +PasteDeploy>=1.5.0 # MIT +oslo.config>=3.14.0 # Apache-2.0 +oslo.context>=2.9.0 # Apache-2.0 +oslo.i18n>=2.1.0 # Apache-2.0 +oslo.log>=1.14.0 # Apache-2.0 +oslo.middleware>=3.0.0 # Apache-2.0 +oslo.policy>=1.9.0 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index 777fcf5..6aadb34 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -1,4 +1,7 @@ -astroid<1.4.0 # breaks pylint 1.4.4 -flake8>2.4.1,<2.6.0 # MIT -pylint==1.4.5 # GNU GPL v2 -hacking>=0.10.2,<0.11 # Apache-2.0 +# The order of packages is significant, because pip processes them in the order +# of appearance. Changing the order has an impact on the overall integration +# process, which may cause wedges in the gate later. +astroid<1.4.0 # LGPLv2.1 # breaks pylint 1.4.4 +flake8<2.6.0,>=2.5.4 # MIT +pylint==1.4.5 # GPLv2 +hacking<0.11,>=0.10.2 # Apache-2.0 @@ -6,3 +9,2 @@ coverage>=3.6 # Apache-2.0 -discover # BSD -mock>=1.2 # BSD -oslosphinx>=2.5.0,!=3.4.0 # Apache-2.0 +mock>=2.0 # BSD +oslosphinx!=3.4.0,>=2.5.0 # Apache-2.0 @@ -10 +12 @@ python-subunit>=0.0.18 # Apache-2.0/BSD -sphinx>=1.1.2,!=1.2.0,!=1.3b1,<1.3 # BSD +sphinx!=1.3b1,<1.3,>=1.2.1 # BSD @@ -12,0 +15 @@ testtools>=1.4.0 # MIT +os-api-ref>=1.0.0 # Apache-2.0 @@ -15 +18 @@ testtools>=1.4.0 # MIT -tempest-lib>=0.14.0 # Apache-2.0 +tempest-lib>=0.14.0 # Apache-2.0

1 0

[new][heat] heat 7.0.0 release (newton)
by no-reply＠openstack.org 06 Oct '16

06 Oct '16

We are amped to announce the release of: heat 7.0.0: OpenStack Orchestration This release is part of the newton release series. For more details, please see below. 7.0.0 ^^^^^ Previously 'parameters' and 'parameter_defaults' specified in an environment file used to overwrite their existing values. Previously the event list REST API call only returned events for the specified stack even when that stack contained nested stack resources. This meant that fetching all nested events required an inefficient recursive client-side implementation. Support external resource reference in template. New Features ************ * Add *template_dir* to config. Normally heat has template directory */etc/heat/templates*. This change makes it more official. In the future, it is possible to implement features like access templates directly from global template environment. * Adds optional section "conditions" for hot template ( heat_template_version.2016-10-14) and "Conditions" for cfn template (AWSTemplateFormatVersion.2010-09-09). * Adds some condition functions, like "equals", "not", "and" and "or", these condition functions can be used in "conditions" section to define one or more conditions which are evaluated based on input parameter values provided when a user creates or updates a stack. * Adds optional section "condition" for resource and output definitions. Condition name defined in "conditions" and condition functions can be referenced in this section, in order to conditionally create resources or conditionally give outputs of a stack. * Adds function "if" to return corresponding value based on condition evaluation. This function can be used to conditionally set the value of resource properties and outputs. * OS::Cinder::QoSSpecs resource plugin added to support cinder QoS Specs, which is provided by cinder "qos-specs" API extension. * cinder.qos_specs constraint added to support to validate QoS Specs attribute. * New resource "OS::Cinder::Quota" is added to manage cinder quotas. Cinder quotas are operational limits to projects on cinder block storage resources. These include gigabytes, snapshots, and volumes. * Adds new 'max_server_name_length' configuration option which defaults to the prior upper bound (53) and can be lowered by users (if they need to, for example due to ldap or other internal name limit restrictions). * Supports internal DNS resolution and integration with external DNS services for neutron resources. Template authors can use the "dns_name" and "dns_domain" properties of neutron resource plugins for this functionality. * A new 'parameter_merge_strategies' section can be added to the environment file, where 'default' and/or parameter specific merge strategies can be specified. * Parameters and parameter defaults specified in the environment file would be merged as per their specified strategies. * The event list GET REST API call now has a different behaviour when the 'nested_depth' parameter is set to an integer greater than zero. The response will contain all events down to the requested nested depth. * When 'nested_depth' is set the response also includes an extra entry in the 'links' list with 'rel' set to 'root_stack'. This can be used by client side implementations to detect whether it is necessary to fall back to client-side recurisive event fetching. * Add *external_id* attribute for resource to reference on an exists external resource. The resource (with *external_id* attribute) will not able to be updated. This will keep management rights stay externally. * This feature only supports templates with version over *2016-10-14*. * OS::Glance::Image resource plug-in is updated to support tagging when image is created or updated as part of stack. * Add "map_replace" function, that takes 2 arguments an input map and a map containing a "keys" and/or "values" map. key/value substitutions on the input map are performed based on the mappings passed in "keys" and "values". * Add optional 'period' property for Monasca Notification resource. The new added property will now allow the user to tell Monasca the interval in seconds to periodically invoke a webhook until the ALARM state transitions back to an OK state or vice versa. This is useful when the user wants to create a stack which will automatically scale up or scale down more than once if the alarm state continues to be in the same state. To conform to the existing Heat autoscaling behaviour, we manually create the monasca notification resource in Heat with a default interval value of 60. * OS::Monasca::AlarmDefinition and OS::Monasca::Notification resource plug-ins are now supported by heat community as monasca became offcial OpenStack project. * Add "yaql" function, that takes 2 arguments "expression" of type string and "data" of type map and evaluates "expression" on a given "data". Upgrade Notes ************* * New config section "volumes" with new config option "[volumes]backups_enabled" (defaults to "True"). Operators that do not have Cinder backup service deployed in their cloud are encouraged to set this option to "False". Bug Fixes ********* * Allow to configure Heat service to forbid creation of stacks containing Volume resources with "deletion_policy" set to "Snapshot" when there is no Cinder backup service available. Changes in heat 6.0.0.0rc1..7.0.0 --------------------------------- e59f927 Get rid of circular reference in Event class ee86435 Increase the timeout for the stop_stack message fb26ec9 Do not attempt deletion of a DELETE_COMPLETE stack in service api a96d89b Don't use cast() to do StackResource delete 9ece778 Fix cancel update for nova server with defined port c6bc3fe Re-trigger on update-replace 2dd44db Legacy delete attempt thread cancel before stop 9ea43ed Updated from global requirements 25fbedc Cancel traversal of nested stack d26c903 Correct the response info of template-version-list c7fe0ba Fix sync point delete 14a90d6 Use correct schema for SoftwareDeploymentGroup rolling_update 80081db Update UPPER_CONSTRAINTS_FILE for stable/newton 4695f47 Don't acquire the lock when cancelling a stack 5443453 Allow update inplace for allowed_address_pairs 4a57772 Don't log locked resource at ERROR level 8938a26 Update .gitreview for stable/newton fbc0021 Make get_attr consistent across template versions 90d8ab6 Avoid circular references in Macro class 97483d5 Do str_replace in a single pass 0b5b21c Skip resource counting during validation c7e3b8b Add releasenote for conditions function 6d0e8e9 Always use context manager for DB transactions 4a92678 Allows condition name using boolean or function b67605d Refactor resource definition parsing in HOT/cfn 50bc53a Create ResourceDefinitions directly in ResourceGroup/Chain bca8b8e Allow referencing conditions by name 4090dfe Refactor boolean condition functions 8262265 Make cfn functions inherit from HOT 0327c33 Ensure cached conditions match stack 7b129f6 Copy correct definition to the backup stack b76f5b6 Add functional test for SDG rolling_update 6d61a7a Create a public Conditions class API d98d821 Raise StackValidationFailed instead of InvalidCondition* f18e57e Revert "Improve validation for some functions" 24bc69f Add way to use custom paths in translation 9b302b8 Add test for SoftwareDeploymentGroup resource 6dc3ab9 Deletion of in-progress stack 0f48b1d Convergence: Run scenario tests synchronously 873a408 Convergence: basic framework for cancelling workers 503108a Non-destructive upgrade for structured deployments 4d7257a Override the default Template.outputs() implementation 7de1c14 Handle outputs with an OutputDefinition class d792364 Updated from global requirements 0d3bed1 Update plugin-guide documentation page 27aea71 Add releasenotes for OS::Cinder::QoSSpecs 8167a21 standardize release note page ordering e417fc3 Revert "Allow reference conditions by name" f655726 Restore timezone information in API response 29734db [api-ref] Remove temporary block in conf.py 8563762 Allow hyphens in OS::Trove::Instance database names 9ce052f Lazy-load outputs cdae301 Trivial: remove unused LOG attribute 7ea3586 Migrate to keystoneauth 1fb6859 Use keystone session in endpoint_utils 4a8ad39 Allow reference conditions by name c99165d Pre-validate cinder quotas with the real fact cc94806 Correcting parameter type c650b38 Cinder::Volume observe reality implementation 1744d67 Get rid of Template.validate_condition_definitions() 9bd13ad Evaluate resource conditions in-place 576d092 Use physical name in event if resource_id is None edea948 Get rid of extra_rsrc_defn in templates e3a2432 Modify use of assertTrue(A in B) 3aeaefc Non-destructive upgrade for deprecated resources 9f9cb4b Deprecate Template.validate_resource_definitions() 795041c Deprecate Template.validate_resource_key_type() bc1adff Add unit tests for invalid keys in resources fdcba53 Prevent direct access to conditions in templates b26d28b Don't add new abstract methods to Template class 17c61da Provide default implementation of _parser_condition_functions 09042cc Call base __init__ from FakeHTTPClient 9982fd8 Remove _get_client_args() from client_plugin 567e93a Use heat functions from plugin for upgrade 14616c1 raw_template_files_get always use context session 094a146 Allow any data to be passed to yaql function 0641625 Updated from global requirements d8260b7 Correct link reference in heat/doc a3df3f8 [api-ref] Rewrite the Heat API version 7afb32b Don't run neutron tests before upgrade 860b927 Updated from global requirements 2c5fdb4 Unify getting properties for method of Server res c898c77 Properly evaluate yaql expressions c19c71a Config logABug feature for heat api-ref 3fbc60e Add cinder qos specs constraint 6522de8 Minor fix for hot_spec.rst 831e23d Add OS::Cinder::QoSSpecs bfd8d7b Provide 'or' function 3f64680 Add doc and reno note for environment merging 6aa4967 Aodh::Gnocchi resources observe reality implementation b22cd9d Change type of X-Openstack-Request-Id 93bbf92 Updated from global requirements c00e776 Fix senlin profile/policy type constraint check 2656e35 Delete mox.stubs in heat 97ceec2 Updated from global requirements d446b2f Improve efficiency of SoftwareDeployment updates 3552246 Fix incorrect behaviour of repeat function 80bc4fb Convert props form delimited params to lists f95a805 Validate that python3 is ready for loguserdata e3cc29c Improve validation in OS::Monasca::Notification 9c79ee4 Add interrupt points for convergence check-resource operations b5a7d14 Add new resource l7rule 3e6edb2 Clean imports in code 1e03e62 Minor fix for senlin cluster update 73a1eed Check action status instead of cluster status for cluster creation 3ba521e Updated from global requirements 8fcebfa Fix building derived inputs from a derived config 6fa325e Provide 'and' function 8d390d6 Stop using mox.stubs in heat 2726c95 Refactor senlin node update logic 3ca7493 Add 'resources' to error msg path if res' condition invalid 20ccad0 Updated from global requirements aeb15bf Provides 'not' condition function 4c4d790 Provides 'if' intrinsic function 4af3247 Add a Macro class to heat.engine.function 4552e08 Support condition for output bbb1dfb Fix SoftwareDeployment when dealing with deleted configs af62cba Add functional test coverage for files API d41452f Use correct args to resolve senlin node attributes 59476f6 Support condition for resource 0ff37ff Don't raise error in custom guidelines on IOError af09656 Check action status instead of node status for node creation 25fa722 Add action check function to senlin plugin a9a45e5 Updated from global requirements e154961 Include heat_integrationtests in setup.py install 084d0eb Convergence cancel update implementation 654b334 Fix problems left in api-ref 78d56b1 Convergence: fix input to check_stack_complete 1bb21c5 Delete RoleAssignment if user/group does not exist 68c015a Refactor validate_resource_definitions() 4c8294d Use param_schema and merge strategy for merging 35a2dd9 Refactor to use param_schemata with env merge 5b0fe81 Improve deep merge for parameters 59b2a55 Move merge_environment to environment_util module 36a0ad2 Add valid merge strategies 68944d2 Migrate stacks from legacy to convergence engine cd04e9e api-ref - software config status codes 772c897 api-ref - template version and functions 623c5a5 api-ref - stack actions 50f3841 api-ref - events 2286eae api-ref - stack snapshots 81d92be api-ref - stack resources 14a7304 api-ref - services/stack-outputs doc 5a43527 api-ref - stack identity usage in find calls 84b1d89 api-ref - build/resource-type/versions c3fd83a Updated from global requirements f3103c6 Add OS::Heat::Value resource 3202da7 Get ready for os-api-ref sphinx theme change 959b569 api-ref doc for stack (5) b65b38d Add new environment section for merge strategies 9a768ce Correct mistaken parameters of test_hacking.py in tests 5210589 Move NoActionRequired exception back where it belongs c5ebe66 Begin move of UpdateReplace back to its rightful location 285802b Add a replace_on_change option to the SW Config input schema 60e90c0 Add reno note on volumes.backups_enabled option cba1098 Override client() for RoleAssignment resources 77a1011 EncryptedVolumeType observe reality implement 6cbfdb9 Cinder::VolumeType observe reality implementation 772ef5e api-ref doc for stack (4) 652a1a8 Add v2 glance image props a2a028b api-ref doc for stack (3) d130a72 api-ref doc for stack (2) fa39e4b api-ref doc for stack (1) 7792776 Split stack api-ref doc into three files e7e13ca Handle case where the Nova AZ extension is disabled 7954bcf Add OS::Cinder::Quota resource c283f8b Don't use config option sqlite_db eb8b9b8 Parse JSON as JSON when converting to YAML bd1ea9e Log missing clients as WARNING instead of ERROR 9811510 Nova::HostAggregate observe reality implement 1f88c67 Remove tenant_safe flag from rpc and db api e8f6c36 Clean imports in code bc3b84f A context cache for Resource objects 3ab0ede Always eager load the raw_template for a stack d072f6e Add validating of section 'conditions' fab4fe7 Load resources from DB for resource list fff6518 Run heat_integrationtests as a tempest plugin 2af6c6f Do not use env var conf defaults 6d8f296 Use a variable for which conf file to write to 6b576ff Use tempest.conf when running under tempest 80b8ce1 Don't manipulate config for admin creds 00a1814 Register heat tempest plugin d21be7d Depend on tempest in test-requirements.txt a2f5b5c Perform str_replace trying to match longest string first 9fc7b1d Support maps as argument for repeat/for_each b1da94e Add validate for external resources. c385388 Add support for a resource level external_id 6f3b9b7 Updated from global requirements 168a779 Use is_admin_project from context d019947 Updated from global requirements 3cf288b no need to run integration tests in upgrade ed08e4f Put common implementation of HOT/CFN into new class d66ea4c Move 'validate_section' to hot/template.py dd9ede9 Validate the input/output configs in Software Config e79727d Single definition of top-level SoftwareConfig keys d12161c Catch NotSupported when cancelling a nested stack c801b22 Update HOT template guide preface b1617c8 Set properties to before_props before calling handle_update 96e9ff0 Fix devstack plugin 49bc52e Updated from global requirements 6c2e0c9 Fix resouce group resource removal policy name inconsistency with DB 8ee3e58 Fix api-ref doc for software deployment. 1243dc3 Fix software config api-ref doc 025c4fe Don't change properties in regenerate_info_schema 05007cf Unit tests: Use Properties objects instead of dicts 52a3e06 Don't load stack when getting files 372a237 Fix path_in_stack for scheduler hints 56fad61 Adds some infos for stack notification ec26be4 Fix null param for _create_arguments() for volume resource 1872a1d Rename swift.py to container.py for swift container resource 432e240 Fix iteration in floatingip's add dependencies method 4787c32 Updated from global requirements e9030c7 Add scenario test_server_signal 9af4a0a Release note, api-ref for event list nested_depth 8bd5847 Make the removed resources in resource group visible on REST db90ea2 Network validation in Manila e2704de Remove additional purge test aa2f3d2 Check policy of resource type again 395cfbd Adopt tempest plugin config namespace 70c4ab3 Support 'conditions' section for templates d87c8be Fix two typos 0dabb9f Remove deprecated v1 cinder api support 73f0b0b Updated from global requirements d2ba2b0 Fix str_split function when string is None 70422e6 New common constraint 'Expiration' 1faf5cf Updated from global requirements 998d47a Updated from global requirements 61bda3a modify the home-page info with the developer documentation 587d0b4 Explicitly set heat.conf logging_exception_prefix 1266323 Cancel nested stack creation when sibling fails 1075d7e Allow stack create operations to be cancelled 97a3670 Use handle_update_cancel() to cancel nested stack updates 2245aa1 Don't pass value_specs when creating internal port d0f72ac Add Python 3.5 classifier and venv e61542f Add an integration for server using neutron f4a2d8d Fix get_endpoint() call in is_using_neutron abde6bf Increase default sighup_timeout 2e6ce70 Always use upper-constraints 75f46e9 Don't log ERROR for remote stack exceptions 299d1f5 Silence swiftclient logging 002f815 Retry neutron resource deletion if the physical resource exists 904bed0 Allow for retries after certain resource delete failures 74815da Fix is_using_neutron 2d61ac7 Move cinder api version tests f6cf44c Supplement：use assertEqual() instead of assertDictEqual() cd125f3 Use keystone session from context in client plugin 10030be Fallback to db for resource show f38be35 Use assertEqual() instead of assertDictEqual() c5a4dea Add reno note for DNS functionality 4cfc9a2 Add dns properties and attributes 5797d34 Add dns constraints 9a248ad Check for empty sections in environment fe4f250 Don't check alarm state when signaled f019fb0 Fix some map_replace issues bf8031a Updated from global requirements f1868d0 Unskip AutoscalingLoadBalancerv2Test 61836db Purge deleted stacks for specific project ee4515e Replace while with if in resolve function 897177b Add new resource l7policy ab57f54 Add reno for map_replace and fix docs nit acbcb6e Use exception_filter from oslo_utils b862945 Implement map_replace intrinsic function 6926f3c Updated from global requirements a23928c Implement the correct total ordering for scheduler.Timeout 7b1f4e6 Use TaskRunner.as_task() for the create retry delay bcd6542 Allow a grace period when cancelling a stack update b12ec30 Use a queue instead of an event to send messages 796cea6 Raise the last exception thrown into DependencyTaskGroup 991d41f Scheduler: Add a progress callback to TaskRunner 1de87a9 Always call TaskRunner._sleep() 0951799 Unit tests: add a test resource that takes multiple steps ecdaa8e Scheduler: Allow TaskRunner to be used as a task cac2bf7 Allow individual resources to control the cancellation grace period 8e2c1db Updated from global requirements a9a645a Add direct_use=False flag to constructor of novaclient cac0dea Skip AutoscalingLoadBalancerv2Test 891298e Add version keyword argument to RAX glanceclient f629fb5 Do not show HIDDEN props in res type template 9ce43a9 Add reno for yaql function db51ae1 Fix validate method definitions 456fe5f Add __ne__ built-in function 483c505 Do not raise NotFound for resource_get_all_* queries 236ee7e Add new resource Security Group Rule 1163e46 Scheduler: Allow a per-task customisable grace period 2ffbd91 Catch exceptions when cancelling tasks in DependencyTaskGroup 40036af Add a Resource plugin API for cancelling actions d01b4dc Don't persist_state of IN_PROGRESS stack again b125b81 Remove remaining methods from db objects 8450750 Remove the db object delete method b8a529a Only call session.refresh from within db_api functions 38db9f4 Remove unnecessary checks 59fc53a Use Fedora 24 base image 5289454 Use to_policy_values from context for policy ebe5179 Fix doc of OS::Heat::AutoScalingGroup outputs and outputs_list 221c928 Only use client_plugin() if default_client_name is set 316b5b6 Add stack files retrieval API 706cc04 Propage errors in post test hook ab71c79 Correct reraising of exception 7a1a65b Create an admin context to refresh template files 26b0dd2 Do not populate unused stack and watch rule objects cf4acdf Remove unused LOG to keep code clean 6c601f3 Updated from global requirements 5c3bb70 Updated from global requirements 7f2f6fe HAProxy uses milliseconds for its timeout values. 36bf170 Improve validation for some functions 7f8e3ff Aodh::Alarm observe reality implementation e95d912 Hidden StructuredDeployments and SoftwareDeployments 2d194eb Add networking-sfc port-pair resource plug-in 7cb7432 Allow admins to create public image by default bc78253 To delete the keypair preparing for update replacement 150a013 Fail the test run if image download fails d6e36c2 Improve validation during template.parse fa33a1d Do not show HIDDEN props in res type show d995aeb Fix empty values validation in nova server 25639d8 Correct doc about os-collect-config metadata polling 479cf14 sqlalchemy tests don't assume same session 459086f Convergence: Cancel message 906a0ed Convergence: Fix concurrent update resource delete 5465579 Add rolling update for SDG 8a4df57 Change namespace 'ceilometer' to 'aodh' 26bab91 Deprecate combination alarm 42fb929 Migrate to aodh for gnocchi alarms beb86a2 Correct parameter when raise NotSupported exception 4f012ab Updated from global requirements b47c002 Keep encrypted_param_names environment internal to heat 50e638b Fix another test race in test_update_restricted fd1e9f7 Fix Broken Link in Contributing > Blueprints Doc 2c31974 Add key/value support for orchestrating images dd093f1 Use oslo.context's from_environ for creating context 8479545 Use openstack commands for prepare_test_network.sh 0d33c45 Use latest HOT version in Resource.build_template_dict 68fa82c Move _RESOURCE_KEYS down to class level dd45786 Add information about Resolve rule to docs 4a79f7c Migrate to aodh for OS::Ceilometer::Alarm ebbff16 Use openstack command for prepare_test_env.sh 152b03b Add default release names for template versions cefd3d0 Add a sleep after delete before purging ce78ba1 Correct the usage of properties.get() with default value ffda522 Config: no need to set default=None 6c4cd9e Use default client name for cinder resources add4dc3 Replace raw_input with input to make PY3 compatible dbf27c3 Revert "Skip AutoScalingSignalTest.test_signal_during_suspend" ad2b579 Use LOG.exception() properly 6e4da4e Make sure to update image tags successful 558a8cd Correct message when extension is not available 491937c Add keystone_session property to context 0e5bae8 Updated from global requirements 668ceb6 Careful with OS::Nova::Server dependencies on subnets 9749835 Install Guide: Set bug project 1424a76 Wait for stack status instead of group status faec3a0 Decouple hot and cfn for outputs ea6a743 Remove duplicate code of software deployment resource 690b1a4 Add aodh client plugin 5c7bd7f Updated from global requirements 7ea3e68 Skip AutoScalingSignalTest.test_signal_during_suspend 920f661 Updated from global requirements 7c389dd Fix some spelling mistakes in heat as follows: a3860b1 Wait for 404 on floatingip delete 744527f Deal with cinder-backup service absent a5cda7a Added refs_map attribute to AutoScalingGroup fb76364 Add constraint for Security Group 9d239cc Don't use stored context to reset stacks 4bf062c Fix non-uniqueness error message for image e6ef39a Updated from global requirements 750d4e4 Minor reorg of sqlalchemy encrypt test functions 9e007ac Add context to stack lock function arguments a65bd2b Replace model_query with direct query call 419c9ab del _session(), use context.session directly 4ed4367 Be consistent about context first argument in db api e14fafc Fix service type for Magnum resources 1359887 Check immutable and update_allowed conflict in schema validation 82f3817 Use Zaqar signed URLs in software deployment 9d0878c Commented config for unit test sql logging f5c32ad Added heat.resource_type custom constraint 4fdf72b Make template available to parameter constraint checking 4e0d1e0 Add in missing log translation hints ccdb9c9 Show 'deletion_time' for stack-list/stack-show apis 9ed1288 Add launch-instance to install-guide fefb0b1 Updated from global requirements 145a683 Deprecate lbaas v1 resources 2b41589 [api-ref] Correct stack-list api-ref 0c6236d Add period property to Monasca Notification resource 5676298 Remove deprecated auth_plugin config 87a37f5 Sync context with oslo.context 6196907 Fix typo in LBaaS support 6769253 Improve unit tests for stack-update-cancel f1ea02f Improve translation properties 992e3b2 Use the correct action for failure reason 9101cd4 Add wait_sec for test_stack_update_from_failed 5d99936 Pass input_values when creating SoftwareDeployment resources c85cae5 Fix test_update_restricted timeouts due to timestamp resolution 43b83b8 Remove heat.openstack.common.notifier supports 3b0f8ad Add integration tests for admin actions ac86702 Authorize super admin actions on all projects 353178b Run orig jobs without convergence engine 54caa85 Set nested_depth when creating Stack from db 32ade7a Implement event list nested-depth ed8a086 on-delete cascade rule for resource_data 406dd7f Fix env passed to test_replace 2a04ea4 Do a single query to fetch all event_list stacks 7bfbace Use Event versioned object for event_list formatting 1783de3 Updated from global requirements dd272a2 Adds monasca client plugin config support in heat.conf d9855df Fix tests on Neutron port behavior 2195998 Monasca: Don't pass keyword arguments of value None 13c338f Clean up tests setup 39cb8ef Updated from global requirements 9d9fd60 Fix broken links in developing_guides index ac4df48 Fix comment/doc for 1.28 RPC version dfbd237 Remove _show_resource in mistral f1c7b6d Updated from global requirements 50b1182 Fix creating SDGroup with no properties 4c54183 Don't hard code subnet 8cc5b0c Enable convergence by default 94d6f34 Ignore notfound error when delete image tags e57a293 Make sure glance image create success with tags 3a93b12 Add install-guide for heat edfc99a Pass filters to iter_resources for nested d9459c4 Fix syntax error in yaql hot spec example 59713c5 Pass keystone session to clients 34b372d Use generic auth plugins 5566e6f Get rid of gratuitous use of six.iterkeys() 37b3d1d Don't use default None for params in handle_update 490702f Downgrade some exception logs to INFO level 9a73e0b Network resolving in Manila when only subnet passed 3bdd2cb Convergence: Catch exceptions in restore_prev_rsrc 4866280 Convergence: Fix unit tests f448693 Fix building query key for ceilometer alarm a07dcce Migrate to nova api version 2.1 bfa7f85 Get rid of Parameters._validate_template_parameters() 2b24b1c Updated from global requirements de99472 DB query to get all resources by the root stack 2347fd7 Updated from global requirements 1a224a3 Allow deletion_policy to be lowercase in HOT 0e30ace Reformat HOT version history 091ed70 Fix the definition of has_nested() 01cc407 Add refs attribute to AutoScalingGroup 02c7439 Imported Translations from Zanata 13f8527 [api-ref] Correct service-list api-ref 8a36f99 Updated from global requirements e0e92b9 Move heat_keystoneclient to clients package 4f3bdcc Use get_auth_ref() rather than auth_ref property ef4cf62 Move some functions to service_utils c9ebf50 Updated from global requirements e4fe6d2 Allow deletion policies to be versioned in HOT cb565e3 Correct the docs on deletion_policy in the HOT spec 9cf021a Convergence: DB api to get all active resources of stack f5e7a31 Convergence: Throttle to sync point updates d898623 Improve validation of cinder volume resource 0b9d2cb Updated from global requirements 8a2f821 Updated from global requirements 74d3131 Keep Trace Back in Exception 90faf89 Fix nested identifier when not created 06a4ad7 Updated from global requirements 83966b7 Add `template_dir` to config c3a83a8 [api-ref] Added template-function-list d6be252 Correct the validation of server 'networks' 3b10ddc Deprecate Stack.resource_restart() c789a98 Ignore NotFound exception in metadata_set 5b2bcd8 Updated from global requirements fb7f838 Correct redundancies in Scheduler Hints docs de96d03 Fix resource loading in resource filtering 60d9fb9 Correct type of HeatTemplate20161014 to cfn c2208f1 Declare and use keyword args for Stack.get_all fef94d0 De-duplicate raw_template.files c67e601 Adds clarity to the default value of num_engine_workers f5b64b3 Add to resource_schema returning description 42bfc8a Add to resource-type-list returning description 1d6cc2d Provides 'equals' intrinsic function 534dfe4 Don't support floating ip if only specify 'network' 5da09ea Allow creation of cache classes associated with a context c62e1b3 Use a weakref for the data object context 0ef5d60 Don't load nested stack to build the identifier 56b95a0 Lazy-load stack tags e416943 Avoid full stack load for identify_stack b3c228d Stack list does direct stack object query 0f6d61e Simplify url_for in client_plugin 44862d9 Use keystoneauth1 instead of keystoneclient.auth e585676 Fix GetAttThenSelect for convergence 5f1d3bb Apply ResourceGroup blacklist at create time ea6ae8b string parameter type mismatch 4c4301f Add wait_secs to test_stack_update_from_failed_patch 222f0fc Updated from global requirements af7f317 Revert "Don't use stored context to reset stacks" ad97123 resource list filtering api-ref update 4635f66 template validate ignore errors api-ref update 516a543 Fixes resource filter to handle physical_resource_id properly 2ec5d94 Convergence: Set traversal to empty string on failure 4ebc89b Refactor resource update function to reduce complexity 697a33a Updated from global requirements 7267a36 Fixed variable shadowing in test_software_deployment 1d8a6a9 Let setup.py compile_catalog process all language files 43dde8b Convergence: show parameters while deleting stack 7fc8527 Mark monasca resources supported in release notes 4d6e3a9 Glance image tag support release notes 22d2149 Updated from global requirements 05ea885 Added refs_map attribute to resource groups d4b096a Remove html_static_path from api-ref d8fefed Fix Cloud Server image/flavor combination validation 832f15b doc: fix issue in template_guide/software_deployment 026cc94 Don't use stored context to reset stacks c9751d4 migrate to upstream os-api-ref 022eaf8 Fix small nits for tests introduced in bug/1571975 75b13f7 Don't translate when resource_validate=False b3de0a9 Updated from global requirements a52b821 Adds default policy rule for resources limited to administrator 7b73474 Clarified servers property description for SoftwareDeploymentGroup 27dd19d Allow resources to delay polling 8f83305 Allow scheduler tasks to request longer wait periods c92e5a2 Add devstack plugin 14b7600 Copy devstack code to heat tree 95ad071 Fix the documentation for HIDDEN support status 7c17582 Remove unnecessary usage of stack_name 66b6490 Set security_groups when create internal ports for nova server 0321d86 Correct filters for resource search 61b7606 RDO-Manager name change 3d17383 Migrate nova_instance to physical_resource_id 4181eda Revert "Add timeout for software deployments" 149447c Updated from global requirements bcadd55 Lazy-load context information requiring Keystone calls e7a3b38 Use original request context for logging 2cbcd6f Improve logging of unexpected exceptions 2c3def1 Fix api-ref generation errors a3a0cec Add timeout for software deployments 2786593 Avoid passing templates/files over RPC 9a650a5 RPC API: Add a template_id parameter to stack_create/update fdbb08c Make cinder resources available based on extensions 45d79cb Convergence: Un-skip functional test 6b8f1ae Fix heat-keystone-setup-domain 080ace0 Fixes cooldown logic throws ValueError a9b5cc4 Makes monasca plugin as supported ad52b42 Updated from global requirements c64b2cd Break reference cycle in KeystoneClient plugins f46c3b4 Add check for server existence on software deployment delete afeee48 Remove usages of :linenos: in docs b9a61b8 Add yaql function 6f361f7 Fix DBDeadlock error in stack update 530544b Add deployment ID to deploy signal events 8ac7fa0 Allow the server name limit to be configurable a7b8378 Adds tag support for glance image resource plugin 9ccb094 Adding two parameters into Software configuration cf49093 Eager fetch stack tags with a subqueryload 50f5142 Remove stack ObjectField from resource ef47b4c Updated from global requirements 4200c6c Refactor confusing code in custom_guidelines.py e78c287 Support neutron QoSDscpMarkingRule resource plugin 00d3677 Enable client plugin to support dynamic api version a9f38e1 Cleanup magnum client test case c310070 Use '--visibility' instead of '--is-public' 6e2d1a4 Exclude plugins from custom_guidelines.py 6f13be8 Update log levels 94480d4 Revert "Replace SD RPC polling by long RPC call" 4170566 Migrate API documentations into the Heat tree 8cb315a Check for missing param schema in encryption utility 59084fa Add --verbose-update-params option to heat-manage 0fb2e0f Make parameter decryption more robust d7b1246 Reset env.encrypted_param_names on stack update 4b46151 Delete snaphots on deleting stack 23cc156 Unit tests: Don't use ResourceDefinition as cfn snippet 52925a9 Use ResourceDefinition API in resource_facade f1751ae Don't treat ResourceDefinition as cfn template in resources b3e5932 Deprecate the Resource.parsed_template() method 0496c3c Unit tests: Eliminate deprecated use of ResourceDefinition.Diff e59c30a Don't use two different names for the same flag 8f98d34 Add --insecure in CURL if set True in client option 74db0b6 Updated from global requirements 9561c54 Removes duplicate code autoscale_complete 5e7d1e0 Make physical_network property optional 51d913a Check for worker_service initialization 829e80d Convergence: Refactor worker d19c624 Make RPC call to abandon nested stack 633e745 Revert "Enable abandon option to nested resource" bc7e503 use thread safe fnmatch fe8f0cd Updated from global requirements 9f046cb Clarify the help text for error_wait_time 7f801df Break reference cycle between ResourceRegistry and ResourceInfo ec5e5c5 Break reference cycle between Environment and ResourceRegistry a78303b Don't access `_stored_properties_data` 85896cf Remove redundant properties construction 19d1c9a Add RESOLVE translation for some sahara resources ade1772 Updated from global requirements d815a06 Fix properties usage in ResourceChain update fa253bb Added unit tests for get_template c2c5301 Imported Translations from Zanata b0ca694 Add environment retrieval API 4bd0f63 Remove tests for show attribute in cinder 9c1f87b Add senlin to README.rst (github main page) fa67f34 Use to_dict() instead for cinder resources 84da9e5 Remove conditional import 7f07e97 Fix stack deleting problem in magnum stacks 7977f9f Add command to reset one stack status b7b7102 Magnum::Bay observe reality implementation afbbe07 Use messaging notifications transport instead of default ee9ce1d Updated from global requirements f89cfcc Use the ResourceDefinition.Diff API in resources 75b5678 Implement diffs of ResourceDefinitions d76e825 Unit tests: use frozen_definition() in update tests 6d786e6 Reinstate deprecation warnings dc28090 Remove _show_resource from barbican resources a450444 Designate::Record observe reality implementation 36eeff1 Designate::Domain observe reality implementation dfad3ad Change type of raised exception in translation 025f155 Updated from global requirements 5646811 Fix doc build if git is absent 3ed5948 Set enforce_type=True on config overrides in tests 4ee0e8d Updated from global requirements e64283f Add attribute for extra specs to Nova::Flavor 8c0efbf Squash database patches 5d32fae Rename source_path in translation 45cf8b9 Remove some redundant resolve_* functions 2d18dc0 Use RESOLVE translation for lbaasv2 resources 905839a Use RESOLVE translation rules for vpnservice e1091f7 Use RESOLVE rule for lbaasv1 resources 6d6bab7 Use RESOLVE translation for more neutron resources eff0ce0 Use RESOLVE translation for more sahara resources b0f97c3 Imported Translations from Zanata 8f630a8 Add fixtures into test-requirements d0f0998 Wording fix to list index error message 10ba949 Update the Administrator Guide links with new ones 1df6d2a Support string index for list in get_param a709637 Replace SD RPC polling by long RPC call 0d0ea75 Updated from global requirements 681f2e9 Updated from global requirements e79f28d Fix unfortunate spelling error 802f42f Keystone::User: do not update if no changes 120a1e7 Added new property 'image' for bdm_v2 in Nova Server f185892 Add information about ResourceGroup attributes 8fde8e7 Fix typo `after_porps` in resource 5fa84f2 Updated from global requirements 2009e57 Check for missing/unexpected data in encryption utility 2f46d24 Don't scale when action is not complete 480271d Don't try scaling when no change in size 7a0709a Nova::Flavor get_live_state implementation be03185 Convergence: Ignore not found when releasing lock 2aed488 Remove the unused parameter in method _build_properties() 7933a8b Don't validate template resource parameter defaults in parent 72d3599 Refactor unit tests for encryption utility and add assertions 2897634 Avoid reference loops in DependencyTaskGroup bea576f Sync integration tests requirements d263687 Warn against API calls in plugin guide 950505d Revert "Check RBAC policy for nested stacks" 354f1bc Revert "Check RBAC policy for nested stacks" 184b09a Imported Translations from Zanata ed47b50 Add volume_driver in OS::Magnum::BayModel 0c407b8 Add translation rule to delete ssh auth key from Magnum baymodel e6c9076 Use a context manager to re-raise local exceptions in StackResource db06ee4 Increase timeout of WaitCondition due to ConcurrentTransactions 8f370d6 Increase timeout of WaitCondition due to ConcurrentTransactions 145be13 Imported Translations from Zanata 0ab68f8 Add translation rule to delete ssh auth key from Magnum baymodel a2a6fa7 Fix update issues with autoscaling group ab8e7a2 Avoid cooldown when group size does not change e767eb4 Raise explicit exception when deleting config which has been referenced 1ecf93c Mark resources UPDATE_COMPLETE when they request replacement f1da4f0 Updated from global requirements 99a14f5 Add update_replace_value property to test resource 28184c8 Fix handle_delete of HostAggregate resource 537fdee Add validate for babican secret 678fa7d Imported Translations from Zanata 6bd7352 Fix update issues with autoscaling group 77a4a6d Improve guidelines of using devstack of heat f0497e0 Add id and name properties for flavor resource f9e3c97 Introduce 'immutable' of parameters 4307f87 Make encryption script log exception and continue 151e8b8 Stop engine service correctly dd50ac6 Create integration tests requirements on the fly c82b752 Remove property "ssh_authorized_key" from OS::Magnum::BayModel 07847b6 Removing some redundant words 7479630 Imported Translations from Zanata 45a7d1d Set OS_PROJECT_NAME in grenade script 7adce61 Add lbaas v2 scenario test c13c944 Reset stack status after resources ec0d321 oslo config clients_xxx enabled for all supported services 443f867 Fix race condition for WaitCondition with several signals 06d58ff Refactor BaseWaitConditionHandle._metadata_format_ok() 2494a20 Downgrade WaitCondition logs 71861f4 Handling concurrent transactions in metadata_set method a0aee7e Imported Translations from Zanata 0e84651 Make sure to delete the credentials when stack deletion 018bbd6 Add a new HOT template version for Newton 4446b86 Don't create an "update task" inside a try block f8861a0 Add validation check for barbican order 4ed57d8 Remove property "ssh_authorized_key" from OS::Magnum::BayModel 8554d06 Tidy up BarbicanClientPlugin 55713b9 Use domain env variables as defaults 6cae574 Add validation for mistral cron trigger cbed623 Use region from config in functional tests 2d95f8c Restrict use of iteritems, iterkeys and itervalues c4c33c2 Added constraint for mistral workflow cb3183d Fix race condition for WaitCondition with several signals 82b7440 Handling concurrent transactions in metadata_set method 368491c Add retries to avoid dberror for user_creds_delete 8a6566d Imported Translations from Zanata 9597110 Added constraint for barbican order 23eb545 Imported Translations from Zanata e00fce9 Made workflow name required in crontrigger 419da65 Remove unknown parameters in patched update 9b9584d Imported Translations from Zanata 8f3d827 Make sure to delete the credentials when stack deletion 6c25e83 Avoid cooldown when group size does not change 2ef91a7 hacking log warn b828eae Imported Translations from Zanata 45722e6 Add retries to avoid dberror for user_creds_delete 90fc4fe Remove unknown parameters in patched update a7403a9 Explicitly naming resources in "unsupported" warnings 42b165b Add length constraint for workflow tasks 38c7d18 Imported Translations from Zanata c4fde70 Convergence: Fix rollback considered as failed concurrent update dfff614 Fixes the sequence of release notes e033549 Added missing dot 8399481 Update reno for stable/mitaka ddbe642 Update .gitreview for stable/mitaka 7ccf4d0 Explicitly naming resources in "unsupported" warnings 0c8d914 Use EntityNotFound instead of SyncPointNotFound f2bf265 Pass environment variables of proxy to tox a12a0fc Use ClientPlugin.ignore_not_found as a context manager Diffstat (except docs and test files) ------------------------------------- .gitignore | 4 +- .gitreview | 1 + HACKING.rst | 9 + README.rst | 2 + api-ref/source/conf.py | 238 + api-ref/source/index.rst | 24 + api-ref/source/v1/build-info.inc | 45 + api-ref/source/v1/events.inc | 214 + api-ref/source/v1/general-info.inc | 13 + api-ref/source/v1/index.rst | 35 + api-ref/source/v1/parameters.yaml | 1618 ++++ api-ref/source/v1/resource-types.inc | 201 + api-ref/source/v1/resources.inc | 298 + api-ref/source/v1/samples/build-info-response.json | 8 + .../source/v1/samples/config-create-request.json | 28 + .../source/v1/samples/config-create-response.json | 32 + .../source/v1/samples/config-show-response.json | 32 + .../source/v1/samples/configs-list-response.json | 8 + .../v1/samples/deployment-create-request.json | 8 + .../v1/samples/deployment-create-response.json | 14 + .../v1/samples/deployment-metadata-response.json | 130 + .../v1/samples/deployment-show-response.json | 14 + .../v1/samples/deployment-update-request.json | 10 + .../v1/samples/deployment-update-response.json | 19 + .../v1/samples/deployments-list-response.json | 21 + api-ref/source/v1/samples/event-show-response.json | 33 + .../source/v1/samples/events-find-response.json | 5 + .../source/v1/samples/events-list-response.json | 50 + .../v1/samples/resource-metadata-response.json | 6 + .../v1/samples/resource-schema-response.json | 30 + .../source/v1/samples/resource-show-response.json | 27 + .../resource-type-template-hot-response.json | 57 + .../samples/resource-type-template-response.json | 57 + .../resource-types-list-advanced-response.json | 24 + .../v1/samples/resource-types-list-response.json | 7 + .../source/v1/samples/resources-list-response.json | 25 + .../source/v1/samples/services-list-response.json | 30 + .../source/v1/samples/stack-abandon-response.json | 73 + .../stack-action-cancel-update-request.json | 3 + .../v1/samples/stack-action-check-request.json | 3 + .../v1/samples/stack-action-resume-request.json | 3 + .../v1/samples/stack-action-suspend-request.json | 3 + api-ref/source/v1/samples/stack-adopt-request.json | 33 + .../source/v1/samples/stack-create-request.json | 32 + .../source/v1/samples/stack-create-response.json | 11 + .../samples/stack-environment-show-response.json | 9 + .../source/v1/samples/stack-export-response.json | 60 + .../v1/samples/stack-files-show-response.json | 3 + .../v1/samples/stack-find-delete-response.json | 5 + api-ref/source/v1/samples/stack-find-response.json | 5 + .../v1/samples/stack-output-show-response.json | 8 + .../v1/samples/stack-outputs-list-response.json | 8 + .../source/v1/samples/stack-preview-response.json | 171 + api-ref/source/v1/samples/stack-show-response.json | 33 + .../source/v1/samples/stack-snapshot-request.json | 3 + .../source/v1/samples/stack-snapshot-response.json | 8 + .../samples/stack-snapshot-restore-response.json | 5 + .../v1/samples/stack-snapshot-show-response.json | 47 + .../v1/samples/stack-snapshots-list-response.json | 12 + .../v1/samples/stack-update-preview-response.json | 67 + .../source/v1/samples/stack-update-request.json | 28 + .../source/v1/samples/stack-update-response.json | 5 + .../source/v1/samples/stacks-list-response.json | 24 + .../samples/template-functions-list-response.json | 44 + .../source/v1/samples/template-show-response.json | 28 + .../v1/samples/template-validate-request.json | 3 + .../v1/samples/template-validate-response.json | 41 + .../v1/samples/template-versions-response.json | 44 + .../source/v1/samples/versions-list-response.json | 14 + api-ref/source/v1/services.inc | 65 + api-ref/source/v1/software-config.inc | 513 ++ api-ref/source/v1/stack-actions.inc | 203 + api-ref/source/v1/stack-outputs.inc | 99 + api-ref/source/v1/stack-snapshots.inc | 253 + api-ref/source/v1/stack-templates.inc | 153 + api-ref/source/v1/stacks.inc | 1015 +++ api-ref/source/v1/status.yaml | 62 + api-ref/source/v1/versions.inc | 41 + bin/heat-keystone-setup-domain | 18 +- config-generator.conf | 2 +- contrib/heat_docker/setup.cfg | 2 +- contrib/rackspace/heat_keystoneclient_v2/client.py | 14 +- contrib/rackspace/rackspace/clients.py | 2 +- .../rackspace/rackspace/resources/auto_scale.py | 7 +- .../rackspace/resources/cloud_loadbalancer.py | 11 +- .../rackspace/rackspace/resources/cloud_server.py | 27 +- contrib/rackspace/setup.cfg | 2 +- devstack/README.rst | 15 + devstack/files/apache-heat-api-cfn.template | 27 + devstack/files/apache-heat-api-cloudwatch.template | 27 + devstack/files/apache-heat-api.template | 27 + devstack/files/apache-heat-pip-repo.template | 15 + devstack/files/debs/heat | 1 + devstack/lib/heat | 503 ++ devstack/plugin.sh | 54 + devstack/settings | 10 + devstack/upgrade/resources.sh | 13 +- devstack/upgrade/upgrade.sh | 22 +- etc/heat/environment.d/default.yaml | 7 +- etc/heat/policy.json | 15 +- etc/heat/templates/AWS_CloudWatch_Alarm.yaml | 26 +- etc/heat/templates/AWS_RDS_DBInstance.yaml | 6 +- heat/api/aws/ec2token.py | 3 - heat/api/aws/exception.py | 1 - heat/api/cfn/v1/stacks.py | 4 - heat/api/cloudwatch/watch.py | 6 +- heat/api/middleware/fault.py | 1 - heat/api/openstack/v1/__init__.py | 15 +- heat/api/openstack/v1/events.py | 32 +- heat/api/openstack/v1/software_configs.py | 13 +- heat/api/openstack/v1/stacks.py | 81 +- heat/api/openstack/v1/util.py | 2 +- heat/api/openstack/v1/views/stacks_view.py | 8 +- heat/cloudinit/loguserdata.py | 14 +- heat/cmd/manage.py | 59 +- heat/common/auth_password.py | 19 +- heat/common/config.py | 63 +- heat/common/context.py | 275 +- heat/common/endpoint_utils.py | 11 +- heat/common/environment_format.py | 15 +- heat/common/environment_util.py | 168 + heat/common/exception.py | 34 +- heat/common/heat_keystoneclient.py | 569 -- heat/common/i18n.py | 4 +- heat/common/messaging.py | 54 +- heat/common/netutils.py | 36 + heat/common/param_utils.py | 10 + heat/common/pluginutils.py | 24 + heat/common/policy.py | 10 +- heat/common/service_utils.py | 13 + heat/common/template_format.py | 70 +- heat/common/timeutils.py | 10 + heat/db/api.py | 102 +- heat/db/sqlalchemy/api.py | 708 +- .../sqlalchemy/migrate_repo/versions/028_havana.py | 184 - .../migrate_repo/versions/029_event_id_to_uuid.py | 24 - .../migrate_repo/versions/030_remove_uuidutils.py | 32 - .../migrate_repo/versions/031_stack_lock.py | 34 - .../migrate_repo/versions/032_decrypt_method.py | 26 - .../migrate_repo/versions/033_software_config.py | 69 - .../versions/034_raw_template_files.py | 25 - .../migrate_repo/versions/035_event_uuid_to_id.py | 147 - .../versions/036_stack_domain_project.py | 24 - .../versions/037_migrate_hot_template.py | 59 - .../versions/038_software_config_json_config.py | 23 - .../versions/039_user_creds_nullable.py | 22 - .../040_software_deployment_no_signal_id.py | 21 - .../versions/041_migrate_hot_template_resources.py | 70 - .../042_software_deployment_domain_project.py | 24 - .../versions/043_migrate_template_versions.py | 57 - .../migrate_repo/versions/044_snapshots.py | 45 - .../migrate_repo/versions/045_stack_backup.py | 35 - .../migrate_repo/versions/046_properties_data.py | 25 - .../versions/047_stack_nested_depth.py | 45 - .../048_resource_id_server_default_none_psql.py | 24 - .../versions/049_user_creds_region_name.py | 24 - .../migrate_repo/versions/050_stack_tags.py | 24 - .../migrate_repo/versions/051_service.py | 42 - .../migrate_repo/versions/052_convergence_flag.py | 23 - .../versions/053_stack_name_tenant_indexes.py | 27 - .../migrate_repo/versions/054_stack_tags_table.py | 39 - .../migrate_repo/versions/055_stack_convg_data.py | 90 - .../versions/056_convergence_parameter_storage.py | 113 - .../versions/057_resource_uuid_to_id.py | 262 - .../versions/058_resource_engine_id.py | 23 - .../migrate_repo/versions/059_sync_point.py | 47 - .../versions/060_resource_convg_data.py | 42 - .../versions/061_status_reason_longtext.py | 36 - .../sqlalchemy/migrate_repo/versions/062_kilo.py | 362 + .../migrate_repo/versions/062_parent_resource.py | 23 - .../versions/072_raw_template_files.py | 40 + .../073_resource_data_fk_ondelete_cascade.py | 44 + heat/db/sqlalchemy/migration.py | 2 +- heat/db/sqlalchemy/models.py | 78 +- heat/db/sqlalchemy/utils.py | 10 + heat/db/utils.py | 14 +- heat/engine/api.py | 144 +- heat/engine/attributes.py | 14 +- heat/engine/cfn/functions.py | 278 +- heat/engine/cfn/template.py | 214 +- heat/engine/check_resource.py | 392 + heat/engine/clients/__init__.py | 19 +- heat/engine/clients/client_plugin.py | 202 +- heat/engine/clients/os/aodh.py | 48 + heat/engine/clients/os/barbican.py | 42 +- heat/engine/clients/os/ceilometer.py | 19 +- heat/engine/clients/os/cinder.py | 93 +- heat/engine/clients/os/designate.py | 13 +- heat/engine/clients/os/glance.py | 35 +- heat/engine/clients/os/heat_plugin.py | 20 +- heat/engine/clients/os/keystone.py | 194 - heat/engine/clients/os/keystone/__init__.py | 132 + .../clients/os/keystone/heat_keystoneclient.py | 569 ++ .../clients/os/keystone/keystone_constraints.py | 77 + heat/engine/clients/os/magnum.py | 14 +- heat/engine/clients/os/manila.py | 9 +- heat/engine/clients/os/mistral.py | 22 +- heat/engine/clients/os/monasca.py | 35 +- heat/engine/clients/os/neutron/__init__.py | 64 +- .../clients/os/neutron/neutron_constraints.py | 4 + heat/engine/clients/os/nova.py | 28 +- heat/engine/clients/os/sahara.py | 10 +- heat/engine/clients/os/senlin.py | 18 +- heat/engine/clients/os/swift.py | 10 +- heat/engine/clients/os/trove.py | 14 +- heat/engine/clients/os/zaqar.py | 23 +- heat/engine/conditions.py | 79 + heat/engine/constraint/common_constraints.py | 86 +- heat/engine/constraint/heat_constraints.py | 45 + heat/engine/constraints.py | 40 +- heat/engine/dependencies.py | 6 +- heat/engine/environment.py | 100 +- heat/engine/event.py | 29 +- heat/engine/function.py | 90 +- heat/engine/hot/functions.py | 697 +- heat/engine/hot/template.py | 378 +- heat/engine/output.py | 51 + heat/engine/parameters.py | 61 +- heat/engine/properties.py | 54 +- heat/engine/resource.py | 580 +- heat/engine/resources/__init__.py | 4 +- heat/engine/resources/alarm_base.py | 211 + .../resources/aws/autoscaling/autoscaling_group.py | 124 +- .../resources/aws/autoscaling/launch_config.py | 2 +- heat/engine/resources/aws/ec2/instance.py | 18 +- heat/engine/resources/aws/s3/s3.py | 4 +- heat/engine/resources/openstack/aodh/__init__.py | 0 heat/engine/resources/openstack/aodh/alarm.py | 312 + .../resources/openstack/aodh/gnocchi/__init__.py | 0 .../resources/openstack/aodh/gnocchi/alarm.py | 225 + .../resources/openstack/barbican/container.py | 6 - heat/engine/resources/openstack/barbican/order.py | 17 +- heat/engine/resources/openstack/barbican/secret.py | 50 +- .../resources/openstack/ceilometer/__init__.py | 0 .../engine/resources/openstack/ceilometer/alarm.py | 474 -- .../openstack/ceilometer/gnocchi/__init__.py | 0 .../openstack/ceilometer/gnocchi/alarm.py | 191 - .../openstack/cinder/encrypted_volume_type.py | 29 +- .../engine/resources/openstack/cinder/qos_specs.py | 95 + heat/engine/resources/openstack/cinder/quota.py | 175 + heat/engine/resources/openstack/cinder/volume.py | 112 +- .../resources/openstack/cinder/volume_type.py | 50 +- .../engine/resources/openstack/designate/domain.py | 8 + .../engine/resources/openstack/designate/record.py | 9 + heat/engine/resources/openstack/glance/image.py | 126 +- .../resources/openstack/heat/autoscaling_group.py | 73 +- .../resources/openstack/heat/cloud_config.py | 6 +- .../engine/resources/openstack/heat/cloud_watch.py | 6 +- .../resources/openstack/heat/ha_restarter.py | 5 +- .../resources/openstack/heat/instance_group.py | 10 +- heat/engine/resources/openstack/heat/multi_part.py | 6 +- .../resources/openstack/heat/remote_stack.py | 17 +- .../resources/openstack/heat/resource_chain.py | 19 +- .../resources/openstack/heat/resource_group.py | 92 +- .../resources/openstack/heat/scaling_policy.py | 84 +- .../resources/openstack/heat/software_component.py | 19 +- .../resources/openstack/heat/software_config.py | 70 +- .../openstack/heat/software_deployment.py | 410 +- .../resources/openstack/heat/structured_config.py | 18 +- .../resources/openstack/heat/test_resource.py | 23 +- heat/engine/resources/openstack/heat/value.py | 110 + .../openstack/heat/wait_condition_handle.py | 21 +- heat/engine/resources/openstack/keystone/group.py | 2 +- .../engine/resources/openstack/keystone/project.py | 2 +- .../openstack/keystone/role_assignments.py | 33 +- heat/engine/resources/openstack/keystone/user.py | 16 +- heat/engine/resources/openstack/magnum/bay.py | 14 +- heat/engine/resources/openstack/magnum/baymodel.py | 57 +- .../resources/openstack/manila/share_network.py | 44 +- .../resources/openstack/mistral/cron_trigger.py | 21 +- .../engine/resources/openstack/mistral/workflow.py | 21 +- .../openstack/monasca/alarm_definition.py | 32 +- .../resources/openstack/monasca/notification.py | 103 +- .../resources/openstack/neutron/extraroute.py | 3 +- .../resources/openstack/neutron/floatingip.py | 27 +- .../openstack/neutron/lbaas/health_monitor.py | 6 +- .../resources/openstack/neutron/lbaas/l7policy.py | 271 + .../resources/openstack/neutron/lbaas/l7rule.py | 216 + .../resources/openstack/neutron/lbaas/listener.py | 29 +- .../openstack/neutron/lbaas/loadbalancer.py | 18 +- .../resources/openstack/neutron/lbaas/pool.py | 23 +- .../openstack/neutron/lbaas/pool_member.py | 17 +- .../resources/openstack/neutron/loadbalancer.py | 61 +- heat/engine/resources/openstack/neutron/net.py | 11 + .../resources/openstack/neutron/network_gateway.py | 36 +- heat/engine/resources/openstack/neutron/neutron.py | 19 +- heat/engine/resources/openstack/neutron/port.py | 31 +- .../resources/openstack/neutron/provider_net.py | 3 +- heat/engine/resources/openstack/neutron/qos.py | 70 +- .../resources/openstack/neutron/security_group.py | 9 +- .../openstack/neutron/security_group_rule.py | 200 + .../resources/openstack/neutron/sfc/__init__.py | 0 .../resources/openstack/neutron/sfc/port_pair.py | 127 + .../resources/openstack/neutron/vpnservice.py | 25 +- heat/engine/resources/openstack/nova/flavor.py | 52 +- .../resources/openstack/nova/host_aggregate.py | 15 +- heat/engine/resources/openstack/nova/keypair.py | 7 + heat/engine/resources/openstack/nova/server.py | 112 +- .../openstack/nova/server_network_mixin.py | 164 +- heat/engine/resources/openstack/sahara/cluster.py | 48 +- heat/engine/resources/openstack/sahara/image.py | 20 +- .../engine/resources/openstack/sahara/templates.py | 127 +- heat/engine/resources/openstack/senlin/cluster.py | 42 +- heat/engine/resources/openstack/senlin/node.py | 78 +- heat/engine/resources/openstack/senlin/policy.py | 2 +- heat/engine/resources/openstack/swift/container.py | 297 + heat/engine/resources/openstack/swift/swift.py | 297 - .../resources/openstack/trove/os_database.py | 8 +- heat/engine/resources/scheduler_hints.py | 16 +- heat/engine/resources/signal_responder.py | 8 + heat/engine/resources/stack_resource.py | 189 +- heat/engine/resources/stack_user.py | 2 +- heat/engine/resources/template_resource.py | 20 +- heat/engine/resources/volume_base.py | 34 +- heat/engine/resources/wait_condition.py | 66 +- heat/engine/rsrc_defn.py | 173 +- heat/engine/scheduler.py | 148 +- heat/engine/service.py | 725 +- heat/engine/service_software_config.py | 92 +- heat/engine/service_stack_watch.py | 7 +- heat/engine/software_config_io.py | 175 + heat/engine/stack.py | 522 +- heat/engine/stack_lock.py | 35 +- heat/engine/support.py | 12 +- heat/engine/sync_point.py | 23 +- heat/engine/template.py | 184 +- heat/engine/template_common.py | 205 + heat/engine/template_files.py | 136 + heat/engine/translation.py | 361 +- heat/engine/update.py | 51 +- heat/engine/watchrule.py | 3 +- heat/engine/worker.py | 429 +- heat/hacking/__init__.py | 0 heat/hacking/checks.py | 70 + heat/locale/cs/LC_MESSAGES/heat-log-critical.po | 8 +- heat/locale/de/LC_MESSAGES/heat-log-critical.po | 8 +- heat/locale/de/LC_MESSAGES/heat.po | 2856 ++++++- heat/locale/es/LC_MESSAGES/heat-log-critical.po | 8 +- heat/locale/es/LC_MESSAGES/heat.po | 7995 ++++++++++++++++++ heat/locale/fr/LC_MESSAGES/heat-log-critical.po | 8 +- heat/locale/fr/LC_MESSAGES/heat-log-error.po | 15 +- heat/locale/fr/LC_MESSAGES/heat.po | 7965 ++++++++++++++++++ heat/locale/heat-log-critical.pot | 24 - heat/locale/heat-log-error.pot | 302 - heat/locale/heat-log-info.pot | 583 -- heat/locale/heat-log-warning.pot | 378 - heat/locale/heat.pot | 8891 -------------------- heat/locale/it/LC_MESSAGES/heat-log-critical.po | 8 +- heat/locale/it/LC_MESSAGES/heat.po | 7946 +++++++++++++++++ heat/locale/ja/LC_MESSAGES/heat-log-critical.po | 8 +- heat/locale/ja/LC_MESSAGES/heat.po | 7629 +++++++++++++++++ heat/locale/ko_KR/LC_MESSAGES/heat-log-critical.po | 8 +- heat/locale/ko_KR/LC_MESSAGES/heat-log-error.po | 243 + heat/locale/ko_KR/LC_MESSAGES/heat-log-warning.po | 336 + heat/locale/ko_KR/LC_MESSAGES/heat.po | 7428 ++++++++++++++++ heat/locale/pt/LC_MESSAGES/heat-log-critical.po | 8 +- heat/locale/pt_BR/LC_MESSAGES/heat-log-critical.po | 8 +- heat/locale/pt_BR/LC_MESSAGES/heat.po | 7836 +++++++++++++++++ heat/locale/ru/LC_MESSAGES/heat-log-critical.po | 8 +- heat/locale/ru/LC_MESSAGES/heat.po | 976 ++- heat/locale/tr_TR/LC_MESSAGES/heat-log-critical.po | 8 +- heat/locale/zh_CN/LC_MESSAGES/heat-log-critical.po | 8 +- heat/locale/zh_CN/LC_MESSAGES/heat.po | 838 +- heat/locale/zh_TW/LC_MESSAGES/heat-log-critical.po | 8 +- heat/locale/zh_TW/LC_MESSAGES/heat.po | 7140 ++++++++++++++++ heat/objects/base.py | 21 + heat/objects/event.py | 9 + heat/objects/raw_template.py | 41 +- heat/objects/raw_template_files.py | 51 + heat/objects/resource.py | 103 +- heat/objects/resource_data.py | 7 +- heat/objects/stack.py | 56 +- heat/objects/stack_lock.py | 16 +- heat/objects/user_creds.py | 4 +- heat/objects/watch_data.py | 10 +- heat/objects/watch_rule.py | 7 +- heat/openstack/common/crypto/utils.py | 9 +- heat/rpc/api.py | 14 +- heat/rpc/client.py | 144 +- heat/rpc/worker_client.py | 17 + heat/scaling/cooldown.py | 59 +- .../api/openstack_v1/test_views_stacks_view.py | 8 +- .../openstack/ceilometer/test_ceilometer_alarm.py | 773 -- .../openstack/ceilometer/test_gnocchi_alarm.py | 365 - .../cinder/test_volume_type_encryption.py | 44 +- .../heat/test_instance_group_update_policy.py | 23 +- .../openstack/heat/test_software_deployment.py | 414 +- .../openstack/keystone/test_role_assignments.py | 127 +- .../openstack/manila/test_security_service.py | 9 +- .../openstack/monasca/test_alarm_definition.py | 25 +- .../openstack/neutron/lbaas/test_health_monitor.py | 3 - .../openstack/neutron/lbaas/test_loadbalancer.py | 7 +- .../openstack/neutron/lbaas/test_pool_member.py | 1 + .../openstack/neutron/test_neutron_firewall.py | 32 +- .../openstack/neutron/test_neutron_floating_ip.py | 98 +- .../openstack/neutron/test_neutron_loadbalancer.py | 40 +- .../neutron/test_neutron_network_gateway.py | 84 +- .../neutron/test_neutron_security_group.py | 28 + .../neutron/test_neutron_security_group_rule.py | 98 + .../openstack/neutron/test_neutron_subnetpool.py | 2 +- .../openstack/neutron/test_neutron_vpnservice.py | 14 +- .../openstack/neutron/test_sfc/test_port_pair.py | 169 + .../functional/functional_base.py | 1 - .../functional/test_admin_actions.py | 101 + .../functional/test_autoscaling.py | 5 +- .../functional/test_cancel_update.py | 63 + .../functional/test_conditional_exposure.py | 89 +- .../functional/test_conditions.py | 622 ++ .../functional/test_create_update.py | 3 +- .../functional/test_create_update_neutron_port.py | 12 +- .../functional/test_encryption_vol_type.py | 11 +- .../functional/test_external_ref.py | 83 + .../functional/test_nova_server_networks.py | 70 +- .../functional/test_os_wait_condition.py | 107 + .../functional/test_remote_stack.py | 10 +- .../functional/test_replace_deprecated.py | 92 + .../functional/test_resource_chain.py | 19 + .../functional/test_resource_group.py | 4 +- .../functional/test_resources_list.py | 43 + .../functional/test_software_deployment_group.py | 142 + .../functional/test_template_resource.py | 66 + .../functional/test_update_restricted.py | 13 +- .../templates/app_server_lbv2_neutron.yaml | 69 + .../scenario/templates/test_aodh_alarm.yaml | 33 + .../templates/test_autoscaling_lbv2_neutron.yaml | 116 + .../scenario/templates/test_ceilometer_alarm.yaml | 33 - .../scenario/templates/test_server_signal.yaml | 104 + .../scenario/test_autoscaling_lb.py | 10 +- .../scenario/test_autoscaling_lbv2.py | 65 +- .../scenario/test_ceilometer_alarm.py | 57 - .../scenario/test_server_cfn_init.py | 7 +- .../scenario/test_server_signal.py | 74 + .../scenario/test_server_software_config.py | 4 - install-guide/source/conf.py | 299 + install-guide/source/get_started.rst | 37 + install-guide/source/index.rst | 20 + install-guide/source/install-debian.rst | 46 + install-guide/source/install-obs.rst | 430 + install-guide/source/install-rdo.rst | 440 + install-guide/source/install-ubuntu.rst | 436 + install-guide/source/install.rst | 21 + install-guide/source/launch-instance.rst | 138 + install-guide/source/next-steps.rst | 12 + install-guide/source/verify.rst | 36 + .../add-template-dir-config-b96392a9e116a2d3.yaml | 6 + .../bp-support-conditions-1a9f89748a08cd4f.yaml | 17 + .../notes/cinder-backup-cb72e775681fb5a5.yaml | 10 + ...cinder-qos-specs-resource-ca5a237ebc114729.yaml | 6 + .../cinder-quota-resource-f13211c04020cd0c.yaml | 5 + ...gurable-server-name-limit-947d9152fe9b43ee.yaml | 6 + .../notes/dns-resolution-5afc1c57dfd05aff.yaml | 7 + .../environment-merging-d623362fac1279f7.yaml | 11 + .../event-list-nested-depth-80081a2a8eefee1a.yaml | 14 + .../notes/external-resources-965d01d690d32bd2.yaml | 10 + .../notes/glance-image-tag-6fa123ca30be01aa.yaml | 4 + .../map-replace-function-26bf247c620f64bf.yaml | 7 + .../notes/monasca-period-f150cdb134f1e036.yaml | 10 + .../notes/monasca-supported-71c5373282c3b338.yaml | 5 + .../notes/yaql-function-4895e39555c2841d.yaml | 5 + releasenotes/source/index.rst | 3 +- releasenotes/source/mitaka.rst | 6 + requirements.txt | 66 +- setup.cfg | 47 +- test-requirements.txt | 18 +- tools/custom_guidelines.py | 23 +- tox.ini | 54 +- 699 files changed, 98766 insertions(+), 24858 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 80f689e..11ac45d 100644 --- a/requirements.txt +++ b/requirements.txt @@ -6 +6 @@ pbr>=1.6 # Apache-2.0 -Babel>=1.3 # BSD +Babel>=2.3.4 # BSD @@ -8 +8 @@ croniter>=0.3.4 # MIT License -cryptography>=1.0 # BSD/Apache-2.0 +cryptography!=1.3.0,>=1.0 # BSD/Apache-2.0 @@ -12 +12,2 @@ greenlet>=0.3.2 # MIT -keystonemiddleware!=4.1.0,>=4.0.0 # Apache-2.0 +keystoneauth1>=2.10.0 # Apache-2.0 +keystonemiddleware!=4.1.0,!=4.5.0,>=4.0.0 # Apache-2.0 @@ -14 +15 @@ lxml>=2.3 # BSD -netaddr!=0.7.16,>=0.7.12 # BSD +netaddr!=0.7.16,>=0.7.13 # BSD @@ -16,4 +17,4 @@ oslo.cache>=1.5.0 # Apache-2.0 -oslo.config>=3.7.0 # Apache-2.0 -oslo.concurrency>=3.5.0 # Apache-2.0 -oslo.context>=0.2.0 # Apache-2.0 -oslo.db>=4.1.0 # Apache-2.0 +oslo.config>=3.14.0 # Apache-2.0 +oslo.concurrency>=3.8.0 # Apache-2.0 +oslo.context>=2.9.0 # Apache-2.0 +oslo.db!=4.13.1,!=4.13.2,>=4.10.0 # Apache-2.0 @@ -22 +23 @@ oslo.log>=1.14.0 # Apache-2.0 -oslo.messaging>=4.0.0 # Apache-2.0 +oslo.messaging>=5.2.0 # Apache-2.0 @@ -24 +25 @@ oslo.middleware>=3.0.0 # Apache-2.0 -oslo.policy>=0.5.0 # Apache-2.0 +oslo.policy>=1.9.0 # Apache-2.0 @@ -27,4 +28,4 @@ oslo.serialization>=1.10.0 # Apache-2.0 -oslo.service>=1.0.0 # Apache-2.0 -oslo.utils>=3.5.0 # Apache-2.0 -osprofiler>=1.1.0 # Apache-2.0 -oslo.versionedobjects>=1.5.0 # Apache-2.0 +oslo.service>=1.10.0 # Apache-2.0 +oslo.utils>=3.16.0 # Apache-2.0 +osprofiler>=1.4.0 # Apache-2.0 +oslo.versionedobjects>=1.13.0 # Apache-2.0 @@ -33,3 +34,4 @@ pycrypto>=2.6 # Public Domain -python-barbicanclient>=3.3.0 # Apache-2.0 -python-ceilometerclient>=2.2.1 # Apache-2.0 -python-cinderclient>=1.3.1 # Apache-2.0 +aodhclient>=0.5.0 # Apache-2.0 +python-barbicanclient>=4.0.0 # Apache-2.0 +python-ceilometerclient>=2.5.0 # Apache-2.0 +python-cinderclient!=1.7.0,!=1.7.1,>=1.6.0 # Apache-2.0 @@ -37,7 +39,8 @@ python-designateclient>=1.5.0 # Apache-2.0 -python-glanceclient>=2.0.0 # Apache-2.0 -python-heatclient>=0.6.0 # Apache-2.0 -python-keystoneclient!=1.8.0,!=2.1.0,>=1.6.0 # Apache-2.0 -python-magnumclient>=0.2.1 # Apache-2.0 -python-manilaclient>=1.3.0 # Apache-2.0 -python-mistralclient>=1.0.0 # Apache-2.0 -python-neutronclient!=4.1.0,>=2.6.0 # Apache-2.0 +python-glanceclient!=2.4.0,>=2.3.0 # Apache-2.0 +python-heatclient>=1.4.0 # Apache-2.0 +python-keystoneclient!=2.1.0,>=2.0.0 # Apache-2.0 +python-magnumclient>=2.0.0 # Apache-2.0 +python-manilaclient>=1.10.0 # Apache-2.0 +python-mistralclient>=2.0.0 # Apache-2.0 +python-monascaclient>=1.1.0 # Apache-2.0 +python-neutronclient>=5.1.0 # Apache-2.0 @@ -46 +49 @@ python-openstackclient>=2.1.0 # Apache-2.0 -python-saharaclient>=0.13.0 # Apache-2.0 +python-saharaclient>=0.18.0 # Apache-2.0 @@ -49,2 +52,2 @@ python-swiftclient>=2.2.0 # Apache-2.0 -python-troveclient!=2.1.0,>=1.2.0 # Apache-2.0 -python-zaqarclient>=0.3.0 # Apache-2.0 +python-troveclient>=2.2.0 # Apache-2.0 +python-zaqarclient>=1.0.0 # Apache-2.0 @@ -53 +56 @@ PyYAML>=3.1.0 # MIT -requests!=2.9.0,>=2.8.1 # Apache-2.0 +requests>=2.10.0 # Apache-2.0 @@ -55,2 +58,2 @@ retrying!=1.3.0,>=1.2.3 # Apache-2.0 -Routes!=2.0,!=2.1,>=1.12.3;python_version=='2.7' # MIT -Routes!=2.0,>=1.12.3;python_version!='2.7' # MIT +Routes!=2.0,!=2.1,!=2.3.0,>=1.12.3;python_version=='2.7' # MIT +Routes!=2.0,!=2.3.0,>=1.12.3;python_version!='2.7' # MIT @@ -60 +63 @@ sqlalchemy-migrate>=0.9.6 # Apache-2.0 -stevedore>=1.5.0 # Apache-2.0 +stevedore>=1.16.0 # Apache-2.0 @@ -61,0 +65 @@ WebOb>=1.2.3 # MIT +yaql>=1.1.0 # Apache 2.0 License diff --git a/test-requirements.txt b/test-requirements.txt index a20adba..d4e6029 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -7 +7 @@ hacking<0.11,>=0.10.0 -bandit>=0.17.3 # Apache-2.0 +bandit>=1.1.0 # Apache-2.0 @@ -8,0 +9 @@ coverage>=3.6 # Apache-2.0 +fixtures>=3.0.0 # Apache-2.0/BSD @@ -10 +11 @@ kombu>=3.0.25 # BSD -mock>=1.2 # BSD +mock>=2.0 # BSD @@ -12 +13,3 @@ mox3>=0.7.0 # Apache-2.0 -PyMySQL>=0.6.2 # MIT License +PyMySQL!=0.7.7,>=0.6.2 # MIT License +openstackdocstheme>=1.5.0 # Apache-2.0 +os-api-ref>=1.0.0 # Apache-2.0 @@ -15 +17,0 @@ oslotest>=1.10.0 # Apache-2.0 -paramiko>=1.16.0 # LGPL @@ -18 +20 @@ psycopg2>=2.5 # LGPL/ZPL -sphinx!=1.2.0,!=1.3b1,<1.3,>=1.1.2 # BSD +sphinx!=1.3b1,<1.3,>=1.2.1 # BSD @@ -23 +25,5 @@ testresources>=0.2.4 # Apache-2.0/BSD -reno>=0.1.1 # Apache2 +reno>=1.8.0 # Apache2 +# Next are used in integration tests only +os-collect-config # Apache-2.0 +paramiko>=2.0 # LGPLv2.1+ +tempest>=12.1.0 # Apache-2.0

1 0

[new][designate] designate-dashboard 3.0.0 release (newton)
by no-reply＠openstack.org 06 Oct '16

06 Oct '16

We are amped to announce the release of: designate-dashboard 3.0.0: Designate Horizon UI bits This release is part of the newton release series. For more details, please see below. Changes in designate-dashboard 2.0.0.0rc1..3.0.0 ------------------------------------------------ b3b56d4 Imported Translations from Zanata 472e7a9 Allow V1 Panels to be used 725380d Imported Translations from Zanata 183b279 Imported Translations from Zanata c868c62 Imported Translations from Zanata 6d87667 Update .gitreview for stable/newton 54e46c9 API v2 Dashboard 5a0ce41 Allow SRV/MX records to have priority 0 7be9313 Remove token logging 1a05272 Update home-page info in the configuration file 713e772 Imported Translations from Zanata e96fddb Updated from global requirements 3afaf1f Follow-up Ibddffc5f: Also allow PTR records pointing to the domain itself 2669ea5 Updated from global requirements 69caf63 SSHFP validation: Allow algorithm 4 - ED25519 2d17e1a Remove discover from test-requirements c915a15 Updated from global requirements e937d32 Updated from global requirements 4069460 Add option for records pointing to domain a65f899 Updated from global requirements 4783fbf Imported Translations from Zanata 8fdef7b Updated from global requirements a275499 Updated from global requirements 442dec6 Imported Translations from Zanata 135c0c8 Imported Translations from Zanata b7d0c77 Imported Translations from Zanata 61b5a0c Imported Translations from Zanata 552968e Updated from global requirements c93239b Updated from global requirements 38db436 Updated from global requirements 85b493d Updated from global requirements b48e13b Imported Translations from Zanata c6477f9 Imported Translations from Zanata 9266cb1 Updated from global requirements 576dc66 Fix package name in init.py 7eadcaf Imported Translations from Zanata 20d036d Updated from global requirements 7fbe18a Imported Translations from Zanata 2fdca52 Fix unit tests under Django 1.9 72d45d6 Add ADD_INSTALLED_APPS to 'enabled' file 76df49e Extract strings from django templates 03813a8 Imported Translations from Zanata 9aa1f9b Fix unit tests under Django 1.9 8cb1543 Extract strings from django templates 1ed7893 Add ADD_INSTALLED_APPS to 'enabled' file 202300b Imported Translations from Zanata a829a1b Update .gitreview for stable/mitaka Diffstat (except docs and test files) ------------------------------------- .gitreview | 1 + babel-django.cfg | 4 + designatedashboard/__init__.py | 2 +- designatedashboard/api/designate.py | 3 - designatedashboard/api/rest/__init__.py | 16 + designatedashboard/api/rest/passthrough.py | 114 +++++++ .../dashboards/project/dns_domains/forms.py | 12 +- .../templates/dns_domains/domain_detail.html | 2 +- .../dns_domains/templates/dns_domains/records.html | 2 +- .../dashboards/project/dns_domains/views.py | 1 + .../dashboards/project/ngdns/__init__.py | 1 + .../project/ngdns/reverse_dns/__init__.py | 0 .../dashboards/project/ngdns/reverse_dns/panel.py | 25 ++ .../dashboards/project/ngdns/reverse_dns/urls.py | 22 ++ .../dashboards/project/ngdns/reverse_dns/views.py | 19 ++ .../dashboards/project/ngdns/zones/__init__.py | 0 .../dashboards/project/ngdns/zones/panel.py | 25 ++ .../dashboards/project/ngdns/zones/urls.py | 22 ++ .../dashboards/project/ngdns/zones/views.py | 19 ++ .../enabled/_1720_project_dns_panel.py | 2 + .../enabled/_1721_dns_zones_panel.py | 40 +++ .../enabled/_1722_dns_reversedns_panel.py | 38 +++ designatedashboard/locale/cs/LC_MESSAGES/django.po | 341 ++++++++++++++++++++ designatedashboard/locale/de/LC_MESSAGES/django.po | 351 ++++++++++++++++++++ designatedashboard/locale/django.pot | 343 -------------------- .../locale/en_GB/LC_MESSAGES/django.po | 345 ++++++++++++++++++++ designatedashboard/locale/fr/LC_MESSAGES/django.po | 52 ++- designatedashboard/locale/ja/LC_MESSAGES/django.po | 141 ++++++++- .../locale/ko_KR/LC_MESSAGES/django.po | 350 ++++++++++++++++++++ .../locale/pt_BR/LC_MESSAGES/django.po | 345 ++++++++++++++++++++ designatedashboard/locale/ru/LC_MESSAGES/django.po | 23 +- .../locale/tr_TR/LC_MESSAGES/django.po | 29 +- .../locale/zh_CN/LC_MESSAGES/django.po | 352 +++++++++++++++++++++ .../designatedashboard.module.js | 78 +++++ .../designatedashboard/designatedashboard.scss | 0 .../actions/actions.module.js | 66 ++++ .../os-designate-floatingip/actions/set.service.js | 170 ++++++++++ .../actions/unset.service.js | 139 ++++++++ .../os-designate-floatingip/api.service.js | 121 +++++++ .../details/details.module.js | 66 ++++ .../os-designate-floatingip/details/drawer.html | 10 + .../details/overview.controller.js | 46 +++ .../os-designate-floatingip/details/overview.html | 11 + .../os-designate-floatingip.module.js | 154 +++++++++ .../actions/actions.module.js | 79 +++++ .../actions/common-forms.service.js | 165 ++++++++++ .../actions/create.service.js | 132 ++++++++ .../actions/delete.service.js | 182 +++++++++++ .../actions/update.service.js | 159 ++++++++++ .../os-designate-recordset/api.service.js | 136 ++++++++ .../details/details.module.js | 109 +++++++ .../os-designate-recordset/details/drawer.html | 10 + .../details/overview.controller.js | 46 +++ .../os-designate-recordset/details/overview.html | 45 +++ .../details/zone-recordsets.controller.js | 39 +++ .../details/zone-recordsets.html | 8 + .../os-designate-recordset.module.js | 238 ++++++++++++++ .../os-designate-zone/actions/actions.module.js | 76 +++++ .../actions/common-forms.service.js | 184 +++++++++++ .../os-designate-zone/actions/create.html | 1 + .../os-designate-zone/actions/create.service.js | 126 ++++++++ .../os-designate-zone/actions/delete.service.js | 169 ++++++++++ .../os-designate-zone/actions/update.service.js | 147 +++++++++ .../resources/os-designate-zone/api.service.js | 152 +++++++++ .../os-designate-zone/details/details.module.js | 61 ++++ .../os-designate-zone/details/drawer.html | 10 + .../details/overview.controller.js | 46 +++ .../os-designate-zone/details/overview.html | 58 ++++ .../os-designate-zone/os-designate-zone.module.js | 202 ++++++++++++ .../resources/resources.module.js | 36 +++ .../designatedashboard/resources/util.service.js | 107 +++++++ .../static/designatedashboard/reverse_dns.html | 4 + .../static/designatedashboard/zones.html | 4 + requirements.txt | 2 +- setup.cfg | 2 +- test-requirements.txt | 13 +- 83 files changed, 6334 insertions(+), 473 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index bc3b7d3..d9f7cca 100644 --- a/requirements.txt +++ b/requirements.txt @@ -5 +5 @@ pbr>=1.6 # Apache-2.0 -Babel>=1.3 # BSD +Babel>=2.3.4 # BSD diff --git a/test-requirements.txt b/test-requirements.txt index 145d831..5c7f88d 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -7,2 +7 @@ coverage>=3.6 # Apache-2.0 -discover # BSD -mock>=1.2 # BSD +mock>=2.0 # BSD @@ -11,2 +10,2 @@ mox3>=0.7.0 # Apache-2.0 -oslo.config>=3.7.0 # Apache-2.0 -pylint==1.4.5 # GNU GPL v2 +oslo.config>=3.14.0 # Apache-2.0 +pylint==1.4.5 # GPLv2 @@ -16 +15 @@ unittest2 # BSD -sphinx!=1.2.0,!=1.3b1,<1.3,>=1.1.2 # BSD +sphinx!=1.3b1,<1.3,>=1.2.1 # BSD @@ -21 +20 @@ openstack.nose-plugin>=0.7 # Apache-2.0 -django-nose>=1.2 # BSD +django-nose>=1.4.4 # BSD @@ -27 +26 @@ django-compressor>=2.0 # MIT -django-openstack-auth>=2.0.0 # Apache-2.0 +django-openstack-auth>=2.4.0 # Apache-2.0

1 0