- Release-announce - lists.openstack.org

[searchlight] searchlight 2.0.0 (ocata)
by no-reply＠openstack.org 22 Feb '17

22 Feb '17

We are jazzed to announce the release of: searchlight 2.0.0: OpenStack Search Service This release is part of the ocata release series. Download the package from: https://tarballs.openstack.org/searchlight/ For more details, please see below. 2.0.0 ^^^^^ Add support for the new Neutron tenant RBAC policy functionality. This allows networks to be shared across tenants. Introduce a pipeline architecture to configure publishers for resource plugins. Added 'size' and 'from' as synonyms of 'limit' and 'offset', to closer match the Elasticsearch API. When user requests a reindex by specifying --type parameter, searchlight may copy existing Elasticsearch data to reindex, if these old indices or type mappings are missing, newly created indices will have incomplete resource data. Some Neutron ports that do not send notificatons to Searchlight. Do not initially index them. In Elasticsearch 2.x field names cannot contain '.', so when indexing document with property contains '.' in field name, it will fail with error "cannot contain '.'". New Features ************ * Adds notification handler for nova server group. * Notifications for flavor are now supported. * Adds ironic plugin with nodes, ports and chassis support. * Add support for the new Neutron tenant RBAC policy functionality. This allows networks to be shared across tenants. * Publishers can be configured at plugin level or top level in configuration file. When Searchlight does incremental updates via notifications, configured publishers will receive information about modified resources and publish them to subscribers outside Searchlight. * Adds on option "--notification-less" to "searchlight-manage index sync" to re-sync only plugins that don't have notifications. * In order to more closely match the Elasticsearch API, 'size' and 'from' can be used in place of 'limit' and 'offset'. * Add "error" notification level processing to listener. Known Issues ************ * The projects list will not present in the flavor related versioned notifications if you update the flavor access only because of a lazy-loaded bug in nova. Upgrade Notes ************* * To enable the notifications for flavor you need to config *notifications_topics_exchanges = versioned_notifications,nova* under section *resource_plugin:os_nova_flavor* * If you want to search field contains '.', you need to replace '.' with '++', e.g. 'sahara_tag_2.7.1' -> 'sahara_tag_2++7++1'. * Need to specify auth_type or auth_plugin(deprecated) to v2password in service_credentials group to make index work properly if you were using keystone v2 auth. Bug Fixes ********* * Fix a bug that incomplete types may be copyed during reindex. Add checks about data integrity before copying existing Elasticsearch data, warn user if there is any missing index or type mapping and exit. Users can suppress exit behavior by using force parameter. * Searchlight is indexing unused Neutron ports. Some Neutron ports do not result in notifications to Searchlight. We do not want to initially index them. * Replace '.' with '++' when saving documents to Elasticsearch, and convert back when searching results. Changes in searchlight 1.0.0.0rc1..2.0.0 ---------------------------------------- 30e64ae Updated from global requirements 9eacee8 Update UPPER_CONSTRAINTS_FILE for stable/ocata 5b4536d Update .gitreview for stable/ocata 6ba886b Use keystoneauth1 session instead of keystoneclient 1157d5c Handle ironic service not being present c823ebe Disable ironic plugin by default in devstack c7e9e69 Fix filtered queries for Elasticsearch 5 28b2701 Searchlight ironic plugin 741f419 Handle nova rename events 174284c Fix search policy unit test failure 1544a6c Implement flavor notification handler f2a3ce0 Fix server group rbac test 3593e3c Fix typo in utils.py 4b45f22 Updated from global requirements 5252235 Add a hacking to check double word typo automatically 3bd009f Fix HACKING.rst with hacking checks 4e1e6fd Update nova config reference file. 56a9add Removing Unused imports dd4f5ce Implement pipeline afc5ed8 Add metadata field and updated_at field to server group index 4e2ab07 Add server group notification handler c6664ec Support tests coverage report efab8bc Fix multi-typo in searchlight 19ba6ff Fix typo bfdb08e Updated from global requirements aef31cc Fix dot issue in field name 9ee9d89 Remove unused using_elasticsearch_v2 function 97b11aa Trival fix api-ref 10485a1 Updated from global requirements a8be92a Delete deprecated Hacking in tox.ini f974cbc Updated from global requirements 527706f Warn user if types using es to reindex don't exist 231780e Updated from global requirements 706a3fd Add alt text for badges a497b76 Use default jdk in devstack setup f44a90f Add tools/test-setup.sh script to setup test environment ba05d5f Fix typo in Helper.py 6126674 Use ConfigParser instead of SafeConfigParser in Python 3 6fca79e Show team and repo badges on README 1b6ca1a Replace six.iteritems() with .items() 019d33b Duplicated ES reindex when plugins in different groups b471409 Add option to reindex notification-less plugins 3cd5834 Remove uneccessary "in" from CONTRIBUTING.rst 0adbf58 Use messagingv2 by default ddab5e9 Replaces uuid.uuid4 with uuidutils.generate_uuid() 837a61c Modify variable's using method in Log Messages 6571bc6 Fix a typo in manage.py & utils.py c8b328e Fix typo in helper.py 61c2fd1 Allow notification handler cls to be None f9b2d67 Updated from global requirements 556e62e Updated from global requirements 682a7e6 Comment 'man_pages' config in conf.py 362bb12 Fix the issue that plugins list not shown on Searchlight Indexing page 3d1823e Change "Openstack" to "OpenStack" db19cd5 Remove mox3 in test-requirement.txt 6335ec7 Allow 'size' and 'from' as search parameters cfb7fdf Allow listener to process "error" notification priority dbed7e5 Drop MANIFEST.in - it's not needed by pbr 8ba8008 Remove html_static_path from doc ecf68bf Tool to translate a *.po file. 0128b2f Add http_proxy_to_wsgi to api-paste 0eaadd4 Don't include openstack/common in flake8 exclude list 84cb0e2 Enable release notes translation 171733a Fix typo: remove redundant 'the' f903665 Fix typo in notification_handlers.py d987b7f Fix typo in docstring 4b8ff3b Use upper constraints for all jobs in tox.ini f1804f2 Updated from global requirements 0a35be8 Fix a typo in documentation 5f34e51 Fix a typo in authoring-plugins.rst,etc 97b8bcd api-ref: Add Searchlight api-ref 3c60230 Use upper-constraints for tox envs 80a728c Docstrings should not start with a space eabdaf2 TrivialFix: Remove default=None when set value in Config aef7fed RBAC for network sharing f0a4630 Return __searchlight-user-role with highlighting 10d47a0 Restrict image member list 5d50149 Support X_IS_ADMIN_PROJECT header on auth response f9ad0ea Don't listen for dns.zone.exists 13e9cfa Security group rule race condition be5ef61 Log indexing exceptions at 'exception' level 4387547 Updated from global requirements 33a14d4 Do not index some Neutron ports. c15df25 'deleted_at' Date field needed for get_version 88fa016 Cinder mapping incorrect. 60d2b52 Update reno for stable/newton 09dc0f1 Remove duplicate project facets from cinder plugins Closes-Bug: #1558606 Diffstat (except docs and test files) ------------------------------------- .gitreview | 1 + CONTRIBUTING.rst | 2 +- HACKING.rst | 33 +- MANIFEST.in | 16 - README.rst | 14 + api-ref/source/http-codes.yaml | 55 ++ api-ref/source/index.rst | 7 +- .../samples/create-search-admin-request.json | 6 + .../samples/create-search-aggregation-request.json | 11 + .../create-search-aggregation-response.json | 64 ++ .../source/samples/create-search-all-request.json | 5 + .../source/samples/create-search-all-response.json | 61 ++ .../create-search-complex-boolean-request.json | 25 + .../create-search-complex-boolean-response.json | 93 +++ .../samples/create-search-free-text-request.json | 9 + .../samples/create-search-free-text-response.json | 45 ++ .../create-search-multiple-type-request.json | 6 + .../create-search-phrase-field-request.json | 8 + .../create-search-phrase-field-response.json | 45 ++ .../samples/create-search-single-type-request.json | 6 + .../create-search-single-type-response.json | 44 ++ .../list-facets-all-response-exclude-options.json | 78 +++ .../source/samples/list-facets-all-response.json | 90 +++ .../list-facets-include-fields-response.json | 11 + .../source/samples/list-facets-type-response.json | 27 + api-ref/source/samples/list-plugins-response.json | 14 + api-ref/source/search-parameters.yaml | 170 +++++ api-ref/source/searchlight-v1.inc | 696 +++++++++++++++++++++ devstack/local.conf | 11 +- devstack/plugin.sh | 20 +- etc/api-paste.ini | 6 +- etc/policy.json | 9 +- ...roup-notification-handler-d10aed78bede2c12.yaml | 3 + ...nfigurable-index-settings-59e00230f669c1a8.yaml | 2 +- .../bp-flavor-notifications-c9454eb39ab8f567.yaml | 11 + .../notes/bp-ironic-plugin-922204f24ecb2f16.yaml | 3 + .../bp-neutron-tenant-rbac-0922f23111965f7c.yaml | 9 + .../bp-pipeline-architecture-dc2d10d5609af1f9.yaml | 11 + .../bp-reindex-interval-a43c37189e948d28.yaml | 4 + ...bug-1568923-add-size-from-4dd681d72bc0ef6c.yaml | 8 + .../notes/bug-1596710-6a5287f0cd77cba0.yaml | 15 + ...bug-1621914-neutron-ports-58cf966264c09ce4.yaml | 8 + .../notes/bug-1622343-648b6b2b85e67209.yaml | 11 + .../notes/bug-1653752-a34a9a85deb92ed2.yaml | 5 + .../listener-error-level-582765d9d48d4e01.yaml | 3 + releasenotes/source/conf.py | 3 + releasenotes/source/index.rst | 1 + releasenotes/source/newton.rst | 6 + requirements.txt | 27 +- searchlight/api/middleware/context.py | 9 +- searchlight/api/v1/search.py | 94 +-- searchlight/cmd/manage.py | 125 ++-- searchlight/common/config.py | 2 - searchlight/common/property_utils.py | 9 +- searchlight/common/resource_types.py | 4 + searchlight/common/utils.py | 29 +- searchlight/common/wsgi.py | 12 +- searchlight/elasticsearch/__init__.py | 30 +- searchlight/elasticsearch/plugins/base.py | 118 +++- .../elasticsearch/plugins/cinder/__init__.py | 4 +- .../elasticsearch/plugins/cinder/snapshots.py | 1 - .../cinder/snapshots_notification_handler.py | 19 +- .../elasticsearch/plugins/cinder/volumes.py | 3 +- .../plugins/cinder/volumes_notification_handler.py | 23 +- .../plugins/designate/notification_handlers.py | 75 ++- .../elasticsearch/plugins/glance/__init__.py | 7 +- searchlight/elasticsearch/plugins/glance/images.py | 39 +- .../plugins/glance/images_notification_handler.py | 37 +- .../elasticsearch/plugins/glance/metadefs.py | 23 +- .../glance/metadefs_notification_handler.py | 306 +++++---- searchlight/elasticsearch/plugins/helper.py | 52 +- .../elasticsearch/plugins/ironic/__init__.py | 43 ++ .../elasticsearch/plugins/ironic/chassis.py | 61 ++ searchlight/elasticsearch/plugins/ironic/nodes.py | 71 +++ .../plugins/ironic/notification_handlers.py | 187 ++++++ searchlight/elasticsearch/plugins/ironic/ports.py | 71 +++ .../elasticsearch/plugins/ironic/resources.py | 113 ++++ .../elasticsearch/plugins/neutron/__init__.py | 19 + .../elasticsearch/plugins/neutron/networks.py | 57 +- .../plugins/neutron/notification_handlers.py | 342 +++++++--- searchlight/elasticsearch/plugins/neutron/ports.py | 44 +- .../elasticsearch/plugins/neutron/subnets.py | 23 +- searchlight/elasticsearch/plugins/nova/__init__.py | 53 +- searchlight/elasticsearch/plugins/nova/flavors.py | 16 +- .../elasticsearch/plugins/nova/hypervisors.py | 3 - .../plugins/nova/notification_handler.py | 251 ++++++-- .../elasticsearch/plugins/nova/servergroups.py | 4 +- searchlight/elasticsearch/plugins/nova/servers.py | 2 + .../elasticsearch/plugins/openstack_clients.py | 96 +-- .../elasticsearch/plugins/swift/__init__.py | 7 +- .../elasticsearch/plugins/swift/containers.py | 16 +- searchlight/elasticsearch/plugins/swift/objects.py | 28 +- .../plugins/swift/swift_notification_handler.py | 84 ++- searchlight/elasticsearch/plugins/utils.py | 46 +- searchlight/hacking/checks.py | 16 + searchlight/listener.py | 58 +- searchlight/opts.py | 8 +- searchlight/pipeline.py | 120 ++++ searchlight/publisher/__init__.py | 0 searchlight/publisher/log.py | 29 + searchlight/service_policies.py | 3 +- .../unit/test_neutron_securitygroup_plugin.py | 126 +++- setup.cfg | 5 + test-requirements.txt | 13 +- tools/check_translate.sh | 127 ++++ tools/test-setup.sh | 14 + tox.ini | 15 +- 162 files changed, 6741 insertions(+), 1340 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index b90f6f9..9d189ea 100644 --- a/requirements.txt +++ b/requirements.txt @@ -5 +5 @@ -pbr>=1.6 # Apache-2.0 +pbr>=1.8 # Apache-2.0 @@ -16,2 +16,2 @@ Routes!=2.0,!=2.3.0,>=1.12.3;python_version!='2.7' # MIT -WebOb>=1.2.3 # MIT -oslo.config>=3.14.0 # Apache-2.0 +WebOb>=1.6.0 # MIT +oslo.config!=3.18.0,>=3.14.0 # Apache-2.0 @@ -22,3 +22,3 @@ oslo.service>=1.10.0 # Apache-2.0 -oslo.utils>=3.16.0 # Apache-2.0 -stevedore>=1.16.0 # Apache-2.0 -keystonemiddleware!=4.1.0,!=4.5.0,>=4.0.0 # Apache-2.0 +oslo.utils>=3.18.0 # Apache-2.0 +stevedore>=1.17.1 # Apache-2.0 +keystonemiddleware>=4.12.0 # Apache-2.0 @@ -30 +30 @@ Paste # MIT -python-keystoneclient!=2.1.0,>=2.0.0 # Apache-2.0 +python-keystoneclient>=3.8.0 # Apache-2.0 @@ -36,3 +36,3 @@ oslo.i18n>=2.1.0 # Apache-2.0 -oslo.log>=1.14.0 # Apache-2.0 -oslo.messaging>=5.2.0 # Apache-2.0 -oslo.policy>=1.9.0 # Apache-2.0 +oslo.log>=3.11.0 # Apache-2.0 +oslo.messaging>=5.14.0 # Apache-2.0 +oslo.policy>=1.17.0 # Apache-2.0 @@ -47,2 +47,2 @@ python-designateclient>=1.5.0 # Apache-2.0 -python-glanceclient!=2.4.0,>=2.3.0 # Apache-2.0 -python-novaclient!=2.33.0,>=2.29.0 # Apache-2.0 +python-glanceclient>=2.5.0 # Apache-2.0 +python-novaclient!=7.0.0,>=6.0.0 # Apache-2.0 @@ -51 +51,2 @@ python-cinderclient!=1.7.0,!=1.7.1,>=1.6.0 # Apache-2.0 -python-swiftclient>=2.2.0 # Apache-2.0 +python-swiftclient>=3.2.0 # Apache-2.0 +python-ironicclient>=1.11.0 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index 2459aff..63f85cc 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -12 +12 @@ Babel>=2.3.4 # BSD -coverage>=3.6 # Apache-2.0 +coverage>=4.0 # Apache-2.0 @@ -14 +13,0 @@ fixtures>=3.0.0 # Apache-2.0/BSD -mox3>=0.7.0 # Apache-2.0 @@ -16,2 +15,2 @@ mock>=2.0 # BSD -sphinx!=1.3b1,<1.3,>=1.2.1 # BSD -requests>=2.10.0 # Apache-2.0 +sphinx!=1.3b1,<1.4,>=1.2.1 # BSD +requests!=2.12.2,>=2.10.0 # Apache-2.0 @@ -20 +19 @@ testtools>=1.4.0 # MIT -psutil<2.0.0,>=1.1.1 # BSD +psutil>=3.0.1 # BSD @@ -22 +21 @@ oslotest>=1.10.0 # Apache-2.0 -reno>=1.8.0 # Apache2 +reno>=1.8.0 # Apache-2.0 @@ -28 +27 @@ os-api-ref>=1.0.0 # Apache-2.0 -oslosphinx!=3.4.0,>=2.5.0 # Apache-2.0 +oslosphinx>=4.7.0 # Apache-2.0

1 0

[heat] heat 8.0.0 (ocata)
by no-reply＠openstack.org 22 Feb '17

22 Feb '17

We contentedly announce the release of: heat 8.0.0: OpenStack Orchestration This release is part of the ocata release series. Download the package from: https://tarballs.openstack.org/heat/ For more details, please see below. 8.0.0 ^^^^^ New Features ************ * OS::Aodh::CompositeAlarm resource plugin is added to manage Aodh composite alarm, aim to replace OS::Aodh::CombinationAlarm which has been deprecated in Newton release. * OS::Cinder::QoSAssociation resource plugin is added to support cinder QoS Specs Association with Volume Types, which is provided by cinder "qos-specs" API extension. * Designate v2 resource plugins OS::Designate::Zone and OS::Designate::RecordSet are newly added. * A new resource plugin "OS::Keystone::Domain" is added to support the lifecycle of keystone domain. * The "resource mark unhealthy" command now accepts either a logical resource name (as it did previously) or a physical resource ID to identify the resource to be marked unhealthy. * New resource "OS::Neutron::Quota" is added to manage neutron quotas. * New resource "OS::Nova::Quota" is added to enable an admin to manage Compute service quotas for a specific project. * A new resource "OS::Sahara::Job" has been added, which allows to create and launch sahara jobs. Job can be launched with resource- signal. * Custom constraints for all sahara resources added - sahara.cluster, sahara.cluster_template, sahara.data_source, sahara.job_binary, sahara.job_type. * OS::Nova::Server now supports ephemeral_size and ephemeral_format properties for block_device_mapping_v2 property. Property ephemeral_size is integer, that require flavor with ephemeral disk size greater that 0. Property ephemeral_format is string with allowed values ext2, ext3, ext4, xfs and ntfs for Windows guests; it is optional and if has no value, uses default, defined in nova config file. * New "OS::Zaqar::Notification" and "OS::Zaqar::MistralTrigger" resource types allow users to attach to Zaqar queues (respectively) notifications in general, and notifications that trigger Mistral workflow executions in particular. Deprecation Notes ***************** * Designate v1 resource plugins OS::Designate::Domain and OS::Designate::Record are deprecated. Bug Fixes ********* * 'CEPHFS' can be used as a share protocol when using OS::Manila::Share resource. Changes in heat 7.0.0.0rc1..8.0.0 --------------------------------- b79195d Add CEPHFS manila share protocol 82aabe9 Just to migrate existing resource to backup stack b38ff79 Use region_name when creating keystone client 8ef4566 Prepare for using standard python tests 59cad62 Update UPPER_CONSTRAINTS_FILE for stable/ocata d8f851f Update .gitreview for stable/ocata 01580af Fix restore_prev_rsrc assert weakref 057f563 ResourceGroup fix issue with batch create and zero count aee1099 Move CFN pseudo functions out of Parameters base class 2b69e0e Don't try to store i18n messages 00e3e16 Don't mock internal method of ceilometerclient cb7aeb6 Fix ceilometerclient mocks for 2.8.0 release 49f316b Fix i18n issue in event.py e873228 Add attribute 'collect' to senlin cluster 8065962 Keystone::Project observe reality implementation e7ad297 Add missing import for zaqar client 197febd Improve resource.NoActionRequired 57c5aae De-duplicate properties_data between events, resources 8496d98 Updated from global requirements a1835e6 Delete accidental artifact d6a90cc Fix for resources stuck in progress after engine crash b340c13 Don't make client calls when adding dependencies 4b25dd6 Don't override _show_resource() for image 78d1f4c Remove py26 support e6c88a0 Updated from global requirements 0549ee2 Always replace DELETE_COMPLETE resources on update bbb7b21 Don't look at convergence_engine conf option in Resource 54f1304 Updated from global requirements 10ddb89 Provide unified _show_resource() for senlin resources 60cfa2a Fix nits of server tag test b075ae7 Fix handle_create() of senlin cluster resource 6a64578 Use os_cache in place of no_cache d33ade9 Fix MistralClientPluginTest.test_create a9db263 Skip integration tests when not configured 91a7a41 Add policies property to cluster resource efabef6 Efficient passing of attrs during traversals ef176f3 Add reno for OS::Sahara::Job 166ad02 Add translation rules for OS::Sahara::Job 0266de6 Add sahara constraints c4acd52 Refactor _show_resource() for neutron resources 65790f6 Add translation rules to senlin policy resource 76450e6 Add reality support to senlin node resource d566f0f Add translation rules to senlin node resource 936b3c3 Change order of init _facade and osprofiler 9014a2b Updated from global requirements cfe4e9e Add port_security_enabled property to ProviderNet 5ce7978 Add gabbi tests for resource REST API 8434563 Add cluster property to senlin node resource e950bbb Don't load resources in dep_attrs 4507322 Don't load non-referenced resources from DB c4c5dfd Allow admins to get resource by physical resource id f0f58a8 Remove handle_delete() for keystone group 25f2a7b Avoid to use internal attribute '_info' 03708d5 Release notes for designate v2 support 6ef5fa9 Make API services with apache the default e943d08 Make number of workers configurable with apache 3593545 Set content-type when signaling deployment af6fb8a Use super method _show_resource() for alarms c1d6ee1 Fix validate_external() 3227b1d Don't use MagicMock for stacks in tests e1aeaba Ignore dependency errors with conditions 20cadfb Fix errors resulting from over-long Zaqar queue names 80e2fba Unit tests: Don't mock client_plugin for Zaqar subscription f08e592 Allow query types other than string in Aodh alarms 16a4637 Deprecate OS::Glance::Image e8a5ce0 Sort JSON output in intrinsic functions d6f6bfc Mark nested stacks unhealthy by refid fc0f4a1 Add OS::Neutron::Quota resource 6813a76 Default to Glance v2 09fc044 Allow to scale when group is in CHECK_COMPLETE 53690ff Add reality support for senlin cluster resource e1124b2 Include an OS::stack_id output when generating a template 5553a6f Correct output values when generating templates fbc6911 Correct to 'heat_config_notify_script' 71ca073 Add translate rules for senlin cluster 52de872 Don't replace failed neutron resources always 116158a Check `resource_validate` before validate external f92a3c8 Deprecate designate v1 resource plugin d615066 Add designate recordset support 55f26d7 Add designate zone support 9087f24 Add note for env prepare of `Custom image script` 82a11ce Do not replace failed server always 2a6dc1a Check if image_identifier is UUID 600a448 Do nothing in prepare_for_replace if server not created 19632db Fix senlin resources update failure 75b68fb Updated from global requirements def894c Release notes for OS::Keystone::Domain a7616c3 Remove greenlet useless requirement 557eff5 Replace always if resource is in CHECK_FAILED 7bf4595 Don't try detach interface when server not found 88b15d1 Remove repeat entity defination c31343f Enable resource _show_resource with dict type 587d128 Use correct charset when create a text/* type MIME 5b04acb To reset metadata for resources when mark unhealthy 27a99d5 Fix a small nit of docs 241b02e Add more gabbi REST API tests 172fe35 Initial heat REST API tests with gabbi bd3199c make the rabbitmq configuration simpler 75595ec Set access_policy for messaging's dispatcher 23f6ea3 Updated from global requirements 1a7881f Use heat.engine.resource.UpdateReplace 24d820d Enable coverage report 35a4981 Don't use keystone_authtoken section for trust da864c8 Use 'openstack' commands instead in docs 18178ce Make sure heat works with novaclient 7.0.0 e6aed1b Add OS::Sahara::Job resource b40115b Use _show_resource() of super class 745c155 Avoid to use same code for aodh resources 0a66b77 Sanitize newly added heat-manage command 94bdbee Trivial fix some typos in api-ref ae1ebcc Fix for validating firewall resource status a658a18 Updated from global requirements 92c2454 Fix string declaration in environment_util.py eaca4eb Returns project info while getting sd with admin context 791c245 Add resource_properties_data assoc. to resource, event objs 1ea6bb8 Add the ResourcePropertiesData object d80c23f Add resource_properties_data data migration f3e6f47 One transaction per encrypt/decrypt batch c540293 map_replace allow noop colliding replacements 13d2560 Make *_id/name_url required for api-ref 922f51e Skip test_server_signal_userdata_format_software_config 3f683ab Recreate db only if db service is enabled 2f317af Use metadata and personality with server rebuild ee2cdd3 Make subnet required for lbaasv2 member resource b84e31b Correct the order of assertEqual eb7b5a3 Don't validate rsrc properties with external_id 798bb10 Several improvements of pluginguide.rst a6f34dd Avoid Forcing the Translation of Translatable Variables c669955 Update the constraint value of schema 'ACCESS_TYPE' for Manila share d4307b5 Allows to create x509 keypair 2d66f74 Allow to create admin context for tests 3bc38ee Updated from global requirements 1e5f5ca Use urllib to correctly escape URLs for Zaqar queues 52cbc83 Add convenience properties for alarm queue actions 626d7fc Add a zaqar.queue custom constraint 1b64098 Nova Flavor Resource Update c2c55ba Updated from global requirements 6647354 Refactor batch encrypt/decrpyts of params, props 2310d0b Update fedora image in devstack 5807064 Updated from global requirements c0f051b Refactor BaseAlarm.actions_to_urls() aee97eb Fix inconsistencies in updating alarms 8933667 Default implementation parse_live_resource_data a3b1b17 Correct response of template-version-list 9ee3a7e Updated from global requirements f2fb0c1 Add DeployedServer resource 6959f4b Use BaseServer base class for Nova Server resource 84067db Remove db.api wrapper d9021d3 Support composite alarm 5cf81b2 Set default value for 'metadata' of cinder volume 0fc8e63 Set default value for 'metadata' of nova server 5360729 Cleanup test env after tests dbd6784 Refactor port tests 4a610e6 Support new osprofiler API e42f1b3 Remove unused mock for server check tests c38f68e Use assertIsNone(...) instead of assertEqual(None, ...) ca71c69 Don't replace failed volume always 3e633fb Include API version in Zaqar URLs 563bbe8 Updated from global requirements d5f1e90 Ephemeral disk size support for server bdm_v2 82478c2 Use mock instead of mox for keypair test 8d25dc6 Updated from global requirements 14fe913 Fix typo in plugin.sh bebe21a Revert "Fix devstack plugin" workaround 698d703 Add policy for Keystone resource types 549285c Don't use hardcoded flavors in tests 4e46540 Allow mark-unhealthy by physical resource ID f310a1f Handle ambiguous physical resource IDs 780f4dc Updated from global requirements b158dcf More efficient db resources-per-stack count 510a37b Updated from global requirements 636b6c7 Don't validate address when using get_attr a5e0da1 Updated from global requirements c93e44d Use __slots__ for dependencies.Node ec7abd0 Add an OS::Zaqar::MistralTrigger resource type 9d282ed Use keystone session with zaqar client plugin 35c6ee5 Use both domain id and name 6c26eb8 Fix a small nit 01487eb Make the name of a Zaqar queue optional 015c3c2 Don't return the signed queue URL from get_resource 6afc7a6 Includes project info while admin getting stacks 63318f4 Supports 'direct-physical' and 'baremetal' vnic type for port 1b05208 Add validation for conflicting merge strategies f3302c3 Do not count events for every event created a673ee2 Refactor, add encrypt/decrypt data dict functions to crypt 0925692 Minor encrypt/decrypt unittest refactor 882a640 Refactor purge_deleted, operate on batches of stacks ced6f78 Avoid re-validating resources in nested stacks ffdf485 Fix typo 77f6c5a Show team and repo badges on README 16be8ba Do not set the mime-type for userdata 0225ff7 Updated from global requirements da1af07 Keystone::User observe reality implementation e0ff43e Refactor _needs_update() for resource 1c714d9 Use i18n to translate msg in LOG.xxx() 9b7c72b Updated from global requirements f1bc509 More efficient pruning of events 3aebdab Avoid redundant validations 39eaa84 Allow 'mac_address' updatable for neutron port dfcb265 Use more specific asserts in tests 7780f7a Use both endpoint and endpoint_override 0fb991c Move call trove cluster delete to check complete ea3eb60 Skip test_cancel_update_server_with_port bdcedf2 Use endpoint_override with heat client plugin 2045a8d Remove oslo-incubator use in other client plugins 536eb28 Use apache config templates from local tree af4086b Docs of configuring Devstack to enable heat bc989cd Remove extra resource definition loading 6282332 Fix get all attributes with cache data 0ee5aa1 Updated from global requirements 8bec657 Remove unused pylintrc b579d9f Give correct example for translation_rules definition e1237f4 Don't use oslo-incubator in glance client plugin 551b185 Don't try to delete trust if trustor not found 756dda7 Replace retrying with tenacity ddd5556 Use timeout as whole seconds in swift plugin e1d8eb7 Cleanup heat apache wsgi configs 0fe4bc7 Update .coveragerc after the removal of openstack directory 349e67b Do not throw an exception if stack outputs is not set 65b3f84 Add OS::Nova::Quota resource 25f44b5 Add tags property to OS::Nova::Server ce64d23 Add support different versions for nova client 0ab60b0 Observe reality for OS::Keystone::Domain 98f2372 Don't include openstack/common in flake8 exclude list f20c53b Updated from global requirements 5734f52 Updated from global requirements 87d0ca5 Adds Keystone Domain resource plugin 0f2f9c2 Remove oslo-incubator modules aa000b2 m1.tiny is not always there 892a4ea Do not load templates in stop_traversal 498ee45 Initial PropertiesGroup implementation 0725399 Updated from global requirements d5ef455 Make FloatingIP depend on all RouterInterfaces again df674a7 Add filter function 073222e Add OS::Zaqar::Subscription resource 34f6ff9 Cleanup service usage 4239a95 Fix resource-list with nested_depth in convergence 18fb531 Updated from global requirements 571740f Support Zaqar signed queue URLs c28c314 Updated from global requirements 96faa97 Speed up lbaasv2 test 26aa33e Fix resource_signal with convergence 2407c86 Ignore merged env if environment files are specified d30965a Imported Translations from Zanata 5d2ff48 Don't operate queue if it was not found 99edb79 Updated from global requirements c2cde5a Keystone::Group observe reality implementation a7c7945 Add info to docs about heat devstack plugin 96cec39 Keystone::Region observe reality implementation 049a6a9 Updated from global requirements 0fed810 Updated from global requirements 0c92216 Use osc commands for creating neutron resources 4794cf2 Raise TypeError when a bool property has int value a408ccd dd missing memory.resident to NOVA_METERS d3828e8 Updated from global requirements ad4329d Remove unnecessary install_heat_other c598658 Don't query raw_template in stacks uselessly eab9a33 Prevent template validate from scanning ports 9037221 Updated from global requirements 7dd06fc Adds 5 backport db migration place holder for newton f9fe6ab Squash database patches 4ca2950 Don't resolve attribute pre-storage b53e9ef Remove the deprecated Stack.resolve_static_data() method 2c6fc7b Remove support for accessing ResourceDefinition like a dict 53482b0 Unit tests: Don't use ResourceDefinition as cfn snippet 5b6aa66 Remove the Resource.parsed_template() method 58c0bbf Get rid of cfn-compatibility in ResourceDefinition.Diff 62f6045 Return condition functions based on the filter param 43af5e4 Add noauth middleware 1486289 heat-all: all-in-one heat launcher 45076fb Updated from global requirements e099af6 Change credentials.create argument cc98596 Add OS::Aodh::EventAlarm resource 3a3e6a8 Use RPC to retrieve nested stack output df88948 Avoid loading nested stacks in memory where possible 7bf5527 Keep same physical_resource_name in backup stack b1144b2 Add a modulo core constraint 9180d7b Add networking-sfc port-chain resource plug-in aac3e7a Add new hot function str_replace_strict f7a0cd4 Keystone::Endpoint observe reality implementation 6ad6ca3 Add http_proxy_to_wsgi middleware to Heat CFN endpoint cd69fe3 Fix typo in documentation 741ee95 Updated from global requirements f09a37e Correct invalid git URL in LogABug config 413a114 Enable release notes translation 2199065 Use __slots__ in Parameter classes bca740a Avoid double init of classes with __new__ 9a76d19 Add networking-sfc flow-classifier resource plug-in df71486 Pass region_name to session client 8b7e5be Create a root Yaql context 6396d7c Add workaround for functions in translation f2881d4 Resolve all functions before RESOLVE translation adb8629 Use __slots__ in ResourceInfo classes de319d2 Add implicit deps after calculation of all explicit deps 260b79e Don't always eagerly load the raw_template for a stack 1e92462 Properly compute resource_properties pickle 89526b5 Use empty list for None values in repeat function 0830318 Don't create yaql context 74dde02 Make nova server user_data format configurable 58a88d9 Correct deleting of role assignments 1c1948b Updated from global requirements 5fc3e01 Don't get derived config if resource ID unset bc3c16a Remove unnecessary setUp and tearDown 279ad22 Fix a typo in engine_wrapper.py d17144d Use minimal image wherever possible 4e5b0ce Updated from global requirements 2e40bcc Add Apache 2.0 license to source file 5c0b9d4 Switch fedora mirror 8b3308c Allow policies for resource_types with wildcard 513f409 Fix typo in docstring 2a5dbdc Using assertIsNone() instead of assertEqual(None, ...) ada0a1a Enforce policy before resource.validate c3021de Break cycle between Resource and Attributes 8de00cd Keystone role assignment observe reality method 2993aac Hidden policies property of OS::Mistral::Workflow fa2f4fa Small refactoring translation mechanism 794cf5c Speed up environment test 7bc114b Using assertIsNotNone() instead of assertIsNot(None) 9e7ac66 Using assertIsNone() instead of assertIs(None) a7106c9 Updated from global requirements 23f68fa Run integration tests with tempest before upgrade eaedf85 Fix indentation in get_param example b3733f1 Fix typo 'duplcate' to 'duplicate' in status.yaml 2793421 Fix create/update keystone endpoint with service name 38483c5 Avoid circular refs more aggressively in DependencyTaskGroup 4d10955 Use save_and_reraise_exception() in HeatException 82b8fd8 Get rid of circular reference in Event class e56fc68 Increase the timeout for the stop_stack message ec45f0e Return error with path in function validate d4a9cdb Wait for deletion_time in integration tests 1061ba7 Updated from global requirements c9ceacf Nova::Server observe reality implementation e1f161a Do not attempt deletion of a DELETE_COMPLETE stack in service api aa90b5a Add a new HOT template version for Ocata e5cec71 Don't use cast() to do StackResource delete 55c21c1 Don't delete RawTemplate if it referenced by a stack 0dbe25a Add networking-sfc port-pair-group resource plug-in 65e7e59 Set hooks before storing events 4ddb703 Use neutron cli command instead of osc 2ca07d1 Add Ocata version '8.0.0' in doc f34a7bb Trivial:Standardize the output format of 'help' in some files c056352 Remove unnecessary __init__ 5c74723 Add missing %s in print message 584efe3 Fix cancel update for nova server with defined port 99b055b Re-trigger on update-replace a5eb936 Trivial refactor of session var in reset_stack_status b75407f Updated from global requirements cd09078 Add resource OS::Cinder::QoSAssociation 3000f90 Legacy delete attempt thread cancel before stop 2a66246 Raise NotImplementedError instead of NotImplemented e2ba339 Don't acquire the lock when cancelling a stack 676281d Use correct schema for SoftwareDeploymentGroup rolling_update 728646e delete python bytecode including pyo before every test run d5cd398 Example for "Replace" function should use self.fn_name 353e731 Allow update inplace for allowed_address_pairs bc2e136 Cancel traversal of nested stack 1b47a59 Update reno for stable/newton 7f5bd76 Don't log locked resource ERROR level 7b6ac8a Update link reference 2e281df Fix sync point delete bf5ce6a Correct the response info of template-version-list 6552396 Trivial: Replace 'assertTrue(a not in b)' with 'assertNotIn(a, b)' 4bd9b81 Release resource lock when executing reset_stack_status e6da5b5 Use enginefacade instead of db_session 2a16c58 Using oslo_config's min attribute in heat cfb07cb Use upper constraints for all jobs in tox.ini 57c2af3 Functional test for asg cooldown property 886b99e Functional test for asg max_size and min_size Diffstat (except docs and test files) ------------------------------------- .coveragerc | 2 +- .gitreview | 1 + HACKING.rst | 3 + README.rst | 9 + api-ref/source/conf.py | 4 +- api-ref/source/v1/events.inc | 2 +- api-ref/source/v1/parameters.yaml | 21 +- api-ref/source/v1/resources.inc | 4 +- .../v1/samples/template-versions-response.json | 21 +- api-ref/source/v1/stack-templates.inc | 2 +- api-ref/source/v1/stacks.inc | 4 +- api-ref/source/v1/status.yaml | 2 +- bin/heat-keystone-setup-domain | 21 +- contrib/heat_docker/setup.cfg | 1 - contrib/rackspace/README.md | 4 +- contrib/rackspace/setup.cfg | 1 - devstack/files/apache-heat-api-cfn.template | 5 +- devstack/files/apache-heat-api-cloudwatch.template | 5 +- devstack/files/apache-heat-api.template | 5 +- devstack/lib/heat | 114 +--- devstack/plugin.sh | 14 +- devstack/upgrade/resources.sh | 8 +- devstack/upgrade/upgrade.sh | 2 +- etc/heat/api-paste.ini | 15 +- etc/heat/policy.json | 6 +- heat/api/aws/exception.py | 1 + heat/api/middleware/fault.py | 1 + heat/api/middleware/ssl.py | 8 +- heat/api/openstack/v1/stacks.py | 18 +- heat/cmd/all.py | 91 +++ heat/cmd/api.py | 37 +- heat/cmd/api_cfn.py | 39 +- heat/cmd/api_cloudwatch.py | 41 +- heat/cmd/engine.py | 15 +- heat/cmd/manage.py | 27 +- heat/common/config.py | 27 +- heat/common/context.py | 37 +- heat/common/crypt.py | 73 +- heat/common/environment_util.py | 37 +- heat/common/exception.py | 47 +- heat/common/messaging.py | 5 +- heat/common/noauth.py | 70 ++ heat/common/pluginutils.py | 6 +- heat/common/policy.py | 19 +- heat/common/profiler.py | 16 +- heat/common/urlfetch.py | 3 +- heat/common/wsgi.py | 9 +- heat/db/api.py | 463 ------------- heat/db/sqlalchemy/api.py | 757 +++++++++++++-------- heat/db/sqlalchemy/migrate_repo/manage.py | 13 + .../sqlalchemy/migrate_repo/versions/062_kilo.py | 362 ---------- .../versions/063_properties_data_encrypted.py | 25 - .../versions/064_raw_template_predecessor.py | 52 -- .../migrate_repo/versions/065_liberty.py | 368 ++++++++++ .../migrate_repo/versions/065_root_resource.py | 48 -- .../migrate_repo/versions/074_placeholder.py | 20 + .../migrate_repo/versions/075_placeholder.py | 20 + .../migrate_repo/versions/076_placeholder.py | 20 + .../migrate_repo/versions/077_placeholder.py | 20 + .../migrate_repo/versions/078_placeholder.py | 20 + .../versions/079_resource_properties_data.py | 55 ++ heat/db/sqlalchemy/migration.py | 2 +- heat/db/sqlalchemy/models.py | 20 + heat/db/sqlalchemy/utils.py | 10 +- heat/db/utils.py | 57 -- heat/engine/api.py | 16 +- heat/engine/attributes.py | 21 +- heat/engine/cfn/parameters.py | 52 ++ heat/engine/cfn/template.py | 7 +- heat/engine/check_resource.py | 27 +- heat/engine/clients/__init__.py | 3 +- heat/engine/clients/client_exception.py | 27 + heat/engine/clients/client_plugin.py | 7 +- heat/engine/clients/os/aodh.py | 3 +- heat/engine/clients/os/barbican.py | 3 +- heat/engine/clients/os/ceilometer.py | 8 +- heat/engine/clients/os/cinder.py | 1 + heat/engine/clients/os/designate.py | 33 +- heat/engine/clients/os/glance.py | 44 +- heat/engine/clients/os/heat_plugin.py | 5 +- .../clients/os/keystone/heat_keystoneclient.py | 17 +- heat/engine/clients/os/magnum.py | 5 +- heat/engine/clients/os/manila.py | 5 +- heat/engine/clients/os/neutron/__init__.py | 63 +- .../clients/os/neutron/neutron_constraints.py | 26 + heat/engine/clients/os/nova.py | 106 ++- heat/engine/clients/os/sahara.py | 95 ++- heat/engine/clients/os/senlin.py | 40 ++ heat/engine/clients/os/swift.py | 2 +- heat/engine/clients/os/trove.py | 5 +- heat/engine/clients/os/zaqar.py | 32 +- heat/engine/constraints.py | 79 +++ heat/engine/dependencies.py | 2 + heat/engine/environment.py | 28 +- heat/engine/event.py | 68 +- heat/engine/function.py | 26 +- heat/engine/hot/functions.py | 121 +++- heat/engine/hot/parameters.py | 78 ++- heat/engine/hot/template.py | 50 +- heat/engine/notification/__init__.py | 6 +- heat/engine/output.py | 4 +- heat/engine/parameters.py | 35 +- heat/engine/properties.py | 15 +- heat/engine/properties_group.py | 84 +++ heat/engine/resource.py | 330 +++++---- heat/engine/resources/alarm_base.py | 115 +++- .../resources/aws/autoscaling/autoscaling_group.py | 7 +- heat/engine/resources/aws/cfn/wait_condition.py | 3 - heat/engine/resources/aws/lb/loadbalancer.py | 4 +- heat/engine/resources/openstack/aodh/alarm.py | 150 +++- .../resources/openstack/aodh/composite_alarm.py | 101 +++ .../resources/openstack/aodh/gnocchi/alarm.py | 16 +- .../resources/openstack/barbican/container.py | 2 + heat/engine/resources/openstack/barbican/order.py | 2 + heat/engine/resources/openstack/barbican/secret.py | 2 + .../engine/resources/openstack/cinder/qos_specs.py | 94 +++ heat/engine/resources/openstack/cinder/volume.py | 13 + .../resources/openstack/cinder/volume_type.py | 5 +- .../engine/resources/openstack/designate/domain.py | 13 +- .../engine/resources/openstack/designate/record.py | 9 +- .../resources/openstack/designate/recordset.py | 175 +++++ heat/engine/resources/openstack/designate/zone.py | 180 +++++ heat/engine/resources/openstack/glance/image.py | 43 +- .../resources/openstack/heat/deployed_server.py | 118 ++++ heat/engine/resources/openstack/heat/multi_part.py | 11 +- .../resources/openstack/heat/remote_stack.py | 2 + .../resources/openstack/heat/resource_group.py | 3 +- .../resources/openstack/heat/scaling_policy.py | 7 +- .../openstack/heat/software_deployment.py | 30 +- .../resources/openstack/heat/wait_condition.py | 3 - heat/engine/resources/openstack/keystone/domain.py | 102 +++ .../resources/openstack/keystone/endpoint.py | 29 + heat/engine/resources/openstack/keystone/group.py | 29 +- .../engine/resources/openstack/keystone/project.py | 37 +- heat/engine/resources/openstack/keystone/region.py | 19 + .../openstack/keystone/role_assignments.py | 105 +-- heat/engine/resources/openstack/keystone/user.py | 76 ++- heat/engine/resources/openstack/manila/share.py | 6 +- .../resources/openstack/manila/share_network.py | 2 + .../resources/openstack/mistral/cron_trigger.py | 2 + .../engine/resources/openstack/mistral/workflow.py | 63 +- .../openstack/monasca/alarm_definition.py | 5 - .../resources/openstack/monasca/notification.py | 15 +- .../resources/openstack/neutron/extraroute.py | 4 +- .../engine/resources/openstack/neutron/firewall.py | 17 + .../resources/openstack/neutron/floatingip.py | 24 +- .../openstack/neutron/lbaas/pool_member.py | 8 +- heat/engine/resources/openstack/neutron/neutron.py | 36 + heat/engine/resources/openstack/neutron/port.py | 19 +- .../resources/openstack/neutron/provider_net.py | 14 +- heat/engine/resources/openstack/neutron/quota.py | 159 +++++ heat/engine/resources/openstack/neutron/router.py | 11 +- .../openstack/neutron/sfc/flow_classifier.py | 190 ++++++ .../resources/openstack/neutron/sfc/port_chain.py | 140 ++++ .../openstack/neutron/sfc/port_pair_group.py | 112 +++ heat/engine/resources/openstack/nova/flavor.py | 69 +- heat/engine/resources/openstack/nova/floatingip.py | 2 + heat/engine/resources/openstack/nova/keypair.py | 41 +- heat/engine/resources/openstack/nova/quota.py | 249 +++++++ heat/engine/resources/openstack/nova/server.py | 528 +++++++------- .../openstack/nova/server_network_mixin.py | 129 ++-- heat/engine/resources/openstack/sahara/cluster.py | 7 +- heat/engine/resources/openstack/sahara/job.py | 314 +++++++++ .../resources/openstack/sahara/job_binary.py | 1 - heat/engine/resources/openstack/senlin/cluster.py | 283 ++++++-- heat/engine/resources/openstack/senlin/node.py | 119 +++- heat/engine/resources/openstack/senlin/policy.py | 28 +- heat/engine/resources/openstack/senlin/profile.py | 16 +- heat/engine/resources/openstack/senlin/receiver.py | 17 +- heat/engine/resources/openstack/senlin/res_base.py | 44 ++ heat/engine/resources/openstack/trove/cluster.py | 26 +- .../resources/openstack/trove/os_database.py | 2 + heat/engine/resources/openstack/zaqar/queue.py | 148 +++- .../resources/openstack/zaqar/subscription.py | 233 +++++++ heat/engine/resources/server_base.py | 309 +++++++++ heat/engine/resources/signal_responder.py | 1 + heat/engine/resources/stack_resource.py | 114 ++-- heat/engine/resources/stack_user.py | 15 +- heat/engine/resources/template_resource.py | 30 +- heat/engine/rsrc_defn.py | 187 +---- heat/engine/scheduler.py | 79 ++- heat/engine/service.py | 259 ++++--- heat/engine/service_software_config.py | 13 +- heat/engine/stack.py | 224 +++--- heat/engine/stack_lock.py | 7 +- heat/engine/template_files.py | 2 +- heat/engine/translation.py | 14 +- heat/engine/worker.py | 100 ++- heat/locale/de/LC_MESSAGES/heat.po | 318 ++++----- heat/locale/es/LC_MESSAGES/heat.po | 166 +---- heat/locale/fr/LC_MESSAGES/heat-log-error.po | 141 ---- heat/locale/fr/LC_MESSAGES/heat.po | 170 +---- heat/locale/it/LC_MESSAGES/heat.po | 167 +---- heat/locale/ja/LC_MESSAGES/heat.po | 162 +---- heat/locale/ko_KR/LC_MESSAGES/heat-log-error.po | 43 +- heat/locale/ko_KR/LC_MESSAGES/heat-log-warning.po | 12 +- heat/locale/ko_KR/LC_MESSAGES/heat.po | 159 +---- heat/locale/pt_BR/LC_MESSAGES/heat.po | 164 +---- heat/locale/ru/LC_MESSAGES/heat.po | 161 +---- heat/locale/zh_CN/LC_MESSAGES/heat.po | 141 +--- heat/locale/zh_TW/LC_MESSAGES/heat.po | 141 +--- heat/objects/event.py | 21 +- heat/objects/raw_template.py | 2 +- heat/objects/raw_template_files.py | 2 +- heat/objects/resource.py | 75 +- heat/objects/resource_data.py | 2 +- heat/objects/resource_properties_data.py | 70 ++ heat/objects/service.py | 2 +- heat/objects/snapshot.py | 2 +- heat/objects/software_config.py | 2 +- heat/objects/software_deployment.py | 2 +- heat/objects/stack.py | 21 +- heat/objects/stack_lock.py | 2 +- heat/objects/stack_tag.py | 2 +- heat/objects/sync_point.py | 2 +- heat/objects/user_creds.py | 2 +- heat/objects/watch_data.py | 2 +- heat/objects/watch_rule.py | 2 +- heat/openstack/__init__.py | 0 heat/openstack/common/README | 16 - heat/openstack/common/__init__.py | 0 heat/openstack/common/_i18n.py | 45 -- heat/openstack/common/crypto/__init__.py | 0 heat/openstack/common/crypto/utils.py | 198 ------ heat/rpc/api.py | 9 +- heat/rpc/client.py | 13 +- heat/scaling/cooldown.py | 39 +- .../scenarios/update_remove_rollback.py | 2 +- .../convergence/scenarios/update_user_replace.py | 2 +- .../heat/test_instance_group_update_policy.py | 6 +- .../openstack/heat/test_software_deployment.py | 28 + .../openstack/keystone/test_role_assignments.py | 79 +++ .../openstack/monasca/test_alarm_definition.py | 8 - .../openstack/neutron/lbaas/test_pool_member.py | 42 -- .../openstack/neutron/test_neutron_firewall.py | 38 +- .../openstack/neutron/test_neutron_floating_ip.py | 11 - .../openstack/neutron/test_neutron_provider_net.py | 9 +- .../neutron/test_sfc/test_flow_classifier.py | 206 ++++++ .../openstack/neutron/test_sfc/test_port_chain.py | 173 +++++ .../neutron/test_sfc/test_port_pair_group.py | 186 +++++ .../api/gabbits/environments.yaml | 55 ++ .../api/gabbits/resourcetypes.yaml | 24 + .../functional/test_autoscaling.py | 44 +- .../functional/test_cancel_update.py | 61 ++ .../functional/test_conditional_exposure.py | 7 +- .../functional/test_conditions.py | 3 - .../functional/test_create_update.py | 6 - .../functional/test_create_update_neutron_port.py | 116 +--- .../test_create_update_neutron_subnet.py | 34 +- .../functional/test_default_parameters.py | 3 - .../functional/test_encrypted_parameter.py | 3 - .../functional/test_event_sinks.py | 6 +- .../functional/test_heat_autoscaling.py | 118 +++- .../functional/test_instance_group.py | 42 +- .../functional/test_reload_on_sighup.py | 21 +- .../functional/test_resource_chain.py | 8 +- .../functional/test_resource_group.py | 12 - .../functional/test_software_config.py | 2 +- .../functional/test_stack_events.py | 5 +- .../functional/test_swiftsignal_update.py | 3 - .../functional/test_template_resource.py | 21 - .../functional/test_unicode_template.py | 3 - .../scenario/templates/test_server_signal.yaml | 5 +- .../templates/test_volumes_create_from_backup.yaml | 1 - .../templates/test_volumes_delete_snapshot.yaml | 1 - .../scenario/test_autoscaling_lbv2.py | 2 + .../scenario/test_server_cfn_init.py | 4 + .../scenario/test_server_signal.py | 17 +- .../scenario/test_server_software_config.py | 11 +- install-guide/source/install-obs.rst | 10 +- install-guide/source/install-rdo.rst | 10 +- install-guide/source/install-ubuntu.rst | 10 +- openstack-common.conf | 7 - pylintrc | 29 - .../add-aodh-composite-alarm-f8eb4f879fe0916b.yaml | 5 + ...add-cephfs-share-protocol-033e091e7c6c5166.yaml | 5 + ...p-update-cinder-resources-e23e62762f167d29.yaml | 5 + .../designate-v2-support-0f889e9ad13d4aa2.yaml | 7 + .../keystone-domain-support-e06e2c65c5925ae5.yaml | 4 + .../mark-unhealthy-phys-id-e90fd669d86963d1.yaml | 3 + .../neutron-quota-resource-7fa5e4df8287bf77.yaml | 3 + .../nova-quota-resource-84350f0467ce2d40.yaml | 4 + .../sahara-job-resource-84aecc11fdf1d5af.yaml | 7 + .../server-ephemeral-bdm-v2-55e0fe2afc5d8b63.yaml | 8 + .../notes/zaqar-notification-a4d240bbf31b7440.yaml | 3 + releasenotes/source/conf.py | 3 + releasenotes/source/index.rst | 1 + releasenotes/source/newton.rst | 6 + requirements.txt | 55 +- setup.cfg | 16 +- test-requirements.txt | 15 +- tools/subunit-trace.py | 2 +- tools/test-setup.sh | 57 ++ tox.ini | 24 +- 451 files changed, 15930 insertions(+), 7744 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 8b61d36..98a3e42 100644 --- a/requirements.txt +++ b/requirements.txt @@ -5 +5 @@ -pbr>=1.6 # Apache-2.0 +pbr>=1.8 # Apache-2.0 @@ -11,5 +11,4 @@ eventlet!=0.18.3,>=0.18.2 # MIT -greenlet>=0.3.2 # MIT -keystoneauth1>=2.10.0 # Apache-2.0 -keystonemiddleware!=4.1.0,!=4.5.0,>=4.0.0 # Apache-2.0 -lxml>=2.3 # BSD -netaddr!=0.7.16,>=0.7.12 # BSD +keystoneauth1>=2.18.0 # Apache-2.0 +keystonemiddleware>=4.12.0 # Apache-2.0 +lxml!=3.7.0,>=2.3 # BSD +netaddr!=0.7.16,>=0.7.13 # BSD @@ -17 +16 @@ oslo.cache>=1.5.0 # Apache-2.0 -oslo.config>=3.14.0 # Apache-2.0 +oslo.config!=3.18.0,>=3.14.0 # Apache-2.0 @@ -20 +19 @@ oslo.context>=2.9.0 # Apache-2.0 -oslo.db!=4.13.1,!=4.13.2,>=4.10.0 # Apache-2.0 +oslo.db>=4.15.0 # Apache-2.0 @@ -22,2 +21,2 @@ oslo.i18n>=2.1.0 # Apache-2.0 -oslo.log>=1.14.0 # Apache-2.0 -oslo.messaging>=5.2.0 # Apache-2.0 +oslo.log>=3.11.0 # Apache-2.0 +oslo.messaging>=5.14.0 # Apache-2.0 @@ -25 +24 @@ oslo.middleware>=3.0.0 # Apache-2.0 -oslo.policy>=1.9.0 # Apache-2.0 +oslo.policy>=1.17.0 # Apache-2.0 @@ -29 +28 @@ oslo.service>=1.10.0 # Apache-2.0 -oslo.utils>=3.16.0 # Apache-2.0 +oslo.utils>=3.18.0 # Apache-2.0 @@ -31 +30 @@ osprofiler>=1.4.0 # Apache-2.0 -oslo.versionedobjects>=1.13.0 # Apache-2.0 +oslo.versionedobjects>=1.17.0 # Apache-2.0 @@ -34 +33 @@ pycrypto>=2.6 # Public Domain -aodhclient>=0.5.0 # Apache-2.0 +aodhclient>=0.7.0 # Apache-2.0 @@ -39,3 +38,3 @@ python-designateclient>=1.5.0 # Apache-2.0 -python-glanceclient!=2.4.0,>=2.3.0 # Apache-2.0 -python-heatclient>=1.4.0 # Apache-2.0 -python-keystoneclient!=2.1.0,>=2.0.0 # Apache-2.0 +python-glanceclient>=2.5.0 # Apache-2.0 +python-heatclient>=1.6.1 # Apache-2.0 +python-keystoneclient>=3.8.0 # Apache-2.0 @@ -43 +42 @@ python-magnumclient>=2.0.0 # Apache-2.0 -python-manilaclient>=1.10.0 # Apache-2.0 +python-manilaclient>=1.12.0 # Apache-2.0 @@ -47,5 +46,5 @@ python-neutronclient>=5.1.0 # Apache-2.0 -python-novaclient!=2.33.0,>=2.29.0 # Apache-2.0 -python-openstackclient>=2.1.0 # Apache-2.0 -python-saharaclient>=0.18.0 # Apache-2.0 -python-senlinclient>=0.3.0 # Apache-2.0 -python-swiftclient>=2.2.0 # Apache-2.0 +python-novaclient!=7.0.0,>=6.0.0 # Apache-2.0 +python-openstackclient>=3.3.0 # Apache-2.0 +python-saharaclient>=1.1.0 # Apache-2.0 +python-senlinclient>=1.1.0 # Apache-2.0 +python-swiftclient>=3.2.0 # Apache-2.0 @@ -55,3 +54,3 @@ pytz>=2013.6 # MIT -PyYAML>=3.1.0 # MIT -requests>=2.10.0 # Apache-2.0 -retrying!=1.3.0,>=1.2.3 # Apache-2.0 +PyYAML>=3.10.0 # MIT +requests!=2.12.2,>=2.10.0 # Apache-2.0 +tenacity>=3.2.1 # Apache-2.0 @@ -63,2 +62,2 @@ sqlalchemy-migrate>=0.9.6 # Apache-2.0 -stevedore>=1.16.0 # Apache-2.0 -WebOb>=1.2.3 # MIT +stevedore>=1.17.1 # Apache-2.0 +WebOb>=1.6.0 # MIT diff --git a/test-requirements.txt b/test-requirements.txt index d4e6029..43306ea 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -8 +8 @@ bandit>=1.1.0 # Apache-2.0 -coverage>=3.6 # Apache-2.0 +coverage>=4.0 # Apache-2.0 @@ -10 +10 @@ fixtures>=3.0.0 # Apache-2.0/BSD -kombu>=3.0.25 # BSD +kombu<4.0.0,>=3.0.25 # BSD @@ -12,2 +12,2 @@ mock>=2.0 # BSD -mox3>=0.7.0 # Apache-2.0 -PyMySQL!=0.7.7,>=0.6.2 # MIT License +mox3!=0.19.0,>=0.7.0 # Apache-2.0 +PyMySQL>=0.7.6 # MIT License @@ -16 +16 @@ os-api-ref>=1.0.0 # Apache-2.0 -oslosphinx!=3.4.0,>=2.5.0 # Apache-2.0 +oslosphinx>=4.7.0 # Apache-2.0 @@ -20 +20 @@ psycopg2>=2.5 # LGPL/ZPL -sphinx!=1.3b1,<1.3,>=1.2.1 # BSD +sphinx!=1.3b1,<1.4,>=1.2.1 # BSD @@ -25 +25 @@ testresources>=0.2.4 # Apache-2.0/BSD -reno>=1.8.0 # Apache2 +reno>=1.8.0 # Apache-2.0 @@ -29,0 +30 @@ tempest>=12.1.0 # Apache-2.0 +gabbi>=1.26.1 # Apache-2.0

1 0

[sahara] sahara-extra 6.0.0 (ocata)
by no-reply＠openstack.org 22 Feb '17

22 Feb '17

We are pleased to announce the release of: sahara-extra 6.0.0: Extras for Sahara: hadoop-swiftfs This release is part of the ocata release series. Download the package from: https://tarballs.openstack.org/sahara-extra/ For more details, please see below. Changes in sahara-extra 5.0.0.0rc1..6.0.0 ----------------------------------------- 85fd550 Add Constraints support ac8b048 Show team and repo badges on README a7af6c1 Updated from global requirements ef3c1ab Adds the lazy seek b2f6ad9 Make all components in a list in README e7a84c6 remove section [files] in setup.cfg 2e516a8 Remove not exists dir in tox.ini f01fb7b Modify the description of edp-examples Diffstat (except docs and test files) ------------------------------------- README.rst | 20 ++++++++++++++------ edp-examples/README.rst | 3 ++- .../fs/swift/snative/SwiftNativeInputStream.java | 22 ++++++++++++++++++++++ requirements.txt | 2 +- setup.cfg | 6 +----- tox.ini | 4 ++-- 6 files changed, 42 insertions(+), 15 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 95d0fe8..1a62d2e 100644 --- a/requirements.txt +++ b/requirements.txt @@ -5 +5 @@ -pbr>=1.6 # Apache-2.0 +pbr>=1.8 # Apache-2.0

1 0

[designate] designate-dashboard 4.0.0 (ocata)
by no-reply＠openstack.org 22 Feb '17

22 Feb '17

We exuberantly announce the release of: designate-dashboard 4.0.0: Designate Horizon UI bits This release is part of the ocata release series. Download the package from: https://tarballs.openstack.org/designate-dashboard/ For more details, please see below. Changes in designate-dashboard 3.0.0.0rc1..4.0.0 ------------------------------------------------ 451f0e2 Imported Translations from Zanata e36ce46 Update UPPER_CONSTRAINTS_FILE for stable/ocata ab71553 Update .gitreview for stable/ocata ffc6014 Actually show attribute on zone info page 1269e4a Ensure slash character for URL of dns service Solves a pep8 warning too. 5d6095f Updated from global requirements cd77ca8 Remove support for py33 and update to py35 8b68651 Enable release notes translation 9fdd096 Switch to oslo_log 875f658 Imported Translations from Zanata c8f2e82 H803 hacking have been deprecated c052896 Imported Translations from Zanata 04e4a22 Updated from global requirements d460950 Added release notes for Designate-dashboard 0d27081 Show team and repo badges on README 427c9eb Updated from global requirements a0dc4f3 Imported Translations from Zanata 0310887 Updated from global requirements 145d35d Imported Translations from Zanata 44f32e8 Imported Translations from Zanata 6edc942 Updated from global requirements 39aa6e4 Updated from global requirements 56a5ef3 Remove vim header 4a7b63f Add Upper constraints to dashboard Diffstat (except docs and test files) ------------------------------------- .gitignore | 1 + .gitreview | 1 + README.rst | 9 + designatedashboard/api/designate.py | 2 +- designatedashboard/api/rest/passthrough.py | 13 +- .../dashboards/project/dns_domains/forms.py | 2 +- .../dashboards/project/dns_domains/tables.py | 3 +- designatedashboard/locale/de/LC_MESSAGES/django.po | 351 +++++++++++++++++++++ .../locale/en_GB/LC_MESSAGES/django.po | 14 +- designatedashboard/locale/fr/LC_MESSAGES/django.po | 101 +++++- designatedashboard/locale/id/LC_MESSAGES/django.po | 350 ++++++++++++++++++++ designatedashboard/locale/ja/LC_MESSAGES/django.po | 22 +- .../locale/ko_KR/LC_MESSAGES/django.po | 15 +- designatedashboard/locale/ru/LC_MESSAGES/django.po | 133 +++++++- .../locale/zh_CN/LC_MESSAGES/django.po | 44 +-- .../actions/common-forms.service.js | 3 +- .../details/overview.controller.js | 9 + releasenotes/notes/.placeholder | 0 releasenotes/source/conf.py | 285 +++++++++++++++++ releasenotes/source/index.rst | 18 ++ releasenotes/source/mitaka.rst | 6 + releasenotes/source/newton.rst | 6 + releasenotes/source/unreleased.rst | 5 + requirements.txt | 3 +- setup.cfg | 2 +- test-requirements.txt | 13 +- tox.ini | 12 +- 28 files changed, 1351 insertions(+), 74 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index d9f7cca..c622d4b 100644 --- a/requirements.txt +++ b/requirements.txt @@ -4 +4,2 @@ -pbr>=1.6 # Apache-2.0 +oslo.log>=3.11.0 # Apache-2.0 +pbr>=1.8 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index 5c7f88d..10eaf3e 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -6 +6 @@ hacking<0.11,>=0.10.0 -coverage>=3.6 # Apache-2.0 +coverage>=4.0 # Apache-2.0 @@ -9,2 +9,2 @@ mox>=0.5.3 # Apache-2.0 -mox3>=0.7.0 # Apache-2.0 -oslo.config>=3.14.0 # Apache-2.0 +mox3!=0.19.0,>=0.7.0 # Apache-2.0 +oslo.config!=3.18.0,>=3.14.0 # Apache-2.0 @@ -15,2 +15,3 @@ unittest2 # BSD -sphinx!=1.3b1,<1.3,>=1.2.1 # BSD -oslosphinx!=3.4.0,>=2.5.0 # Apache-2.0 +sphinx!=1.3b1,<1.4,>=1.2.1 # BSD +oslosphinx>=4.7.0 # Apache-2.0 +reno>=1.8.0 # Apache-2.0 @@ -26 +27 @@ django-compressor>=2.0 # MIT -django-openstack-auth>=2.4.0 # Apache-2.0 +django-openstack-auth>=3.1.0 # Apache-2.0

1 0

[octavia] neutron-lbaas 10.0.0 (ocata)
by no-reply＠openstack.org 22 Feb '17

22 Feb '17

We are gleeful to announce the release of: neutron-lbaas 10.0.0: OpenStack Networking Load Balancing as a Service This release is part of the ocata release series. Download the package from: https://tarballs.openstack.org/neutron-lbaas/ For more details, please see below. 10.0.0 ^^^^^^ New Features * Adds the ability to automatically reschedule load balancers from LBaaS agents the server detects to have died. Previously, load balancers could be scheduled and realized across multiple LBaaS agents, however if a hypervisor died, the load balancers scheduled to that node would cease operation. Now, these load balancers will be automatically rescheduled to a different agent. This feature is turned off by default and controlled via allow_automatic_lbaas_agent_failover * Implements ProcessMonitor in the HaproxyNSDriver class (v2) to utilize the external_process module in order to monitor and respawn the haproxy processes if and when needed. The LBaaS agent (v2) will load external_process related options in order to take a configured action when haproxy process dies unexpectedly. * Adds support for the VMWare driver to use the L7 rules and policies. Changes in neutron-lbaas 9.0.0.0rc1..10.0.0 ------------------------------------------- 85f08fc Only if loadbalancer's status is normal then create pool in db a60bb41 Remove psutil dependency 27d34ca Updated from global requirements 31a413d Use neutron-lib portbindings api-def 081982a Don't use the python directly in devstack f39610d Updated from global requirements 195fdf6 Replaces uuid.uuid4 with uuidutils.generate_uuid() 8c01eff Implements ProcessMonitor in the haproxy driver bc7d70a VMWare driver support for l7 rules & policies 46f24eb Set access_policy for messaging's dispatcher 91b7b4e Updated from global requirements dc5e602 Fix for error "no attribute tenant_id" 5248d79 Updated from global requirements c025712 Updated from global requirements 6ef87fe Auto reschedule loadbalancers from dead agents 52ed416 Updated from global requirements 4fb7bdb Updated from global requirements 159ae0c Add support to update members in LBaaS extension fa3628a Reduce the amount of smoke tests from 109 to 36 b77c0ce Pass network MTU into namespace driver aa63f5b Use DB field sizes instead of _MAX_LEN constants bad6fd8 Use ExtensionDescriptor from neutron-lib 2d69369 Remove PLURALS da625cd Show team and repo badges on README ad4d0a6 Replace six.iteritems with dict.items() 8418c8a Support xenial in devstack install 7ee2b3a Fix a typo 00568ab Switch to using plugins directory in lieu of neutron manager 9453e07 Updated from global requirements 48a0470 Updated from global requirements 41b46bd Remove last vestiges of oslo-incubator d8fd453 Updated from global requirements 4a708bf HAProxy - Add host routes to the lbaas namespace ae37c67 Add openstack tenant id to back-end server call c316590 Drop MANIFEST.in - it's not needed by pbr f268c67 Fix various neutron deprecation warnings 1256286 Updated from global requirements da7e6ca Create a consolidated API test 68ae7d9 Fix a gate issue with a mock and deprecated call b13f30f Updated from global requirements 63d7c18 Enable release notes translation 691756b Updated from global requirements 92c46f4 Switched devstack plugin to stevedore alias for service plugin 75faa63 Switch HAProxy health check timeout to seconds fe0a7ba Updated from global requirements ebf96b5 Use a cached get-pip.py if it is availble cd361ee Fix typo in v2_driver.py 09db87f Updated from global requirements 1dbaa3c Fixed lbaasv2 service plugin alias definition c68e0fa Updated from global requirements f9da306 Updated from global requirements d0f96c1 Temporarily support two INTERFACE_DRIVER_OPTS 1c2ac1c Update reno for stable/newton d42438c Updated from global requirements a792d89 haproxy ns driver: set global haproxy maxconn 7cd3443 Adds neutron_lbaas.conf and services_lbaas.conf to q-svc command line ad0955e Import model_base from neutron-lib 9073940 The lb namespace can not be deleted e0d64a4 Plugin to run neutron-lbaas tests with tempest Diffstat (except docs and test files) ------------------------------------- .pylintrc | 7 +- MANIFEST.in | 11 -- README.rst | 9 ++ devstack/plugin.sh | 5 +- devstack/settings | 12 +- neutron_lbaas/agent/agent.py | 2 + neutron_lbaas/agent/agent_device_driver.py | 3 +- neutron_lbaas/agent/agent_manager.py | 6 +- neutron_lbaas/agent_scheduler.py | 22 ++- .../common/cert_manager/local_cert_manager.py | 4 +- neutron_lbaas/common/exceptions.py | 5 + neutron_lbaas/db/loadbalancer/loadbalancer_dbv2.py | 7 +- neutron_lbaas/db/loadbalancer/models.py | 10 +- neutron_lbaas/drivers/common/agent_callbacks.py | 7 +- neutron_lbaas/drivers/common/agent_driver_base.py | 59 ++++++- neutron_lbaas/drivers/haproxy/jinja_cfg.py | 11 ++ neutron_lbaas/drivers/haproxy/namespace_driver.py | 89 +++++++---- .../haproxy/templates/haproxy.loadbalancer.j2 | 1 + .../drivers/haproxy/templates/haproxy_base.j2 | 1 + .../drivers/haproxy/templates/haproxy_proxies.j2 | 2 +- .../drivers/octavia/octavia_messaging_consumer.py | 5 +- neutron_lbaas/drivers/radware/v2_driver.py | 5 +- neutron_lbaas/drivers/vmware/edge_driver_v2.py | 32 ++++ .../extensions/healthmonitor_max_retries_down.py | 2 +- neutron_lbaas/extensions/l7.py | 23 +-- neutron_lbaas/extensions/lb_graph.py | 2 +- neutron_lbaas/extensions/lb_network_vip.py | 2 +- neutron_lbaas/extensions/lbaas_agentschedulerv2.py | 14 +- neutron_lbaas/extensions/loadbalancerv2.py | 53 ++++--- neutron_lbaas/extensions/sharedpools.py | 2 +- neutron_lbaas/opts.py | 17 +- neutron_lbaas/services/loadbalancer/data_models.py | 28 +++- neutron_lbaas/services/loadbalancer/plugin.py | 28 ++-- .../tempest/v2/api/test_health_monitor_admin.py | 1 - .../v2/api/test_health_monitors_non_admin.py | 20 --- .../tempest/v2/api/test_listeners_non_admin.py | 10 -- .../tempest/v2/api/test_load_balancers_admin.py | 3 - .../v2/api/test_load_balancers_non_admin.py | 14 -- .../unit/db/loadbalancer/test_db_loadbalancerv2.py | 23 ++- .../unit/drivers/common/test_agent_callbacks.py | 11 +- .../unit/drivers/common/test_agent_driver_base.py | 153 +++++++++++++++++- .../haproxy/sample_configs/sample_configs.py | 9 +- .../unit/drivers/haproxy/test_namespace_driver.py | 74 +++++---- .../drivers/netscaler/test_netscaler_driver_v2.py | 2 +- .../octavia/test_octavia_messaging_consumer.py | 4 +- .../unit/drivers/radware/test_v2_plugin_driver.py | 9 +- .../unit/drivers/vmware/test_edge_driver_v2.py | 10 ++ .../loadbalancer/test_loadbalancer_quota_ext.py | 19 +++ ...reschedule_load_balancers-c0bc69c6c550d7d2.yaml | 12 ++ ...xy_driver_process_monitor-fbf4992b2c3e9418.yaml | 7 + .../vmware-driver-l7-support-570fecca245d1a37.yaml | 5 + releasenotes/source/conf.py | 3 + releasenotes/source/index.rst | 5 +- releasenotes/source/newton.rst | 6 + requirements.txt | 24 +-- setup.cfg | 4 +- test-requirements.txt | 12 +- tools/install_venv.py | 72 --------- tools/install_venv_common.py | 172 --------------------- tools/with_venv.sh | 19 --- 72 files changed, 741 insertions(+), 583 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index f48c060..2002f51 100644 --- a/requirements.txt +++ b/requirements.txt @@ -4 +4 @@ -pbr>=1.6 # Apache-2.0 +pbr>=1.8 # Apache-2.0 @@ -7,3 +7,3 @@ eventlet!=0.18.3,>=0.18.2 # MIT -requests>=2.10.0 # Apache-2.0 -netaddr!=0.7.16,>=0.7.12 # BSD -neutron-lib>=0.4.0 # Apache-2.0 +requests!=2.12.2,>=2.10.0 # Apache-2.0 +netaddr!=0.7.16,>=0.7.13 # BSD +neutron-lib>=1.1.0 # Apache-2.0 @@ -11 +11 @@ SQLAlchemy<1.1.0,>=1.0.10 # MIT -alembic>=0.8.4 # MIT +alembic>=0.8.10 # MIT @@ -13,4 +13,4 @@ six>=1.9.0 # MIT -oslo.config>=3.14.0 # Apache-2.0 -oslo.db!=4.13.1,!=4.13.2,>=4.10.0 # Apache-2.0 -oslo.log>=1.14.0 # Apache-2.0 -oslo.messaging>=5.2.0 # Apache-2.0 +oslo.config!=3.18.0,>=3.14.0 # Apache-2.0 +oslo.db>=4.15.0 # Apache-2.0 +oslo.log>=3.11.0 # Apache-2.0 +oslo.messaging>=5.14.0 # Apache-2.0 @@ -20 +20 @@ oslo.service>=1.10.0 # Apache-2.0 -oslo.utils>=3.16.0 # Apache-2.0 +oslo.utils>=3.18.0 # Apache-2.0 @@ -25 +25 @@ pyOpenSSL>=0.14 # Apache-2.0 -stevedore>=1.16.0 # Apache-2.0 +stevedore>=1.17.1 # Apache-2.0 @@ -27 +27 @@ cryptography!=1.3.0,>=1.0 # BSD/Apache-2.0 -keystoneauth1>=2.10.0 # Apache-2.0 +keystoneauth1>=2.18.0 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index 3cdcdad..89b869e 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -6 +6 @@ hacking<0.11,>=0.10.0 -coverage>=3.6 # Apache-2.0 +coverage>=4.0 # Apache-2.0 @@ -10,3 +10,3 @@ python-subunit>=0.0.18 # Apache-2.0/BSD -requests-mock>=1.0 # Apache-2.0 -sphinx!=1.3b1,<1.3,>=1.2.1 # BSD -oslosphinx!=3.4.0,>=2.5.0 # Apache-2.0 +requests-mock>=1.1 # Apache-2.0 +sphinx!=1.3b1,<1.4,>=1.2.1 # BSD +oslosphinx>=4.7.0 # Apache-2.0 @@ -19 +19 @@ testscenarios>=0.4 # Apache-2.0/BSD -WebOb>=1.2.3 # MIT +WebOb>=1.6.0 # MIT @@ -21 +21 @@ WebTest>=2.0 # MIT -reno>=1.8.0 # Apache2 +reno>=1.8.0 # Apache-2.0

1 0

[freezer] freezer-api 4.0.0 (ocata)
by no-reply＠openstack.org 22 Feb '17

22 Feb '17

We eagerly announce the release of: freezer-api 4.0.0: OpenStack Backup and Restore API Service This release is part of the ocata release series. Download the package from: https://tarballs.openstack.org/freezer-api/ For more details, please see below. Changes in freezer-api 3.0.0.0rc1..4.0.0 ---------------------------------------- e2ad726 Enable release notes translation c4c1e21 Remove link to modindex 7219b6f Updated from global requirements 1d0cd4b Fix failed tempest tests with KeystoneV2 3bc0135 Remove default=None for config options 8ea79dd Add session scheduling information validation. bdbd9f9 Elasticsearch module is logging too much. 94dbb18 Fix description for 'Freezer sessions management' and 'Session-Job association' in README.rst 7976a0c Fix No handlers could be found for logger "elasticsearch.trace" 50089f9 Updated from global requirements cf95fa1 Add full pep8 check 54c6559 Correct reraising of exception 8002c1f Fix get backup object f497984 Define apache version for ErrorLogFormat 4dc1077 Use UUID as backup_id parameter 9154cb1 Show team and repo badges on README 102acdd Fix inconsistent freezer-api log output 877a2da Fix warn 'Unable to retrieve request id from context' 10a3e58 Fix a bug of doing devstack installation on CentOS a15f8a1 Using assertIsNone() instead of assertEqual(None, ...) 0ac8349 Added py35 environment configuration to tox.ini e4162ef API routes section error in freezer-api README.rst 13e49dc Updated from global requirements 1f473e5 Update freezer-api README.rst 164faf0 Refactoring dsvm gate job 191e7c9 Added releasenotes for freezer-api fbd1f04 Use http_proxy_to_wsgi middleware 7a32832 Added OpenJDK 7 ppa for xenial dccbbf3 Updated from global requirements 4136fb8 Delete python bytecode file 10f69d0 Support upper-constraints in tox.ini 26b4e0c Updated from global requirements e86108a Using assertEqual instead of assertEquals d963673 Change default value of elasticsearch replicas 84487bf Fix the step of editing configure file in freezer-api/README.rst 8bbc37b remove repeat test assert 74d0421 Devstack take up screen of freezer Diffstat (except docs and test files) ------------------------------------- .gitignore | 1 + README.rst | 19 +- config-generator/freezer-api.conf | 1 + devstack/files/apache-freezer-api.template | 5 +- devstack/gate_hook.sh | 4 + devstack/lib/freezer-api | 19 +- devstack/plugin.sh | 1 + devstack/settings | 5 + etc/freezer/freezer-api.conf.sample | 131 +- etc/freezer/freezer-paste.ini | 7 +- freezer_api/api/common/middleware.py | 48 +- freezer_api/api/common/resource.py | 4 +- freezer_api/api/common/utils.py | 12 +- freezer_api/api/v1/actions.py | 1 + freezer_api/api/v1/backups.py | 5 +- freezer_api/api/v1/clients.py | 3 +- freezer_api/api/v1/homedoc.py | 1 - freezer_api/api/v1/jobs.py | 14 +- freezer_api/api/v1/sessions.py | 7 +- freezer_api/cmd/api.py | 15 +- freezer_api/cmd/db_init.py | 385 ------ freezer_api/cmd/manage.py | 49 +- freezer_api/cmd/wsgi.py | 4 +- freezer_api/common/config.py | 22 +- freezer_api/common/db_mappings.py | 3 - freezer_api/common/exceptions.py | 5 +- freezer_api/common/json_schemas.py | 22 +- freezer_api/common/utils.py | 36 +- freezer_api/policy.py | 3 +- freezer_api/service.py | 21 +- freezer_api/storage/driver.py | 17 +- freezer_api/storage/elastic.py | 101 +- .../services/freezer_api_client.py | 16 +- install-guide/source/get_started.rst | 8 +- install-guide/source/install.rst | 7 +- install-guide/source/metadata_structure.rst | 2 +- releasenotes/source/conf.py | 265 ++++ releasenotes/source/index.rst | 18 + releasenotes/source/mitaka.rst | 6 + releasenotes/source/newton.rst | 6 + releasenotes/source/unreleased.rst | 5 + requirements.txt | 8 +- setup.cfg | 1 - specs/Freezer-API-spec.rst | 8 +- test-requirements.txt | 7 +- tox.ini | 39 +- 75 files changed, 2250 insertions(+), 2336 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 3562212..3e7263f 100644 --- a/requirements.txt +++ b/requirements.txt @@ -7 +7 @@ jsonschema!=2.5.0,<3.0.0,>=2.0.0 # MIT -keystonemiddleware!=4.1.0,!=4.5.0,>=4.0.0 # Apache-2.0 +keystonemiddleware>=4.12.0 # Apache-2.0 @@ -10 +10 @@ PasteDeploy>=1.5.0 # MIT -oslo.config>=3.14.0 # Apache-2.0 +oslo.config!=3.18.0,>=3.14.0 # Apache-2.0 @@ -13 +13 @@ oslo.i18n>=2.1.0 # Apache-2.0 -oslo.log>=1.14.0 # Apache-2.0 +oslo.log>=3.11.0 # Apache-2.0 @@ -15 +15 @@ oslo.middleware>=3.0.0 # Apache-2.0 -oslo.policy>=1.9.0 # Apache-2.0 +oslo.policy>=1.17.0 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index 6aadb34..e96612e 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -8 +8 @@ hacking<0.11,>=0.10.2 # Apache-2.0 -coverage>=3.6 # Apache-2.0 +coverage>=4.0 # Apache-2.0 @@ -10 +10 @@ mock>=2.0 # BSD -oslosphinx!=3.4.0,>=2.5.0 # Apache-2.0 +oslosphinx>=4.7.0 # Apache-2.0 @@ -12 +12 @@ python-subunit>=0.0.18 # Apache-2.0/BSD -sphinx!=1.3b1,<1.3,>=1.2.1 # BSD +sphinx!=1.3b1,<1.4,>=1.2.1 # BSD @@ -15,0 +16 @@ os-api-ref>=1.0.0 # Apache-2.0 +reno>=1.8.0 # Apache-2.0

1 0

[mistral] mistral-dashboard 4.0.0 (ocata)
by no-reply＠openstack.org 22 Feb '17

22 Feb '17

We contentedly announce the release of: mistral-dashboard 4.0.0: Mistral dashboard This release is part of the ocata release series. Download the package from: https://pypi.python.org/pypi/mistral-dashboard For more details, please see below. Changes in mistral-dashboard 3.0.0.0rc1..4.0.0 ---------------------------------------------- 72a0ef3 Fix 'tox -ereleasenotes' Error 7bd5e93 Update UPPER_CONSTRAINTS_FILE for stable/ocata fda730a Update .gitreview for stable/ocata b82f870 Updated from global requirements 8d7810e Updated from global requirements ac86dfc Removed unnecessary utf-8 encoding 696c330 Task table - type column would refer to workflow executions accordingly 55425db Remove django<1.8 from tests b1c1627 Move _50_mistral.py file into enabled folder 7037048 Remove the dependency on horizon repo 907cb4d Fixed: Dashboard: "Run action" functionality doesn't work cd1c789 add CONTRIBUTING.rst 5584e25 Add Constraints support 61ff4a5 Updated from global requirements a0262da Workflow list - added missing fields 0bcc4a9 Added links to DSL docs in create/update views 08e21dd Fix docs-gate for mistral-dashboard 4830558 Changed "Task Details" to "Task Execution Details" 91fac9f mistral-dashboard:fixed boolean field design bug 2a54532 mistral-dashboard: added action executions screens b335f12 Updated from global requirements 92e3177 Show team and repo badges on README e66e1f6 Fixed action screen "run" button CSS issue 576fbfa Remove mox in test-requirement.txt 14e0dc0 Added reno for stable/mitaka, stable/liberty and stable/newton 29824af Adding files to .gitignore 9cc8911 Cleanup unused files 1b73cff mistral-dashboard: entities name change for system consistency d6c6c9c Updated from global requirements 539d53c Delete *openstack/common* in flake8 exclude list 95e1142 Updated from global requirements e87c40b Updated from global requirements 69c29c7 Enable release notes translation 21563bf Maintain releasenotes for mistral dashboard 40f1fec Updated from global requirements c53f508 Updated from global requirements 8030749 Updated from global requirements 0c1250f Added sphinix config to setup.cfg Diffstat (except docs and test files) ------------------------------------- .gitignore | 6 + .gitreview | 1 + CONTRIBUTING.rst | 16 ++ README.rst | 11 +- _50_mistral.py.example | 11 -- mistraldashboard/action_executions/__init__.py | 0 mistraldashboard/action_executions/forms.py | 102 ++++++++++++ mistraldashboard/action_executions/panel.py | 26 +++ mistraldashboard/action_executions/tables.py | 180 +++++++++++++++++++++ .../templates/action_executions/_update.html | 17 ++ .../templates/action_executions/detail.html | 96 +++++++++++ .../templates/action_executions/filtered.html | 13 ++ .../templates/action_executions/index.html | 9 ++ .../templates/action_executions/update.html | 11 ++ mistraldashboard/action_executions/urls.py | 34 ++++ mistraldashboard/action_executions/views.py | 174 ++++++++++++++++++++ mistraldashboard/actions/tables.py | 15 +- .../actions/templates/actions/detail.html | 6 +- mistraldashboard/actions/views.py | 8 + mistraldashboard/api.py | 63 +++++++- .../templates/cron_triggers/_create.html | 2 +- .../templates/cron_triggers/detail.html | 6 +- mistraldashboard/cron_triggers/views.py | 6 + mistraldashboard/dashboard.py | 5 +- mistraldashboard/default/SmartCell.py | 81 ---------- mistraldashboard/default/panel.py | 2 - mistraldashboard/default/smart_cell.py | 81 ++++++++++ .../default/templates/default/_booleanfield.html | 4 + .../default/templates/default/_preprint.html | 3 + mistraldashboard/default/utils.py | 28 +++- mistraldashboard/enabled/_50_mistral.py | 25 +++ mistraldashboard/enabled/__init__.py | 0 mistraldashboard/executions/panel.py | 4 +- mistraldashboard/executions/tables.py | 6 +- .../executions/templates/executions/detail.html | 8 +- .../executions/templates/executions/index.html | 4 +- .../templates/executions/index_filtered_task.html | 8 + mistraldashboard/executions/urls.py | 4 +- mistraldashboard/executions/views.py | 82 +++++++++- .../static/mistraldashboard/css/style.css | 46 +++++- mistraldashboard/tasks/panel.py | 4 +- mistraldashboard/tasks/tables.py | 28 +++- mistraldashboard/tasks/templates/tasks/detail.html | 23 ++- .../tasks/templates/tasks/filtered.html | 2 +- mistraldashboard/tasks/templates/tasks/index.html | 4 +- mistraldashboard/tasks/urls.py | 7 +- mistraldashboard/tasks/views.py | 41 +++-- mistraldashboard/workbooks/panel.py | 2 - mistraldashboard/workbooks/tables.py | 2 - .../templates/workbooks/_select_definition.html | 6 + .../workbooks/templates/workbooks/detail.html | 4 +- mistraldashboard/workbooks/urls.py | 2 - mistraldashboard/workbooks/views.py | 8 +- mistraldashboard/workflows/panel.py | 2 - mistraldashboard/workflows/tables.py | 24 ++- .../templates/workflows/_select_definition.html | 6 + .../workflows/templates/workflows/detail.html | 4 +- mistraldashboard/workflows/urls.py | 6 +- mistraldashboard/workflows/views.py | 67 ++++++-- releasenotes/notes/.placeholder | 0 releasenotes/source/_static/.placeholder | 0 releasenotes/source/_templates/.placeholder | 0 releasenotes/source/conf.py | 63 ++++++++ releasenotes/source/index.rst | 13 ++ releasenotes/source/liberty.rst | 6 + releasenotes/source/mitaka.rst | 6 + releasenotes/source/newton.rst | 6 + releasenotes/source/unreleased.rst | 5 + requirements.txt | 6 +- setup.cfg | 3 + test-requirements.txt | 22 ++- tools/install_venv.py | 147 ----------------- tools/with_venv.sh | 4 - tox.ini | 25 +-- 75 files changed, 1374 insertions(+), 379 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 9f2292c..346b1f3 100644 --- a/requirements.txt +++ b/requirements.txt @@ -5 +5 @@ -pbr>=1.6 # Apache-2.0 +pbr>=1.8 # Apache-2.0 @@ -9 +9 @@ django-compressor>=2.0 # MIT -django-openstack-auth>=2.4.0 # Apache-2.0 +django-openstack-auth>=3.1.0 # Apache-2.0 @@ -12 +12 @@ python-mistralclient>=2.0.0 # Apache-2.0 -PyYAML>=3.1.0 # MIT +PyYAML>=3.10.0 # MIT diff --git a/test-requirements.txt b/test-requirements.txt index 923e213..c899d1d 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -3,0 +4 @@ + @@ -6,2 +6,0 @@ hacking<0.11,>=0.10.0 -# Testing Requirements -http://tarballs.openstack.org/horizon/horizon-master.tar.gz#egg=horizon @@ -9 +8,2 @@ http://tarballs.openstack.org/horizon/horizon-master.tar.gz#egg=horizon -coverage>=3.6 # Apache-2.0 +# Testing Requirements +coverage>=4.0 # Apache-2.0 @@ -12,3 +12,2 @@ mock>=2.0 # BSD -mox>=0.5.3 # Apache-2.0 -mox3>=0.7.0 # Apache-2.0 -nodeenv>=0.9.4 # BSD License # BSD +mox3!=0.19.0,>=0.7.0 # Apache-2.0 +nodeenv>=0.9.4 # BSD @@ -21,0 +21 @@ xvfbwrapper>=0.1.3 #license: MIT + @@ -23,2 +23,8 @@ xvfbwrapper>=0.1.3 #license: MIT -sphinx!=1.3b1,<1.3,>=1.2.1 # BSD -oslosphinx!=3.4.0,>=2.5.0 # Apache-2.0 +sphinx!=1.3b1,<1.4,>=1.2.1 # BSD +oslosphinx>=4.7.0 # Apache-2.0 +reno>=1.8.0 # Apache-2.0 +docutils!=0.13.1,>=0.11 # OSI-Approved Open Source, Public Domain + +# Horizon requirements +django-compressor>=2.0 # MIT +django-openstack-auth>=3.1.0 # Apache-2.0

1 0

[neutron] networking-ovn 2.0.0 (ocata)
by no-reply＠openstack.org 22 Feb '17

22 Feb '17

We are happy to announce the release of: networking-ovn 2.0.0: OpenStack Neutron integration with OVN This release is part of the ocata release series. The source is available from: http://git.openstack.org/cgit/openstack/networking-ovn Download the package from: https://pypi.python.org/pypi/networking-ovn Please report issues through launchpad: http://bugs.launchpad.net/networking-ovn For more details, please see below. 2.0.0 ^^^^^ New Features ************ * OVN native L3 implementation. The native implementation supports distributed routing for east-west traffic and centralized routing for north-south (floatingip and snat) traffic. Also supported is the Neutron L3 Configurable external gateway mode. * OVN native DHCPv6 implementation. The native implementation supports distributed DHCPv6. Support Neutron IPv6 subnet whose "ipv6_address_mode" attribute is None, "dhcpv6_stateless", or "dhcpv6_stateful". Deprecation Notes ***************** * The "ovn" group "vif_type" configuration option is deprecated and will be removed in the next release. The port VIF type is now determined based on the OVN chassis information when the port is bound to a host. [Bug 1606458 (https://bugs.launchpad.net/bugs/1606458) * The "ovn" group "ovsdb_connection" configuration option was deprecated in the "Newton" release and has now been removed. Changes in networking-ovn 1.0.0.0rc1..2.0.0 ------------------------------------------- 3123e7f Enable placement-api in devstack CI jobs. fdbc00a Re-enable a passing test. 9242721 Add two more good blog posts I just found. 1e416ba Issue of router updating with subnet and fixed-ip 8b8a7dd Replace six.itervalues() with .values() Replace six.iterkeys() with "for key in dict" 47d220a Revise initial status of create_floatingip 9a25667 Use neutron-lib portbindings api-def 68bb4d3 fix CI jobs broken after neutron.agent.ovsdb.native.Connection change e21d3f2 Remove support for py33 b141ee2 Use neutron-lib provider net api-def 6953f80 Updated from global requirements 23bf0ed Need not add ext gw router ip to peer nat_addresses options e649839 Adapt neutron-ovn-db-sync-util to ml2 abbr. b2dafee fix some parameter description mistakes 0cc8c0d neutron-ovn-db-sync-util cmd call trace ce0b830 Resolve create_nova_conf_neutron not found issue fe1b960 Some change for unit test test_update_router_with_ext_gw bede717 Devstack failed for OVS DB connection modification 144803f Fix wrong column change to Logical_Switch_Port when neutron port update 5fefcf0 Remove redundant comment in local.conf.sample 04d8107 Eliminate ovsdb error vlog when creating some LSPs 6c31b07 Fix wrong type for enable_snat 6cd34ec readme: Add another blog post. 2743852 Fix issue of adding router interface from dashboard with specified IP 1d40650 Fix skydive git repo location. 3cda653 readme: Update blog, talk, and tutorial links. 0ca9e32 correcting variables seting in get_ovn_port_options dc54418 Fix the CI failures after xenial uprade b773eb9 Fix dhcp_options fake row value in Class TestNBImplIdlOvn e1c7b8a Increase ovsdb timeout default value. 3bb9426 Fix typo in devstack/local.conf.sample bfa1c22 Log OVS IDL library errors to neutron logs when used by networking-ovn 15f0698 Retry port create to deal with race condition. a60b703 Add system-id when start ovs 60fa7af Improve neutron-ovn-db-sync-util error messages 00ce5db Fix file permissions 5f0f0fb Drop docs related to L3 agent. ca030c2 Show team and repo badges on README 89a04ac Switch to using plugins directory in lieu of neutron manager ac1764b Replace six.iteritems() with .items() 52b29ea Update GW SNAT rule in if already exists for 'dnat_and_snat' type 7dffd60 Fix a few grammatical errors 59fcdb2 Finalize ovs transaction mutate support 666fc5c Exclude the failing tempest test in devstackgaterc job 0db63c6 Exclude the failing tempest test in native tempest job 33062fd format string is error f765cb9 Replaces uuid.uuid4 with uuidutils.generate_uuid() 97d5af0 Updated from global requirements f6970f0 rally: Sync rally job config from neutron. 6a52e30 Drop L3 agent from CI jobs. 9471d7f Neutron lib integrations (L3) 3ef9957 Updated from global requirements 17a5433 Disable q-dhcp in the devstackgaterc job a725546 Remove workarounds for python ovs mutate bug b40f1dd NAT support (SNAT, FloatingIP) 368691c Updated from global requirements 51f8f69 Updated from global requirements 70a8ecb Skip set of OVSDB connection manager target 9411ce7 Updated from global requirements 9cb2869 Updated from global requirements 77c3886 README: Add more blog links. 4635dc9 Drop MANIFEST.in - it's not needed by pbr 2b6f47c Update .coveragerc after the removal of openstack directory c11aa7a Fix file permissions e214575 Use diff_list_of_dict from neutron-lib ff4a8d4 enhance DHCP with improved transaction ed998d2 Support native OVN DHCPv6 07998fc Fix tox_install.sh 7ea5f61 Fix the KeyError in neutron-ovn-db-sync-util 7bd6a3c Use parse_mappings from neutron-lib 9b8de93 Update tox install to support constraints and branches d60923c Enable release notes translation c3fb983 Refuse port binding if not supported for host 8608f26 Updated from global requirements d51ce8f Improve test coverage for add DHCP options command 41c397e Workaround OVS transaction mutate bug 6116b2c Add unit tests for neutron-ovn-db-sync-util command 48ff584 Fix 'uuid' to 'UUID' 206d9ae Configure subnode for devstack multinode 031bc93 Fix typos in native_dhcp.rst & troubleshooting.rst 8261203 Revert "Workaround DHCP agent gate issues" d61ee1b Updated from global requirements 9670fff Docstrings should not start with a space 3b7a302 Replace retrying with tenacity 5279d21 Initial unit tests for impl_idl_ovn 8d0674f Increase OVSDB monitor unit test coverage 2a3b589 Increase trunk driver unit test coverage. ea91e0a Increase ACL unit test coverage 275475f Fix for vtep port 1fb7343 Add unit tests for ACL ovsdb commands 4fed9d0 Fix test waiting for ovn-northd to start 1a765d7 Workaround DHCP agent gate issues 699239c Add unit tests for lswitch and lrouter port ovsdb commands 9eb110e Add unit tests for lrouter and addrset ovsdb commands 4ae6b67 Update port provisioning block registration 551f81c Configure vxlan encap on computes for vtep 5be7dfe Support a mixed DPDK and non-DPDK environment d0de15e Remove ovsdb_connection config option deprecated in Newton 4796029 Updated from global requirements 49a8d61 Add unit tests for update ovsdb commands 7daa60e Add unit tests for lrouter static routes ovsdb commands 949d244 Update reno for stable/newton c2525f1 Remove unnecessary mocks for impl_idl_ovn in unit tests 3c9b501 Add __ne__ built-in function for networking_ovn Diffstat (except docs and test files) ------------------------------------- .coveragerc | 2 +- MANIFEST.in | 6 - README.rst | 21 +- devstack/devstackgatekuryrrc | 2 +- devstack/devstackgatenativeservicesrc | 41 +- devstack/devstackgaterc | 25 +- devstack/lib/networking-ovn | 26 +- devstack/local.conf.sample | 13 +- devstack/plugin.sh | 1 + networking_ovn/cmd/neutron_ovn_db_sync_util.py | 18 +- networking_ovn/common/acl.py | 25 +- networking_ovn/common/config.py | 27 +- networking_ovn/common/constants.py | 32 +- networking_ovn/common/exceptions.py | 33 + networking_ovn/common/extensions.py | 3 +- networking_ovn/common/utils.py | 51 +- networking_ovn/l3/l3_ovn.py | 787 +++++++++++-- networking_ovn/l3/l3_ovn_admin_net.py | 215 ++++ networking_ovn/ml2/mech_driver.py | 419 ++++--- networking_ovn/ml2/qos_driver.py | 6 +- networking_ovn/ml2/trunk_driver.py | 9 +- networking_ovn/ovn_db_sync.py | 182 +-- networking_ovn/ovsdb/commands.py | 271 ++++- networking_ovn/ovsdb/impl_idl_ovn.py | 169 ++- networking_ovn/ovsdb/ovn_api.py | 159 ++- networking_ovn/ovsdb/ovsdb_monitor.py | 54 +- networking_ovn/ovsdb/row_event.py | 3 + networking_ovn/ovsdb/vlog.py | 30 + .../unit/cmd/test_neutron_ovn_db_sync_util.py | 156 +++ rally-jobs/ovn.yaml | 30 +- .../notes/bug-1606458-b9f809b3914bb203.yaml | 6 + .../notes/networking-ovn-0df373f5a7b22d19.yaml | 2 +- .../notes/ovn-native-nat-9bbc92f16edcf2f5.yaml | 8 + .../notes/ovn_dhcpv6-729158d634aa280e.yaml | 7 + .../notes/ovsdb_connection-cef6b02c403163a3.yaml | 4 + releasenotes/source/conf.py | 3 + releasenotes/source/index.rst | 1 + releasenotes/source/newton.rst | 6 + requirements.txt | 13 +- setup.cfg | 1 - test-requirements.txt | 10 +- tools/tox_install.sh | 45 +- tox.ini | 6 +- 69 files changed, 6309 insertions(+), 1252 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 2650d84..762e2ed 100644 --- a/requirements.txt +++ b/requirements.txt @@ -5,7 +5,6 @@ -netaddr!=0.7.16,>=0.7.12 # BSD -neutron-lib>=0.4.0 # Apache-2.0 -oslo.config>=3.14.0 # Apache-2.0 -ovs>=2.5.0;python_version=='2.7' # Apache-2.0 -ovs>=2.6.0.dev3;python_version>='3.4' # Apache-2.0 -pbr>=1.6 # Apache-2.0 -retrying!=1.3.0,>=1.2.3 # Apache-2.0 +netaddr!=0.7.16,>=0.7.13 # BSD +neutron-lib>=1.1.0 # Apache-2.0 +oslo.config!=3.18.0,>=3.14.0 # Apache-2.0 +ovs>=2.6.1 # Apache-2.0 +pbr>=1.8 # Apache-2.0 +tenacity>=3.2.1 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index 2b8590c..4a0815d 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -7 +7 @@ hacking<0.11,>=0.10.0 -coverage>=3.6 # Apache-2.0 +coverage>=4.0 # Apache-2.0 @@ -9,2 +9,2 @@ python-subunit>=0.0.18 # Apache-2.0/BSD -sphinx!=1.3b1,<1.3,>=1.2.1 # BSD -oslosphinx!=3.4.0,>=2.5.0 # Apache-2.0 +sphinx!=1.3b1,<1.4,>=1.2.1 # BSD +oslosphinx>=4.7.0 # Apache-2.0 @@ -13 +13 @@ oslotest>=1.10.0 # Apache-2.0 -os-testr>=0.7.0 # Apache-2.0 +os-testr>=0.8.0 # Apache-2.0 @@ -19 +19 @@ testtools>=1.4.0 # MIT -reno>=1.8.0 # Apache2 +reno>=1.8.0 # Apache-2.0

1 0

[neutron] neutron 10.0.0 (ocata)
by no-reply＠openstack.org 22 Feb '17

22 Feb '17

We high-spiritedly announce the release of: neutron 10.0.0: OpenStack Networking This release is part of the ocata release series. Download the package from: https://tarballs.openstack.org/neutron/ For more details, please see below. 10.0.0 ^^^^^^ Hyper-V Neutron Agent has been fully decomposed from Neutron. Therefore, the *neutron.plugins.hyperv.agent.security_groups_driver.H yperVSecurityGroupsDriver* firewall driver has been deleted. Update the *neutron_hyperv_agent.conf* / *neutron_ovs_agent.conf* files on the Hyper-V nodes to use *hyperv.neutron.security_groups_driver.HyperVSecurityGroupsDriver*, which is the networking_hyperv security groups driver. New Features ************ * Middleware was added to parse the "X-Forwarded-Proto" HTTP header or the Proxy protocol in order to help Neutron respond with the correct URL references when it's put behind a TLS proxy such as "haproxy". This adds "http_proxy_to_wsgi" middleware to the pipeline. This middleware is disabled by default, but can be enabled via a configuration option in the "[oslo_middleware]" group. * The Linux Bridge agent now supports QoS DSCP marking rules. * Keepalived VRRP health check functionality to enable verification of connectivity from the "master" router to all gateways. Activation of this feature enables gateway connectivity validation and rescheduling of the "master" router to another node when connectivity is lost. If all routers lose connectivity to the gateways, the election process will be repeated round-robin until one of the routers restores its gateway connection. In the mean time, all of the routers will be reported as "master". * Linux Bridge driver now supports QoS egress minimum bandwidth limit rules. * Add a new configuration section, "[placement]", with two new options that allow to make "segments" plugin to use the "Compute" placement ReST API. This API allows to influence node placement of instances based on availability of IPv4 addresses in routed networks. The first option, *region_name*, indicates the placement region to use. This option is useful if keystone manages more than one region. The second option, *endpoint_type*, determines the type of a placement endpoint to use. This endpoint will be looked up in the keystone catalog and should be one of "public", "internal" or "admin". * Designate driver can now use Keystone v3 authentication options. "The "[designate]" section now accepts the "auth_type" option, as well as other "keystoneauth" options (e.g. "auth_url", "username", "user_domain_name", "password", "project_name", "project_domain_name")." * Resource tag mechanism now supports subnet, port, subnetpool and router resources. * A new mechanism has been added to the "neutron-netns-cleanup" tool that allows to kill processes listening on any "Unix" or network socket within a namespace. The new mechanism will try to kill those processes gracefully using the "SIGTERM" signal and, if they refuse to die, then the "SIGKILL" signal will be sent to each remaining process to ensure a proper cleanup. * The QoS driver architecture has been refactored to overcome several previous limitations, the main one was the coupling of QoS details into the mechanism drivers, and the next one was the need of configuration knobs to enable each specific notification driver, that will be handled automatically from now on. * The "created_at" and "updated_at" resource fields now include a timezone indicator at the end. Because this is a change in field format, the old "timestamp_core" extension has been removed and replaced with a "standard-attr-timestamp" extension. * Initial support for "oslo.privsep" has been added. Most external commands are still executed using "oslo.rootwrap". * vhost-user reconnect is a mechanism which allows a vhost-user frontend to reconnect to a vhost-user backend in the event the backend terminates either as a result of a graceful shutdown or a crash. This allows a VM utilising a vhost-user interface to reconnect automatically to the backend e.g. Open vSwitch without requiring the VM to reboot. In this release, support was added to the neutron Open vSwitch agent and "ml2" driver for vhost-user reconnect. Known Issues ************ * In kernels < 3.19 "net.ipv4.ip_nonlocal_bind" sysctl option was not isolated to network namespace scope. L3 HA sets this option to zero to avoid sending gratuitous ARPs for IP addresses that were removed while processing. If this happens, then gratuitous ARPs will be sent. It may populate ARP cache tables of peer machines with wrong MAC addresses. Upgrade Notes ************* * The "api-paste.ini" configuration file for the paste pipeline was updated to add the "http_proxy_to_wsgi" middleware. * The "dhcp_domain" DHCP agent configuration option was deprecated in Liberty cycle, and now is no longer used. The "dns_domain" option should be used instead. * On upgrade, IPv6 addresses in DHCP namespaces that have been created dynamically via SLAAC will be removed, and static IPv6 addresses will be added instead. * Update the *neutron_hyperv_agent.conf* / *neutron_ovs_agent.conf* files on the Hyper-V nodes to use *hyperv.neutron.security_groups_driver.HyperVSecurityGroupsDriver*, which is the networking_hyperv security groups driver. * A new option "ha_keepalived_state_change_server_threads" has been added to configure the number of concurrent threads spawned for keepalived server connection requests. Higher values increase the CPU load on the agent nodes. The default value is half of the number of CPUs present on the node. This allows operators to tune the number of threads to suit their environment. With more threads, simultaneous requests for multiple HA routers state change can be handled faster. * Obsolete "oslo.messaging.notify.drivers" entrypoints that were left in tree for backwards compatibility with pre-Icehouse releases have been removed. Those are "neutron.openstack.common.notifier.log_notifier", "neutron.openstack.common.notifier.no_op_notifier", "neutron.openstack.common.notifier.test_notifier", "neutron.openstack.common.notifier.rpc_notifier2", "neutron.openstack.common.notifier.rpc_notifier". Use values provided by "oslo.messaging" library to configure notification drivers. * The "advertise_mtu" option is removed. Now Neutron always uses all available means to advertise MTUs to instances (including DHCPv4 and IPv6 RA). * The "min_l3_agents_per_router" configuration option was deprecated in Newton cycle and removed in Ocata. HA routers no longer require a minimal number of L3 agents to be created, although obviously they require at least two L3 agents to provide HA guarantees. The rationale for the removal of the option is the case a router was created just when an agent was not operational. The creation of the router will now succeed, and when a second agent resumes operation the router will be scheduled to it providing HA. * After upgrade, a macvtap agent without physical_interface_mappings configured can not be started. Specify a valid mapping to be able to start and use the macvtap agent. * The "timestamp_core" extension has been removed and replaced with the "standard-attr-timestamp" extension. Resources will still have timestamps in the "created_at" and "updated_at" fields, but timestamps will have time zone info appended to the end to be consistent with other OpenStack projects. Deprecation Notes ***************** * Configuration options "kernel_hz" and "tbf_latency" in "[qos]" section have been removed due to being no longer used. * The "physical_device_mappings" option is deprecated and will be removed in Pike. PCI device validation is done in Nova, controlled via the "pci_whitelist" configuration option. Therefore it is redundant to validate it in Neutron with "physical_device_mappings". * The L3 agent "send_arp_for_ha configuration" option is deprecated and will be removed in Pike. The functionality will remain, and the agent will send three gratuitious ARPs whenever a new floating IP is configured. * The "iptables" firewall driver will no longer enable bridge firewalling in next versions of Neutron. If your distribution overrides the default value for any of relevant sysctl settings ("net.bridge.bridge-nf-call-arptables", "net.bridge.bridge-nf-call- ip6tables", and "net.bridge.bridge-nf-call-iptables") then make sure you set them back to upstream kernel default ("1") using /etc/sysctl.conf or /etc/sysctl.d/* configuration files. * notification_drivers from [qos] section has been deprecated. It will be removed in a future release. Bug Fixes ********* * There is a race condition when adding ports in DHCP namespaces where an IPv6 address could be dynamically created via SLAAC from a Router Advertisement sent from the L3 agent, leading to a failure to start the DHCP agent. This bug has been fixed, but care must be taken on an upgrade dealing with any potentially stale dynamic addresses. For more information, see bug 1627902 (https://launchpad.net/bugs/1627902) * Versions of "keepalived" < 1.2.20 don't send gratuitous ARPs when keepalived process receives a "SIGHUP" signal. These versions are not packaged in some Linux distributions like Red Hat Enterprise Linux 7, CentOS 7, or Ubuntu Xenial. Not sending gratuitous ARPs may lead to peer ARP cache tables containing wrong entries about floating IP addresses until those entries are invalidated. To fix that scenario, Neutron now sends gratuitous ARPs for all new IP addresses that appear on non-HA interfaces in router namespaces. This behavior simulates behavior of new versions of "keepalived". Other Notes *********** * Due to changes in internal L3 logic, a server crash/backend failure during FIP creation may leave dangling ports attached on external networks. These ports can be identified by a "PENDING" "device_id" parameter. While those ports can also be removed by admins, the "neutron-server" service will now also trigger periodic (approximately once in 10 minutes) cleanup to address the issue. * The "allow_pagination" and "allow_sorting" configuration options are now removed. Now, sorting and pagination are always enabled for plugins that support the features. * vhost-user reconnect requires dpdk 16.07 and qemu 2.7 and openvswitch 2.6 to function. if an older qemu is used, reconnect will not be available but vhost-user will still function. Changes in neutron 9.0.0.0rc1..10.0.0 ------------------------------------- 339855f Clean up ovsdb-native's use of verify() 0eb59ef Invert device_owner to avoid filtering too much 54a3dd6 Switch to 'subquery' for 1-M relationships ae74f0a DVR: Look at all SNAT ports for a subnet match 8905397 Pecan: Fix tags handling for pecan 7d372b6 Update UPPER_CONSTRAINTS_FILE for stable/ocata 0eb7bf9 Revert "Linux Bridge: driver support for QoS egress minimum bandwidth" c93215f Update devref for enhanced tag mechanism 365ad91 Skip reading config files from neutron.conf.d for the namespace proxy 0fb35ea Use only_contrib option for nova_client calls 7d04882 Improve tunnel_sync 48e1b42 DVR: Add static routes to FIP namespace a264318 Update .gitreview for stable/ocata f7b1fc6 Terminate macvtap agent when physical_interface_mapping config not present fbf40fe Enhance tag mechanism 0dad0bc Tag the alembic migration revisions for Ocata 1e1e7a8 Add Loki service plugin for optional DB havoc 33129f2 Use bytes for python3 friendly os.write 8aa7a46 Updated from global requirements c88debc Use addCleanup instead of tearDown b53291a Remove --omit argument in run_tests.sh f3a2266 Integration of Provisioning Block OVO. 185d6cb Add support for Keepalived VRRP health check 5c5badf Use socket.AF_INET6 in ip_lib tests 792cc0f Update bug triaging policy for documentation 95ce333 Remove duplicated and unused code in iptables_firewall 7b5f01c Add IPv6 Prefix Delegation support for DVR b61b630 Fix port update for service subnets 49e84a7 Update in-tree code to use new neighbour functions e5320e7 functional: Check for processes only if there are any 1182508 Fix link in QoS devref 10bfa69 Clear conntrack entries without zones if CT zones are not used cd38886 Fix iptables rules for Prefix Delegated subnets 3a1873f policies: Replace Joe's graphite graphs with Grafana 4750112 Init privsep on l3 agent start afab7c6 Display deprecation warning in test only once a502c96 Kill the metadata proxy process unconditionally 38de22b Always acquire network.id lock in dhcp port update b6d9a3f Fix WaitTimeout string representations 8d3f216 Addressing L3 HA keepalived failures in functional tests 6ce47f1 Stop passing datapath as 'may_exist' argument 4c636bd Retry on routerport delete race c148edb Do not raise an error deleting neighbour entry 7872508 [Live Migration] Extend ml2_port_binding table 26128ac Fix some pylint errors in IPAM tests faf80b9 Use weakrefs for common_db_mixin callbacks 9645877 Add bulk pull OVO interface 750c491 Handle attempt to enable br_netfilter in namespace 59727be Check arg type for SegmentTypeDriver functions 8a79090 Add missing port UPDATE event to ML2 28d2e69 Fixes to allow OVO deserializion of ports/networks 7915b4a Add missing module-level SUBNET ref 829b39b ovsfw: Refresh OFPort when necessary 4fe3d27 Fix a bad docstring in provisioning blocks module 38c1812 Transition qos notification driver into qos driver 271a4ff OVS: merge the required OpenFlow version rather than replace f8a224a Adjust psutil usage for psutil > 2 318650a Allow all migration of routers c7dd0ab Set access_policy for messaging's dispatcher 72154cc Elminate join for network owner filter 519d7cc Always add unique sort keys when sorting 1bcdc29 Allow the other nic to allocate VMs post PCI-PT VM creation. d7a6827 Change neighbour commands to use pyroute2 5cbdd10 Routed networks IPv4 inventory in Nova GRP af6b9b3 Correctly set project_name 7d99bf0 Break circular import with use of common_types d5c07fe ovsfw: Support protocol numbers instead of just tcp and udp d6c99d5 Add KillFilter for python 3.5 553ab6d Register sqlalchemy events through hook for UT cleanup 7953e98 Fix empty string check for python 3 6ffc58d Update docstring in validate_provider_segment a43e992 Modify docref commands to reflect OSC transition d8440e4 Server-side push notifications for ML2 e834986 Allow 0 in port range for securitygrouprule object 48580f3 Updated from global requirements 89f6dd3 OVO for Ipam(Allocation,Subnet,Pool) 91b2efc Remove get_router_cidrs method of dvr_edge_ha router 6944d74 Use plugin directory fixture ea2cab0 openvswitch agent: add OVS_RESTARTED event 4f17f70 Stop using legacy facade 8047da1 XenAPI: Support daemon mode for rootwrap 66c7c60 Fix importing old path for exceptions 743a610 Use ubuntu image for tempest scenarios from Neutron a594df6 Catch invalid subnet service_types on input 45e047f Fullstack SG test for LinuxBridge agent 8252b94 Get rid of L3 HA override of _update_router_db 0296455 Get rid of create_router override in l3_ha mixin ebe62dc Add a ReST client for placement API 39c74b0 Add OVO for AutoAllocatedTopology ada4237 Fix typos 39567df Fix broken Windows compatibility in ovs_lib 18e2e2d Add IPLink class to Windows ip_lib implementation 71edbb0 Support ovsdb-client monitor with remote connection 393a3bd Protect against non-determinstic sort dd5aca3 Remove deprecated min_l3_agents_per_router 2725b4d Include port_security check in fullstack tests a8b6a59 Revert "Setup firewall filters only for required ports" e9572ea test_l3: Enable native pagination and sort e74b45d Revert "Protect against non-determinstic sort" 4a66fa8 Multiple tweaks for Ocata release notes 536ea85 L3: Add in missing translation d8d41ae Fix broken links in devref a27ec6c Rename a test method dcd4c8b DVR: delete stale devices after router update 84b3ae3 Linux Bridge: driver support for QoS egress minimum bandwidth 8b048cc Use project_id instead of tenant_id in objects f57dbf3 Remove references to defunct Stadium docs decbf0c Use new enginefacade for dvr mac db f15851b DHCP: enhance DHCPAgent startup procedure bd9e646 Use writer for trunk database operations 1927da1 Add check for ha state 38c070b DVR: fix csnat port missing after router update fc075fa Manually add pk for alembic_version table a734bdd Only migrate ports on DVR migration 175bfe0 Protect against non-determinstic sort a7c633d Decompose router extra attr processing f2b6975 Use unique subnetpools in SubnetPoolPrefixDbObjectTestCase 3f9f740 Fix netns_cleanup interrupted on rwd I/O 7b1a390 Don't emit SG rule AFTER events until TX closed 7872160 Updated from global requirements 526816d neutron-lib: use L3 constant b38f1cb Use the session loader in keystoneauth1 for designate 3040e44 Fix delete_network to delete ports one by one 9a0bdb9 Cleanup unused helper function from test code dd36243 Added UT for floating ips with dns d5f4cdc Centralize creation of security group test obj 6f20f1c Suppress annoying "Could not load" stevedore warnings ca60a91 adds support for vhost user reconnect. 5b7c8c3 Clean up _get_ports_query f204728 Get rid of additional fixed_ip filter join b09a380 Remove advertise_mtu config option 495b786 Get rid of _network_model_hook for external_net b87715d Protect against '.delete()' for quota and revisions bf56b85 Don't use .delete() on a port in unit test 9dea90d Stop using .delete() in external net handling code 3e4c0ae Revert "Add ALLOCATING state to routers" 3ea5f7c Get rid of ml2 port model hook join 0378194 Add retry to _create_ha_port_binding b4c1dda Correct the msg ipv6 enable in system 42cc227 Change default exception in wait_until_true 45ae248 Checking functionality of DVR 7c0e62e l3scheduler: create ha_vr_id more robustly 911eb51 Get rid of l3 ha delete_router inheritance 47ee253 Allow to pass suite flavor to gate_hook to disable dvr tests ffc4489 Don't create default SG in transaction 17c2b45 Kill neutron-keepalived-state-change gracefully f142ab2 gate_hook: Add support for neutron-full with the ovs firewall 22707fb Add filter check for quering d17befe Fix dir doc typo error 8de5060 Flavor and Service Profile to OVO 021f2f8 DHCP: "reserved_dhcp_port" not well managed during startup 161e580 Raise AssertionError instead of eventlet.timeout.Timeout when failing. 327f7fc Adding debug trace to IPWrapper.get_devices() b1405cb Use gate_hook to enable q-trunk for rally. 5b056e0 Update contacts and team list 4f3be30 Replaces uuid.uuid4 with uuidutils.generate_uuid() 9a022e7 Reduce IP link show calls for SR-IOV scan loop cc27af1 Add DictOfMiscValuesField in OVO for dict usage d5205e8 SR-IOV: Remove physical_device_mappings depreciation warning 69b49a5 Fix a typo in iptables_manager.py 2ba12ae DB: remove deprecated oslo_db warnings a12de89 Fullstack tests for DHCP agent HA 444184a Remove greenlet useless requirement 5af25db Fix pylint warning in test_l3_hamode_db.py e1f43a6 Fix typo 8f37f2d Replace nc command with ncat 7fc79f4 Refactors QosAgentDriver 0af6e6d Change the order of installing flows for br-int 5a0aa8d Updated from global requirements ce9aa9c [TrivialFix] Fix comment typo error 2ad9c67 Don't create HA resources until needed 6958829 Do not try and remove non-existent iptables chains dbcdc11 Fix ext alias in revision API test e54ddc9 Modify error word "procedence" to "precedence" 8754b9c Updated from global requirements 2d508fc [TrivialFix] Fix comment typo error ad16d63 neutron-lib: use CORE from neutron lib constants c28bade Use Port OVO in ml2/db and plugins/ml2/test_db 8ef0979 gate_hook: Add a no-op rally case 45ef899 Remove Duplicate line in privsep.filters 1c5bf09 Use DB field sizes instead of _MAX_LEN constants 9bab88b Account for unwire failures during OVS trunk rewiring operations 12b0e16 Change passing session to context in segments db functions 55a25bd Fix a bug in process_spawn binding on ports af3620e team update: john-davidge doc liasion 2b16cb8 OVO for FlatAllocation 5c02e1f Fix python3 issues with devstack af0c538 iptables: don't enable arptables firewall aacd8e0 Pecan: Fix subresource policy check 9183da7 Adopt privsep and read routing table with pyroute2 df7e36c Change passing session to context for TypeDriver 92199db of_interface: Revert patching ryu 22352f5 Remove iptables nat and mangle rules for security group e9efe86 SR-IOV: remove ml2_conf_sriov.ini from oslo-config-generator a0b8ea7 Sort and Remove duplicate field types 1d38f30 Kill processes when cleaning up namespaces d67a966 Don't return content when we set HTTP 204 e234ecc Set standard_attr_id as property in DeclarativeObject. e48caf6 Add agent object in router info 6bd3ad2 Bump revision of resource on tag add/remove a802b38 Use subqueries for rbac_entries and subnets<->network a66c271 ovsfw: Raise exception if tag cannot be found in other_config 0176637 Proposing tidwellr and njohnston as service layer go-to contacts 8733190 Propose mlavalle as neutron core and L3 second in command 71fac62 Use get_random_string from neutron-lib 605df9c Moving pyroute and oslo.privsep deps into requirements.txt af28cba devref: suggest bug deputies to send brief reports to ML 02fa4a1 Ensure random object unique constraints aren't violated 14bf594 Update comment about foreign keys 3bac406 Document how to proceed with new platform features 5c8dffa Update MTU on existing devices eccb6e4 Added log messages while creating neutron objects. 15163c0 Add subprojects database migration f38688c Fullstack test for DHCP agent ec153ee get_random_object_fields() for setting object attr 489cc97 Updated from global requirements 118720d Remove external_fixed_ips from Plural_mappings in l3.py 3fec181 Clean-up L3 constant TODOs 2cedbf2 Unittests improvement 7b6e236 Restore extraroute dict after OVO change aed187d tests: change order of assertion in _validate/compare_resource 4eb4500 Refactor ml2_db to pass context db59d42 Propose abhiraut as neutronclient core 2baeaea OVO for Allocation and Endpoint e45d2a9 Correctly print --limit value passed via API 9b58a18 Fix flake8 error in DHCPOptsTestCase class 0ec47f9 objects: add delete_objects public method d40322c DVR: Fix race condition in creation of fip gateway 1866bd4 Bulk creation of SecurityGroups 55bda46 Remove model_base deprecations fd3bf33 DSCP packet marking support in Linuxbridge agent 503fc8c Remove duplicated revises_on_change in qos db model 1800ae6 Fix DHCP Port Creation on Service Subnets 60dc1a0 tempest: Fix qos extension check fd3eebb Unplug external device when delete snat namespace ced332c Revert "Squash revert to breaking changes" a1817f7 Optimize trunk details extension hook 8976e42 rally trunk port list 5772ba5 Get rid of DVR override of remove_router_interface a5a8a37 Check for unbound ports in L3 RPC handler 464397f devref: don't suggest to manually request stable branches d352661 Revert "lb-agent: ensure tap mtu is the same as physical device" 7eba573 Fix some slow unit tests ec6ed98 DVR: Fix IPtables driver for metering with DVR routers efe1c30 Get rid of DVR override of add_router_interface 8055746 Remove redundant "dvr" in test name cf6ffb7 Pass context and resource_type in RPC callback 9f19b3e Tempest tests uses only supported QoS rule types 2f4154a Get rid of DVR override of _port_has_ipv6_address e91561e Add filters support to constant queries test 6578c53 Remove deprecated dhcp_domain from dhcp_agent.ini 1a2a71b SRIOV: don't block report_state with device count 640618b OVO for VlanAllocation 21bb776 Correctly configure IPv6 addresses on upgrades 6948467 Add janitor to cleanup orphaned fip ports bb78621 Make UUIDField actually validate UUIDs 2acdced Delete related conntrack when delete vm 5cb73f5 Pecan: Change Quotas to use original controllers 1ef552a Use Query.column_descriptions instead of private property a2f971c Remove fallback functions in agent/rpc 3ee76d4 Convert filters to empty dict if None in DB's get_subnetpools(). c0983a1 stadium guidelines: Document stable branch creation 26020fe doc: Fix a warning 91d048d Allow keystone v3 in the designate driver 8fcba9d QoS: update the database before notifying the backend on delete fc251bf Expose [agent] extensions option into l3_agent.ini ebc56e8 Include ovsdb_connection option into all interface_driver agents 5e674bf Eliminate DVR inheritance of router create/update_db dfe738a Use ExtensionDescriptor from neutron-lib d8055d5 Support alembic 0.8.9 in test_autogen_process_directives d49b6f5 Use Port OVO object in test_l3_ext_gw_mode 42031f7 Refactoring config opts for ml2 plugin openvswitch b0ea7c9 Don't compile OVS kernel modules for functional job 5b49eff Update bug tag contacts due to absconsions 74e7145 configure_for_func_testing.sh: Remove neutron-legacy inclusion c15c4e4 configure_for_func_testing.sh: Source lib/neutron as well 59bb1ec Functional tests: change assert to wait_until_true 6ef6c3c revise doc: support_extension_aliases to supported_extension_aliases 958c093 Pecan: Remove get_resources() from get_pecan_resources() 76c9984 Fix docs headers f87274c Update DB lieutenant to Ann Taraday aa5985d Compare port_rule_masking() results with different approach 2e621ee Use to_policy_values for policy enforcement 028a349 Skip larger than /64 subnets in DHCP agent 78d5b24 Refactoring config options for mech_sriov opts 9168dbf Delete conntrack when remote ipset member removed 4c41a25 Migrate device_owner for router's interface 61eb74a Remove allow_pagination and allow_sorting config options a1b21e3 Integration of RouterRoute OVO 79e6251 tests: introduce update_obj_fields method in base objects test class 0daed9e Add notify for tag operations 10c0e36 gate_hook: Remove a stale comment c952952 Renamed all [AGENT] config sections into [agent] 1e36e9b Reuse plugin's update method for changing trunk status b522345 Calculate IPv4 DHCP subnets once for metadata d1930ce Lock in DHCP agent based on network_id 6aa9a3c Fix OSprofiler support a2047bb Introduce objects_exist method in neutron/objects/base.py a20eac7 OVO: add SubnetServiceType object and code integration. b25e29c Revert "Deprecate SR-IOV 'physical_device_mappings' config option" ea517a0 Removed deprecated method 69d7363 ml2: Add original port to context on _bind_port 0d07327 Integrate Address Scope OVO into DB 3b610a1 Add missing revises_on_change attribute 8b0bdbe Redirect ExtensionDescriptor to neutron-lib f33bada Remove PLURALS 20cd64b Show team and repo badges on README 949bce9 ovs-agent: Close ryu app on all exceptions f6df76c Get rid of DVR inheritance of _delete_current_gw_port 62176a9 Solve unexpected NoneType returned by _get_routers_can_schedule. 88ee81d fullstack: add some more security group tests 9660c2f Update network dict with segment and mtu info in _create_subnet_db 9e006cb Capture NotFound Exceptions in subnet postcommit 4e96500 Revert "DHCP agent: advertise SLAAC prefixes" 46430ab Get rid of floating IP bgp next_hop query 6566fb1 L3: Only send notifications if l3 plugin exists 542ff34 Pecan: Minor Fix in startup b0fd588 Squash revert to breaking changes 4151486 Remove REVERSED_PLURALS and get_resource_info() 562b638 Remove legacy oslo.messaging.notify.drivers 29273ad Fix InvalidInput exception output 2db889b Revert "Fix file permissions" 17563a8 Adopt neutron-lib plugin directory cf6917f DB: use get_unique_keys from oslo_db 7d42176 ovsdb: don't erase existing ovsdb managers 4c45d1e OVO for Provisioning Block DB Model 3e45c19 ovs-agent: Catch exceptions in agent_main_wrapper 3815a60 functional: Remove unused l3 config 427a960 Updated from global requirements e83d07d Improve performance of _modify_rules 1e91b63 Refactoring config options for plugin l2pop opts 5e1c3c7 Refactoring config options for plugin macvtap opts d7b40d1 Refactoring config options for l2 agent ext opts fcc13b5 Refactoring agent metadata config 7962dd4 Metering: sync only active routers hosted on the same host 42b209a Fix security_groups_provider_updated for linuxbridge cc92b42 Using a new security group in scenario tests eb14f66 Fix file permissions 3b8143b DB: remove deprecation warnings for BASEV2 fe7cac5 cors: update default configuration 138179a Add unit test in test_allowedaddresspairs_db 90398a3 Adjustment method execution order 2e5b4cb functional: Pass string tag to other_config 54beb5e functional: Use VLAN tags from range <1; 4094> 8f4a84c Replace create_test_segment with NetworkSegment object 846cad8 Remove unused LOG 132e220 Get post-subnet actions out of transaction c932b69 ProviderResourceAssociation to OVO 7e8f9d4 sanity check: Check that ip_nonlocal_bind works with namespaces eef348f callbacks: Make the value of FLOATING_IP match with api resource 299c3f8 Move SR-IOV VIF type constants to the portbindings extension 43b75bf Use new enginefacade metering db 5ea4c98 Move DVR fip agent gw port create out of transaction c935868 Separate floating IP port creation from transaction 03f7ec3 Use callbacks to create DVR floating GW port 01c4bda Disallow specifying too long name and description for qos 8eac5e2 Move AgentStatusCheckWorker to PeriodicWorker 5ff8aec Speed-up iptables_manager remove_chain() code 512455d Typo on side_effect rendering the test useless 7c7e241 Fix reset/start methods on AgentStatusCheckWorker d99724b Pecan:Add functional test for QuotasController 19336bb Elimination duplication of lots of DVR tests 0e51574 Have qos object increment port/network revision 07c8e14 Update devref examples about alembic migrations 9dbaf1c Trivial Fix - Update code to use Pike as the code name 5d6585b Stop using deprecated CORS.set_latent() 1e195af L3 scheduler: add retry indicators for bind_router 7403bcc Install OVS from git if current version < 2.5.1 1a0da09 Fix typos in standard_attr.py & attributes.py 081ad3b Clean up agent status check debt 894999d Collect OVS Debt 904f85e Disable 'accept_ra' in DHCP agent namespace f276a96 Replace assertEqual(None, *) with assertIsNone in tests 202564c Fix ML2, base db plugin update_subnet for transactions bd63489 DVR: Fix func docstring and comments 97f4a3f Move sysctl out of IPDevice class 7647e3e Parse the output of ip route more robustly 16ae419 Add L3 HA test with linux bridge bc03048 Fix "failed unplugging ha interface" error when deleting router d2c292e Add a trunk rally test 56a195e Updated from global requirements 653972f Fix typo in release note filename 9cb31b1 Use new enginefacade for servicetype_db b45fd35 Remove floatingip address ignores ha_state 7db68e3 ovsfw: small cleanups to improve readability 53ad480 Use new enginefacade for tag 4a91eea Change import statement to not rename the module 90e6715 Add unit tests for ip_lib.get_routing_table 3d6d939 policy: cache extracted parent fields for OwnerCheck cc9ce51 Changing arping command execute to accept 1 as extra OK code 4fdd89e l3-ha: Send gratuitous ARP when new floating IP is added 17ecc54 Make OVO exception NeutronDbObjectDuplicateEntry retriable 0a27cf7 Move OVO exceptions to neutron/objects/exceptions 7c0b219 neutron-lib: complete usage of helpers 63d428a Add check to address_pair that items in list are dict f5e30ab Add rally hook to neutron devstack plugin 96b8d9a Agent to OVO b0e56ac Retire deprecations for constants, exceptions, attributes c9847ef Remove second -m protocol from iptables rules 0140a18 Truncate IPDevice's name to interface max size 9c81f27 Change cfg.set_defaults into cors.set_defaults 9f1057b DHCP: Add missing path for marking ports as ready f90eefc Stop using osprofiler options as if they are part of public API e727b92 Register osprofiler options before setting engine hook 79ad849 Don't pass config object to send_ip_addr_adv_notif() 03b84bc Deprecate SR-IOV 'physical_device_mappings' config option 5805a07 Remove timeutils.clear_time_override in neutron 2013058 Refactor OVSDB native lib to be more customizable e8e4e5d Deprecate run_tests.sh e43eb80 Removed deprecation warning for waiting_until_true bea8985 Removed deprecated tests function 6bb12ef Removed deprecated function import_modules_recursively 4e25ba8 Switch to new hacking 0.12 b97d008 Avoid UnboundLocalErrors in _create_bulk_ml2 f5a721e Introduce context in methods for Router Extra Attributes OVO usage. 3e44d75 Pecan: Find subresource controllers by parent eca4ace Removed dispose_pool() from db/api 6d85a51 Removed deprecation warning for converters and validators 7d17f8c Removed get_engine() from db/api 5189cbc Removed paginate_query and sqlalchemyutils module 05cd620 Removed deprecated methods for AgentSchedulers 1cd0585 Removed deprecated checks eb43062 Removed update_network from plugin.common.utils 3e6eea3 Removed network_segment functions from ml2.db 4ec456d Removed deprecated class LocalVLANMapping 6b59cc7 Deprecate send_arp_for_ha option cc861ad Change IPAM DB API to use context instead of session object. ea7b516 Add fullstack test for check DSCP marks outbounds 0e8b32b L3-HA: remove unused deprecated code 3d68a51 neutron-lib: use replace_file from neutron lib f692c81 Remove unused configuration variable fa34da9 Fix typo in comment ed6aeed Migrate to neutron-lib released API definition for trunk APIs db353d3 Updated from global requirements 16901e8 Reduce rally executions of create_and_list_ports f2fb460 Neutron lib adoption dbbbe59 Use ensure_tree from oslo_utils.fileutils 7b277a1 Remove last vestiges of oslo-incubator 4c5a654 Updated from global requirements ac2b7b0 Updated from global requirements 1392d37 Pecan: No fields to plugin on GET member actions 468b2f1 IP Conntrack Manager changes for FWaaS v2 7dc2707 Only mark ports ready on synced networks 660946a Fix modify_fields_from_db for vif_details empty str 1a696c5 Forbid contract migration scripts for Ocata 7675495 Check if namespace exists before getting devices 11c3f0c DHCP agent: advertise SLAAC prefixes 8be87fb Use new enginefacade for address_scope_db b7fad98 Replace a test with use of network object d400c04 Add 'to_primitive' for MACAddress and IPNetwork be3aa89 Update Lieutenant table with new entries 48d9583 Usage of new enginefacade for flavor db 3c1bf86 Don't depend on translated strings for error check 204a89e Simplify resources module in RPC callbacks e8fd250 SR-IOV: Remove deprecated supported_pci_vendor_devs option fef33d7 ipv6_utils: delete get_ipv6_addr_by_EUI64 2475265 Fix specs broken link 6980962 Make README less verbose and to the point aa54d12 Make crystal clear how to contribute/approach the neutron community 8f80a52 Refactor/prepare db common utils for neutron-lib 837abf5 Add OVO for dns Objects 23ffde8 Fix test_unwatch_log() to cleanup after itself 4135040 Updated from global requirements 2605056 TrivialFix: Modify the spelling mistake 4f0caa0 Rename ipv6_utils.is_enabled() 2c7ef56 Handle db_add in transaction for new objects 6baedb9 [TrivialFix] Replace 'assertTrue(a in b)' with 'assertIn(a, b)' c154045 Correcting a spelling in README d34bbf5 Refactoring config options for cache_utils opts a44543f Updated from global requirements a233ac5 OVO for SegmentHostMapping 32e1ee2 Updated from global requirements 6425240 Pecan: Bulk create with one item returns plural 93104d3 Log OVS IDL library errors to neutron logs e8bd642 Replace retrying with tenacity b806d2c Removes the superfluous 'that' f7a2d4e Add functional tests for OVSDB Connection 9a6e3f9 Removed unnecessary file(openstack/common) in run_stack.sh 063cbca objects: add validate_filters option for count() method. 14ee329 ovsfw: Add a dl_type match for action=ct flows 784864d Update metadata proxy when subnet add/delete dcf2efd OVO for Router Extra Attributes 9204b34 Validate type of allowed_address_pairs c1b28a8 Pecan: Fix internal server error on QoS rule PUT 9006726 Pecan: Don't prefetch resource fields on DELETE 4264083 Generate OVSDB schema helper in a separate method de3ff15 objects: Remove tenant_id from to_dict() when project_id is not set. b39bad5 Updated from global requirements 934b95d Cleanup coverage configuration 71c8d35 Fix spelling errors ca62e7e Make ovs functional tests mutually isolated 7fdb98c Pecan: rework notifier hook for registry callbacks cb48d15 set_db_attribute differs between vsctl and native 3d500d3 Only send string values to OVSDB other_config column c4b2c8d test_routers_flavors: Skip if requirements are not met 19c354a Add http_proxy_to_wsgi to api-paste 46ba1aa Only emit deprecation warning when deprecated value read 0c1c754 Swap the order of arguments to _check_equal 9733825 Cleanup of SecurityGroup classes 013a48f Remove deprecation warnings for agents_db 29e15f9 Have RouterRoute object increment Router revision 070ee35 Allow to override Idl class in OVSDB Connection 43f5b59 Drop MANIFEST.in - it's not needed by pbr 7858b75 Updated from global requirements ff9c6e2 fullstack: Add security group tests c4a3a72 neutron-lib: use dict methods from helpers 6941152 neutron-lib: use get_hostname 45517be neutron-lib: use cpu_count e6d6a38 Pecan: add http_proxy_to_wsgi middleware 6d143e8 Use BaseDbObjectTestCase in AddressScope UT 20a290d Devref: fix repeated 'testing documentation' text 03be404 Removes remaining Hyper-V plugin 1d01864 Added trailing slash in link to Networking API v2.0 135a3fd Add db_add to OVSDB API abc31a7 Extend project_id in object dicts (Newton only) a6909c8 Integrate SubnetRoute OVO 83479f8 Fix callers of _make_port_dict() 88853cc objects: Removed project_id/tenant_id field translation 2901640 Remove deprecation warnings for l3_hamode_db 14ffea4 Fix IPv6 PD with pluggable IPAM bb9b610 OVO for Router Route 1628fb7 Improved readibility and fixed indentation 396abb8 neutron-lib: start using neutron-lib helpers 497e6bd Cleanup Newton Release Notes 6d7586e Fix periodic jobs: Add databases to bindep.txt ead39fa Relocate DNS db models f1099f1 Updated from global requirements 84511a8 ovsfw: Fix warning message when fetching port's other_config e669e7b Relocate Agent DB model db9ef6d Add api test for create update network and port with dns 0963aec Refactor code to deprecate get_interface_mac 1762dc7 Objects: Add README for neutron/objects directory tree 68caece Add sample_default for state change server config 0e5caeb Ignore gre0 and gretap0 devices in netns cleanup script. 145dbaa Get rid of double-join to rbac_entries without filter bd1c454 Deterministic ordering of fixed_ips eb1efc7 Account for Py2/Py3 differences in fcntl.ioctl return value cf7bb2f Enable release notes translation 2d33e2d Handle label_id's DBReferenceError when creating label-rule 945295a Add required extension to trunk_details descriptor 72ddd23 Relocate Segment DB Models d41ebf8 Make Jakub Libosvar contact for ovs-fw tag fc93f7f Relocate Flavor and ServiceProfile DB models 6797cbe Fix typo in comment fb53038 L3 DVR: always notify on ROUTER_INTERFACE AFTER_CREATE 5b9fe34 Fix _list_availability_zones for PostgreSQL 509bc4c Relocate dvr model 19af726 Fix the 'port_id' attribute not exist error f9b1f09 Relocate L3HARouter DB model 6a011c3 Replace create_test_network with network object b6a296e Relocate Tag DB model 2f7c58f DVR: remove misleading error log 5c09536 Enable OVSDB Connection unit tests for py3 1f4f806 Handle uuid references within an ovsdb transaction f327aa6 Remove deprecation warning for l3_agent_scheduler a8e1bad Expose OVS bridge related options into metering agent config file 62fd09a Refactoring config options for ml2 plugin drivers 676257c Remove recursion from import_modules_recursively 2823c2e Refactoring config options for l3 ha agent opts cf6d700 Relocate SegmentHostMapping DB model 22b4f03 Relocate Router Extra Attributes DB Model 8ad62fe Remove old oslo.messaging transport aliases a53a4d9 Relocate router route DB model d59fa2b Disallow specifying too long name for meter-label 190ae4f Fix misleading error trace in trunk fullstack life cycle test e1a832d Relocate Geneve DB models 438d4a8 TestSanityCheck: drop test tables during cleanup 322c1ee Removed is_deadlock from db/api 2760157 Relocate external network db models f0439a0 fullstack: VLAN aware VMs test 94ee8bc Introduce ovo objects for networks 698a8f0 Schedulers: use consistent plugin, context args 80eb375 Fixed functional iptables firewall tests for newer kernels 286af7c Relocate ProviderResourceAssociation DB models dcd7842 Introduce ovo objects for ports 558c051 Relocate VlanAllocation DB model a80b89b Ignore NULL fixed_ips for duplicate floating_ip check 820270f Relocate Metering DB models 930655c Relocate RouterL3AgentBinding DB model ddc2367 Updated from global requirements 2b66c6a Relocate L3 DB Models 0d81441 Relocate Provisioning Block DB Model 4148102 Process OVS trunk bridges associated to VM deletes 7acfc2f Fix typo overriden => overridden e83a44b iptables: fail to start ovs/linuxbridge agents on missing sysctl knobs cd7d63b Refetch subnet/network from DB in ML2 update ops 71dd840 Send a callback before attaching a subnet to a router 98de72e Don't try to delete non-existent namespace a9585c7 Added bindep.txt to the project 83ef231 Don't swallow ImportError from load_class_by_alias_or_classname e17d8ec Remove requests-mock from test-requirements c0d0986 Correct fix for IPv6 auto address interfaces 3daffd2 Darek (@dasm) is our new release liaison for Ocata 3ace0e5 Make HenryG the Magnificent responsible for 'oslo' LP tag 971cf85 Add missing revision number altercations d1fb423 Fixes for missing IPs on subnets in DHCP agent 873b5ac Retry port update on IpAddressAllocationNotFound 70ea188 New option for num_threads for state change server 08f2af1 Handle add/remove subports events loss due to agent failures e49b707 Fullstack: Add helper FakeFullstackMachinesList d24f664 trunk: Log RPC communication 3224e39 tests: Move testtools to 3rd party libraries section a17cda0 Fix pep8 E501 line too long d4f92ed Fix dhcp_release6 error when not supported 0d84833 XenAPI: add support for conntrack with XenServer cb79d09 Fix ML2 revision_number handling in port updates 7e82296 Fix ML2 test extension driver API test cases 7422903 Relocate PortBindingPort DB Model b078060 Relocate VxlanAllocation/VxlanEndpoints DB model c582d17 Support new osprofiler API 8612aaa Include entity in provisioning block logs edf3f23 API tests: Check MTU sanity of trunk/subport a4846c0 Use assertItemsEqual to compare dicts a01ca10 Fix wrong use of six.moves.queue.get() 9730104 Allow more time for DB migration tests 2945763 Update trunk metadata during wire/unwire operations 4371ae0 Ensure trunk status is acknowledged during OVS subport operations 66df336 Clean-up Tempest test networks with project_id 39c4f8f Add MAC address to subports in trunk_details 01f3c54 Updated from global requirements d1389dc Install dibbler.filters rootwrap file e11102e tests: catch eventlet.Timeout exception 8842460 Add basic status transition trunk scenario test 49609f3 Remove deprecated class NeutronController 5e39b88 Fix typos in test_ipam_pluggable_backend.py & base.py 09d1185 Do not retry default security group creation e80112c Fix a release note typo for implicit provider loading deprecation 2a5826c Revert "Do not retry default security group creation" 14fee9c Try to reuse existing IPs when a port update specifies subnet 9019ff2 Make DHCP agent use 'revision_number' bad3eaa Stop oslo_messaging from error logging CallbackNotFound 673abd5 Don't immediately restart in DHCP agent on port change 70907b3 Always cleanup stale devices on DHCP setup failure 0db052d Reduce log level for extensions not being supported b65d18c Add admin api tests for project-id 5ad5d10 Do not retry default security group creation 648e079 Increase subnet count for rally test a15d259 Lower concurrency on rally port job 933af3f Add to rally quotas to handle worst case quota race 19f3e9a Fix linuxbridge trunk subport RPC event handler 039673c OVS agent: configure both OF10 and OF13 251922f Disable DHCP on agent port removal 414f607 Garbage collect HasStandardAttributes subclasses in StandardAttrTestCase 225477c fullstack: execute qos tests for all ovsdb/of interface permutations ecdf751 Change the prefix for trunk subports device_owner 0541402 Fix devref typo b3af52e Keepalived global_defs configuration entries required to avoid DNS lookup d9cc6de DHCP: enhance DHCP release log d0f1a61 Make neutron-db-manage ready for ocata development f1f4121 Update reno for stable/newton f4a7ad4 Fix useless use of _nxm variant in an OVS field name ebd9aff Added missing translation marker for an error 033903a Add fullstack test with OVS arp_responder 0f5d18d Don't raise RetryRequest for port in delete_subnet 31e1aeb Forbid importing neutron.tests.* from outside tests subtree 268e10e Raise level of message to info 465d221 Add common way to extend standard attribute models e80e19f Don't warn in VLAN Plumber on tagless children 424a633 Include timezone in timestamp fields 42b574e Demote error trace to debug level for auto allocation operations a17c52f tests: Don't raise TimeoutError when waiting for ping 3e25ee3 Add sg_id in the AFTER_DELETE event of sg_rule delete 053448d stadium: remove neutron-release from release job for stadium projects 65757a3 devref: cleaning up release guidelines for stadium subprojects 1380856 Fix SR-IOV qos extension calls to clear_rate functions. 47439cb Add link to review dashboard in the effective guide 9339117 Remove duplicated tool 0494f21 ovsfw: fix troublesome port_rule_masking b5fa868 Skip setup_port_filters for skipped_devices ae09911 Disallow specifying too long description for meter-label 55b6c6a Fixes DBDeadlock race condition during driver initialization. 753f4ea Not check subnet with dhcp disabled when get_isolated_subnets 7e5d12d Clean import in code 7deba33 Use more specific asserts in tests 989aba6 fullstack: test for IPv6 north-south traffic 2e33fd8 ML2: Lower log level of "Host filtering is disabled" message 20bdfaa Removing unused file neutron/agent/l3/config a348c38 Add API test for tag 846b83f Remove unused params named "context" in filter_attributes a167a3e Check for l3 agents count before router update Diffstat (except docs and test files) ------------------------------------- .coveragerc | 2 +- .gitreview | 1 + .pylintrc | 2 +- .testr.conf | 6 +- CONTRIBUTING.rst | 12 +- HACKING.rst | 3 +- MANIFEST.in | 14 - README.rst | 44 +- TESTING.rst | 116 +-- bin/neutron-rootwrap-xen-dom0 | 24 +- bindep.txt | 19 + devstack/lib/dns | 6 + devstack/lib/ovs | 73 +- devstack/plugin.sh | 7 + .../devref/db_transient_failure_injection.rst | 38 + etc/api-paste.ini | 11 +- etc/neutron/rootwrap.d/dhcp.filters | 5 +- etc/neutron/rootwrap.d/iptables-firewall.filters | 9 +- etc/neutron/rootwrap.d/l3.filters | 9 +- etc/neutron/rootwrap.d/netns-cleanup.filters | 12 + etc/neutron/rootwrap.d/privsep.filters | 31 + etc/oslo-config-generator/dhcp_agent.ini | 1 + etc/oslo-config-generator/l3_agent.ini | 1 + etc/oslo-config-generator/metering_agent.ini | 1 + etc/oslo-config-generator/ml2_conf_sriov.ini | 6 - etc/oslo-config-generator/neutron.conf | 1 + etc/oslo-config-generator/openvswitch_agent.ini | 1 + neutron/agent/agent_extensions_manager.py | 17 +- neutron/agent/common/config.py | 12 +- neutron/agent/common/ovs_lib.py | 54 +- neutron/agent/common/utils.py | 8 + neutron/agent/dhcp/agent.py | 185 +++-- neutron/agent/dhcp_agent.py | 6 +- neutron/agent/l2/extensions/fdb_population.py | 18 +- neutron/agent/l2/extensions/qos.py | 15 +- neutron/agent/l2/extensions/qos_linux.py | 29 + neutron/agent/l2/l2_agent_extensions_manager.py | 3 +- neutron/agent/l3/agent.py | 19 +- neutron/agent/l3/config.py | 26 - neutron/agent/l3/dvr.py | 6 - neutron/agent/l3/dvr_edge_ha_router.py | 12 +- neutron/agent/l3/dvr_edge_router.py | 37 +- neutron/agent/l3/dvr_fip_ns.py | 177 ++++- neutron/agent/l3/dvr_local_router.py | 112 ++- neutron/agent/l3/dvr_router_base.py | 34 +- neutron/agent/l3/dvr_snat_ns.py | 17 +- neutron/agent/l3/ha.py | 58 +- neutron/agent/l3/ha_router.py | 47 +- neutron/agent/l3/keepalived_state_change.py | 45 +- neutron/agent/l3/l3_agent_extensions_manager.py | 3 +- neutron/agent/l3/legacy_router.py | 2 +- neutron/agent/l3/router_info.py | 140 ++-- neutron/agent/l3/router_processing_queue.py | 2 +- neutron/agent/l3_agent.py | 11 +- neutron/agent/linux/async_process.py | 21 +- neutron/agent/linux/daemon.py | 2 +- neutron/agent/linux/dhcp.py | 163 +++-- neutron/agent/linux/dibbler.py | 6 +- neutron/agent/linux/external_process.py | 4 +- neutron/agent/linux/interface.py | 106 ++- neutron/agent/linux/ip_conntrack.py | 104 ++- neutron/agent/linux/ip_lib.py | 310 +++++--- neutron/agent/linux/ipset_manager.py | 9 +- neutron/agent/linux/iptables_firewall.py | 187 ++--- neutron/agent/linux/iptables_manager.py | 34 +- neutron/agent/linux/keepalived.py | 130 +++- .../agent/linux/openvswitch_firewall/constants.py | 6 - .../agent/linux/openvswitch_firewall/exceptions.py | 28 + .../agent/linux/openvswitch_firewall/firewall.py | 139 ++-- neutron/agent/linux/openvswitch_firewall/rules.py | 11 +- neutron/agent/linux/ovsdb_monitor.py | 23 +- neutron/agent/linux/pd.py | 38 +- neutron/agent/linux/polling.py | 4 +- neutron/agent/linux/ra.py | 8 +- neutron/agent/linux/utils.py | 110 ++- neutron/agent/linux/xenapi_root_helper.py | 120 ++++ neutron/agent/metadata/agent.py | 2 +- neutron/agent/metadata/config.py | 116 --- neutron/agent/metadata/namespace_proxy.py | 41 +- neutron/agent/metadata_agent.py | 8 +- neutron/agent/ovsdb/api.py | 63 +- neutron/agent/ovsdb/impl_idl.py | 25 +- neutron/agent/ovsdb/impl_vsctl.py | 45 +- neutron/agent/ovsdb/native/commands.py | 175 ++++- neutron/agent/ovsdb/native/connection.py | 94 ++- neutron/agent/ovsdb/native/helpers.py | 12 +- neutron/agent/ovsdb/native/idlutils.py | 57 +- neutron/agent/ovsdb/native/vlog.py | 30 + neutron/agent/rpc.py | 85 +-- neutron/agent/securitygroups_rpc.py | 50 +- neutron/agent/windows/ip_lib.py | 44 +- neutron/agent/windows/utils.py | 5 +- neutron/api/api_common.py | 49 +- neutron/api/extensions.py | 154 +--- .../api/rpc/agentnotifiers/dhcp_rpc_agent_api.py | 7 +- neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py | 9 +- .../rpc/agentnotifiers/metering_rpc_agent_api.py | 9 +- neutron/api/rpc/callbacks/consumer/registry.py | 26 +- neutron/api/rpc/callbacks/resources.py | 45 +- neutron/api/rpc/callbacks/version_manager.py | 4 +- neutron/api/rpc/handlers/dhcp_rpc.py | 18 +- neutron/api/rpc/handlers/dvr_rpc.py | 4 +- neutron/api/rpc/handlers/l3_rpc.py | 18 +- neutron/api/rpc/handlers/metadata_rpc.py | 4 +- neutron/api/rpc/handlers/resources_rpc.py | 44 +- neutron/api/rpc/handlers/securitygroups_rpc.py | 4 +- neutron/api/v2/attributes.py | 147 +--- neutron/api/v2/base.py | 22 +- neutron/api/v2/resource.py | 1 + neutron/api/v2/resource_helper.py | 14 +- neutron/api/v2/router.py | 10 +- neutron/api/views/versions.py | 2 +- neutron/callbacks/events.py | 2 + neutron/callbacks/resources.py | 3 +- neutron/cmd/eventlet/usage_audit.py | 10 +- neutron/cmd/linuxbridge_cleanup.py | 6 +- neutron/cmd/netns_cleanup.py | 111 ++- neutron/cmd/pd_notify.py | 6 +- neutron/cmd/sanity/checks.py | 65 +- neutron/cmd/sanity_check.py | 40 +- neutron/common/cache_utils.py | 46 +- neutron/common/config.py | 47 +- neutron/common/constants.py | 40 +- neutron/common/eventlet_utils.py | 3 + neutron/common/exceptions.py | 30 +- neutron/common/ipv6_utils.py | 42 +- neutron/common/profiler.py | 17 +- neutron/common/rpc.py | 21 +- neutron/common/utils.py | 577 +++++++++------ neutron/conf/agent/agent_extensions_manager.py | 25 + neutron/conf/agent/database/__init__.py | 0 neutron/conf/agent/database/agents_db.py | 28 + neutron/conf/agent/dhcp.py | 7 - neutron/conf/agent/l2_ext_fdb_population.py | 32 + neutron/conf/agent/l3/config.py | 1 + neutron/conf/agent/l3/ha.py | 62 ++ neutron/conf/agent/metadata/__init__.py | 0 neutron/conf/agent/metadata/config.py | 119 ++++ neutron/conf/agent/metadata/namespace_proxy.py | 54 ++ neutron/conf/agent/xenapi_conf.py | 36 + neutron/conf/cache_utils.py | 31 + neutron/conf/common.py | 43 +- neutron/conf/plugins/ml2/drivers/driver_type.py | 98 +++ neutron/conf/plugins/ml2/drivers/l2pop.py | 29 + neutron/conf/plugins/ml2/drivers/macvtap.py | 38 + .../plugins/ml2/drivers/mech_sriov/__init__.py | 0 .../plugins/ml2/drivers/mech_sriov/agent_common.py | 57 ++ neutron/conf/plugins/ml2/drivers/ovs_conf.py | 164 +++++ neutron/conf/services/extdns_designate_driver.py | 14 +- neutron/conf/services/qos_driver_manager.py | 4 +- neutron/context.py | 33 +- neutron/core_extensions/qos.py | 7 +- neutron/db/_utils.py | 123 ++++ neutron/db/address_scope_db.py | 73 +- neutron/db/agents_db.py | 120 ++-- neutron/db/agentschedulers_db.py | 83 +-- neutron/db/allowedaddresspairs_db.py | 24 +- neutron/db/api.py | 74 +- neutron/db/availability_zone/router.py | 35 +- neutron/db/common_db_mixin.py | 166 ++--- neutron/db/db_base_plugin_common.py | 47 +- neutron/db/db_base_plugin_v2.py | 261 ++++--- neutron/db/dns_db.py | 113 +-- neutron/db/dvr_mac_db.py | 50 +- neutron/db/external_net_db.py | 93 ++- neutron/db/extra_dhcp_opt/models.py | 3 +- neutron/db/extraroute_db.py | 63 +- neutron/db/flavors_db.py | 272 +++----- neutron/db/ipam_backend_mixin.py | 161 +++-- neutron/db/ipam_pluggable_backend.py | 7 +- neutron/db/l3_agentschedulers_db.py | 165 ++--- neutron/db/l3_attrs_db.py | 96 ++- neutron/db/l3_db.py | 611 ++++++++-------- neutron/db/l3_dvr_db.py | 562 +++++++-------- neutron/db/l3_dvrscheduler_db.py | 29 +- neutron/db/l3_gwmode_db.py | 3 +- neutron/db/l3_hamode_db.py | 506 ++++++-------- neutron/db/l3_hascheduler_db.py | 36 +- neutron/db/metering/metering_db.py | 144 ++-- neutron/db/metering/metering_rpc.py | 17 +- neutron/db/migration/__init__.py | 11 + neutron/db/migration/alembic_migrations/env.py | 2 +- .../alembic_migrations/versions/EXPAND_HEAD | 2 +- .../alembic_migrations/versions/kilo_initial.py | 2 + .../liberty/expand/48153cb5f051_qos_db_changes.py | 8 +- .../contract/5ffceebfada_rbac_network_external.py | 10 +- .../mitaka/contract/c6c112992c9_rbac_qos_policy.py | 7 +- .../mitaka/expand/15e43b934f81_rbac_qos_policy.py | 6 +- .../3b935b28e7a0_migrate_to_pluggable_ipam.py | 4 +- ...61a21bcfc_uniq_floatingips0floating_network_.py | 2 +- .../expand/929c968efe70_add_pk_version_table.py | 33 + .../a9c43481023c_extend_ml2_port_bindings.py | 71 ++ neutron/db/migration/cli.py | 6 +- neutron/db/migration/models/head.py | 20 - neutron/db/model_base.py | 35 - neutron/db/models/address_scope.py | 5 +- neutron/db/models/agent.py | 59 ++ neutron/db/models/allowed_address_pair.py | 3 +- neutron/db/models/dns.py | 92 +++ neutron/db/models/dvr.py | 26 + neutron/db/models/external_net.py | 38 + neutron/db/models/flavor.py | 49 ++ neutron/db/models/l3.py | 118 ++++ neutron/db/models/l3_attrs.py | 48 ++ neutron/db/models/l3agent.py | 41 ++ neutron/db/models/l3ha.py | 87 +++ neutron/db/models/metering.py | 46 ++ neutron/db/models/plugins/ml2/geneveallocation.py | 42 ++ neutron/db/models/plugins/ml2/vlanallocation.py | 41 ++ neutron/db/models/plugins/ml2/vxlanallocation.py | 45 ++ neutron/db/models/portbinding.py | 33 + neutron/db/models/provisioning_block.py | 27 + neutron/db/models/securitygroup.py | 9 +- neutron/db/models/segment.py | 76 ++ neutron/db/models/servicetype.py | 26 + neutron/db/models/subnet_service_type.py | 7 +- neutron/db/models/tag.py | 31 + neutron/db/models_v2.py | 63 +- neutron/db/network_dhcp_agent_binding/models.py | 4 +- neutron/db/port_security/models.py | 2 + neutron/db/portbindings_db.py | 40 +- neutron/db/portsecurity_db_common.py | 14 +- neutron/db/provisioning_blocks.py | 67 +- neutron/db/qos/api.py | 13 +- neutron/db/qos/models.py | 9 +- neutron/db/quota/api.py | 16 +- neutron/db/quota/driver.py | 4 +- neutron/db/rbac_db_mixin.py | 6 +- neutron/db/rbac_db_models.py | 8 +- neutron/db/securitygroups_db.py | 78 ++- neutron/db/securitygroups_rpc_base.py | 6 +- neutron/db/segments_db.py | 124 ++-- neutron/db/servicetype_db.py | 44 +- neutron/db/sqlalchemyutils.py | 32 - neutron/db/standard_attr.py | 62 +- neutron/db/standardattrdescription_db.py | 17 +- neutron/db/tag_db.py | 46 +- neutron/extensions/address_scope.py | 15 +- neutron/extensions/agent.py | 20 +- neutron/extensions/allowedaddresspairs.py | 17 +- neutron/extensions/auto_allocated_topology.py | 8 +- neutron/extensions/availability_zone.py | 10 +- neutron/extensions/default_subnetpools.py | 2 +- neutron/extensions/dhcpagentscheduler.py | 13 +- neutron/extensions/dns.py | 4 +- neutron/extensions/dvr.py | 2 +- neutron/extensions/external_net.py | 2 +- neutron/extensions/extra_dhcp_opt.py | 2 +- neutron/extensions/extraroute.py | 4 +- neutron/extensions/flavors.py | 38 +- neutron/extensions/ip_allocation.py | 3 +- neutron/extensions/l2_adjacency.py | 2 +- neutron/extensions/l3.py | 24 +- neutron/extensions/l3_ext_gw_mode.py | 2 +- neutron/extensions/l3_ext_ha_mode.py | 51 +- neutron/extensions/l3_flavors.py | 2 +- neutron/extensions/l3agentscheduler.py | 12 +- neutron/extensions/metering.py | 15 +- neutron/extensions/multiprovidernet.py | 2 +- neutron/extensions/netmtu.py | 2 +- neutron/extensions/network_availability_zone.py | 2 +- neutron/extensions/network_ip_availability.py | 6 +- neutron/extensions/pagination.py | 6 +- neutron/extensions/portbindings.py | 5 +- neutron/extensions/portsecurity.py | 2 +- neutron/extensions/project_id.py | 4 +- neutron/extensions/providernet.py | 2 +- neutron/extensions/qos.py | 18 +- neutron/extensions/quotasv2.py | 18 +- neutron/extensions/rbac.py | 20 +- neutron/extensions/revisions.py | 17 +- neutron/extensions/router_availability_zone.py | 2 +- neutron/extensions/routerservicetype.py | 2 +- neutron/extensions/securitygroup.py | 23 +- neutron/extensions/segment.py | 15 +- neutron/extensions/servicetype.py | 7 +- neutron/extensions/sorting.py | 6 +- neutron/extensions/standardattrdescription.py | 26 +- neutron/extensions/subnet_service_types.py | 11 +- neutron/extensions/subnetallocation.py | 3 +- neutron/extensions/tag.py | 83 ++- neutron/extensions/tag_ext.py | 90 +++ neutron/extensions/timestamp.py | 61 ++ neutron/extensions/timestamp_core.py | 65 -- neutron/extensions/timestamp_ext.py | 68 -- neutron/extensions/trunk.py | 84 +-- neutron/extensions/trunk_details.py | 28 +- neutron/extensions/vlantransparent.py | 2 +- neutron/hacking/checks.py | 71 +- neutron/ipam/drivers/neutrondb_ipam/db_api.py | 111 ++- neutron/ipam/drivers/neutrondb_ipam/driver.py | 62 +- neutron/ipam/subnet_alloc.py | 9 +- neutron/manager.py | 81 +-- neutron/notifiers/nova.py | 16 +- neutron/objects/README.rst | 22 + neutron/objects/address_scope.py | 4 +- neutron/objects/agent.py | 76 ++ neutron/objects/auto_allocate.py | 37 + neutron/objects/base.py | 169 +++-- neutron/objects/common_types.py | 133 +++- neutron/objects/db/api.py | 26 +- neutron/objects/exceptions.py | 62 ++ neutron/objects/extensions/port_security.py | 8 +- neutron/objects/flavor.py | 97 +++ neutron/objects/floatingip.py | 37 + neutron/objects/ipam.py | 104 +++ neutron/objects/network.py | 255 +++++++ neutron/objects/network/__init__.py | 0 neutron/objects/network/extensions/__init__.py | 0 .../objects/network/extensions/port_security.py | 26 - neutron/objects/network/network_segment.py | 38 - neutron/objects/plugins/__init__.py | 0 neutron/objects/plugins/ml2/__init__.py | 0 neutron/objects/plugins/ml2/base.py | 36 + neutron/objects/plugins/ml2/flatallocation.py | 32 + neutron/objects/plugins/ml2/geneveallocation.py | 48 ++ neutron/objects/plugins/ml2/greallocation.py | 48 ++ neutron/objects/plugins/ml2/vlanallocation.py | 36 + neutron/objects/plugins/ml2/vxlanallocation.py | 50 ++ .../objects/port/extensions/allowedaddresspairs.py | 7 +- neutron/objects/port/extensions/extra_dhcp_opt.py | 9 +- neutron/objects/ports.py | 376 ++++++++++ neutron/objects/provisioning_blocks.py | 32 + neutron/objects/qos/policy.py | 16 +- neutron/objects/qos/rule.py | 8 +- neutron/objects/qos/rule_type.py | 28 +- neutron/objects/rbac_db.py | 17 +- neutron/objects/router.py | 97 +++ neutron/objects/securitygroup.py | 16 +- neutron/objects/servicetype.py | 36 + neutron/objects/subnet.py | 54 +- neutron/objects/subnetpool.py | 18 +- neutron/objects/trunk.py | 26 +- neutron/opts.py | 105 ++- neutron/pecan_wsgi/app.py | 6 +- neutron/pecan_wsgi/controllers/quota.py | 7 +- neutron/pecan_wsgi/controllers/resource.py | 26 +- neutron/pecan_wsgi/controllers/utils.py | 194 ++++- neutron/pecan_wsgi/hooks/body_validation.py | 7 +- neutron/pecan_wsgi/hooks/notifier.py | 109 +-- neutron/pecan_wsgi/hooks/ownership_validation.py | 4 +- neutron/pecan_wsgi/hooks/policy_enforcement.py | 47 +- neutron/pecan_wsgi/hooks/quota_enforcement.py | 3 +- neutron/pecan_wsgi/startup.py | 64 +- neutron/plugins/common/constants.py | 9 +- neutron/plugins/common/utils.py | 19 - neutron/plugins/hyperv/__init__.py | 0 neutron/plugins/hyperv/agent/__init__.py | 0 .../plugins/hyperv/agent/security_groups_driver.py | 34 - neutron/plugins/ml2/db.py | 105 ++- neutron/plugins/ml2/driver_api.py | 128 +++- neutron/plugins/ml2/driver_context.py | 6 +- neutron/plugins/ml2/drivers/agent/_common_agent.py | 5 +- neutron/plugins/ml2/drivers/helpers.py | 24 +- neutron/plugins/ml2/drivers/l2pop/config.py | 27 - neutron/plugins/ml2/drivers/l2pop/db.py | 44 +- neutron/plugins/ml2/drivers/l2pop/mech_driver.py | 46 +- .../drivers/l2pop/rpc_manager/l2population_rpc.py | 36 +- .../agent/extension_drivers/qos_driver.py | 106 ++- .../linuxbridge/agent/linuxbridge_neutron_agent.py | 45 +- .../linuxbridge/mech_driver/mech_linuxbridge.py | 5 +- .../plugins/ml2/drivers/macvtap/agent/config.py | 37 - .../drivers/macvtap/agent/macvtap_neutron_agent.py | 20 +- .../ml2/drivers/mech_sriov/agent/common/config.py | 38 +- .../drivers/mech_sriov/agent/eswitch_manager.py | 75 +- .../agent/extension_drivers/qos_driver.py | 10 +- .../ml2/drivers/mech_sriov/agent/pci_lib.py | 20 +- .../drivers/mech_sriov/agent/sriov_nic_agent.py | 16 +- .../drivers/mech_sriov/mech_driver/mech_driver.py | 81 +-- .../ml2/drivers/openvswitch/agent/common/config.py | 148 +--- .../drivers/openvswitch/agent/common/constants.py | 1 + .../agent/extension_drivers/qos_driver.py | 10 +- .../openvswitch/agent/openflow/native/br_int.py | 2 +- .../openvswitch/agent/openflow/native/br_tun.py | 2 +- .../agent/openflow/native/ovs_bridge.py | 2 +- .../agent/openflow/native/ovs_ryuapp.py | 27 +- .../openvswitch/agent/openflow/ovs_ofctl/br_int.py | 2 +- .../agent/openflow/ovs_ofctl/ovs_bridge.py | 3 - .../openvswitch/agent/ovs_dvr_neutron_agent.py | 7 - .../drivers/openvswitch/agent/ovs_neutron_agent.py | 98 ++- .../ml2/drivers/openvswitch/agent/vlanmanager.py | 8 - .../agent/xenapi/etc/xapi.d/plugins/netwrap | 34 +- .../openvswitch/mech_driver/mech_openvswitch.py | 35 +- neutron/plugins/ml2/drivers/type_flat.py | 65 +- neutron/plugins/ml2/drivers/type_geneve.py | 63 +- neutron/plugins/ml2/drivers/type_gre.py | 13 +- neutron/plugins/ml2/drivers/type_local.py | 8 +- neutron/plugins/ml2/drivers/type_tunnel.py | 147 +++- neutron/plugins/ml2/drivers/type_vlan.py | 82 +-- neutron/plugins/ml2/drivers/type_vxlan.py | 55 +- neutron/plugins/ml2/extensions/dns_integration.py | 96 +-- neutron/plugins/ml2/managers.py | 119 ++-- neutron/plugins/ml2/models.py | 15 +- neutron/plugins/ml2/ovo_rpc.py | 120 ++++ neutron/plugins/ml2/plugin.py | 242 ++++--- neutron/plugins/ml2/rpc.py | 21 +- neutron/policy.py | 67 +- neutron/privileged/__init__.py | 26 + neutron/privileged/agent/__init__.py | 0 neutron/privileged/agent/linux/__init__.py | 0 neutron/privileged/agent/linux/ip_lib.py | 177 +++++ neutron/quota/resource.py | 26 +- neutron/scheduler/dhcp_agent_scheduler.py | 31 +- neutron/scheduler/l3_agent_scheduler.py | 249 ++++--- neutron/service.py | 11 +- neutron/services/auto_allocate/db.py | 58 +- .../externaldns/drivers/designate/driver.py | 25 +- neutron/services/l3_router/README | 5 +- neutron/services/l3_router/l3_router_plugin.py | 9 +- .../service_providers/driver_controller.py | 28 +- neutron/services/loki/__init__.py | 0 neutron/services/loki/loki_plugin.py | 49 ++ neutron/services/metering/agents/metering_agent.py | 8 + .../metering/drivers/iptables/iptables_driver.py | 249 ++++--- neutron/services/network_ip_availability/plugin.py | 3 +- neutron/services/provider_configuration.py | 47 +- neutron/services/qos/drivers/__init__.py | 0 neutron/services/qos/drivers/base.py | 100 +++ .../services/qos/drivers/linuxbridge/__init__.py | 0 neutron/services/qos/drivers/linuxbridge/driver.py | 48 ++ neutron/services/qos/drivers/manager.py | 117 ++++ .../services/qos/drivers/openvswitch/__init__.py | 0 neutron/services/qos/drivers/openvswitch/driver.py | 48 ++ neutron/services/qos/drivers/sriov/__init__.py | 0 neutron/services/qos/drivers/sriov/driver.py | 48 ++ .../services/qos/notification_drivers/manager.py | 18 +- .../qos/notification_drivers/message_queue.py | 28 +- neutron/services/qos/qos_consts.py | 2 + neutron/services/qos/qos_plugin.py | 51 +- neutron/services/revisions/revision_plugin.py | 9 +- neutron/services/segments/db.py | 93 ++- neutron/services/segments/placement_client.py | 182 +++++ neutron/services/segments/plugin.py | 321 ++++++++- neutron/services/tag/tag_plugin.py | 65 +- neutron/services/timestamp/timestamp_db.py | 40 +- neutron/services/timestamp/timestamp_plugin.py | 24 +- neutron/services/trunk/constants.py | 2 +- neutron/services/trunk/drivers/base.py | 2 +- .../trunk/drivers/linuxbridge/agent/driver.py | 13 +- .../drivers/linuxbridge/agent/trunk_plumber.py | 6 +- .../trunk/drivers/openvswitch/agent/driver.py | 44 +- .../trunk/drivers/openvswitch/agent/exceptions.py | 4 + .../drivers/openvswitch/agent/ovsdb_handler.py | 251 +++++-- .../drivers/openvswitch/agent/trunk_manager.py | 27 +- neutron/services/trunk/models.py | 7 +- neutron/services/trunk/plugin.py | 34 +- neutron/services/trunk/rpc/agent.py | 16 +- neutron/services/trunk/rpc/server.py | 12 +- neutron/services/trunk/rules.py | 10 +- neutron/services/trunk/utils.py | 5 +- .../exclusive_resources/resource_allocator.py | 3 +- .../l2/extensions/test_ovs_agent_qos_extension.py | 12 +- .../agent/l3/test_keepalived_state_change.py | 68 ++ .../functional/agent/l3/test_legacy_router.py | 12 +- .../agent/linux/openvswitch_firewall/__init__.py | 0 .../linux/openvswitch_firewall/test_firewall.py | 53 ++ .../functional/agent/linux/test_ovsdb_monitor.py | 3 +- .../functional/agent/ovsdb/native/__init__.py | 0 .../agent/ovsdb/native/test_connection.py | 47 ++ .../functional/pecan_wsgi/test_controllers.py | 179 ++++- .../scheduler/test_l3_agent_scheduler.py | 55 +- .../l3_router/test_l3_dvr_ha_router_plugin.py | 103 ++- .../l3_router/test_l3_dvr_router_plugin.py | 113 ++- .../openvswitch/agent/test_ovsdb_handler.py | 70 +- .../openvswitch/agent/test_trunk_manager.py | 25 +- .../exclusive_resources/test_resource_allocator.py | 4 +- .../tempest/api/admin/test_routers_flavors.py | 20 +- .../api/admin/test_shared_network_extension.py | 5 +- .../api/test_network_ip_availability_negative.py | 29 + .../services/network/json/network_client.py | 58 +- .../agent/l2/extensions/test_fdb_population.py | 4 +- .../unit/agent/l3/test_l3_agent_extension_api.py | 12 +- .../linux/openvswitch_firewall/test_firewall.py | 26 +- .../unit/agent/linux/test_external_process.py | 8 +- .../unit/agent/linux/test_iptables_firewall.py | 340 +++++---- .../unit/agent/linux/test_xenapi_root_helper.py | 93 +++ .../unit/agent/ovsdb/native/test_connection.py | 51 +- .../unit/agent/test_agent_extensions_manager.py | 3 +- .../rpc/agentnotifiers/test_dhcp_rpc_agent_api.py | 32 +- .../api/rpc/callbacks/consumer/test_registry.py | 21 +- .../unit/api/rpc/callbacks/test_version_manager.py | 2 +- .../unit/api/rpc/handlers/test_resources_rpc.py | 51 +- .../extensions/test_router_availability_zone.py | 13 +- .../unit/extensions/test_subnet_service_types.py | 63 +- .../ipam/drivers/neutrondb_ipam/test_db_api.py | 62 +- .../ipam/drivers/neutrondb_ipam/test_driver.py | 42 +- .../objects/extensions/test_standardattributes.py | 4 +- .../unit/objects/network/extensions/__init__.py | 0 .../network/extensions/test_port_security.py | 38 - .../unit/objects/network/test_network_segment.py | 36 - .../objects/plugins/ml2/test_flatallocation.py | 29 + .../objects/plugins/ml2/test_geneveallocation.py | 38 + .../unit/objects/plugins/ml2/test_greallocation.py | 39 ++ .../objects/plugins/ml2/test_vlanallocation.py | 28 + .../objects/plugins/ml2/test_vxlanallocation.py | 39 ++ .../port/extensions/test_allowedaddresspairs.py | 5 +- .../objects/port/extensions/test_extra_dhcp_opt.py | 5 +- .../ml2/drivers/agent/test__common_agent.py | 40 +- .../unit/plugins/ml2/drivers/base_type_tunnel.py | 78 +-- .../l2pop/rpc_manager/test_l2population_rpc.py | 2 +- .../unit/plugins/ml2/drivers/l2pop/test_db.py | 12 +- .../plugins/ml2/drivers/l2pop/test_mech_driver.py | 51 +- .../agent/extension_drivers/test_qos_driver.py | 136 +++- .../agent/test_linuxbridge_neutron_agent.py | 55 +- .../macvtap/agent/test_macvtap_neutron_agent.py | 17 +- .../drivers/mech_sriov/agent/common/test_config.py | 15 +- .../agent/extension_drivers/test_qos_driver.py | 2 +- .../mech_sriov/agent/test_eswitch_manager.py | 143 +++- .../ml2/drivers/mech_sriov/agent/test_pci_lib.py | 26 +- .../mech_sriov/agent/test_sriov_nic_agent.py | 19 + .../mech_driver/test_mech_sriov_nic_switch.py | 128 +--- .../agent/extension_drivers/test_qos_driver.py | 2 +- .../agent/openflow/native/ovs_bridge_test_base.py | 4 +- .../agent/openflow/native/test_br_int.py | 12 +- .../agent/openflow/native/test_br_tun.py | 2 +- .../agent/openflow/ovs_ofctl/test_br_int.py | 2 +- .../openvswitch/agent/test_ovs_neutron_agent.py | 88 +-- .../drivers/openvswitch/agent/test_ovs_tunnel.py | 4 +- .../drivers/openvswitch/agent/test_vlanmanager.py | 6 - .../mech_driver/test_mech_openvswitch.py | 59 ++ .../unit/plugins/ml2/drivers/test_type_flat.py | 30 +- .../unit/plugins/ml2/drivers/test_type_gre.py | 11 - .../unit/plugins/ml2/drivers/test_type_local.py | 10 +- .../unit/plugins/ml2/drivers/test_type_vlan.py | 62 +- .../unit/plugins/ml2/extensions/fake_extension.py | 2 +- .../plugins/ml2/extensions/test_dns_integration.py | 181 +++-- .../unit/plugins/ml2/test_ext_portsecurity.py | 5 +- .../unit/plugins/ml2/test_extension_driver_api.py | 23 +- .../unit/scheduler/test_dhcp_agent_scheduler.py | 28 +- .../unit/scheduler/test_l3_agent_scheduler.py | 439 ++++++------ .../service_providers/test_driver_controller.py | 64 +- .../metering/agents/test_metering_agent.py | 7 +- .../services/metering/drivers/test_iptables.py | 162 +++++ .../unit/services/metering/test_metering_plugin.py | 72 +- .../unit/services/qos/drivers/test_manager.py | 94 +++ .../qos/notification_drivers/test_manager.py | 36 +- .../qos/notification_drivers/test_message_queue.py | 69 -- .../services/revisions/test_revision_plugin.py | 85 ++- .../unit/services/test_provider_configuration.py | 2 +- .../trunk/drivers/linuxbridge/agent/test_driver.py | 26 +- .../trunk/drivers/openvswitch/agent/test_driver.py | 50 +- .../openvswitch/agent/test_ovsdb_handler.py | 139 +++- neutron/worker.py | 33 + rally-jobs/extra/trunk_scenario.setup | 1 + rally-jobs/neutron-neutron.yaml | 38 +- rally-jobs/plugins/trunk_scenario.py | 61 ++ ..._proxy_to_wsgi-middleware-24e8271cbd94ffdf.yaml | 11 + ...ing-for-linuxbridge-agent-e765d0d934fa4017.yaml | 3 + .../notes/add-dhcp_release6-ff1b8d62fd7fe76d.yaml | 17 +- ...epalived-vrrp-healt-check-f23ed7c853151484.yaml | 9 + ...width-support-linuxbridge-9dc9d4458d8affef.yaml | 6 + ...api-configuration-options-f1611d0909bf6166.yaml | 11 + ...-physical_device_mappings-67dd3317181eb513.yaml | 6 + ...service-providers-loading-703f984b90351bf0.yaml | 2 +- .../deprecate-router_id-34aca9ea5ee9e789.yaml | 2 +- ...deprecate-send_arp_for_ha-0281853632f58e8d.yaml | 5 + ...signate-driver-keystonev3-8e70d152e84388e0.yaml | 7 + .../dhcp-domain-removed-cc5bc6e2129fdf7f.yaml | 4 + .../dhcp-ipv6-address-update-ff18d1eb0c196bce.yaml | 12 + .../notes/enhance-tags-1f8915fe3e074069.yaml | 4 + .../notes/fip-janitor-53f0d42a7471c5ed.yaml | 8 + ...utron-agent-decomposition-ae6a052aeb48c6ac.yaml | 2 +- ...erv-security-group-driver-fdbe0c0c292a1505.yaml | 13 + ...sysctl-bridge-firewalling-912f157b5671363f.yaml | 14 + ...ate-change-server-threads-9ed775e7533dd1a0.yaml | 10 + .../netns_cleanup_kill_procs-af88d8c47c07dd9c.yaml | 8 + ....messaging.notify.drivers-abb0d17b9e1bd470.yaml | 11 + .../qos-drivers-refactor-16ece9984958f8a4.yaml | 12 + .../remove-advertise_mtu-28933264714453c4.yaml | 5 + ...-pagination-allow-sorting-ff23ca5ccb3007b9.yaml | 5 + ...-min-l3-agents-per-router-27aef7d91dec0348.yaml | 12 + .../sending-garp-for-l3-ha-c118871833ad8743.yaml | 17 + ...rface_mapping-not-present-3109faf3b44d366a.yaml | 6 + .../timestamp_format_change-73eda78566b4690b.yaml | 12 + .../use-pyroute2-in-ip-lib-558bfea8f14d1fea.yaml | 4 + .../vhost-user-reconnect-7650134520022e7d.yaml | 14 + releasenotes/source/README.rst | 2 +- releasenotes/source/conf.py | 5 +- releasenotes/source/index.rst | 3 +- releasenotes/source/newton.rst | 7 + requirements.txt | 49 +- setup.cfg | 16 +- test-requirements.txt | 15 +- tools/configure_for_func_testing.sh | 15 +- tools/list_moved_globals.py | 9 +- tools/milestone-review-dash.py | 171 ----- tox.ini | 14 +- 840 files changed, 29868 insertions(+), 13359 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index b6c8641..2e9ac43 100644 --- a/requirements.txt +++ b/requirements.txt @@ -4 +4 @@ -pbr>=1.6 # Apache-2.0 +pbr>=1.8 # Apache-2.0 @@ -12,2 +12 @@ eventlet!=0.18.3,>=0.18.2 # MIT -pecan!=1.0.2,!=1.0.3,!=1.0.4,>=1.0.0 # BSD -greenlet>=0.3.2 # MIT +pecan!=1.0.2,!=1.0.3,!=1.0.4,!=1.2,>=1.0.0 # BSD @@ -15,4 +14,4 @@ httplib2>=0.7.5 # MIT -requests>=2.10.0 # Apache-2.0 -Jinja2>=2.8 # BSD License (3 clause) -keystonemiddleware!=4.1.0,!=4.5.0,>=4.0.0 # Apache-2.0 -netaddr!=0.7.16,>=0.7.12 # BSD +requests!=2.12.2,>=2.10.0 # Apache-2.0 +Jinja2!=2.9.0,!=2.9.1,!=2.9.2,!=2.9.3,!=2.9.4,>=2.8 # BSD License (3 clause) +keystonemiddleware>=4.12.0 # Apache-2.0 +netaddr!=0.7.16,>=0.7.13 # BSD @@ -20 +19 @@ netifaces>=0.10.4 # MIT -neutron-lib>=0.4.0 # Apache-2.0 +neutron-lib>=1.1.0 # Apache-2.0 @@ -22,2 +21,2 @@ python-neutronclient>=5.1.0 # Apache-2.0 -retrying!=1.3.0,>=1.2.3 # Apache-2.0 -ryu!=4.1,!=4.2,!=4.2.1,!=4.4,>=3.30 # Apache-2.0 +tenacity>=3.2.1 # Apache-2.0 +ryu>=4.9 # Apache-2.0 @@ -25,3 +24,3 @@ SQLAlchemy<1.1.0,>=1.0.10 # MIT -WebOb>=1.2.3 # MIT -keystoneauth1>=2.10.0 # Apache-2.0 -alembic>=0.8.4 # MIT +WebOb>=1.6.0 # MIT +keystoneauth1>=2.18.0 # Apache-2.0 +alembic>=0.8.10 # MIT @@ -29 +28 @@ six>=1.9.0 # MIT -stevedore>=1.16.0 # Apache-2.0 +stevedore>=1.17.1 # Apache-2.0 @@ -32 +31 @@ oslo.concurrency>=3.8.0 # Apache-2.0 -oslo.config>=3.14.0 # Apache-2.0 +oslo.config!=3.18.0,>=3.14.0 # Apache-2.0 @@ -34 +33 @@ oslo.context>=2.9.0 # Apache-2.0 -oslo.db!=4.13.1,!=4.13.2,>=4.10.0 # Apache-2.0 +oslo.db>=4.15.0 # Apache-2.0 @@ -36,2 +35,2 @@ oslo.i18n>=2.1.0 # Apache-2.0 -oslo.log>=1.14.0 # Apache-2.0 -oslo.messaging>=5.2.0 # Apache-2.0 +oslo.log>=3.11.0 # Apache-2.0 +oslo.messaging>=5.14.0 # Apache-2.0 @@ -39 +38,2 @@ oslo.middleware>=3.0.0 # Apache-2.0 -oslo.policy>=1.9.0 # Apache-2.0 +oslo.policy>=1.17.0 # Apache-2.0 +oslo.privsep>=1.9.0 # Apache-2.0 @@ -44,2 +44,2 @@ oslo.service>=1.10.0 # Apache-2.0 -oslo.utils>=3.16.0 # Apache-2.0 -oslo.versionedobjects>=1.13.0 # Apache-2.0 +oslo.utils>=3.18.0 # Apache-2.0 +oslo.versionedobjects>=1.17.0 # Apache-2.0 @@ -47,2 +47,3 @@ osprofiler>=1.4.0 # Apache-2.0 -ovs>=2.5.0;python_version=='2.7' # Apache-2.0 -ovs>=2.6.0.dev3;python_version>='3.4' # Apache-2.0 +ovs>=2.6.1 # Apache-2.0 +pyroute2>=0.4.12 # Apache-2.0 (+ dual licensed GPL2) +weakrefmethod>=1.0.2;python_version=='2.7' # PSF @@ -50 +51 @@ ovs>=2.6.0.dev3;python_version>='3.4' # Apache-2.0 -python-novaclient!=2.33.0,>=2.29.0 # Apache-2.0 +python-novaclient!=7.0.0,>=6.0.0 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index fd66607..b55ee82 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -4 +4 @@ -hacking<0.12,>=0.11.0 # Apache-2.0 +hacking<0.13,>=0.12.0 # Apache-2.0 @@ -6 +6 @@ hacking<0.12,>=0.11.0 # Apache-2.0 -coverage>=3.6 # Apache-2.0 +coverage>=4.0 # Apache-2.0 @@ -10,3 +10,2 @@ python-subunit>=0.0.18 # Apache-2.0/BSD -requests-mock>=1.0 # Apache-2.0 -sphinx!=1.3b1,<1.3,>=1.2.1 # BSD -oslosphinx!=3.4.0,>=2.5.0 # Apache-2.0 +sphinx!=1.3b1,<1.4,>=1.2.1 # BSD +oslosphinx>=4.7.0 # Apache-2.0 @@ -19 +18 @@ oslotest>=1.10.0 # Apache-2.0 -os-testr>=0.7.0 # Apache-2.0 +os-testr>=0.8.0 # Apache-2.0 @@ -22 +21 @@ pylint==1.4.5 # GPLv2 -reno>=1.8.0 # Apache2 +reno>=1.8.0 # Apache-2.0 @@ -24 +23 @@ reno>=1.8.0 # Apache2 -PyMySQL!=0.7.7,>=0.6.2 # MIT License +PyMySQL>=0.7.6 # MIT License

1 0

[cinder] cinder 10.0.0 (ocata)
by no-reply＠openstack.org 22 Feb '17

22 Feb '17

We contentedly announce the release of: cinder 10.0.0: OpenStack Block Storage This release is part of the ocata release series. Download the package from: https://tarballs.openstack.org/cinder/ For more details, please see below. 10.0.0 ^^^^^^ New Features ************ * Dell SC - Compression and Dedupe support added for Storage Centers that support the options. * Dell SC - Volume and Group QOS support added for Storage Centers that support and have enabled the option. * Added ability to query backups by project ID. * Add support to configure IO ports option in Dell EMC Unity driver. * Added reset status API to group snapshot. * Added reset status API to generic volume group. * Add v2.1 volume replication support in VMAX driver. * The IBM_Storage driver has been open sourced. This means that there is no more need to download the package from the IBM site. The only requirement remaining is to install pyxcli, which is available through pypi: ``sudo pip install pyxcli`` * Cinder is now collecting capacity data, including virtual free capacity etc from the backends. A notification which includes that data is periodically emitted. * Added update-host command for consistency groups in cinder-manage. * Added Datera EDF API 2.1 support. * Added Datera Multi-Tenancy Support. * Added Datera Template Support. * Broke Datera driver up into modules. * The "force" boolean parameter has been added to the volume delete API. It may be used in combination with "cascade". This also means that volume force delete is available in the base volume API rather than only in the "volume_admin_actions" extension. * Added backend driver for Dell EMC Unity storage. * Add consistent group capability to generic volume groups in VNX driver. * Added new Hitachi VSP FC Driver. The VSP driver supports all Hitachi VSP Family and HUSVM. * Adds new Hitachi VSP iSCSI Driver. * Hitachi VSP drivers have a new config option "vsp_compute_target_ports" to specify IDs of the storage ports used to attach volumes to compute nodes. The default is the value specified for the existing "vsp_target_ports" option. Either or both of "vsp_compute_target_ports" and "vsp_target_ports" must be specified. * Hitachi VSP drivers have a new config option "vsp_horcm_pair_target_ports" to specify IDs of the storage ports used to copy volumes by Shadow Image or Thin Image. The default is the value specified for the existing "vsp_target_ports" option. Either or both of "vsp_horcm_pair_target_ports" and "vsp_target_ports" must be specified. * Added the ability to list manageable volumes and snapshots to HNAS NFS driver. * Optimize backend reporting capabilities for Huawei drivers. * Added support for querying group details with volume ids which are in this group. For example, "groups/{group_id}?list_volume=True". * Added driver for the InfiniBox storage array. * Added backend FC and iSCSI drivers for NEC Storage. * The NetApp cDOT drivers report to the scheduler, for each FlexVol pool, the fraction of the shared block limit that has been consumed by dedupe and cloning operations. This value, netapp_dedupe_used_percent, may be used in the filter & goodness functions for better placement of new Cinder volumes. * Added extend method to NFS driver for NexentaStor 5. * Added secure HTTP support for REST API calls in the NexentaStor5 driver. Use of HTTPS is set True by default with option "nexenta_use_https". * Added support for snapshots in the NFS driver. This functionality is only enabled if "nfs_snapshot_support" is set to "True" in cinder.conf. Cloning volumes is only supported if the source volume is not attached. * Added Nimble Storage Fibre Channel backend driver. * Add Support for QoS in the Nimble Storage driver. QoS is available from Nimble OS release 4.x and above. * Add Support for deduplication of volumes in the Nimble Storage driver. * The Nimble backend driver has been updated to use REST for array communication. * Add consistent group capability to generic volume groups in Pure drivers. * Allow the RBD driver to work with max_over_subscription_ratio. * Added v2.1 replication support to RBD driver. * Added backend ISCSI driver for Reduxio. * Add provider_id in the detailed view of a volume for admin. * Added volume driver for QNAP ES Storage Driver. * The SolidFire driver will recognize 4 new QoS spec keys to allow an administrator to specify QoS settings which are scaled by the size of the volume. 'ScaledIOPS' is a flag which will tell the driver to look for 'scaleMin', 'scaleMax' and 'scaleBurst' which provide the scaling factor from the minimum values specified by the previous QoS keys ('minIOPS', 'maxIOPS', 'burstIOPS'). The administrator must take care to assure that no matter what the final calculated QoS values follow minIOPS <= maxIOPS <= burstIOPS. A exception will be thrown if not. The QoS settings are also checked against the cluster min and max allowed and truncated at the min or max if they exceed. * Add multipath enhancement to Storwize iSCSI driver. * Added support to querying snapshots filtered by metadata key/value using 'metadata' optional URL parameter. For example, "/v3/snapshots?metadata=={'key1':'value1'}". * Added support for ZMQ messaging layer in multibackend configuration. * Add support to backup volume using snapshot in the Unity driver. * Enable backup snapshot optimal path by implementing attach and detach snapshot in the VMAX driver. * Added the ability to create a CG from a source CG with the VMAX driver. * Support for compression on VMAX All Flash in the VMAX driver. * Storage assisted volume migration from one Pool/SLO/Workload combination to another, on the same array, via retype, for the VMAX driver. Both All Flash and Hybrid VMAX3 arrays are supported. VMAX2 is not supported. * VNX cinder driver now supports async migration during volume cloning. By default, the cloned volume will be available after the migration starts in the VNX instead of waiting for the completion of migration. This greatly accelerates the cloning process. If user wants to disable this, he could add "--metadata async_migrate=False" when creating volume from source volume/snapshot. * Add consistent group capability to generic volume groups in the XtremIO driver. Known Issues ************ * With the Dell SC Cinder Driver if a volume is retyped to a new storage profile all volumes created via snapshots from this volume will also change to the new storage profile. * With the Dell SC Cinder Driver retyping from one replication type to another type (ex. regular replication to live volume replication) is not supported. * Dell SC Cinder driver has limited support in a failed over state so thaw_backend has been implemented to reject the thaw call when in such a state. Upgrade Notes ************* * In certain environments (Kubernetes for example) indirect calls to the LVM commands result in file descriptor leak warning messages which in turn cause the process_execution method to raise and exception. To accommodate these environments, and to maintain backward compatibility in Newton we add a "lvm_suppress_fd_warnings" bool config to the LVM driver. Setting this to True will append the LVM env vars to include the variable "LVM_SUPPRESS_FD_WARNINGS=1". This is made an optional configuration because it only applies to very specific environments. If we were to make this global that would require a rootwrap/privsep update that could break compatibility when trying to do rolling upgrades of the volume service. * Previous installations of IBM Storage must be un-installed first and the new driver should be installed on top. In addition the cinder.conf values should be updated to reflect the new paths. For example the proxy setting of "storage.proxy.IBMStorageProxy" should be updated to "cinder.volume.drivers.ibm.ibm_storage.proxy.IBMStorageProxy". * Removed deprecated option "osapi_max_request_body_size". * To get rid of long running DB data migrations that must be run offline, Cinder will now be able to execute them online, on a live cloud. Before upgrading from Ocata to Pike, operator needs to perform all the Newton data migrations. To achieve that he needs to perform "cinder-manage db online_data_migrations" until there are no records to be updated. To limit DB performance impact migrations can be performed in chunks limited by "--max_number" option. If your intent is to upgrade Cinder in a non-live manner, you can use "-- ignore_state" option safely. Please note that finishing all the Newton data migrations will be enforced by the first schema migration in Pike, so you won't be able to upgrade to Pike without that. * Datera driver location has changed from cinder.volume.drivers .datera.DateraDriver to cinder.volume.drivers.datera.datera_iscsi .DateraDriver. * The Cinder database can now only be upgraded from changes since the Liberty release. In order to upgrade from a version prior to that, you must now upgrade to at least Liberty first, then to Ocata or later. * The v1 API was deprecated in the Juno release and is now defaulted to disabled. In order to still use the v1 API, you must now set "enable_v1_api" to "True" in your cinder.conf file. * There is a new policy option "volume:force_delete" which controls access to the ability to specify force delete via the volume delete API. This is separate from the pre-existing "volume-admin- actions:force_delete" policy check. * The Hitachi NAS iSCSI driver has been marked as unsupported and is now deprecated. "enable_unsupported_drivers" will need to be set to "True" in cinder.conf to continue to use it. * Removed deprecated option "kaminario_nodedup_substring" in Kaminario FC and iSCSI Cinder drivers. * The CloudByte driver has been marked as unsupported and is now deprecated. "enable_unsupported_drivers" will need to be set to "True" in cinder.conf to continue to use it. * The DotHill drivers have been marked as unsupported and are now deprecated. "enable_unsupported_drivers" will need to be set to "True" in cinder.conf to continue to use it. * The HPE XP driver has been marked as unsupported and is now deprecated. "enable_unsupported_drivers" will need to be set to "True" in cinder.conf to continue to use it. * The Nexenta Edge drivers have been marked as unsupported and are now deprecated. "enable_unsupported_drivers" will need to be set to "True" in cinder.conf to continue to use it. * Operator needs to perform "cinder-manage db online_data_migrations" to migrate existing consistency groups to generic volume groups. * The EqualLogic driver is moved to the dell_emc directory and has been rebranded to its current Dell EMC PS Series name. The volume_driver entry in cinder.conf needs to be changed to "cinder.volume.drivers.dell_emc.ps.PSSeriesISCSIDriver". * The ScaleIO driver is moved to the dell_emc directory. volume_driver entry in cinder.conf needs to be changed to "cinder.volume.drivers.dell_emc.scaleio.driver.ScaleIODriver". * The XtremIO driver is moved to the dell_emc directory. volume_driver entry in cinder.conf needs to be changed to "cinder.volume.drivers.dell_emc.xtremio.XtremIOISCSIDriver" or "cinder.volume.drivers.dell_emc.xtremio.XtremIOFCDriver". * New config option added. ""connection_string"" in [profiler] section is used to specify OSProfiler driver connection string, for example, ""connection_string = messaging://"", ""connection_string = mongodb://localhost:27017"" * After running the migration script to migrate CGs to generic volume groups, CG and group APIs work as follows. * Create CG only creates in the groups table. * Modify CG modifies in the CG table if the CG is in the CG table, otherwise it modifies in the groups table. * Delete CG deletes from the CG or the groups table depending on where the CG is. * List CG checks both CG and groups tables. * List CG Snapshots checks both the CG and the groups tables. * Show CG checks both tables. * Show CG Snapshot checks both tables. * Create CG Snapshot creates either in the CG or the groups table depending on where the CG is. * Create CG from Source creates in either the CG or the groups table depending on the source. * Create Volume adds the volume either to the CG or the group. * default_cgsnapshot_type is reserved for migrating CGs. * Group APIs will only write/read in/from the groups table. * Group APIs will not work on groups with default_cgsnapshot_type. * Groups with default_cgsnapshot_type can only be operated by CG APIs. * After CG tables are removed, we will allow default_cgsnapshot_type to be used by group APIs. * EMC VNX driver have been rebranded to Dell EMC VNX driver. Existing configurations will continue to work with the legacy name, but will need to be updated by the next release. User needs update "volume_driver" to "cinder.volume.drivers.dell_emc.vnx.driver.VNXDriver". * Old driver paths have been removed since they have been through our alloted deprecation period. Make sure if you have any of these paths being set in your cinder.conf for the volume_driver option, to update to the new driver path listed here. * Old path - cinder.volume.drivers.huawei.huawei_18000.Huawei18000ISCSIDriver * New path - cinder.volume.drivers.huawei.huawei_driver.HuaweiISCSIDriver * Old path - cinder.volume.drivers.huawei.huawei_driver.Huawei18000ISCSIDriver * New path - cinder.volume.drivers.huawei.huawei_driver.HuaweiISCSIDriver * Old path - cinder.volume.drivers.huawei.huawei_18000.Huawei18000FCDriver * New path - cinder.volume.drivers.huawei.huawei_driver.HuaweiFCDriver * Old path - cinder.volume.drivers.huawei.huawei_driver.Huawei18000FCDriver * New path - cinder.volume.drivers.huawei.huawei_driver.HuaweiFCDriver * Old path - cinder.volume.drivers.san.hp.hp_3par_fc.HP3PARFCDriver * New path - cinder.volume.drivers.hpe.hpe_3par_fc.HPE3PARFCDriver * Old path - cinder.volume.drivers.san.hp.hp_3par_iscsi.HP3PARISCSIDriver * New path - cinder.volume.drivers.hpe.hpe_3par_iscsi.HPE3PARISCSIDriver * Old path - cinder.volume.drivers.san.hp.hp_lefthand_iscsi.HPLeftH andISCSIDriver * New path - cinder.volume.drivers.hpe.hpe_lefthand_iscsi.HPELeftHa ndISCSIDriver * Old path - cinder.volume.drivers.san.hp.hp_xp_fc.HPXPFCDriver * New path - cinder.volume.drivers.hpe.hpe_xp_fc.HPEXPFCDriver * Removing the Dell EqualLogic driver's deprecated configuration options. Please replace old options in your cinder.conf with the new one. * Removed - "eqlx_cli_timeout" * Replaced with - "ssh_conn_timeout" * Removed - "eqlx_use_chap" * Replaced with - "use_chap_auth" * Removed - "eqlx_chap_login" * Replaced with - "chap_username" * Removed - "eqlx_chap_password" * Replaced with - "chap_password" * The Scality backend volume driver was marked as not supported in the previous release and has now been removed. * Configurations that are setting backend config in "[DEFAULT]" section are now not supported. You should use "enabled_backends" option to set up backends. * The volume_clear option to use *shred* was deprecated in the Newton release and has now been removed. Since deprecation, this option has performed the same action as the *zero* option. Config settings for *shred* should be updated to be set to *zero* for continued operation. * The GlusterFS volume driver, which was deprecated in the Newton release, has been removed. * The RBD driver no longer uses the "volume_tmp_dir" option to set where temporary files for image conversion are stored. Set "image_conversion_dir" to configure this in Ocata. * Removing cinder-all binary. Instead use the individual binaries like cinder-api, cinder-backup, cinder-volume, cinder-scheduler. * The VMAX driver is moved to the dell_emc directory. volume_driver entry in cinder.conf needs to be changed to "cinder.volume.drivers.dell_emc.vmax.iscsi.VMAXISCSIDriver" or "cinder.volume.drivers.dell_emc.vmax.fc.VMAXFCDriver". * Added config option "vmware_connection_pool_size" in the VMware VMDK driver to specify the maximum number of connections (to vCenter) in the http connection pool. * In VNX Cinder driver, "replication_device" keys, "backend_id" and "san_ip" are mandatory now. If you prefer security file authentication, please append "storage_vnx_security_file_dir" in "replication_device", otherwise, append "san_login", "san_password", "storage_vnx_authentication_type" in "replication_device". Deprecation Notes ***************** * Deprecated datera_api_version option. * Removed datera_acl_allow_all option. * Removed datera_num_replicas option. * The block_driver is deprecated as of the Ocata release and will be removed in the Queens release of Cinder. Instead the LVM driver with the LIO iSCSI target should be used. For those that desire higher performance, they should use LVM striping. * The Cinder Linux SMBFS driver is now deprecated and will be removed during the following release. Deployers are encouraged to use the Windows SMBFS driver instead. * The HBSD (Hitachi Block Storage Driver) volume drivers which supports Hitachi Storages HUS100 and VSP family are deprecated. Support for HUS110 family will be no longer provided. Support on VSP will be provided as hitachi.vsp_* drivers. * Support for snapshots named in the backend as "snapshot-<snapshot- id>" is deprecated. Snapshots are now named in the backend as "<volume-name>.<snapshot-id>". * The Hitachi NAS iSCSI driver has been marked as unsupported and is now deprecated. "enable_unsupported_drivers" will need to be set to "True" in cinder.conf to continue to use it. The driver will be removed in the next release. * Deprecated the configuration option "hnas_svcX_volume_type". Use option "hnas_svcX_pool_name" to indicate the name of the services (pools). * The CloudByte driver has been marked as unsupported and is now deprecated. "enable_unsupported_drivers" will need to be set to "True" in cinder.conf to continue to use it. If its support status does not change it will be removed in the next release. * The DotHill drivers has been marked as unsupported and are now deprecated. "enable_unsupported_drivers" will need to be set to "True" in cinder.conf to continue to use it. If its support status does not change it will be removed in the next release. * The HPE XP driver has been marked as unsupported and is now deprecated. "enable_unsupported_drivers" will need to be set to "True" in cinder.conf to continue to use it. If its support status does not change it will be removed in the next release. * The Nexenta Edge drivers has been marked as unsupported and are now deprecated. "enable_unsupported_drivers" will need to be set to "True" in cinder.conf to continue to use it. If its support status does not change it will be removed in the next release. * The 7-Mode Data ONTAP configuration of the NetApp Unified driver is deprecated as of the Ocata release and will be removed in the Queens release. Other configurations of the NetApp Unified driver, including Clustered Data ONTAP and E-series, are unaffected. * Marked the ITRI DISCO driver option "disco_wsdl_path" as deprecated. The new preferred protocol for array communication is REST and SOAP support will be removed. Security Issues *************** * The qemu-img tool now has resource limits applied which prevent it from using more than 1GB of address space or more than 2 seconds of CPU time. This provides protection against denial of service attacks from maliciously crafted or corrupted disk images. Bug Fixes ********* * With the Dell SC Cinder Driver retyping to or from a replicated type should now work. * With the Dell SC Cinder Driver retype failed to return a tuple if it had to return an update to the volume state. * The NetApp cDOT driver now sets the "replication_status" attribute appropriately on volumes created within replicated backends when using host level replication. * Fixed an issue where the NetApp cDOT NFS driver failed to clone new volumes from the image cache. * Fixed volume extend issue that allowed a tenant with enough quota to extend the volume to limits greater than what the volume backend supported. * Fixed HNAS bug that placed a cloned volume in the same pool as its source, even if the clone had a different pool specification. Driver will not allow to make clones using a different volume type anymore. * Fixed Non-WAN port filter issue in Kaminario iSCSI driver. * Fixed issue of managing a VG with more than one volume in Kaminario FC and iSCSI Cinder drivers. * For SolidFire, QoS specs are now checked to make sure they fall within the min and max constraints. If not the QoS specs are capped at the min or max (i.e. if spec says 50 and minimum supported is 100, the driver will set it to 100). Other Notes *********** * Now extend won't work on disabled services because it's going through the scheduler, unlike how it worked before. Changes in cinder 9.0.0.0rc1..10.0.0 ------------------------------------ 0df4175 Fix attachments after attached migration ac2d2f9 Fix volume retype with migration as non-admin 7ae9f54 Fix SolidFire cgsnap clone bug 4c9ddb7 SolidFire: Handle connect_volume() failure when create vol from image 7aa0be3 VMAX driver - allow for multi volume types in Consistency Group 4430dfe Fix duplicate lvs2 entry in rootwrap volume filter e8ed3fe fix create_consistencygroup in xiv 13634ee Dell EMC: Create independent volume on clone 708a835 VMAX driver - copy state fix 0f6bbe3 Prepare for using standard python tests 7fe0f8f Update UPPER_CONSTRAINTS_FILE for stable/ocata fed8f1d Update .gitreview for stable/ocata 5d7ab2a Reserve 5 migrations for DB backports d706b40 Tests: Fix NetApp unit test failure w/ hash randomization 0a47ab8 xiv create vol from replicated source fails 6c01699 Don't use None value for sql query. aa14ae5 Remove promote and reenable from policy dacd6c8 VMAX driver - ignore service level and workload in xml ac9ac76 VMAX driver - Convert eval to ast.literal_eval cde8697 VMAX driver - failover error fix 0b112b8 Add SUPPORTED flag to Lenovo FC driver 5bd297d Image utils: fix fetching available space on Windows d861384 Fix max_age calculation for quota usage refresh bb3bfb1 Fix 500 error while listing manageable volumes and snapshots 9a996c4 Add usage and limit info on quota limit errors c891ca9 Convert ignoreskippedcluster check to be static c5630ce Clean up release notes for Ocata da33a73 xiv delete cg fails if removed on backend 7401d0d Make get_capabilities look for clusters 777128d Resolve Brocade HTTPS connection error dece301 Add SUPPORTED flag to Lenovo iSCSI driver fc0eb50 Add SUPPORTED flag to HP MSA driver b9b352f Hitachi VSP: Specify compute nodes and copy ports 248324d ZTE: Added CI_WIKI_NAME e7171fd Fix notification short-circuit fd4f42d Fix CopyVolumeToImageTestCase max recursion depth d1f23f3 HNAS: Cloned volume with different volume type 743bd61 Move release notes to correct location da8f485 Add cluster_name to temporary volumes 4cca67f Fix host assignment when clustered 5c73230 3PAR: Inconsistency in copied and source CG a4318ac Remove redundant log during initialize connection 7c8cab0 VMAX driver - sync sv issue 7847cf1 Reduced the complexity of the main() method b65db84 Add descriptions to Pure drivers 8362202 Adds API documentation for update snapshot status 9dac476 clean up replication volume on an xiv backend c71d978 Add create volume from image policy a130387 Short-circuit notifications when not enabled 2bce7d6 Stop get_notifier mock in tests cleanup 61972f7 VMAX driver - removed incorrect six.text_type 0159704 Updated from global requirements 4e5c2be Rebrand and move EQLX driver to dell_emc folder 0b7e783 Fix Live Migration for Nimble Storage Driver 1df882d create consistency group mishandles types d4d88f3 VMAX driver - QoS key fix d063ed9 VMAX driver - remove global mock of volume_types c9a6969 Set image_owner before adding location to glance 0a36a89 Dell EMC SC: Delete doesn't account for migration cc325cb Zero out SolidFire capacity when unreachable 9f2308a IBM driver update CI_WIKI_NAME 1c98d16 Fix Qos for clone for Nimble Storage Driver f824bc0 Add lock acquire/release debug messages b548287 [api-ref]Fix the volume metadata description error 3ebee7f [api-ref]Add volumes/summary API doc 144ddd5 [api-ref]Change tenant to project 3acf94d Fix double call to "qemu-img create" bc7c001 Fix api-ref status parameter 893eb18 Small change to microversion header on devref 494264e Check if volume node has enough space for image operations 4b5d96d Revert "Mark the sheepdog driver as unsupported" 6543c0e backup of active 3par ISCSI bootable volume fails 1c7fe96 Open the source code of ibm_storage driver 2d77a7a NFS snapshots c9a604b Tests: Fix hash unstable dict comparison c0bce8c Tests: Fix mock for vzstorage remotefs a360290 Fix the api-ref CI failure 07ce5f6 Eager load projects when getting types by group e569188 VMAX driver - rename and restructure driver ff50631 Updated from global requirements 8e55405 Switch ManageableSnaphots & ManageableVolumes list to OVO d7f93d5 VMAX driver - storage group cleanup on error 0b7c4cc Add assert_min_rpc_version decorator ebb62a7 NetApp cDOT: Add NetApp Volume Encryption support 4f5adf4 Add volume backup tempest tests 28a0511 Make CappedVersionUnknown exception more useful f0f46e5 Break migrate_add_message_prefix into two queries ff49bff Remove useless FIXME d7997d3 Fix some problem for attachment list 3843479 Don't drop the volume type's extra spec at DB layer abf53e0 Switch to using generic groups with Pure driver 67a2178 VMAX driver - Implement volume replication for VMAX 2b0bfcc Brcd zonemanager: Fix unstable command generation a836157 Dell SC: Logging asyncTask if XML returned fabee55 Test: Fix assert_has_calls dict order bug (QoS) 9e6e56e FalconStor: Drop the copy_image_to_volume feature 85c9826 Refactor backup RPC API test cases d721119 Refactor scheduler RPC API test cases a998c3a Update the parameter check when create attachment 39eaa59 FalconStor: Restore option "san_secondary_ip" da90ffd Extracted HTTP response codes to constants ca77a48 XtremIO: Add CG capability to generic groups. 54e7c1d VMAX driver - Consistency Group automerge fix. a9a3edd VMAX driver - Support for compression on All Flash. 22e6998 Add new attachment APIS fb9ed78 Add lock around SolidFire clone-image 6624c31 VMAX driver - Storage assisted volume migration. c514b25 Dell SC: Retype fixes ff4ce83 Revert "Mark Huawei volume driver as unsupported" 170a166 Fix typos 96b8734 Adds getfattr and mount to Cinder rootwrap volume.filters 8840091 Refactor volume RPC API test cases e4b468a Make notify_service_capabilities cluster aware 6ccfcaf VNX: Add async migration support 2d5bad7 VNX: Update sg cache if it already existed e0aff5b Allow snapshots and volumes to have Null group values e73ae91 Fix for FC Initiator API in Nimble Storage Driver 4769acf Revert "Mark Quobyte volume driver as unsupported" dafd68e Fix retype with migrate 9a889a9 VMware: Allow deletion of snapshot in error state a879e4a Move driver tests to tests/unit/volume/drivers 24bab6b Prevent claiming and updating races on worker 2195885 Fix replication freeze mechanism 73603d5 Move service and cluster creation in test to utils 4d3e1e7 Make Image Volume Cache cluster aware b4a1328 Make Replication support Active-Active 94c5642 Fix for live migration for Nimble Storage e0a6071 NexentaStor5: Added extend method to NFS driver 3e0684d Sync ``services`` SQLA model with what's in the DB b93d0b7 Make BackupManager not a SchedulerDependentManager 857182e Optimise: Use sqlalchemy to build table sequence 03ad26c Fix volume manage a7d6323 Revert "Mark Tintri volume driver as unsupported" 97c082d Nosec subprocess with shell equal True from Bandit 58123e1 Modify the spelling mistakes 038fdda Add volume to fake snapshot object def9485 Clean up image tmp file if c-vol gets restarted d116647 Prevent driver load failures from objects 84db869 Nosec Paramiko exec_command() warning from Bandit 53f2e4c Replace deprecated pylint disable-msg with disable 66bc864 Updated from global requirements beccf8b Save model_update as admin in create_volume 5e0393b Improvement to get group detail(Part 2) c50d383 Add api version history for 3.23 d623546 Deprecate the Linux SMBFS driver 693c914 Storwize: do the correct update after failover 17171f6 Unity Driver: Backup volume via snapshot a2de857 RBD: Fix RBD replication on volumes from image source. 69daa50 Dell SC: Change DRP search to reference type c1b0c4d vzstorage: fixed snapshot deletion in error state 0efcf0e Dell SC: Missing version history 5fcfdc2 Remove deprecated RequestBodySizeLimiter class efa8e21 Allow triggering cleanup from API 9497e97 [py35] image file should be open in binary mode 8f82bb7 HNAS: Change snapshot names d876680 Add prefix to user message event ids 5b1c206 Improve compatibility with novaclient 7.0.0 179e35c Updated from global requirements 8e4e0c8 Unity: Add support to set IO ports in option d3ffcd5 Fixes hpelefthandclient AttributeError eec8559 Mark the sheepdog driver as unsupported 2f409f9 Add volume type access operations notification 6458931 Remove inheritance from deprecated classes 9a46106 FusionStorage: rename the CI_WIKI_NAME 653e147 Dell SC: Failback timeout extended 01a8d9e Tests: Remove more InvalidUUID warnings 379973a Don't translate exceptions w/ no message 91609a4 Add command information to cinder-manage.rst 6359dce Add CG capability to generic groups in VNX driver e739953 RBD: Remove volume_tmp_dir option 94d24cd VMware: Use versionutils in oslo.utils 7f09229 Delete volume when rescheduling 6b9464e VMware: Set backend UUID to volume UUID e01f24f Rename AddFCZone and RemoveFCZone according to PEP 8 b7e7a33 Cleanup limit view name processing 9a8dc08 Datera 2.3 driver update cf6744d Skip CI link in list for infra supported drivers 458153d Add manage/unmanage to DISCO driver 6b09ec5 Updated from global requirements 9d17ac9 Fix a few typos in storwize_svc_common.py 14d7450 Doc: Fix build warnings for missing code-block lang 304436c CoprHD: Handle ScaleIO CI failing with version-3.5 1016531 Python3 common patterns dbf61cd Enable DeprecationWarning in test environments 3ab0331 Add orm type check for paginate_query 3f7200b [api-ref]Add api ref for "volume type encryption" c64a9da Fix sphinx errors related to missing paths/modules 4d454f6 Cascade + force volume delete parameters f5cdbe8 Adds metadata in search option for snapshot c03c2fa Fix python integer interpretation in Py2 and Py3 27b7a29 Fix Cisco Initiator zoning updates d7931d7 Add QoS and Dedupe Support for Nimble Storage 49e99be Remove unused PasteAppNotFound exception 67ea024 tgt: Remove existence check before delete 0df3d7a Only log insecure key manager warning once 5c841f2 Refactoring ITRI DISCO cinder volume driver 2ac4e29 Convert 'parallels' format name to 'ploop' 193d912 Add psycopg2 and PyMySQL to test-requirements d0abb60 Attach/Delete volume for tgt driver race condition fix b907450 Correct RBD Provision stats&fix a perf problem d35c3ba Avoid Forcing the Translation of Translatable Variables cc9ab4e Updated from global requirements 65fe16e Deprecate the block_device driver 15c5554 [1/4]Reset generic volume group status 9885cb2 HNAS: Deprecate HNAS iSCSI driver 46726f7 VMAX driver - PortGroup rollback error path scenario. 277059a Report multiattach capability for Hitachi VSP drivers 65b97f6 Merge changes from kilo version of the dothill driver dde4f79 Tests: Split up NFS backup notification test 002170b Set replication_status automatically on retype 7647f99 Set replication_status on volume creation 36735e2 Update replication property in capabilities 7ca7b25 Cisco: can't add new zone when no zone is created before d42250e VMware: Fix inventory folder after volume transfer df647d0 Use oslo.messaging topics for multibackend 3f7acda Backup project attribute support 2655e8b Cinder consistency group returning generic error message c479e94 Move VNX driver to dell_emc folder 51368da NexentaStor5: sessions and HTTPS support 0d2dced Add more operations to cluster 91d3161 Make workers ORM compatible with SQLAlchemy 1.1.4 da9f529 VMAX driver - MVs and SGs not reflecting correct protocol. 7cbbb89 Delete space to pass the check of pep8 ca43430 Fix logging traceback in service logs e679627 Remove "service" from required_import_options c9eada8 Add Rest API Support for Nimble Storage 31dba52 Adds release note for 'Route extend_volume' bugfix 3b17143 Add 'unmanaging' state to volumes and snapshots 3c6a64b Fix service_get mock method de67779 Mark Nexenta Edge volume drivers as unsupported e35da7d Mark DotHill volume drivers as unsupported 55466de leave the unreleased branch unspecified for release notes 4e3eb04 Fix VMAX clone CG release note 2144668 Mark Tintri volume driver as unsupported 76ef111 Mark Quobyte volume driver as unsupported aec037b Mark Huawei volume driver as unsupported f0cf730 Mark CloudByte volume driver as unsupported 0b2bf68 Mark HPE XP volume driver as unsupported f81d8a3 RBD: Implement v2.1 replication cfdb587 Updated from global requirements 441442f Storwize: create vol fails near licensed limit 3f930bb Add get_all capability to volume_attachments 5181540 Cluster volume group fix in lvm c1183c6 Drop the judgement condition for FakeConnector fc0034b Rolling upgrade procedure documentation a931f9d Remove Scality backend driver 96d441a Use method is_valid_boolstr from oslo_utils 1d4d3a9 Updated from global requirements d48e967 Support new osprofiler API 7fa8165 [api-ref] Show more specific parameter of capabilities 41bbdbc Cosmetic changes to scheduler 9acf079 Support A/A on Scheduler operations 63475ef Fix detach twice of snapshot cb668cb Add cinder volume drivers for NEC Storage M series 2251525 Remove authorisation checks at the DB level for quota operations 842d17f Fix condition parameter bug in routes 88e9110 Add Apache 2.0 license to source file efd0703 VMAX driver - Attach and detach snapshot 8d56537 Improve DB method naming consistency ef44589 Simplify calls to mock_object ebdac1c Make APIVersionRequest's null check more pythonic b224ae8 Nexenta: Added ZFS cleanup in NexentaStor4 iSCSI driver 4fdfb81 Correct reraising of exception 45bfe2e Fix warning when running `tox -e docs` 4d2124f ibm_storage driver: Added fczm decorators 08c3db8 Dell SC: Added Logging to _swap_credentials ab84ead Unreserve volume: fix log message for completion c5368a7 Dell SC: Missing volume creation options. eca603b Hacking: Remove N333 oslo namespace import check 5a8f26e Adds Unity Cinder Driver 5bb68e4 Added initial backend ISCSI driver for Reduxio ca07867 Switch default py3x to py35 5d870b5 Remove run_tests.sh wrapper 6d7125b Do not manage VG with > 1 volume in Kaminario driver fb87dc5 HNAS: Add list manageable volume/snapshots daf404d Move to hacking 0.12 863486f Modify variable's usage in Log Messages 55fe4a2 Prohibit creating volume from source with dif encryptions c5afe76 Route extend_volume calls to scheduler f90c49e Remove deprecated volume_clear shred option 62fdf82 Fix dos-style endlines f6342d0 Add QNAP ES Storage Driver 218528c Fix TypeError when execute cinder-volume-usage-audit 55e3d5c Log detailed attach/detach volumes info efe7b1c Remove anyjson test dependency daeaf70 EMC VMAX: Remove unused is_in_range() method e8fb599 Non-WAN port filter issue in Kaminario iSCSI driver f33eed4 Updated from global requirements 3f6a973 Introduce Hitachi VSP iSCSI driver 681d090 Remove Kaminario deprecated option 5c81538 Introduce Hitachi VSP driver f91b29c Support A/A in delete actions and get_capabilities dcdc952 Dell SC: Incorrect exceptions being returned 2cad534 Tests: Fix invalid UUID warnings 850a197 Block 3.1 message with c-sch RPCAPI pinned to 3.0 49a0e86 Huawei: Mask unnecessary log print 4fb420c Fix status after a VolumeDriverException 7a66835 Fix replication_status on InvalidReplicationTarget 57bd024 Add host check on replication actions c250a3f Updated from global requirements 7b25637 Revert "Swap volume type for migration started by retype" 409391d SolidFire QoS scaled by volume size 14c053c Refactor api test_common to use ddt library 8020d32 New cinder driver to support INFINIDAT InfiniBox b069c02 Remove cgsnapshot_id before snapshot.save c7db2b8 Add missing consistencygroup_id in volume e8e3ae7 Remove support for single backend config 8737d16 Add back policy check for CG 005ba24 Fix secondary lvm cmds rootwrap filters 324fae7 Update detach_volume() with versionedobjects f0998f7 Update attach_volume() with versionedobjects b67a416 Calculate virtual free capacity and notify beed5c7 NetApp cDOT driver fails to clone from NFS cache da0ea57 Admin API policy enforcement contingent on is_admin_project c23c44a test: fix wrong usage of config option in test_window ccd8abb Fix wrong usage of config option gpfs_images_share_mode 57406b2 Correct the attributes of volume which created by clone a CG ef98a0b Swap volume type for migration started by retype 25782bd Replace functions 'Dict.get' and 'del' with 'Dict.pop' 4e1643e Reuse already existing groups in tempest plugin 1353e9f Huawei: Mark password option as secret d6f1137 Remove Unicode byte order mark c43e1cc Add driver interface for groups e56e866 Remove emc folder 25ae4bc Always allow to create snapshot db record with snapshot-manage 7592c8e [api-ref] Correct status code of backup delete 0594f1a Add cg constraint when deleting a volume type 556a2f8 Fix response bootable parameter type in api document 9cdf7c3 Skip more parameters when import backup record 3f5a7e1 Dell SC: Reject thaw call when backend is failed over 584ac57 Dell SC: Unable to locate LV primary after LV-AFO 229512a Remove nosetests i18n fix dfbd902 Remove temporary directory creation for BaseBackupTest adcc5c7 Add logging to FakeLoggingVolumeDriver 47c71f5 Remove empty debug_opts 2a247e8 Add unsupported status to driver listing 2d79c21 Add is_up property to service and cluster objects 19ad533 HNAS: Rename hnas_svcX_volume_type 57d257f Fix UnBoundLocalError in update_consistencygroup aff6574 Support A/A in attach/detach operations 409d48a Remove 2 unnecessary assignments d1a8b73 Show team and repo badges on README 9b0c5c4 HPE3PAR: handle conflict in iscsi host create 6c698bc Add dev doc for generic volume groups 28ce384 Remove unused constant in hbsd_horcm.py 21365ab Fix create_group with group type name ef0d793 Show provider_id for admin 2c19b1c Fix online data migrations cmd in release notes 84450e9 Fix UnableToFailOver exception message 4f5a596 Gate migration tests: Add Cinder tempest hook 87d6267 Updated from global requirements d7af72b Create a dell_emc folder for Dell EMC drivers 44ebdd2 CG API changes for migrating CGs 304ff4c [2/4]Reset group snapshot status 6f72616 Update is_up from Service OVO class to match ORM dff9fce Replace assertDictMatch with assertDictEqual method in tests dccd458 Move XtremIO driver to dell_emc folder fac3203 Replace six.iteritems with dict.items() b6b41d4 Fix VMAX unit test timeout issue 307da07 Migrate consistency groups to groups 3ff03ff Move ScaleIO driver to dell_emc folder b63c622 Modify the position of try-except 423aa5c Fix names in online-data-migrations release note dea50f7 Windows SMB: use os-brick remotefs client c78f9a4 Fix typo in test_quotas.py 072f9af Skip test_storwize_get_host_from_connector_with_lshost_failure 9ee2e94 Update v2 and v3 Volume actions documentation 80b93f2 Handle NotImplementedError for image cache cloning 33d1270 Fix v2 volume create api-reference request parameters e29f4b1 VMware: VMDK driver performance improvements 24ec725 VMAX driver - Create a CG from a source CG ba1e0d7 Deprecate Hitachi Block Storage Driver ace2203 Add host check while create snapshot 384cb34 Prevent Active-Active on drivers by default 50a1868 Log traceback for validate_connector exception aaa5169 Fix "wrap functions with 2 blank lines" pep8 check b3026c1 RBD: improve readability in over provisioning tests 04807b9 Delete the redundant expression expected_attrs d111600 Remove use of timeutils.set_time_override 942317a Add generic code for online data migrations ae4d479 VMAX driver - Ensure VMAX volume matches cinder db volume f89374e Updated from global requirements 93a2647 Pass OVO instance to copy_volume_to_image 5aba68e Drop unused parameter in class EntryCreateTask 4f31fb7 Set EVENTLET_NO_GREENDNS for IPv6 and dnspython compat 609ce1f Fix doc comments ad59cb5 Add multipath enhancement to Storwize iSCSI driver 01357dc Update replication doc 0a32edb Add VolumeAttachStatus Enum 84e4c2b Dell SC: Live Volumes not cleaned up d0100ab Remove race conditions from transfer API a08aa7a Convert backup_device to OVO 8080380 Clean _get_cctxt method signatures daf0b43 DB: Optimize volume_update method 5b4d38c Fix typo error 188abda Fix compatibility with decorator < 4.0.x ea0fcc9 Fix config generator issue with OVO decorators 439fd47 Dell SC: Minor cleanup d6bd4c8 NetApp ONTAP: Deprecate 7-mode driver dc84c1d Fix unit tests for LVM migration with os-brick 1.7.0 85b7fd8 Fix releasenotes job d2ec578 Make c-vol use workers table for cleanup 0079ead Updated from global requirements 6027c71 Dell SC: Log FO state more clearly e719f00 Add API unit tests for snapshot creation force values 1ce4063 Use VolumeDriverException for driver exceptions ab7e3f1 Dell SC: Error creating snapshots with live volume 16e93cc Remove GlusterFS volume driver e26368e VMAX driver - Useful name convention for CG names 486ed0d VMAX driver - Duplicate initiator group name error. 8bd424b To fix miscellaneous bugs in OVOs cae993a Dell SC: Add init_volume check and logging 4bf72b0 RBD: prevent creation of encrypted volumes 217746e Remove mox3 in test-requirement.txt b47099e Fix typos in comment fdc6f22 VMAX driver - No support for creating CG from CG source f054744 Updated from global requirements 326bdd7 NetApp Data ONTAP driver enhanced support logging 475566a FalconStor: Fix creating snapshot failed 6599529 Dell SC: AsyncTask could return incomplete 8f84505 VNX:Add more check on replication_device keys f1f90c8 Skip unit-tests which use os.fdatasync on MacOS 8d5a563 Missing parameter for storage pools in Pure Storage driver 685e4c9 NetApp: Report shared blocks exhaustion cf5c1fc Allow entry created in VolumeAttachment table for 2nd and later volumes 26e38af storwize: get_host_from_connector optimization d4ae67d Huawei: Fix the rest query timeout problem a0dda6d Updated from global requirements 4aaf78b Remove logging import unused 50be507 Add current status to error msg in reserve_volume e435194 Return HTTPBadRequest instead of HTTPNotFound 2fa79b3 Removed extra xml api-ref files ea97d8f Fix return values of consistencygroup actions in Pure storage driver 31769a4 Update .coveragerc after the removal of openstack directory bc2f011 Fixes ZFSSANFS driver on Solaris platform 2fce7a3 VMware:Config option for http connection pool size 4da5ba3 Updated from global requirements 069daac Add generic reset-status method in admin actions' testcases cb828dd Updated from global requirements 6705334 Imported Translations from Zanata 91b4ea7 Mark backup_swift_key option as secret dd0e0ae make Liberty incompatibility error more helpful c3d1dd1 Add Fibre Channel support for Nimble Storage d5f1bf8 Updated from global requirements dd0ab65 Adjust doc about threading 0ccce3c RemoteFS: Remove deprecated config options d724c75 Fix HNAS Driver KeyError exception in volume manage 0865c4a NetApp NFS: Look for new file for >60s 10bff37 Cleanup RCP API versioning ad444d9 VMware: Fix deprecation warning c4a634d VMware:Remove redundant check for usable ESX hosts e59f5b8 Updated from global requirements f1bbaea NetApp Data ONTAP headroom calculation error 70d9d18 Update synchronized decorator 95dacbf VNX: use delete instead of remove ce6646f Stop using mox in unit/api/v2/ tests b01fa27 Fix the issue that osprofiler opts not in cinder.conf.sample 6f174b4 Remove volid from attachments_get_by_host|instance a097c5c Coho Data: New socket connections per request 6eb6bc3 Imported Translations from Zanata f4f42c9 Log message cleanup for volume-usage-audit 44e172f Imported Translations from Zanata ad36b69 Make divisible py3 compatible in remotefs driver 27bf3fb Add 'cinder' to the 'allowed_direct_url_schemes' 674a6b0 Imported Translations from Zanata ebcf4fb Add backup notification to cinder-volume-usage-audit f963173 VMAX driver - Create initiator group in single call 2a5edb7 Fix log translation marker in volume/utils.py 817d6bc Fix policy file used for testing 4b4b6fe Imported Translations from Zanata a1c0fc3 Dell SC: Can incorrectly identify if it is failed over 20d0200 Enable release notes translation 0da95a1 Add VERSION to ZTE driver class f70367a Imported Translations from Zanata 6843bc5 Switch from tempest-lib to tempest 11f0455 VMAX driver - Misleading logging on portgroups. d9ccfae VMAX driver - Heat detach issue. 6632875 Sort options in cinder.conf by module name a8a0053 Fix typos in documentation 324d020 Move volume drivers unit tests to tests.unit.volume.driver module 6dd3965 Add version to ibm_storage driver 9a73f59 Remove support for 2.x volume RPC API d056718 Remove support for 2.x scheduler RPC API c517116 Imported Translations from Zanata a53f14f Error message for image conversion failure 95170e5 Add cleanable base object and cleanup request VO 1d6b7a9 Imported Translations from Zanata d63b455 Fix for Tegile driver failing to establish volume connection 58cc482 Removing deprecated Dell EqualLogic config options cdd560f Hacking: Remove C305 contextlib.nested check 62a0df2 Fix typo: remove redundant 'that' dafc68a Removing cinder-all binary 5224f10 Updated from global requirements 6ac5d02 Remove old deprecated driver mappings 3499070 Imported Translations from Zanata 9ef18b4 Nexenta: Use base VolumeDriver migrate_volume e030aae Add the note of maximum microversion a87d978 VNX: raise exception if no storops e408e5b Speed up kaminario's drivers tests 63bf7eb VMware: Skip setting vmdk UUID 26919e7 Imported Translations from Zanata ee7c338 Fix typo in emc_vmax_fast.py 7fcca07 Disable API v1 by default d4fd566 RBD Thin Provisioning stats 7abd20f Drop unused parameter in class ExtractSchedulerSpecTask. 5f8d4dc Add interface decorator to ibm_storage driver 24d7f16 Imported Translations from Zanata acfecc5 VMware: Remove FakeObject d3f2e3f Updated from global requirements 0217f47 Fix typo in devref/api_conditional_updates.rst 087734f Fix a typo in manager.py,test_common.py and emc_vmax_utils.py bdce7f9 Re-use RBDImageMetadata and RBDVolumeIOWrapper from os-brick d96fb9a Fix IndexError in volume manager 792108f Remove ovo[fixtures] dependency from tox.ini b66a41c extract_host: Handle empty host string input 14e1c1f Updated from global requirements 33c6e8d Hacking checks for H105 154404f Remove dead code - replication RPC APIs 305ec36 Speed up ibm storwize svc driver's tests 09bd44a Files with no code must be left completely empty 6850c8b Add support for Infortrend GS Series products 8efbf75 Add 'replication_targets' and 'display_name' in API docs ecd2567 Imported Translations from Zanata e75f298 OVO: OPTIONAL_FIELDS should be moved inside the OVO f71879b OPTIONAL_FIELDS should be inside OVO object group_snapshot fd5e2aa Moving the OPTIONAL_FIELDS inside the OVO object group d53f37d Updated from global requirements 073d824 Cleanup lintstack exceptions related to objects 1a120c9 Imported Translations from Zanata 05b4a01 Remove placeholder tempest test 054a417 Hacking: remove check for "tests/unit/integrated" e4921b4 Allow attribute lazy loading in VolumeType OVO 055ec1c Provide cfg to ignore lvm descriptor leak warnings 7304200 Imported Translations from Zanata 9be1372 Imported Translations from Zanata e5a88b0 Imported Translations from Zanata e7de3c6 Volume get: Check policy before fetching metadata c944a22 Fix a typo in scheduler manager "filter_propterties" ad7c181 Fix test case note d3ded36 Fix project assignment in VolumeType OVO 587a606 Imported Translations from Zanata 2792308 Fix pep8 E501 line too long 49b3186 Using assertIsNone() instead of assertIs(None) 06f9b65 Fix formatting in generate_config_opts 0396e19 Reduce redundant call of image show 78f17f0 Limit memory & CPU when running qemu-img info 6ecec80 Updated from global requirements a59cbe5 Allow getting qos_specs in db.volume_type_get 6f66b8d Fix missing string format specifiers 4cd96d9 Deprecate LocalVD, SnapshotVD, CGVD, ExtendVD, TransferVD 5194460 Use keystoneauth1 for creating the keystone session 85ae8dc Add test_get_all_by_volume in objects/test_backup ad9af68 replace filter() to meet python3 d1a035f Add snapshot id validation during volume creation a0b9357 Imported Translations from Zanata 051ff39 Remove extra param in list_manageable_snapshots 5ed4e58 Stop using mox in cinder/tests/unit b66d4d9 Modifies override logic for key_manager b87441c Remove unnecessary setUp f0f5ac7 Imported Translations from Zanata cc123d5 Sheepdog: fix clone failure 4fe3f4c Read domain info from context when contacting nova 38f2ad5 Compact Liberty database migrations a18253f XtremIO: fix migration bug 0408797 Remove unnecessary setUp and tearDown ad3da2a Imported Translations from Zanata a283978 Don't attempt to escalate cinder-manage privileges c06ee90 Remove duplicate keys from dictionary 8849b3b Remove unnecessary setUp and tearDown 77d2157 Add missing %s in print message 931e2f8 Create v3 API Reference 1369293 Reserve 5 migrations for Newton backports 2aed75f Add os-detach to api-ref 32bfddf Fix request_spec conversion from o.vo to dict f3d1be2 Storwize: remove SCSI LUN ID for volume attaching 14063a1 Stop using mox in unit/*.py (2/2) c240eaf Imported Translations from Zanata c557f3b Huawei: Backend capabilies report optimization 4bf66da Imported Translations from Zanata e0d3e1e Imported Translations from Zanata 9b5036a Update reno for stable/newton df284e6 NetApp cDOT: Fix model update for cheesecake volumes 081e5bb Mark v1 as DEPRECATED in devref 4708aa1 Dell SC: ISCSI initialize_connection fixes ed6e9b0 Add combined function get_vol_type_by_name_or_id 383c37e Fix release notes formatting 730761a Fix glance v2 image update aec5fbf DRBD: Don't put clients everywhere 2987b33 Have a default OPTIONAL_FIELDS for persistent OVOs f63f146 Include OPTIONAL_FIELDS in VolumeType OVO class f5fa8c7 Merge two fake drivers into the one FakeLoggingVolumeDriver 91bdf9d Fix creating typeless volumes with Mitaka's c-sch a1284a5 [api-ref] Correct response code in Cinder API v2 e6a5bda Fix order of arguments in assertIs cff6c08 Doc: qos-specs is always and only "Administrators only" acb86b6 Clean create_snapshots_in_db method 45bc8ab Dell SC: Error attaching after LV-AFO e82d639 [api-ref] Correct response code in Cinder API v1 0e206c9 VMAX driver - Replace "SLO" tag with "ServiceLevel" tag efd1f5c Refactor volume status in managing vol 3437ff9 Switch StrOpt to URIOpt for URL config options 7b03534 [Trivial] Refactor the using of dict.get() in the test assertion 49ed717 Refactor the usage of save_and_reraise_exception 67520e5 Added update-host for CGs in cinder-manage ca25d7a Fix backup NFS share mount with default backup_mount_options 3a7be46 Ceph doesn't save a container name for volume backup 0e8ebbd Add API Reference for groups 40e8908 Added unit test coverage to test_limits.py for api v2 7aab553 Add group_type_id in create_group_snapshot 863e5e0 Remove duplicate code in functional tests 642a1c7 Add functional tests for groups f5f3ca0 Unexpected function is called in _migrate_volume_generic Diffstat (except docs and test files) ------------------------------------- .coveragerc | 2 +- .gitreview | 1 + HACKING.rst | 1 - README.rst | 9 + api-ref/source/index.rst | 1 + api-ref/source/v1/index.rst | 6 +- api-ref/source/v1/os-quota-sets-v1.inc | 21 +- api-ref/source/v1/parameters.yaml | 6 + .../v1/samples/quotas-defaults-show-response.xml | 15 - api-ref/source/v1/samples/quotas-show-response.xml | 15 - .../source/v1/samples/quotas-update-request.xml | 4 - .../source/v1/samples/quotas-update-response.xml | 15 - .../source/v1/samples/snapshot-create-request.xml | 6 - .../v1/samples/snapshot-metadata-show-response.xml | 13 - .../samples/snapshot-metadata-update-request.xml | 4 - .../samples/snapshot-metadata-update-response.xml | 4 - .../source/v1/samples/snapshot-show-response.xml | 9 - .../source/v1/samples/snapshots-list-response.xml | 21 - .../v1/samples/user-quotas-show-response.xml | 15 - .../v1/samples/user-quotas-update-request.xml | 5 - .../v1/samples/user-quotas-update-response.xml | 15 - .../source/v1/samples/volume-create-request.xml | 11 - api-ref/source/v1/samples/volume-show-response.xml | 15 - .../v1/samples/volume-type-create-request.xml | 7 - .../v1/samples/volume-type-show-response.xml | 8 - .../v1/samples/volume-types-list-response.xml | 11 - .../source/v1/samples/volumes-list-response.xml | 25 - api-ref/source/v1/volumes-v1-snapshots.inc | 4 +- api-ref/source/v1/volumes-v1-types.inc | 2 +- api-ref/source/v1/volumes-v1-versions.inc | 3 +- api-ref/source/v1/volumes-v1-volumes.inc | 4 +- api-ref/source/v2/api-versions.inc | 6 - api-ref/source/v2/capabilities-v2.inc | 5 +- api-ref/source/v2/consistencygroups-v2.inc | 15 +- api-ref/source/v2/ext-backups-actions-v2.inc | 4 +- api-ref/source/v2/ext-backups.inc | 10 +- api-ref/source/v2/index.rst | 6 +- api-ref/source/v2/os-cgsnapshots-v2.inc | 4 +- api-ref/source/v2/os-vol-image-meta-v2.inc | 2 +- api-ref/source/v2/os-vol-transfer-v2.inc | 6 +- api-ref/source/v2/parameters.yaml | 25 +- api-ref/source/v2/qos-specs-v2-qos-specs.inc | 17 +- .../v2/samples/backend-capabilities-response.json | 3 +- .../v2/samples/consistency-group-show-response.xml | 14 - .../consistency-groups-list-detailed-response.xml | 25 - .../source/v2/samples/extensions-list-response.xml | 165 - api-ref/source/v2/samples/limits-show-response.xml | 17 - api-ref/source/v2/samples/qos-create-request.xml | 2 - api-ref/source/v2/samples/qos-create-response.xml | 9 - api-ref/source/v2/samples/qos-list-response.xml | 19 - api-ref/source/v2/samples/qos-show-response.xml | 11 - api-ref/source/v2/samples/qos-unset-request.xml | 4 - api-ref/source/v2/samples/qos-update-request.xml | 2 - api-ref/source/v2/samples/qos-update-response.xml | 4 - api-ref/source/v2/samples/qos_show_response.xml | 6 - .../v2/samples/quotas-defaults-show-response.xml | 15 - .../v2/samples/quotas-show-defaults-response.xml | 6 - api-ref/source/v2/samples/quotas-show-response.xml | 6 - .../source/v2/samples/quotas-update-request.xml | 4 - .../source/v2/samples/quotas-update-response.xml | 6 - .../v2/samples/quotas-user-show-response.xml | 6 - .../source/v2/samples/snapshot-create-request.xml | 5 - .../source/v2/samples/snapshot-create-response.xml | 7 - .../v2/samples/snapshot-metadata-show-response.xml | 4 - .../samples/snapshot-metadata-update-request.xml | 4 - .../samples/snapshot-metadata-update-response.xml | 4 - .../source/v2/samples/snapshot-show-response.xml | 11 - .../v2/samples/snapshot-status-reset-request.json | 5 + .../source/v2/samples/snapshot-update-request.xml | 4 - .../source/v2/samples/snapshot-update-response.xml | 14 - .../samples/snapshots-list-detailed-response.xml | 16 - .../source/v2/samples/snapshots-list-response.xml | 13 - .../v2/samples/user-quotas-show-response.xml | 15 - .../v2/samples/user-quotas-update-request.xml | 5 - .../v2/samples/user-quotas-update-response.xml | 15 - .../source/v2/samples/version-show-response.xml | 17 - api-ref/source/v2/samples/versions-response.xml | 25 - .../source/v2/samples/volume-create-request.xml | 5 - .../source/v2/samples/volume-create-response.xml | 11 - .../source/v2/samples/volume-detach-request.json | 6 + .../v2/samples/volume-metadata-show-response.xml | 2 - .../v2/samples/volume-metadata-update-request.xml | 4 - .../v2/samples/volume-metadata-update-response.xml | 4 - api-ref/source/v2/samples/volume-show-response.xml | 19 - .../v2/samples/volume-type-access-add-request.xml | 4 - .../samples/volume-type-access-delete-request.xml | 4 - .../v2/samples/volume-type-create-request.xml | 6 - .../source/v2/samples/volume-type-show-request.xml | 8 - .../v2/samples/volume-type-show-response.xml | 9 - .../v2/samples/volume-type-update-request.xml | 6 - .../v2/samples/volume-types-list-response.xml | 11 - .../source/v2/samples/volume-update-request.xml | 4 - .../source/v2/samples/volume-update-response.xml | 13 - .../v2/samples/volumes-list-detailed-response.xml | 31 - .../source/v2/samples/volumes-list-response.xml | 12 - api-ref/source/v2/volume-manage.inc | 2 +- api-ref/source/v2/volume-type-access.inc | 4 +- api-ref/source/v2/volumes-v2-extensions.inc | 3 +- api-ref/source/v2/volumes-v2-snapshots-actions.inc | 34 + api-ref/source/v2/volumes-v2-snapshots.inc | 16 +- api-ref/source/v2/volumes-v2-types.inc | 2 +- api-ref/source/v2/volumes-v2-versions.inc | 4 +- api-ref/source/v2/volumes-v2-volumes-actions.inc | 57 +- api-ref/source/v2/volumes-v2-volumes.inc | 47 +- api-ref/source/v3/api-versions.inc | 26 + api-ref/source/v3/capabilities-v3.inc | 48 + api-ref/source/v3/consistencygroups-v3.inc | 268 + api-ref/source/v3/ext-backups-actions-v3.inc | 38 + api-ref/source/v3/ext-backups.inc | 275 + api-ref/source/v3/group-snapshots.inc | 181 + api-ref/source/v3/group-types.inc | 251 + api-ref/source/v3/groups.inc | 257 + api-ref/source/v3/index.rst | 31 + api-ref/source/v3/limits.inc | 57 + api-ref/source/v3/os-cgsnapshots-v3.inc | 179 + api-ref/source/v3/os-vol-image-meta-v3.inc | 46 + api-ref/source/v3/os-vol-pool-v3.inc | 50 + api-ref/source/v3/os-vol-transfer-v3.inc | 217 + api-ref/source/v3/parameters.yaml | 1859 ++++ api-ref/source/v3/qos-specs-v3-qos-specs.inc | 315 + api-ref/source/v3/quota-sets.inc | 407 + .../v3/samples/backend-capabilities-response.json | 33 + .../source/v3/samples/backup-create-request.json | 9 + .../source/v3/samples/backup-create-response.json | 16 + .../v3/samples/backup-force-delete-request.json | 3 + .../v3/samples/backup-record-export-response.json | 6 + .../v3/samples/backup-record-import-request.json | 6 + .../v3/samples/backup-record-import-response.json | 16 + .../source/v3/samples/backup-restore-request.json | 6 + .../source/v3/samples/backup-restore-response.json | 6 + .../source/v3/samples/backup-show-response.json | 27 + .../v3/samples/backups-list-detailed-response.json | 54 + .../source/v3/samples/backups-list-response.json | 32 + .../v3/samples/cgsnapshots-create-request.json | 10 + .../v3/samples/cgsnapshots-create-response.json | 6 + .../cgsnapshots-list-detailed-response.json | 20 + .../v3/samples/cgsnapshots-list-response.json | 12 + .../v3/samples/cgsnapshots-show-response.json | 10 + .../consistency-group-create-from-src-request.json | 11 + .../samples/consistency-group-create-request.json | 8 + .../samples/consistency-group-create-response.json | 11 + .../samples/consistency-group-delete-request.json | 5 + .../samples/consistency-group-show-response.json | 13 + .../samples/consistency-group-update-request.json | 8 + .../consistency-groups-list-detailed-response.json | 26 + .../samples/consistency-groups-list-response.json | 12 + .../v3/samples/encryption-type-create-request.json | 8 + .../samples/encryption-type-create-response.json | 10 + .../v3/samples/encryption-type-show-response.json | 12 + .../v3/samples/encryption-type-update-request.json | 7 + .../samples/encryption-type-update-response.json | 7 + .../v3/samples/extensions-list-response.json | 212 + .../v3/samples/group-create-from-src-request.json | 11 + .../source/v3/samples/group-create-request.json | 12 + .../source/v3/samples/group-create-response.json | 6 + .../source/v3/samples/group-delete-request.json | 5 + api-ref/source/v3/samples/group-show-response.json | 16 + .../v3/samples/group-snapshots-create-request.json | 7 + .../samples/group-snapshots-create-response.json | 6 + .../group-snapshots-list-detailed-response.json | 20 + .../v3/samples/group-snapshots-list-response.json | 12 + .../v3/samples/group-snapshots-show-response.json | 10 + .../v3/samples/group-type-create-request.json | 10 + .../source/v3/samples/group-type-show-request.json | 9 + .../v3/samples/group-type-show-response.json | 11 + .../samples/group-type-specs-create-request.json | 6 + .../v3/samples/group-type-update-request.json | 7 + .../v3/samples/group-types-list-response.json | 16 + .../source/v3/samples/group-update-request.json | 8 + .../v3/samples/groups-list-detailed-response.json | 29 + .../source/v3/samples/groups-list-response.json | 12 + api-ref/source/v3/samples/host-attach-request.json | 5 + .../v3/samples/image-metadata-show-request.json | 18 + .../v3/samples/image-metadata-show-response.json | 33 + .../source/v3/samples/limits-show-response.json | 17 + .../v3/samples/pools-list-detailed-response.json | 30 + api-ref/source/v3/samples/qos-create-request.json | 7 + api-ref/source/v3/samples/qos-create-response.json | 21 + api-ref/source/v3/samples/qos-list-response.json | 22 + api-ref/source/v3/samples/qos-show-response.json | 21 + api-ref/source/v3/samples/qos-unset-request.json | 5 + api-ref/source/v3/samples/qos-unset-response.json | 0 api-ref/source/v3/samples/qos-update-request.json | 5 + api-ref/source/v3/samples/qos-update-response.json | 5 + api-ref/source/v3/samples/qos_show_response.json | 9 + .../source/v3/samples/quotas-delete-response.json | 0 .../v3/samples/quotas-show-defaults-response.json | 7 + .../source/v3/samples/quotas-show-response.json | 7 + .../source/v3/samples/quotas-update-request.json | 5 + .../source/v3/samples/quotas-update-response.json | 5 + .../quotas-user-show-detailed-response.json | 19 + .../v3/samples/quotas-user-show-response.json | 7 + .../source/v3/samples/snapshot-create-request.json | 8 + .../v3/samples/snapshot-create-response.json | 12 + .../samples/snapshot-metadata-show-response.json | 5 + .../samples/snapshot-metadata-update-request.json | 5 + .../samples/snapshot-metadata-update-response.json | 5 + .../source/v3/samples/snapshot-show-response.json | 14 + .../v3/samples/snapshot-status-reset-request.json | 5 + .../source/v3/samples/snapshot-update-request.json | 6 + .../v3/samples/snapshot-update-response.json | 11 + .../samples/snapshots-list-detailed-response.json | 18 + .../source/v3/samples/snapshots-list-response.json | 16 + .../v3/samples/user-quotas-show-response.json | 17 + .../v3/samples/user-quotas-update-request.json | 6 + .../v3/samples/user-quotas-update-response.json | 16 + .../source/v3/samples/version-show-response.json | 33 + .../v3/samples/version-v2-show-response.json | 44 + .../v3/samples/version-v3-show-response.json | 88 + api-ref/source/v3/samples/versions-response.json | 76 + .../source/v3/samples/volume-attach-request.json | 6 + .../source/v3/samples/volume-create-request.json | 22 + .../source/v3/samples/volume-create-response.json | 34 + .../source/v3/samples/volume-extend-request.json | 5 + .../v3/samples/volume-force-detach-request.json | 8 + .../samples/volume-image-metadata-set-request.json | 10 + .../volume-image-metadata-unset-request.json | 5 + .../v3/samples/volume-manage-request-cluster.json | 19 + .../source/v3/samples/volume-manage-request.json | 18 + .../source/v3/samples/volume-manage-response.json | 33 + .../v3/samples/volume-metadata-create-request.json | 5 + .../samples/volume-metadata-create-response.json | 5 + .../v3/samples/volume-metadata-show-response.json | 3 + .../v3/samples/volume-metadata-update-request.json | 5 + .../samples/volume-metadata-update-response.json | 5 + .../source/v3/samples/volume-show-response.json | 33 + .../v3/samples/volume-status-reset-request.json | 7 + .../v3/samples/volume-transfer-accept-request.json | 5 + .../samples/volume-transfer-accept-response.json | 17 + .../v3/samples/volume-transfer-create-request.json | 6 + .../samples/volume-transfer-create-response.json | 19 + .../v3/samples/volume-transfer-show-response.json | 18 + .../volume-transfers-list-detailed-response.json | 36 + .../v3/samples/volume-transfers-list-response.json | 34 + .../v3/samples/volume-type-access-add-request.json | 5 + .../samples/volume-type-access-delete-request.json | 5 + .../samples/volume-type-access-list-response.json | 6 + .../v3/samples/volume-type-create-request.json | 10 + .../v3/samples/volume-type-show-request.json | 9 + .../v3/samples/volume-type-show-response.json | 11 + .../v3/samples/volume-type-update-request.json | 10 + .../v3/samples/volume-types-list-response.json | 16 + .../source/v3/samples/volume-unmanage-request.json | 3 + .../source/v3/samples/volume-update-request.json | 6 + .../source/v3/samples/volume-update-response.json | 36 + .../v3/samples/volumes-list-detailed-response.json | 102 + .../source/v3/samples/volumes-list-response.json | 32 + .../v3/samples/volumes-list-summary-response.json | 6 + api-ref/source/v3/volume-manage.inc | 58 + api-ref/source/v3/volume-type-access.inc | 103 + api-ref/source/v3/volumes-v3-extensions.inc | 52 + api-ref/source/v3/volumes-v3-snapshots-actions.inc | 34 + api-ref/source/v3/volumes-v3-snapshots.inc | 359 + api-ref/source/v3/volumes-v3-types.inc | 445 + api-ref/source/v3/volumes-v3-versions.inc | 67 + api-ref/source/v3/volumes-v3-volumes-actions.inc | 269 + api-ref/source/v3/volumes-v3-volumes.inc | 614 ++ cinder/__init__.py | 17 +- cinder/api/common.py | 29 + cinder/api/contrib/admin_actions.py | 40 +- cinder/api/contrib/backups.py | 11 +- cinder/api/contrib/capabilities.py | 14 +- cinder/api/contrib/cgsnapshots.py | 101 +- cinder/api/contrib/consistencygroups.py | 132 +- cinder/api/contrib/qos_specs_manage.py | 16 +- cinder/api/contrib/quotas.py | 17 +- cinder/api/contrib/resource_common_manage.py | 22 +- cinder/api/contrib/services.py | 41 +- cinder/api/contrib/snapshot_actions.py | 3 +- cinder/api/contrib/snapshot_manage.py | 3 +- cinder/api/contrib/snapshot_unmanage.py | 5 +- cinder/api/contrib/types_extra_specs.py | 3 +- cinder/api/contrib/types_manage.py | 11 +- cinder/api/contrib/volume_actions.py | 25 +- cinder/api/contrib/volume_image_metadata.py | 3 +- cinder/api/contrib/volume_manage.py | 44 +- cinder/api/contrib/volume_transfer.py | 7 +- cinder/api/contrib/volume_type_access.py | 5 +- cinder/api/contrib/volume_type_encryption.py | 3 +- cinder/api/contrib/volume_unmanage.py | 5 +- cinder/api/middleware/sizelimit.py | 40 - cinder/api/openstack/api_version_request.py | 36 +- cinder/api/openstack/rest_api_version_history.rst | 100 +- cinder/api/openstack/wsgi.py | 9 +- cinder/api/v1/snapshots.py | 2 +- cinder/api/v1/volumes.py | 18 +- cinder/api/v2/views/volumes.py | 35 +- cinder/api/v2/volumes.py | 26 +- cinder/api/v3/attachments.py | 261 + cinder/api/v3/backups.py | 45 + cinder/api/v3/clusters.py | 21 +- cinder/api/v3/group_snapshots.py | 73 +- cinder/api/v3/group_types.py | 4 +- cinder/api/v3/groups.py | 82 +- cinder/api/v3/resource_common_manage.py | 83 + cinder/api/v3/router.py | 25 +- cinder/api/v3/snapshot_manage.py | 24 +- cinder/api/v3/snapshots.py | 76 + cinder/api/v3/views/attachments.py | 57 + cinder/api/v3/views/clusters.py | 23 +- cinder/api/v3/views/group_snapshots.py | 6 +- cinder/api/v3/views/groups.py | 7 + cinder/api/v3/views/volumes.py | 6 + cinder/api/v3/views/workers.py | 25 + cinder/api/v3/volume_manage.py | 24 +- cinder/api/v3/volumes.py | 66 +- cinder/api/v3/workers.py | 124 + cinder/api/views/cgsnapshots.py | 12 +- cinder/api/views/consistencygroups.py | 13 +- cinder/api/views/limits.py | 8 - cinder/api/views/qos_specs.py | 2 +- cinder/backup/api.py | 10 +- cinder/backup/drivers/ceph.py | 166 +- cinder/backup/drivers/nfs.py | 2 +- cinder/backup/drivers/swift.py | 5 +- cinder/backup/manager.py | 39 +- cinder/backup/rpcapi.py | 44 +- cinder/brick/local_dev/lvm.py | 38 +- cinder/cmd/all.py | 117 - cinder/cmd/manage.py | 94 +- cinder/cmd/volume.py | 14 +- cinder/cmd/volume_usage_audit.py | 308 +- cinder/common/config.py | 11 +- cinder/common/sqlalchemyutils.py | 49 +- cinder/compute/nova.py | 97 +- cinder/config/cinder-config-generator.conf | 1 + cinder/config/generate_cinder_opts.py | 55 +- cinder/consistencygroup/api.py | 18 +- cinder/coordination.py | 45 +- cinder/db/api.py | 178 +- cinder/db/migration.py | 2 +- cinder/db/sqlalchemy/api.py | 1040 +- .../migrate_repo/versions/046_cinder_init.py | 574 -- .../versions/047_add_per_volume_quota.py | 44 - .../versions/048_add_allocated_in_quotas.py | 25 - .../049_add_temp_volume_snapshot_ids_to_backups.py | 31 - .../versions/050_add_previous_status_to_volumes.py | 27 - ..._add_source_cgid_column_to_consistencygroups.py | 26 - .../052_add_provider_auth_column_to_snapshots.py | 25 - .../versions/053_add_version_columns_to_service.py | 36 - ..._add_has_dependent_backups_column_to_backups.py | 33 - .../versions/055_add_image_volume_cache_table.py | 37 - .../migrate_repo/versions/056_placeholder.py | 19 - .../migrate_repo/versions/057_placeholder.py | 19 - .../migrate_repo/versions/058_placeholder.py | 19 - .../migrate_repo/versions/059_placeholder.py | 19 - .../migrate_repo/versions/060_placeholder.py | 19 - .../061_add_snapshot_id_timestamp_to_backups.py | 30 - .../migrate_repo/versions/061_cinder_init.py | 607 ++ .../064_add_restore_volume_id_to_backups.py | 52 +- .../migrate_repo/versions/080_placeholder.py | 22 + .../migrate_repo/versions/081_placeholder.py | 22 + .../migrate_repo/versions/082_placeholder.py | 22 + .../migrate_repo/versions/083_placeholder.py | 22 + .../migrate_repo/versions/084_placeholder.py | 22 + .../versions/085_modify_workers_updated_at.py | 55 + .../versions/086_create_default_cgsnapshot_type.py | 68 + .../087_allow_null_request_id_in_message.py | 21 + .../088_add_replication_info_to_cluster.py | 33 + .../versions/089_add_cluster_name_image_cache.py | 27 + .../versions/090_add_race_preventer_to_workers.py | 27 + .../versions/091_add_attachment_specs.py | 40 + .../migrate_repo/versions/092_placeholder.py | 22 + .../migrate_repo/versions/093_placeholder.py | 22 + .../migrate_repo/versions/094_placeholder.py | 22 + .../migrate_repo/versions/095_placeholder.py | 22 + .../migrate_repo/versions/096_placeholder.py | 22 + cinder/db/sqlalchemy/models.py | 33 +- cinder/exception.py | 148 +- cinder/flow_utils.py | 31 +- cinder/group/api.py | 61 +- cinder/hacking/checks.py | 25 +- cinder/image/cache.py | 49 +- cinder/image/glance.py | 32 +- cinder/image/image_utils.py | 80 +- cinder/interface/backup_chunked_driver.py | 6 +- cinder/interface/backup_driver.py | 15 +- cinder/interface/util.py | 1 + cinder/interface/volume_group_driver.py | 227 + cinder/keymgr/__init__.py | 78 +- cinder/keymgr/conf_key_mgr.py | 9 +- cinder/locale/cs/LC_MESSAGES/cinder-log-error.po | 20 +- cinder/locale/cs/LC_MESSAGES/cinder-log-info.po | 11 +- cinder/locale/cs/LC_MESSAGES/cinder-log-warning.po | 20 +- cinder/locale/cs/LC_MESSAGES/cinder.po | 56 +- cinder/locale/de/LC_MESSAGES/cinder.po | 104 +- cinder/locale/es/LC_MESSAGES/cinder.po | 72 +- cinder/locale/fr/LC_MESSAGES/cinder.po | 65 +- cinder/locale/it/LC_MESSAGES/cinder-log-error.po | 20 +- cinder/locale/it/LC_MESSAGES/cinder-log-info.po | 11 +- cinder/locale/it/LC_MESSAGES/cinder.po | 63 +- cinder/locale/ja/LC_MESSAGES/cinder.po | 683 +- .../locale/ko_KR/LC_MESSAGES/cinder-log-error.po | 20 +- cinder/locale/ko_KR/LC_MESSAGES/cinder-log-info.po | 11 +- cinder/locale/ko_KR/LC_MESSAGES/cinder.po | 60 +- cinder/locale/pt_BR/LC_MESSAGES/cinder.po | 63 +- cinder/locale/ru/LC_MESSAGES/cinder.po | 64 +- .../locale/tr_TR/LC_MESSAGES/cinder-log-error.po | 20 +- cinder/locale/tr_TR/LC_MESSAGES/cinder-log-info.po | 11 +- .../locale/tr_TR/LC_MESSAGES/cinder-log-warning.po | 13 +- cinder/locale/tr_TR/LC_MESSAGES/cinder.po | 61 +- cinder/locale/zh_CN/LC_MESSAGES/cinder.po | 590 +- cinder/locale/zh_TW/LC_MESSAGES/cinder.po | 55 +- cinder/manager.py | 148 +- cinder/message/defined_messages.py | 36 +- cinder/objects/__init__.py | 3 + cinder/objects/backup.py | 63 + cinder/objects/base.py | 27 +- cinder/objects/cgsnapshot.py | 24 +- cinder/objects/cleanable.py | 237 + cinder/objects/cleanup_request.py | 49 + cinder/objects/cluster.py | 21 +- cinder/objects/consistencygroup.py | 20 +- cinder/objects/fields.py | 37 +- cinder/objects/group.py | 10 +- cinder/objects/group_snapshot.py | 22 +- cinder/objects/group_type.py | 11 +- cinder/objects/manageableresources.py | 103 + cinder/objects/qos_specs.py | 9 +- cinder/objects/service.py | 16 +- cinder/objects/snapshot.py | 80 +- cinder/objects/volume.py | 102 +- cinder/objects/volume_attachment.py | 122 +- cinder/objects/volume_type.py | 53 +- cinder/opts.py | 319 +- cinder/quota.py | 6 +- cinder/quota_utils.py | 20 +- cinder/replication/__init__.py | 23 - cinder/replication/api.py | 108 - cinder/rpc.py | 61 +- cinder/scheduler/__init__.py | 22 - cinder/scheduler/driver.py | 48 +- cinder/scheduler/evaluator/evaluator.py | 10 +- cinder/scheduler/filter_scheduler.py | 436 +- cinder/scheduler/filters/__init__.py | 18 +- cinder/scheduler/filters/affinity_filter.py | 26 +- .../scheduler/filters/availability_zone_filter.py | 9 +- cinder/scheduler/filters/capabilities_filter.py | 16 +- cinder/scheduler/filters/capacity_filter.py | 104 +- cinder/scheduler/filters/driver_filter.py | 76 +- .../filters/ignore_attempted_hosts_filter.py | 21 +- .../scheduler/filters/instance_locality_filter.py | 14 +- cinder/scheduler/filters/json_filter.py | 24 +- cinder/scheduler/flows/create_volume.py | 25 +- cinder/scheduler/host_manager.py | 391 +- cinder/scheduler/manager.py | 373 +- cinder/scheduler/rpcapi.py | 212 +- cinder/service.py | 107 +- cinder/test.py | 192 +- .../tempest/api/volume/test_consistencygroups.py | 4 +- .../tempest/api/volume/test_volume_placeholder.py | 25 - .../api/contrib/test_backup_project_attribute.py | 101 + .../unit/api/contrib/test_consistencygroups.py | 20 +- .../unit/api/contrib/test_qos_specs_manage.py | 2 +- .../unit/api/contrib/test_snapshot_actions.py | 4 +- .../unit/api/contrib/test_snapshot_unmanage.py | 18 +- .../api/contrib/test_volume_encryption_metadata.py | 3 +- .../unit/api/contrib/test_volume_host_attribute.py | 3 +- .../unit/api/contrib/test_volume_image_metadata.py | 3 +- .../test_volume_migration_status_attribute.py | 3 +- .../unit/api/openstack/test_api_version_request.py | 6 +- .../unit/attachments/test_attachments_manager.py | 99 + .../unit/backup/drivers/test_backup_glusterfs.py | 12 +- .../objects/test_manageable_volumes_snapshots.py | 107 + .../scheduler/test_allocated_capacity_weigher.py | 12 +- .../scheduler/test_stochastic_weight_handler.py | 6 +- .../unit/scheduler/test_volume_number_weigher.py | 15 +- .../unit/volume/drivers/dell/test_dellscapi.py | 1735 +++- .../volume/drivers/dell_emc/scaleio/__init__.py | 171 + .../unit/volume/drivers/dell_emc/scaleio/mocks.py | 98 + .../dell_emc/scaleio/test_attach_detach_volume.py | 45 + .../dell_emc/scaleio/test_consistencygroups.py | 211 + .../dell_emc/scaleio/test_create_cloned_volume.py | 106 + .../dell_emc/scaleio/test_create_snapshot.py | 117 + .../drivers/dell_emc/scaleio/test_create_volume.py | 138 + .../scaleio/test_create_volume_from_snapshot.py | 100 + .../dell_emc/scaleio/test_delete_snapshot.py | 95 + .../drivers/dell_emc/scaleio/test_delete_volume.py | 82 + .../drivers/dell_emc/scaleio/test_extend_volume.py | 106 + .../dell_emc/scaleio/test_initialize_connection.py | 116 + .../dell_emc/scaleio/test_manage_existing.py | 127 + .../scaleio/test_manage_existing_snapshot.py | 154 + .../volume/drivers/dell_emc/scaleio/test_misc.py | 226 + .../unit/volume/drivers/dell_emc/test_vmax.py | 10197 +++++++++++++++++++ .../unit/volume/drivers/dell_emc/test_xtremio.py | 1234 +++ .../unit/volume/drivers/dell_emc/unity/__init__.py | 0 .../drivers/dell_emc/unity/fake_exception.py | 70 + .../volume/drivers/dell_emc/unity/test_adapter.py | 634 ++ .../volume/drivers/dell_emc/unity/test_client.py | 461 + .../volume/drivers/dell_emc/unity/test_driver.py | 269 + .../volume/drivers/dell_emc/unity/test_utils.py | 254 + .../unit/volume/drivers/dell_emc/vnx/__init__.py | 26 + .../unit/volume/drivers/dell_emc/vnx/fake_enum.py | 119 + .../volume/drivers/dell_emc/vnx/fake_exception.py | 180 + .../drivers/dell_emc/vnx/fake_storops/__init__.py | 76 + .../dell_emc/vnx/fake_storops/lib/__init__.py | 0 .../drivers/dell_emc/vnx/fake_storops/lib/tasks.py | 28 + .../volume/drivers/dell_emc/vnx/mocked_cinder.yaml | 463 + .../volume/drivers/dell_emc/vnx/mocked_vnx.yaml | 2108 ++++ .../unit/volume/drivers/dell_emc/vnx/res_mock.py | 443 + .../volume/drivers/dell_emc/vnx/test_adapter.py | 1516 +++ .../volume/drivers/dell_emc/vnx/test_client.py | 474 + .../volume/drivers/dell_emc/vnx/test_common.py | 314 + .../volume/drivers/dell_emc/vnx/test_driver.py | 81 + .../volume/drivers/dell_emc/vnx/test_res_mock.py | 84 + .../volume/drivers/dell_emc/vnx/test_res_mock.yaml | 59 + .../volume/drivers/dell_emc/vnx/test_taskflows.py | 182 + .../unit/volume/drivers/dell_emc/vnx/test_utils.py | 198 + .../unit/volume/drivers/dell_emc/vnx/utils.py | 85 + .../drivers/disco/test_create_cloned_volume.py | 36 +- .../volume/drivers/disco/test_create_snapshot.py | 26 +- .../volume/drivers/disco/test_create_volume.py | 6 +- .../disco/test_create_volume_from_snapshot.py | 26 +- .../volume/drivers/disco/test_delete_snapshot.py | 6 +- .../volume/drivers/disco/test_delete_volume.py | 6 +- .../volume/drivers/disco/test_extend_volume.py | 4 +- .../volume/drivers/disco/test_manage_existing.py | 133 + .../unit/volume/drivers/emc/scaleio/__init__.py | 171 - .../emc/scaleio/test_attach_detach_volume.py | 45 - .../drivers/emc/scaleio/test_consistencygroups.py | 211 - .../emc/scaleio/test_create_cloned_volume.py | 106 - .../drivers/emc/scaleio/test_create_snapshot.py | 117 - .../drivers/emc/scaleio/test_create_volume.py | 138 - .../scaleio/test_create_volume_from_snapshot.py | 100 - .../drivers/emc/scaleio/test_delete_snapshot.py | 95 - .../drivers/emc/scaleio/test_delete_volume.py | 82 - .../drivers/emc/scaleio/test_extend_volume.py | 106 - .../emc/scaleio/test_initialize_connection.py | 116 - .../drivers/emc/scaleio/test_manage_existing.py | 127 - .../emc/scaleio/test_manage_existing_snapshot.py | 154 - .../unit/volume/drivers/emc/scaleio/test_misc.py | 223 - .../unit/volume/drivers/emc/test_emc_xtremio.py | 1073 -- .../unit/volume/drivers/emc/vnx/fake_exception.py | 172 - .../unit/volume/drivers/emc/vnx/fake_storops.py | 76 - .../unit/volume/drivers/emc/vnx/mocked_cinder.yaml | 445 - .../unit/volume/drivers/emc/vnx/mocked_vnx.yaml | 2029 ---- .../unit/volume/drivers/emc/vnx/test_adapter.py | 1315 --- .../unit/volume/drivers/emc/vnx/test_client.py | 465 - .../unit/volume/drivers/emc/vnx/test_common.py | 297 - .../unit/volume/drivers/emc/vnx/test_driver.py | 73 - .../unit/volume/drivers/emc/vnx/test_res_mock.py | 90 - .../unit/volume/drivers/emc/vnx/test_res_mock.yaml | 59 - .../unit/volume/drivers/emc/vnx/test_taskflows.py | 181 - .../unit/volume/drivers/emc/vnx/test_utils.py | 174 - .../volume/drivers/fusionstorage/test_dsware.py | 1542 +-- .../drivers/fusionstorage/test_fspythonapi.py | 894 +- .../drivers/hitachi/test_hitachi_hnas_backend.py | 234 +- .../drivers/hitachi/test_hitachi_hnas_iscsi.py | 150 +- .../drivers/hitachi/test_hitachi_hnas_nfs.py | 390 +- .../drivers/hitachi/test_hitachi_hnas_utils.py | 64 +- .../drivers/hitachi/test_hitachi_vsp_horcm_fc.py | 1821 ++++ .../hitachi/test_hitachi_vsp_horcm_iscsi.py | 1915 ++++ .../unit/volume/drivers/hpe/test_hpelefthand.py | 4 +- .../volume/drivers/huawei/test_huawei_drivers.py | 882 +- .../huawei/test_huawei_drivers_compatibility.py | 65 - .../volume/drivers/ibm/fake_pyxcli_exceptions.py | 88 + .../unit/volume/drivers/ibm/test_ds8k_proxy.py | 2829 +++++ .../volume/drivers/ibm/test_ibm_flashsystem.py | 5 +- .../unit/volume/drivers/ibm/test_ibm_storage.py | 15 +- .../unit/volume/drivers/ibm/test_storwize_svc.py | 2082 +++- .../unit/volume/drivers/ibm/test_xiv_proxy.py | 1845 ++++ .../drivers/infortrend/test_infortrend_cli.py | 9 +- .../drivers/infortrend/test_infortrend_common.py | 92 +- .../unit/volume/drivers/nec/volume_common_test.py | 299 + .../drivers/netapp/dataontap/client/fakes.py | 99 + .../drivers/netapp/dataontap/client/test_api.py | 84 +- .../netapp/dataontap/client/test_client_7mode.py | 22 +- .../netapp/dataontap/client/test_client_base.py | 16 +- .../netapp/dataontap/client/test_client_cmode.py | 481 +- .../unit/volume/drivers/netapp/dataontap/fakes.py | 1 - .../dataontap/performance/test_perf_7mode.py | 42 +- .../netapp/dataontap/performance/test_perf_base.py | 55 +- .../dataontap/performance/test_perf_cmode.py | 71 +- .../drivers/netapp/dataontap/test_block_7mode.py | 67 +- .../drivers/netapp/dataontap/test_block_base.py | 313 +- .../drivers/netapp/dataontap/test_block_cmode.py | 112 +- .../dataontap/test_block_driver_interfaces.py | 6 +- .../drivers/netapp/dataontap/test_nfs_7mode.py | 42 +- .../drivers/netapp/dataontap/test_nfs_base.py | 192 +- .../drivers/netapp/dataontap/test_nfs_cmode.py | 132 +- .../volume/drivers/netapp/dataontap/utils/fakes.py | 40 +- .../netapp/dataontap/utils/test_capabilities.py | 159 +- .../netapp/dataontap/utils/test_data_motion.py | 132 +- .../netapp/dataontap/utils/test_loopingcalls.py | 4 +- .../drivers/netapp/dataontap/utils/test_utils.py | 67 +- .../unit/volume/drivers/netapp/eseries/fakes.py | 3 +- .../volume/drivers/netapp/eseries/test_client.py | 117 +- .../volume/drivers/netapp/eseries/test_driver.py | 40 +- .../drivers/netapp/eseries/test_host_mapper.py | 114 +- .../volume/drivers/netapp/eseries/test_library.py | 451 +- .../unit/volume/drivers/netapp/test_common.py | 4 +- .../unit/volume/drivers/nexenta/test_nexenta.py | 32 +- .../volume/drivers/nexenta/test_nexenta5_iscsi.py | 222 +- .../drivers/nexenta/test_nexenta5_jsonrpc.py | 251 + .../volume/drivers/nexenta/test_nexenta5_nfs.py | 98 +- .../volume/drivers/nexenta/test_nexenta_edge.py | 1 + .../drivers/nexenta/test_nexenta_edge_nbd.py | 504 + .../unit/volume/drivers/solidfire/__init__.py | 0 .../solidfire/scaled_iops_invalid_data.json | 22 + .../drivers/solidfire/scaled_iops_test_data.json | 134 + .../volume/drivers/solidfire/test_solidfire.py | 1908 ++++ .../drivers/synology/test_synology_common.py | 1658 +++ .../volume/drivers/synology/test_synology_iscsi.py | 355 + .../unit/volume/drivers/test_drbdmanagedrv.py | 3 - .../unit/volume/drivers/test_falconstor_fss.py | 903 ++ .../unit/volume/drivers/test_prophetstor_dpl.py | 10 +- .../volume/drivers/violin/test_v7000_common.py | 3 - .../unit/volume/drivers/violin/test_v7000_fcp.py | 3 - .../unit/volume/drivers/vmware/test_vmware_vmdk.py | 246 +- .../volume/drivers/vmware/test_vmware_volumeops.py | 262 +- .../unit/volume/flows/test_create_volume_flow.py | 221 +- .../unit/volume/flows/test_manage_volume_flow.py | 4 +- .../zonemanager/test_brcd_fc_san_lookup_service.py | 2 +- .../zonemanager/test_brcd_fc_zone_client_cli.py | 2 +- .../zonemanager/test_brcd_http_fc_zone_client.py | 76 +- .../unit/zonemanager/test_brcd_lookup_service.py | 2 +- .../test_cisco_fc_san_lookup_service.py | 2 +- .../zonemanager/test_cisco_fc_zone_client_cli.py | 48 +- .../unit/zonemanager/test_cisco_fc_zone_driver.py | 39 +- .../unit/zonemanager/test_cisco_lookup_service.py | 2 +- cinder/transfer/api.py | 3 +- cinder/utils.py | 50 +- cinder/volume/api.py | 581 +- cinder/volume/driver.py | 326 +- cinder/volume/drivers/__init__.py | 22 - cinder/volume/drivers/block_device.py | 13 +- cinder/volume/drivers/cloudbyte/cloudbyte.py | 5 + cinder/volume/drivers/coho.py | 35 +- cinder/volume/drivers/coprhd/fc.py | 4 +- cinder/volume/drivers/coprhd/helpers/volume.py | 13 +- cinder/volume/drivers/datera.py | 1136 --- cinder/volume/drivers/datera/__init__.py | 0 cinder/volume/drivers/datera/datera_api2.py | 763 ++ cinder/volume/drivers/datera/datera_api21.py | 877 ++ cinder/volume/drivers/datera/datera_common.py | 211 + cinder/volume/drivers/datera/datera_iscsi.py | 739 ++ .../volume/drivers/dell/dell_storagecenter_api.py | 534 +- .../drivers/dell/dell_storagecenter_common.py | 254 +- .../volume/drivers/dell/dell_storagecenter_fc.py | 191 +- .../drivers/dell/dell_storagecenter_iscsi.py | 164 +- cinder/volume/drivers/dell_emc/__init__.py | 0 cinder/volume/drivers/dell_emc/ps.py | 685 ++ cinder/volume/drivers/dell_emc/scaleio/__init__.py | 0 cinder/volume/drivers/dell_emc/scaleio/driver.py | 1421 +++ cinder/volume/drivers/dell_emc/unity/__init__.py | 18 + cinder/volume/drivers/dell_emc/unity/adapter.py | 605 ++ cinder/volume/drivers/dell_emc/unity/client.py | 290 + cinder/volume/drivers/dell_emc/unity/driver.py | 219 + cinder/volume/drivers/dell_emc/unity/utils.py | 286 + cinder/volume/drivers/dell_emc/vmax/__init__.py | 0 cinder/volume/drivers/dell_emc/vmax/common.py | 5926 +++++++++++ cinder/volume/drivers/dell_emc/vmax/fast.py | 830 ++ cinder/volume/drivers/dell_emc/vmax/fc.py | 527 + cinder/volume/drivers/dell_emc/vmax/https.py | 347 + cinder/volume/drivers/dell_emc/vmax/iscsi.py | 452 + cinder/volume/drivers/dell_emc/vmax/masking.py | 2763 +++++ cinder/volume/drivers/dell_emc/vmax/provision.py | 1083 ++ .../volume/drivers/dell_emc/vmax/provision_v3.py | 1062 ++ cinder/volume/drivers/dell_emc/vmax/utils.py | 3026 ++++++ cinder/volume/drivers/dell_emc/vnx/__init__.py | 0 cinder/volume/drivers/dell_emc/vnx/adapter.py | 1570 +++ cinder/volume/drivers/dell_emc/vnx/client.py | 597 ++ cinder/volume/drivers/dell_emc/vnx/common.py | 492 + cinder/volume/drivers/dell_emc/vnx/const.py | 39 + cinder/volume/drivers/dell_emc/vnx/driver.py | 377 + cinder/volume/drivers/dell_emc/vnx/taskflows.py | 598 ++ cinder/volume/drivers/dell_emc/vnx/utils.py | 362 + cinder/volume/drivers/dell_emc/xtremio.py | 1151 +++ cinder/volume/drivers/disco/disco.py | 295 +- cinder/volume/drivers/disco/disco_api.py | 169 + cinder/volume/drivers/disco/disco_attach_detach.py | 70 + cinder/volume/drivers/dothill/dothill_client.py | 284 +- cinder/volume/drivers/dothill/dothill_common.py | 28 +- cinder/volume/drivers/dothill/dothill_fc.py | 33 +- cinder/volume/drivers/dothill/dothill_iscsi.py | 14 +- cinder/volume/drivers/drbdmanagedrv.py | 2 +- cinder/volume/drivers/emc/__init__.py | 0 cinder/volume/drivers/emc/emc_vmax_common.py | 4604 --------- cinder/volume/drivers/emc/emc_vmax_fast.py | 830 -- cinder/volume/drivers/emc/emc_vmax_fc.py | 438 - cinder/volume/drivers/emc/emc_vmax_https.py | 347 - cinder/volume/drivers/emc/emc_vmax_iscsi.py | 411 - cinder/volume/drivers/emc/emc_vmax_masking.py | 2744 ----- cinder/volume/drivers/emc/emc_vmax_provision.py | 1082 -- cinder/volume/drivers/emc/emc_vmax_provision_v3.py | 855 -- cinder/volume/drivers/emc/emc_vmax_utils.py | 2834 ------ cinder/volume/drivers/emc/scaleio.py | 1421 --- cinder/volume/drivers/emc/vnx/__init__.py | 0 cinder/volume/drivers/emc/vnx/adapter.py | 1463 --- cinder/volume/drivers/emc/vnx/client.py | 566 - cinder/volume/drivers/emc/vnx/common.py | 483 - cinder/volume/drivers/emc/vnx/const.py | 39 - cinder/volume/drivers/emc/vnx/driver.py | 333 - cinder/volume/drivers/emc/vnx/taskflows.py | 579 -- cinder/volume/drivers/emc/vnx/utils.py | 339 - cinder/volume/drivers/emc/xtremio.py | 1055 -- cinder/volume/drivers/eqlx.py | 731 -- cinder/volume/drivers/falconstor/fc.py | 4 +- cinder/volume/drivers/falconstor/fss_common.py | 20 +- cinder/volume/drivers/falconstor/iscsi.py | 2 +- cinder/volume/drivers/falconstor/rest_proxy.py | 31 +- cinder/volume/drivers/fujitsu/eternus_dx_fc.py | 4 +- cinder/volume/drivers/fusionstorage/dsware.py | 1254 +-- cinder/volume/drivers/glusterfs.py | 479 - cinder/volume/drivers/hitachi/hbsd_fc.py | 10 +- cinder/volume/drivers/hitachi/hbsd_horcm.py | 1 - cinder/volume/drivers/hitachi/hbsd_iscsi.py | 6 +- cinder/volume/drivers/hitachi/hnas_backend.py | 87 +- cinder/volume/drivers/hitachi/hnas_iscsi.py | 25 +- cinder/volume/drivers/hitachi/hnas_nfs.py | 351 +- cinder/volume/drivers/hitachi/hnas_utils.py | 56 +- cinder/volume/drivers/hitachi/vsp_common.py | 954 ++ cinder/volume/drivers/hitachi/vsp_fc.py | 178 + cinder/volume/drivers/hitachi/vsp_horcm.py | 1436 +++ cinder/volume/drivers/hitachi/vsp_horcm_fc.py | 189 + cinder/volume/drivers/hitachi/vsp_horcm_iscsi.py | 191 + cinder/volume/drivers/hitachi/vsp_iscsi.py | 185 + cinder/volume/drivers/hitachi/vsp_utils.py | 670 ++ cinder/volume/drivers/hpe/hpe_3par_common.py | 48 +- cinder/volume/drivers/hpe/hpe_3par_fc.py | 10 +- cinder/volume/drivers/hpe/hpe_3par_iscsi.py | 40 +- cinder/volume/drivers/hpe/hpe_lefthand_iscsi.py | 10 +- cinder/volume/drivers/hpe/hpe_xp_fc.py | 8 +- cinder/volume/drivers/huawei/constants.py | 2 +- cinder/volume/drivers/huawei/huawei_conf.py | 2 +- cinder/volume/drivers/huawei/huawei_driver.py | 254 +- cinder/volume/drivers/huawei/rest_client.py | 73 +- cinder/volume/drivers/ibm/flashsystem_common.py | 5 +- cinder/volume/drivers/ibm/flashsystem_fc.py | 6 +- cinder/volume/drivers/ibm/flashsystem_iscsi.py | 2 +- cinder/volume/drivers/ibm/gpfs.py | 11 +- cinder/volume/drivers/ibm/ibm_storage.py | 292 - cinder/volume/drivers/ibm/ibm_storage/__init__.py | 138 + .../volume/drivers/ibm/ibm_storage/certificate.py | 66 + cinder/volume/drivers/ibm/ibm_storage/cryptish.py | 27 + .../drivers/ibm/ibm_storage/ds8k_connection.py | 151 + .../volume/drivers/ibm/ibm_storage/ds8k_helper.py | 1044 ++ .../volume/drivers/ibm/ibm_storage/ds8k_proxy.py | 993 ++ .../drivers/ibm/ibm_storage/ds8k_replication.py | 577 ++ .../drivers/ibm/ibm_storage/ds8k_restclient.py | 337 + .../volume/drivers/ibm/ibm_storage/ibm_storage.py | 263 + cinder/volume/drivers/ibm/ibm_storage/proxy.py | 409 + cinder/volume/drivers/ibm/ibm_storage/strings.py | 44 + cinder/volume/drivers/ibm/ibm_storage/xiv_proxy.py | 2559 +++++ .../volume/drivers/ibm/storwize_svc/replication.py | 302 +- .../drivers/ibm/storwize_svc/storwize_const.py | 49 + .../ibm/storwize_svc/storwize_svc_common.py | 1099 +- .../drivers/ibm/storwize_svc/storwize_svc_fc.py | 11 +- .../drivers/ibm/storwize_svc/storwize_svc_iscsi.py | 202 +- cinder/volume/drivers/infinidat.py | 432 + .../drivers/infortrend/eonstor_ds_cli/__init__.py | 0 .../infortrend/eonstor_ds_cli/cli_factory.py | 737 -- .../infortrend/eonstor_ds_cli/common_cli.py | 1942 ---- .../volume/drivers/infortrend/infortrend_fc_cli.py | 7 +- .../drivers/infortrend/infortrend_iscsi_cli.py | 3 +- .../drivers/infortrend/raidcmd_cli/__init__.py | 0 .../drivers/infortrend/raidcmd_cli/cli_factory.py | 737 ++ .../drivers/infortrend/raidcmd_cli/common_cli.py | 1950 ++++ .../volume/drivers/kaminario/kaminario_common.py | 49 +- cinder/volume/drivers/kaminario/kaminario_fc.py | 4 +- cinder/volume/drivers/kaminario/kaminario_iscsi.py | 7 +- cinder/volume/drivers/lenovo/lenovo_common.py | 2 +- cinder/volume/drivers/lenovo/lenovo_fc.py | 12 +- cinder/volume/drivers/lenovo/lenovo_iscsi.py | 12 +- cinder/volume/drivers/lvm.py | 19 +- cinder/volume/drivers/nec/__init__.py | 0 cinder/volume/drivers/nec/cli.py | 781 ++ cinder/volume/drivers/nec/product.xml | 27 + cinder/volume/drivers/nec/volume.py | 76 + cinder/volume/drivers/nec/volume_common.py | 922 ++ cinder/volume/drivers/nec/volume_helper.py | 1699 +++ .../volume/drivers/netapp/dataontap/block_7mode.py | 22 +- .../volume/drivers/netapp/dataontap/block_base.py | 38 +- .../volume/drivers/netapp/dataontap/block_cmode.py | 30 +- .../netapp/dataontap/client/client_7mode.py | 16 + .../drivers/netapp/dataontap/client/client_base.py | 92 - .../netapp/dataontap/client/client_cmode.py | 163 +- cinder/volume/drivers/netapp/dataontap/fc_7mode.py | 16 +- cinder/volume/drivers/netapp/dataontap/fc_cmode.py | 16 +- .../volume/drivers/netapp/dataontap/iscsi_7mode.py | 12 +- .../volume/drivers/netapp/dataontap/iscsi_cmode.py | 12 +- .../volume/drivers/netapp/dataontap/nfs_7mode.py | 30 +- cinder/volume/drivers/netapp/dataontap/nfs_base.py | 58 +- .../volume/drivers/netapp/dataontap/nfs_cmode.py | 35 +- .../netapp/dataontap/performance/perf_base.py | 3 +- .../drivers/netapp/dataontap/utils/capabilities.py | 62 +- .../drivers/netapp/dataontap/utils/data_motion.py | 10 +- .../volume/drivers/netapp/dataontap/utils/utils.py | 45 + cinder/volume/drivers/netapp/eseries/fc_driver.py | 10 +- .../volume/drivers/netapp/eseries/host_mapper.py | 5 +- .../volume/drivers/netapp/eseries/iscsi_driver.py | 6 +- cinder/volume/drivers/netapp/eseries/library.py | 18 +- cinder/volume/drivers/nexenta/iscsi.py | 78 +- cinder/volume/drivers/nexenta/nexentaedge/iscsi.py | 4 + cinder/volume/drivers/nexenta/nexentaedge/nbd.py | 7 +- cinder/volume/drivers/nexenta/ns5/iscsi.py | 297 +- cinder/volume/drivers/nexenta/ns5/jsonrpc.py | 230 +- cinder/volume/drivers/nexenta/ns5/nfs.py | 97 +- cinder/volume/drivers/nexenta/options.py | 9 +- cinder/volume/drivers/nfs.py | 187 +- cinder/volume/drivers/nimble.py | 1721 +++- cinder/volume/drivers/prophetstor/dpl_fc.py | 4 +- cinder/volume/drivers/prophetstor/dplcommon.py | 5 +- cinder/volume/drivers/pure.py | 247 +- cinder/volume/drivers/qnap.py | 1567 +++ cinder/volume/drivers/quobyte.py | 2 +- cinder/volume/drivers/rbd.py | 532 +- cinder/volume/drivers/reduxio/__init__.py | 0 cinder/volume/drivers/reduxio/rdx_cli_api.py | 543 + cinder/volume/drivers/reduxio/rdx_iscsi_driver.py | 502 + cinder/volume/drivers/remotefs.py | 115 +- cinder/volume/drivers/san/__init__.py | 4 +- cinder/volume/drivers/san/hp/hpmsa_common.py | 2 +- cinder/volume/drivers/san/hp/hpmsa_fc.py | 12 +- cinder/volume/drivers/san/hp/hpmsa_iscsi.py | 12 +- cinder/volume/drivers/scality.py | 306 - cinder/volume/drivers/sheepdog.py | 2 +- cinder/volume/drivers/smbfs.py | 2 + cinder/volume/drivers/solidfire.py | 169 +- cinder/volume/drivers/tegile.py | 10 +- cinder/volume/drivers/tintri.py | 1 - cinder/volume/drivers/violin/v7000_fcp.py | 4 +- cinder/volume/drivers/vmware/__init__.py | 18 - cinder/volume/drivers/vmware/vmdk.py | 168 +- cinder/volume/drivers/vmware/volumeops.py | 73 +- cinder/volume/drivers/vzstorage.py | 123 +- cinder/volume/drivers/windows/remotefs.py | 55 - cinder/volume/drivers/windows/smbfs.py | 15 +- cinder/volume/drivers/xio.py | 4 +- cinder/volume/drivers/zfssa/zfssanfs.py | 23 +- cinder/volume/drivers/zte/zte_ks.py | 5 + cinder/volume/flows/api/create_volume.py | 65 +- cinder/volume/flows/api/manage_existing.py | 18 +- cinder/volume/flows/common.py | 9 +- cinder/volume/flows/manager/create_volume.py | 81 +- cinder/volume/flows/manager/manage_existing.py | 20 +- cinder/volume/group_types.py | 27 + cinder/volume/manager.py | 1600 +-- cinder/volume/rpcapi.py | 465 +- cinder/volume/targets/scst.py | 2 +- cinder/volume/targets/tgt.py | 21 +- cinder/volume/utils.py | 114 +- cinder/volume/volume_types.py | 52 +- cinder/zonemanager/__init__.py | 27 - cinder/zonemanager/drivers/__init__.py | 27 - cinder/zonemanager/drivers/brocade/__init__.py | 27 - .../drivers/brocade/brcd_http_fc_zone_client.py | 14 +- .../drivers/cisco/cisco_fc_zone_client_cli.py | 84 +- .../drivers/cisco/cisco_fc_zone_driver.py | 202 +- .../zonemanager/drivers/cisco/fc_zone_constants.py | 3 +- cinder/zonemanager/drivers/fc_zone_driver.py | 14 +- cinder/zonemanager/utils.py | 8 +- etc/cinder/policy.json | 17 +- etc/cinder/rootwrap.d/volume.filters | 32 +- .../Dell-SC-New-Extra-Specs-1de0d3f1ebc62881.yaml | 8 + ...ell-SC-Retype-Limitations-74f4b5f6a94ffe4f.yaml | 16 + ...SC-ServerOS-Config-Option-bd0e018319758e03.yaml | 2 +- .../Dell-SC-thaw_backend-b9362d381fabd4c9.yaml | 5 + ...-backup-project-attribute-3f57051ef9159b08.yaml | 3 + .../add-io-ports-option-c751d1bd395dd614.yaml | 3 + ...set-group-snapshot-status-sd21a31cde5fa035.yaml | 3 + .../add-reset-group-status-sd21a31cde5fa034.yaml | 3 + ...chastic-scheduling-option-99e10eae023fbcca.yaml | 4 +- ...ss-lvm-fd-warnings-option.402bebc03b0a9f00.yaml | 17 + .../add-vmax-replication-490202c15503ae03.yaml | 3 + ...nmanage_itri_disco_driver-1c9ee31cc86b6eda.yaml | 3 + .../apply-limits-to-qemu-img-29f722a1bf4b91f8.yaml | 7 + ...-cinder-driver-update-2.1-5c6455b45563adc5.yaml | 3 +- ...en-src-ibm-storage-driver-d17808e52aa4eacb.yaml | 16 + ...ookupservice_http_support-f6485b38a1feaa15.yaml | 2 +- .../notes/bug-1570845-efdb0206718f4ca4.yaml | 4 +- ...status-cheesecake-volumes-804dc8b0b1380e6b.yaml | 5 + ...lone-from-nfs-image-cache-2218fb402783bc20.yaml | 4 + .../notes/capacity-headroom-4b07701f1df9e5c4.yaml | 5 + ...-remove-deprecated-option-98912ab7e8b472e8.yaml | 3 + ...-online-schema-migrations-d1c0d40f26d0f033.yaml | 13 + .../cluster_job_distribution-f916dd2e4cce6c1b.yaml | 5 + .../consistency_group_manage-d30a2ad8917a7a86.yaml | 3 + .../datera-2.3-driver-update-12d0221fd4bb9fb0.yaml | 15 + .../datera-driver-v2-update-930468e8259c8e86.yaml | 8 +- .../db-schema-from-liberty-f5fa57d67441dece.yaml | 6 + .../default-apiv1-disabled-9f6bb0c67b38e670.yaml | 6 + .../notes/delete_parameters-6f44fece22a7787d.yaml | 13 + .../dell-emc-unity-driver-72cb901467b23b22.yaml | 3 + ...ecate-backends-in-default-b9784a2333fe22f2.yaml | 10 +- ...ecate-block-device-driver-d30232547a31fe1e.yaml | 6 + ...e-cinder-linux-smb-driver-4aec58f15a963c54.yaml | 6 + ...tend-volume-in-thin-pools-57a3d53be4d47704.yaml | 7 + ...ith-different-volume-type-b969897cba2610cc.yaml | 5 + .../generic-groups-in-vnx-cbbe1346e889b5c2.yaml | 3 + .../hbsd-driver-deletion-d81f7c4513f45d7b.yaml | 6 + .../notes/hitachi-vsp-driver-87659bb496bb459b.yaml | 4 + .../hitachi-vsp-iscsi-driver-cac31d7c54d7718d.yaml | 3 + .../hitachi-vsp-ports-option-7147289e6529d7fe.yaml | 16 + ...nas-change-snapshot-names-8153b043eb7e99fc.yaml | 6 + ...as-deprecate-iscsi-driver-cd521b3a2ba948f3.yaml | 10 + ...eprecated-svc-volume-type-77768f27946aadf4.yaml | 4 + .../hnas-list-manageable-9329866618fa9a9c.yaml | 4 + ...ities-report-optimization-d1c18d9f62ef71aa.yaml | 3 + ...ement-to-get-group-detail-0e8b68114e79a8a2.yaml | 5 + ...idat-add-infinibox-driver-67cc33fc3fbff1bb.yaml | 3 + ...cinder-driver-bug-1646692-7aad3b7496689aa7.yaml | 4 + ...cinder-driver-bug-1646766-fe810f5801d24f2f.yaml | 5 + ...r-remove-deprecate-option-831920f4d25e2979.yaml | 5 + ...ark-cloudbyte-unsupported-8615a127439ed262.yaml | 11 + .../mark-dothill-unsupported-7f95115b7b24e53c.yaml | 11 + .../mark-hpe-xp-unsupported-c9ce6cfbab622e46.yaml | 11 + ...k-nexentaedge-unsupported-56d184fdccc6eaac.yaml | 11 + .../mark-scality-unsupported-530370e034a6f488.yaml | 8 +- ...-to-generic-volume-groups-f82ad3658f3e567c.yaml | 5 + ...e-eqlx-driver-to-dell-emc-fe5d2b484c47b7a6.yaml | 6 + ...io-driver-to-dell-emc-dir-c195374ca6b7e98d.yaml | 5 + ...io-driver-to-dell-emc-dir-f7e07a502cafd78f.yaml | 6 + ...nec_storage_volume_driver-57663f9ecce1ae19.yaml | 3 + ...ckend-replication-support-59d7537fe3d0eb05.yaml | 2 +- ...p-deprecate-7mode-drivers-a39bfcb3afefc9a5.yaml | 6 + ..._shared_blocks_exhaustion-073a73e05daf09d4.yaml | 9 + .../new-osprofiler-call-0bb1a305c8e8f9cc.yaml | 7 + .../notes/nexenta-ns5-5d223f3b60f58aad.yaml | 3 + .../notes/nexentastor5-https-6d58004838cfab30.yaml | 4 + .../notes/nfs-snapshots-21b641300341cba1.yaml | 5 + .../nimble-add-fc-support-0007fdbd647be947.yaml | 3 + .../notes/nimble-qos-specs-8cd006777c66a64e.yaml | 5 + .../nimble-rest-api-support-75c2324ee462d026.yaml | 4 + ...rated-groups-with-cp-apis-e5835c6673191805.yaml | 29 + .../notes/os-brick-lock-dir-35bdd8ec0c0ef46d.yaml | 6 +- ...ure-generic-volume-groups-2b0941103f7c01cb.yaml | 3 + .../pure-list-mangeable-fed4a1b23212f545.yaml | 2 +- .../rbd-thin-provisioning-c98522d6fe7b71ff.yaml | 3 + .../rbd-v2.1-replication-64a9d0bec5987faf.yaml | 3 + .../rebranded-vnx-driver-2fb7424ddc9c41df.yaml | 7 + .../reduxio-iscsci-driver-5827c32a0c498949.yaml | 3 + ...actor-disco-volume-driver-3ff0145707ec0f3e.yaml | 5 + ...eprecated-driver-mappings-b927d8ef9fc3b713.yaml | 24 + ...e-eqlx-deprecated-options-89ba02c41d4da62a.yaml | 15 + .../notes/remove-scality-fa209aae9748a1f3.yaml | 5 + .../remove-single-backend-7bf02e525bbbdd3a.yaml | 5 + ...remove-volume-clear-shred-bde9f7f9ff430feb.yaml | 7 + ...e_glusterfs_volume_driver-d8fd2cf5f38e754b.yaml | 5 + ...ove_volume_tmp_dir_option-c83c5341e5a42378.yaml | 7 + .../notes/removed-isertgtadm-7ccefab5d3e89c59.yaml | 4 +- .../removing-cinder-all-9f5c3d1eb230f9e6.yaml | 4 + ...fault-volume-provisioning-c648118fcc8f297f.yaml | 2 +- .../scaleio-scaling-qos-50c58e43d4b54247.yaml | 2 +- ...thin-provisioning-support-9c3b9203567771dd.yaml | 10 +- ...how-provider-id-for-admin-ff4fd5a2518a4bfa.yaml | 3 + .../notes/slug-qnap-driver-d4465ea6009c66df.yaml | 3 + .../solidfire-scaled-qos-9b8632453909e2db.yaml | 20 + ...e_iscsi_multipath_enhance-9de9dc29661869cd.yaml | 3 + ...d-snapshot-list-filtering-6e6df68a7ce981f5.yaml | 5 + .../support-zmq-messaging-41085787156fbda1.yaml | 3 + ...unity-backup-via-snapshot-81a2d5a118c97042.yaml | 3 + ...use-castellan-key-manager-4911c3c4908ca633.yaml | 2 +- ...oslo_middleware_sizelimit-5f171cf1c44444f8.yaml | 12 +- .../vmax-attach-snapshot-3137e59ab4ff39a4.yaml | 4 + .../notes/vmax-clone-cg-09fce492931c957f.yaml | 4 + .../vmax-compression-support-1dfe463328b56d7f.yaml | 3 + .../vmax-rename-dell-emc-f9ebfb9eb567f427.yaml | 6 + .../vmax-volume-migration-992c8c68e2207bbc.yaml | 5 + ...mdk_config_conn_pool_size-0658c497e118533f.yaml | 5 + .../notes/vmware-vmdk-config-eb70892e4ccf8f3c.yaml | 4 +- .../vmware_vmdk_paravirtual-3d5eeef96dcbcfb7.yaml | 4 +- ...x-async-migration-support-3c449139bb264004.yaml | 10 + ...vnx-repv2.1-config-update-cc2f60c20aec88dd.yaml | 8 + .../xtremio-generic-groups-912e11525573e970.yaml | 3 + releasenotes/source/conf.py | 3 + releasenotes/source/index.rst | 1 + releasenotes/source/newton.rst | 6 + requirements.txt | 53 +- setup.cfg | 1 - test-requirements.txt | 19 +- tools/enable-pre-commit-hook.sh | 2 +- tools/generate_driver_list.py | 15 +- tools/hooks/README | 4 + tools/hooks/run_multi_backend_matrix.sh | 99 + tools/hooks/utils.sh | 10 + tools/install_venv.py | 73 - tools/install_venv_common.py | 172 - tools/lintstack.py | 53 +- tools/test-setup.sh | 57 + tox.ini | 9 +- 1205 files changed, 144399 insertions(+), 77223 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 64c1c3a..2fea608 100644 --- a/requirements.txt +++ b/requirements.txt @@ -5 +5 @@ -pbr>=1.6 # Apache-2.0 +pbr>=1.8 # Apache-2.0 @@ -14,5 +14,5 @@ ipaddress>=1.0.7;python_version<'3.3' # PSF -keystoneauth1>=2.10.0 # Apache-2.0 -keystonemiddleware!=4.1.0,!=4.5.0,>=4.0.0 # Apache-2.0 -lxml>=2.3 # BSD -oauth2client>=1.5.0 # Apache-2.0 -oslo.config>=3.14.0 # Apache-2.0 +keystoneauth1>=2.18.0 # Apache-2.0 +keystonemiddleware>=4.12.0 # Apache-2.0 +lxml!=3.7.0,>=2.3 # BSD +oauth2client!=4.0.0,>=1.5.0 # Apache-2.0 +oslo.config!=3.18.0,>=3.14.0 # Apache-2.0 @@ -21,3 +21,3 @@ oslo.context>=2.9.0 # Apache-2.0 -oslo.db!=4.13.1,!=4.13.2,>=4.10.0 # Apache-2.0 -oslo.log>=1.14.0 # Apache-2.0 -oslo.messaging>=5.2.0 # Apache-2.0 +oslo.db>=4.15.0 # Apache-2.0 +oslo.log>=3.11.0 # Apache-2.0 +oslo.messaging>=5.14.0 # Apache-2.0 @@ -25 +25 @@ oslo.middleware>=3.0.0 # Apache-2.0 -oslo.policy>=1.9.0 # Apache-2.0 +oslo.policy>=1.17.0 # Apache-2.0 @@ -31,2 +31,2 @@ oslo.service>=1.10.0 # Apache-2.0 -oslo.utils>=3.16.0 # Apache-2.0 -oslo.versionedobjects>=1.13.0 # Apache-2.0 +oslo.utils>=3.18.0 # Apache-2.0 +oslo.versionedobjects>=1.17.0 # Apache-2.0 @@ -36,0 +37 @@ PasteDeploy>=1.5.0 # MIT +psutil>=3.0.1 # BSD @@ -38 +39 @@ pycrypto>=2.6 # Public Domain -pyparsing>=2.0.1 # MIT +pyparsing>=2.1.0 # MIT @@ -40,4 +41,4 @@ python-barbicanclient>=4.0.0 # Apache-2.0 -python-glanceclient!=2.4.0,>=2.3.0 # Apache-2.0 -python-keystoneclient!=2.1.0,>=2.0.0 # Apache-2.0 -python-novaclient!=2.33.0,>=2.29.0 # Apache-2.0 -python-swiftclient>=2.2.0 # Apache-2.0 +python-glanceclient>=2.5.0 # Apache-2.0 +python-keystoneclient>=3.8.0 # Apache-2.0 +python-novaclient!=7.0.0,>=6.0.0 # Apache-2.0 +python-swiftclient>=3.2.0 # Apache-2.0 @@ -45 +46 @@ pytz>=2013.6 # MIT -requests>=2.10.0 # Apache-2.0 +requests!=2.12.2,>=2.10.0 # Apache-2.0 @@ -49,2 +50,2 @@ Routes!=2.0,!=2.3.0,>=1.12.3;python_version!='2.7' # MIT -taskflow>=1.26.0 # Apache-2.0 -rtslib-fb>=2.1.41 # Apache-2.0 +taskflow>=2.7.0 # Apache-2.0 +rtslib-fb!=2.1.60,!=2.1.61,>=2.1.43 # Apache-2.0 @@ -55 +56 @@ sqlalchemy-migrate>=0.9.6 # Apache-2.0 -stevedore>=1.16.0 # Apache-2.0 +stevedore>=1.17.1 # Apache-2.0 @@ -57 +58 @@ suds-jurko>=0.6 # LGPLv3+ -WebOb>=1.2.3 # MIT +WebOb>=1.6.0 # MIT @@ -59,4 +60,4 @@ oslo.i18n>=2.1.0 # Apache-2.0 -oslo.vmware>=2.11.0 # Apache-2.0 -os-brick>=1.6.1 # Apache-2.0 -os-win>=0.2.3 # Apache-2.0 -tooz>=1.28.0 # Apache-2.0 +oslo.vmware>=2.17.0 # Apache-2.0 +os-brick>=1.8.0 # Apache-2.0 +os-win>=1.4.0 # Apache-2.0 +tooz>=1.47.0 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index 7fb4e7c..45b50a6 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -6 +6 @@ -hacking<0.11,>=0.10.0 +hacking!=0.13.0,<0.14,>=0.12.0 # Apache-2.0 @@ -8,2 +8 @@ hacking<0.11,>=0.10.0 -anyjson>=0.3.3 # BSD -coverage>=3.6 # Apache-2.0 +coverage>=4.0 # Apache-2.0 @@ -13 +11,0 @@ mock>=2.0 # BSD -mox3>=0.7.0 # Apache-2.0 @@ -16 +14,3 @@ oslotest>=1.10.0 # Apache-2.0 -sphinx!=1.3b1,<1.3,>=1.2.1 # BSD +sphinx!=1.3b1,<1.4,>=1.2.1 # BSD +PyMySQL>=0.7.6 # MIT License +psycopg2>=2.5 # LGPL/ZPL @@ -22,3 +22,4 @@ testscenarios>=0.4 # Apache-2.0/BSD -oslosphinx!=3.4.0,>=2.5.0 # Apache-2.0 -os-testr>=0.7.0 # Apache-2.0 -tempest-lib>=0.14.0 # Apache-2.0 +oslosphinx>=4.7.0 # Apache-2.0 +oslo.versionedobjects[fixtures]>=1.17.0 # Apache-2.0 +os-testr>=0.8.0 # Apache-2.0 +tempest>=12.1.0 # Apache-2.0 @@ -26 +27 @@ bandit>=1.1.0 # Apache-2.0 -reno>=1.8.0 # Apache2 +reno>=1.8.0 # Apache-2.0

1 0