We enthusiastically announce the release of: manila 11.0.0: Shared Storage for OpenStack This release is part of the victoria release series. The source is available from: https://opendev.org/openstack/manila Download the package from: https://tarballs.openstack.org/manila/ Please report issues through: https://bugs.launchpad.net/manila/+bugs For more details, please see below. Changes in manila 10.0.0.0rc1..11.0.0 ------------------------------------- c4617f4f [DOC] Add admin and user documentation for share revert to snapshot 39b6a89b [NetApp] Improve Adaptive QoS functionality 295adb71 Documentation for Share Migration Ocata Improvements. ecf43830 Remove unused "_migrate" API method e30c8deb requirements: Drop os-testr bf058a04 [NetApp] Fix issues with share server migration 346cebcb Follow up change for share server migration b1c7c8d6 [NetApp] Fix python-manila package version c3aed22f [NetApp] Fix CIFS promote back issue 05d696c4 Update share replicas api-ref a5112a3f Update api-ref for share groups graduation 40b12b23 Fix manage share server for container in Focal 413e5e6d Fix manila OverQuota issue while managing shares 22d6fe98 Fix capacity calculations in the CephFS driver fec7643a Improve migration_get_progress error handling 12e9c358 Remove install unnecessary packages 2f098160 [NetApp] Adding support for Adaptive QoS in NetApp driver with dhss false. 4bcf21ea [NetApp] Add support for share server migration 370b15b6 Modify share groups w/ manila-manage's update-host ea7e304e [Container driver] Adds share and share server migration 78ca06d6 [NetApp] Enables configuring NFS transfer limits 41b0b95e [Glusterfs] Fix delete share, Couldn't find the 'gluster_used_vols' eb3c897c Add share server migration for Dummy driver 56a6b39a Improve IPv6 documentation for access rules 39efc2bd Add share server migration e0f51934 Update user doc index ffd3f1e7 [goal] Migrate tox based testing to ubuntu focal 25f51564 Update share replica show docstrings bce5429d Update "Create and manage shares" doc aecefee0 Handle oslo.messaging ping endpoint 9d44ba0b [Glusterfs] Fix delete share, mount point not disconnected 090d903b Fix WsgiLimiterProxy check ee5ebc84 Graduate share replication feature 85527715 PowerMax Manila - Version increment for Victoria 36a7ec42 Fix documentation for types and extra specs dd770bd2 DOC: Update admin generic driver network-options immutable a9ce0520 Add the share-type for the server setup metadata 6b8f416e Update docs for create share from snapshot in another back end e2e764d9 Update access rules documentation for user guide c650b63d Updates the API reference for some share operations c1912b70 Add mod_wsgi configuration samples 7a141497 Add uWSGI configuration samples 53f756d0 Fix wrong capacity in pool_stat for DellEMC manila drivers. 271214a0 Update Share types api-ref de62a36e Add api-ref for share network subnets fba472e3 Move hacking checks to tests dir 34982a5f [ci] Replace experimental tripleo job db3f3b5c [victoria][goal] Native Zuulv3 CI jobs e57809fd Harden LVM driver deletion paths 660355eb Zuulv3 native grenade job 770e57ff [ci] Remove explicit compression of log files a3987432 Fix fallback share group snapshot implementation 8cccb73f Add verify-noapi testcase to grenade c94e1def Update LVM volume extend 391ec7df Update NFS helper restart ccc4db69 Use assertEqual instead of assertItemsEqual 3fc96e3a [ci] Re-enable scenario tests for lvm job 3057d064 [NetApp] update set_preferred_dc for ontapi 1.150 99063598 Add plugin name to devstack/settings 365cfa35 add share server update to manila-manage share update_host b166aa56 [ci] Temporarily disable scenario tests aa31a230 Add upgrade documentation f877deed Enforce policy checks getting share-type by name 2d7c4644 Enable cephfs snapshots 03cb8a39 TrivialFix: Correct cephfs support release note 524ad986 Add Ceph support statement 16603855 [api-ref] fix typo 1982b90c Fix NFS/CIFS share creation failure issue 23a8fe86 Make test-setup.sh compatible with mysql8 29622725 [NetApp] Fix HTTPS connection for python 3.7 34978c62 [api-ref] Fix HTTP method on the manage API c8a8494c add manila-manage service cleanup a0dd86a9 [NetApp] Updating the release note for bugfix 1688620 fbcabd2c Fix uwsgi path location 6f58af1a [NetApp] Fix svm scoped account 6462e9a1 Use unittest.mock instead of mock fee462c2 Update admin guide for share network subnets change 9ee74826 Add user guide for share network subnets 7bc4886a Add documentation for share replica quotas 32f1c410 Make volume mount path configurable for ContainerShareDriver 853d4fbc Add user message when share shrinking fails at the driver 2c9fbc75 CIFS extension failing because of volume in use 341b5777 [devstack] Allow cephfs daemon port access dbe34c08 [NetApp] Fix default ipspace deletion issue dd60dbd8 [Unity] Update release note for filter function a386ae30 Remove unused ManilaNode sqlalchemy model 47b90fa8 [Unity]: Failed to enabled ACE for share d5fc7d28 Get ports filtered by subnet id on share-server cleanup 9296424e Switch to newer openstackdocstheme and reno versions 4a0ae205 Fix hacking min version to 3.0.1 9fbde738 Fix pep8 issues da1eb8e2 [NetApp] add max_over_subscription_ratio to pool stats 7e6a7606 TrivialFix: Remove unnecessary future imports 47c8debf [devstack][ci] Set public network ID in tempest.conf 3b509399 [ci][devstack] Install bridge-utils for Container driver 5e9f694a Monkey patch original current_thread _active 0ee41408 [NetApp] Fix falsely report migration cancelation success 2277c20c [devstack][ci] Move bgp setup to plugin 5998d04e [devstack][ci] Fix floatingip allocation a5adb0bd [Unity] Implements default filter function a9032826 [Unity] Fix unit test issue 36b1715e [devstack][ci] Modify firewall in ds-plugin a6712795 [CI] Remove unused jobs ffb283a0 [devstack][ci] Stop requiring g-reg service 45b64631 [doc] Fix tempest doc a47530ce Remove translation sections from setup.cfg 458f307d Remove Babel requirement 52cbbcb0 [grenade] Switch base version e0da21fe [CI] Fix grenade share networks test 72a8d199 Trivial fix: Add spec website link to contributor doc 3d122fa6 Add py38 package metadata f6bc6786 Add Python3 victoria unit tests 3b11a3b0 Update master for stable/ussuri 7aeed39b Update share-manager behavior for shrink share operation Diffstat (except docs and test files) ------------------------------------- .zuul.yaml | 404 ------ .../share-network-span-multiple-subnets-note.rst | 6 + api-ref/source/conf.py | 8 +- api-ref/source/index.rst | 9 +- api-ref/source/limits.inc | 14 +- api-ref/source/parameters.yaml | 437 +++++- api-ref/source/quota-classes.inc | 11 + api-ref/source/quota-sets.inc | 17 + api-ref/source/samples/limits-response.json | 6 +- .../samples/quota-classes-show-response.json | 4 +- .../samples/quota-classes-update-response.json | 4 +- .../source/samples/quota-show-detail-response.json | 8 +- api-ref/source/samples/quota-show-response.json | 4 +- api-ref/source/samples/quota-update-request.json | 3 +- api-ref/source/samples/quota-update-response.json | 4 +- api-ref/source/samples/share-manage-response.json | 1 + .../samples/share-migration-cancel-request.json | 7 + .../samples/share-migration-complete-request.json | 6 + .../share-migration-get-process-request.json | 6 + .../share-migration-get-process-response.json | 4 + .../samples/share-migration-start-request.json | 14 + ...add-security-service-response-with-subnets.json | 26 + .../samples/share-network-create-request.json | 3 +- ...share-network-create-response-with-subnets.json | 26 + ...ove-security-service-response-with-subnets.json | 26 + .../share-network-show-response-with-subnets.json | 25 + .../share-network-subnet-create-request.json | 7 + .../share-network-subnet-create-response.json | 18 + .../share-network-subnet-list-response.json | 36 + .../share-network-subnet-show-response.json | 18 + ...share-network-update-response-with-subnets.json | 26 + ...tworks-list-detailed-response-with-subnets.json | 66 + .../samples/share-replica-create-request.json | 3 +- .../samples/share-server-manage-request.json | 1 + .../samples/share-server-manage-response.json | 1 + .../source/samples/share-server-show-response.json | 1 + .../samples/share-servers-list-response.json | 1 + api-ref/source/samples/share-show-response.json | 1 + api-ref/source/samples/share-update-response.json | 3 +- .../samples/shares-list-detailed-response.json | 2 + api-ref/source/share-group-snapshots.inc | 3 +- api-ref/source/share-group-types.inc | 3 +- api-ref/source/share-groups.inc | 4 +- api-ref/source/share-migration.inc | 197 ++- api-ref/source/share-network-subnets.inc | 264 ++++ api-ref/source/share-networks.inc | 71 +- api-ref/source/share-replicas.inc | 8 + api-ref/source/share-servers.inc | 5 + api-ref/source/share-types.inc | 28 +- api-ref/source/shares.inc | 7 +- babel.cfg | 2 - contrib/ci/common.sh | 119 -- contrib/ci/post_test_hook.sh | 210 +-- contrib/ci/pre_test_hook.sh | 115 +- .../zaqar_notification_example_consumer.py | 2 - devstack/plugin.sh | 83 +- devstack/settings | 7 + devstack/upgrade/resources.sh | 67 +- devstack/upgrade/settings | 18 +- .../admin/group_capabilities_and_extra_specs.rst | 58 +- .../share_back_ends_feature_support_mapping.rst | 128 +- ...ared-file-systems-manage-and-unmanage-share.rst | 6 + .../admin/shared-file-systems-share-networks.rst | 157 ++- .../shared-file-systems-share-replication.rst | 23 +- .../admin/shared-file-systems-share-resize.rst | 8 + ...hared-file-systems-share-revert-to-snapshot.rst | 39 + ...shared-file-systems-share-server-management.rst | 11 + .../admin/shared-file-systems-share-types.rst | 276 ++-- .../drivers/cephfs-native-driver.rst | 8 +- .../drivers/dell-emc-unity-driver.rst | 25 + .../configuration/shared-file-systems/overview.rst | 4 + .../development-environment-devstack.rst | 2 +- .../contributor/samples/container_local.conf | 3 + .../contributor/samples/zfsonlinux_local.conf | 3 + .../user/share-network-subnet-operations.rst | 128 ++ httpd/manila-uwsgi.ini | 18 + httpd/mod_wsgi-manila.conf | 16 + httpd/uwsgi-manila.conf | 3 + lower-constraints.txt | 26 +- manila/api/openstack/api_version_request.py | 10 +- manila/api/openstack/rest_api_version_history.rst | 9 + manila/api/openstack/wsgi.py | 1 + manila/api/v1/limits.py | 3 +- manila/api/v1/scheduler_stats.py | 4 +- manila/api/v1/share_types_extra_specs.py | 2 +- manila/api/v1/shares.py | 6 +- manila/api/v2/messages.py | 2 +- manila/api/v2/share_export_locations.py | 4 +- manila/api/v2/share_group_snapshots.py | 18 +- manila/api/v2/share_group_type_specs.py | 10 +- manila/api/v2/share_group_types.py | 16 +- manila/api/v2/share_groups.py | 16 +- manila/api/v2/share_instances.py | 2 +- manila/api/v2/share_replica_export_locations.py | 31 +- manila/api/v2/share_replicas.py | 123 +- manila/api/v2/share_servers.py | 196 ++- manila/api/v2/share_snapshots.py | 4 +- manila/api/v2/share_types.py | 2 +- manila/api/v2/shares.py | 14 +- manila/api/versions.py | 2 +- manila/api/views/share_server_migration.py | 78 ++ manila/api/views/share_servers.py | 10 +- manila/cmd/api.py | 6 + manila/cmd/data.py | 6 + manila/cmd/manage.py | 32 +- manila/cmd/scheduler.py | 6 + manila/cmd/share.py | 6 + manila/common/constants.py | 36 +- manila/db/api.py | 56 +- manila/db/migrations/alembic/env.py | 2 - ...e673d_add_task_state_field_for_share_servers.py | 64 + manila/db/sqlalchemy/api.py | 271 +++- manila/db/sqlalchemy/models.py | 27 +- manila/exception.py | 14 +- manila/image/__init__.py | 33 + manila/image/glance.py | 71 + manila/message/message_field.py | 18 +- manila/network/linux/ip_lib.py | 2 +- manila/opts.py | 6 + manila/policies/share_server.py | 62 + manila/quota.py | 8 +- manila/share/api.py | 440 +++++- manila/share/driver.py | 303 +++++ manila/share/drivers/cephfs/driver.py | 13 +- manila/share/drivers/container/container_helper.py | 6 +- manila/share/drivers/container/driver.py | 186 ++- manila/share/drivers/container/storage_helper.py | 187 ++- manila/share/drivers/dell_emc/common/enas/utils.py | 9 + manila/share/drivers/dell_emc/driver.py | 5 + .../dell_emc/plugins/powermax/connection.py | 8 +- .../share/drivers/dell_emc/plugins/unity/client.py | 10 +- .../drivers/dell_emc/plugins/unity/connection.py | 24 +- .../drivers/dell_emc/plugins/vnx/connection.py | 5 +- manila/share/drivers/ganesha/manager.py | 16 +- manila/share/drivers/glusterfs/layout_volume.py | 5 + manila/share/drivers/helpers.py | 45 +- manila/share/drivers/lvm.py | 19 +- .../share/drivers/netapp/dataontap/client/api.py | 54 +- .../drivers/netapp/dataontap/client/client_base.py | 4 +- .../netapp/dataontap/client/client_cmode.py | 923 +++++++++++-- .../netapp/dataontap/cluster_mode/data_motion.py | 454 +++++-- .../netapp/dataontap/cluster_mode/drv_multi_svm.py | 50 + .../dataontap/cluster_mode/drv_single_svm.py | 36 + .../netapp/dataontap/cluster_mode/lib_base.py | 234 +++- .../netapp/dataontap/cluster_mode/lib_multi_svm.py | 837 +++++++++++- .../drivers/netapp/dataontap/protocols/base.py | 4 + .../netapp/dataontap/protocols/cifs_cmode.py | 20 +- .../netapp/dataontap/protocols/nfs_cmode.py | 10 +- manila/share/drivers/netapp/options.py | 39 +- manila/share/drivers/netapp/utils.py | 2 +- manila/share/drivers/service_instance.py | 29 +- manila/share/manager.py | 989 ++++++++++++-- manila/share/migration.py | 60 +- manila/share/rpcapi.py | 76 +- .../api/v2/test_share_replica_export_locations.py | 17 +- .../migrations/alembic/migrations_data_checks.py | 28 + .../drivers/container/test_container_helper.py | 1 + .../share/drivers/container/test_storage_helper.py | 123 ++ .../drivers/dell_emc/common/enas/test_utils.py | 16 + .../dell_emc/plugins/powermax/test_connection.py | 9 +- .../drivers/dell_emc/plugins/unity/res_mock.py | 1 + .../dell_emc/plugins/unity/test_connection.py | 35 +- .../dell_emc/plugins/vnx/test_connection.py | 9 +- .../share/drivers/glusterfs/test_layout_volume.py | 8 +- .../share/drivers/netapp/dataontap/client/fakes.py | 148 +- .../drivers/netapp/dataontap/client/test_api.py | 47 +- .../netapp/dataontap/client/test_client_cmode.py | 848 +++++++++++- .../dataontap/cluster_mode/test_data_motion.py | 543 +++++++- .../netapp/dataontap/cluster_mode/test_lib_base.py | 370 ++++- .../dataontap/cluster_mode/test_lib_multi_svm.py | 1428 +++++++++++++++++++- .../dataontap/cluster_mode/test_performance.py | 5 +- .../netapp/dataontap/protocols/test_cifs_cmode.py | 32 +- playbooks/legacy/grenade-dsvm-manila/post.yaml | 15 - playbooks/legacy/grenade-dsvm-manila/run.yaml | 70 - .../post.yaml | 15 - .../run.yaml | 107 -- .../post.yaml | 15 - .../run.yaml | 94 -- .../post.yaml | 15 - .../run.yaml | 107 -- .../post.yaml | 15 - .../run.yaml | 83 -- .../manila-tempest-dsvm-glusterfs-native/post.yaml | 15 - .../manila-tempest-dsvm-glusterfs-native/run.yaml | 83 -- .../post.yaml | 15 - .../run.yaml | 84 -- .../manila-tempest-dsvm-glusterfs-nfs/post.yaml | 15 - .../manila-tempest-dsvm-glusterfs-nfs/run.yaml | 83 -- .../legacy/manila-tempest-dsvm-hdfs/post.yaml | 15 - playbooks/legacy/manila-tempest-dsvm-hdfs/run.yaml | 74 - .../manila-tempest-dsvm-mysql-generic/post.yaml | 15 - .../manila-tempest-dsvm-mysql-generic/run.yaml | 92 -- .../post.yaml | 15 - .../run.yaml | 92 -- .../post.yaml | 15 - .../run.yaml | 92 -- .../post.yaml | 15 - .../run.yaml | 92 -- .../legacy/manila-tempest-dsvm-scenario/post.yaml | 15 - .../legacy/manila-tempest-dsvm-scenario/run.yaml | 92 -- .../post.yaml | 15 - .../run.yaml | 132 -- .../post.yaml | 15 - .../run.yaml | 100 -- .../post.yaml | 28 - .../run.yaml | 132 -- .../post.yaml | 28 - .../run.yaml | 117 -- .../manila-tempest-minimal-dsvm-dummy/post.yaml | 15 - .../manila-tempest-minimal-dsvm-dummy/run.yaml | 84 -- .../manila-tempest-minimal-dsvm-lvm/post.yaml | 15 - .../manila-tempest-minimal-dsvm-lvm/run-ipv6.yaml | 110 -- .../manila-tempest-minimal-dsvm-lvm/run.yaml | 105 -- .../post.yaml | 15 - .../run.yaml | 109 -- .../post.yaml | 28 - .../run.yaml | 109 -- ...ice-image-retrieval-issue-bf7ae3e5aa9446e9.yaml | 21 + ...nity-fix-ace-enable-error-b00281bb306d176b.yaml | 7 + ...dd-share-server-migration-51deb30212859277.yaml | 26 + ...app-migration-cancelation-fb913131eb8eb82a.yaml | 20 + ...-because-of-volume-in-use-3fea31c4a58e2f1b.yaml | 4 + ...sage-when-shrinking-fails-83d0f60ead6f4a4b.yaml | 5 + ...ix-manage-overquota-issue-37031a593b66f8ba.yaml | 10 + ...-1878993-netapp-fix-https-3eddf9eb5b762f3a.yaml | 6 + ...x-cifs-promote-back-issue-d8fe28466f9dde49.yaml | 7 + ...-1879754-teardown-network-d1887cdf6eb83388.yaml | 5 + ...ot-delete-default-ipspace-aee638279e0f8e93.yaml | 9 + ...-manage-update-host-fixes-bbbc4fe2da48cae9.yaml | 5 + ...la-manage-service-cleanup-37019840f01bfa2f.yaml | 10 + ...590-fix-svm-scoped-netapp-85b53830135f7558.yaml | 6 + ...etting-share-type-by-name-5eca17b02bea5261.yaml | 8 + ...0-Glusterfs-fix-del-share-89dabc8751ed4fec.yaml | 6 + ...p-fix-python-package-name-0f3ec3f2deec8887.yaml | 8 + ...dd-cifs-dc-add-skip-check-c8ea9b952cedb643.yaml | 7 + ...up-snapshot-create-delete-0595f9d7a4c0c343.yaml | 6 + ...8915-harden-lvm-deletions-2a735ab0ee4a4903.yaml | 6 + ...gration-get-progress-race-15aea537efec6daf.yaml | 7 + ...incorrect-capacity-report-3a9bdaffcc62ec71.yaml | 22 + ...2-fix-Glusterfs-del-share-3c8467e1d9f0c6e4.yaml | 7 + ...ner-fix-search-veth-regex-7f2156a6fd411bdb.yaml | 8 + .../cephfs-snapshots-enabled-4886147664270c32.yaml | 14 + ...t-for-victoria-and-beyond-e94baa7857b1624c.yaml | 10 + ...dd-share-server-migration-1f4509ade926aec6.yaml | 7 + ...shrinking-data-loss-state-edc87ba2fd7e32d8.yaml | 7 + ...share-replication-feature-17aec111b6c5bf0f.yaml | 9 + .../notes/mount-volume-path-ff3c3f83039e1a3f.yaml | 6 + ...dd-share-server-migration-663f7ced1ef93558.yaml | 19 + ...-support-for-adaptive-qos-d036238e7f29cf75.yaml | 18 + ...cription-ratio-pool-stats-eea763b3b9b3ba7d.yaml | 6 + ...t-multi-svm-configure-nfs-95c9154e1aa28751.yaml | 12 + ...t-filter-function-support-2eefc8044a5add5d.yaml | 13 + ...llemc-fix-capacity-report-25f75a6c96e12b40.yaml | 10 + releasenotes/source/conf.py | 8 +- releasenotes/source/index.rst | 1 + releasenotes/source/ussuri.rst | 6 + requirements.txt | 10 +- setup.cfg | 15 +- test-requirements.txt | 6 +- tools/check_exec.py | 2 +- tools/install_venv_common.py | 2 - tools/test-setup.sh | 4 +- tox.ini | 3 +- zuul.d/grenade-jobs.yaml | 91 ++ zuul.d/project.yaml | 91 ++ 318 files changed, 18175 insertions(+), 5974 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 1d393ab2..18943aa2 100644 --- a/requirements.txt +++ b/requirements.txt @@ -9 +8,0 @@ alembic>=0.8.10 # MIT -Babel!=2.4.0,>=2.3.4 # BSD @@ -11,2 +10,2 @@ eventlet>=0.22.0,!=0.23.0,!=0.25.0 # MIT -greenlet>=0.4.10 # MIT -lxml!=3.7.0,>=3.4.1 # BSD +greenlet>=0.4.15 # MIT +lxml>=4.5.0 # BSD @@ -16 +15 @@ oslo.context>=2.19.2 # Apache-2.0 -oslo.db>=4.27.0 # Apache-2.0 +oslo.db>=5.1.1 # Apache-2.0 @@ -29 +28 @@ oslo.concurrency>=3.26.0 # Apache-2.0 -paramiko>=2.0.0 # LGPLv2.1+ +paramiko>=2.7.1 # LGPLv2.1+ @@ -44,0 +44 @@ python-novaclient>=9.1.0 # Apache-2.0 +python-glanceclient>=2.15.0 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index b3de8f18..aa31ff60 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -6 +6 @@ -hacking>=3.0,<3.1.0 # Apache-2.0 +hacking>=3.0.1,<3.1.0 # Apache-2.0 @@ -18 +18 @@ oslotest>=3.2.0 # Apache-2.0 -PyMySQL>=0.7.6 # MIT License +PyMySQL>=0.8.0 # MIT License @@ -23 +23 @@ os-api-ref>=1.4.0 # Apache-2.0 -os-testr>=1.0.0 # Apache-2.0 +stestr>=2.0.0 # Apache-2.0