We exuberantly announce the release of: manila 10.0.0: Shared Storage for OpenStack This release is part of the ussuri release series. The source is available from: https://opendev.org/openstack/manila Download the package from: https://tarballs.openstack.org/manila/ Please report issues through: https://bugs.launchpad.net/manila/+bugs For more details, please see below. 10.0.0 ^^^^^^ Bug Fixes * When attempting to shrink a share to a size smaller than the current used space, the share status will remain as "available" instead of "shrinking_possible_data_loss_error". The user will receive warning message saying that the shrink operation was not completed. Changes in manila 9.0.0..10.0.0 ------------------------------- 541f9d8d [Unity] Fix unit test issue 3ea582e1 Update share-manager behavior for shrink share operation cec83f8c [CI] Fix grenade share networks test bdb955a1 [grenade][stable/ussuri only] Switch base version c5b95ef4 Update TOX_CONSTRAINTS_FILE for stable/ussuri 2b1ab19b Update .gitreview for stable/ussuri 0a499674 Drop install_command usage in tox 00e548a6 [NetApp] Fix vserver peer accept on intra cluster replication c169902d [NetApp] Fix share shrink error status 78005396 fix bug in quota checking ddb87233 [doc] Annotate max api microversion in Ussuri 4b471012 fix bug in consume from share cf83f962 [cycle-goals] Add PTL and contributor quickstart 59822398 Use unittest.mock instead of third party lib 879f2081 fix bug in tox py test c5558960 Fix invalid assert statement 93487666 VNX/PowerMax: Fix export locations 0d949ac4 [NetApp] Fix vserver peer creation with same vserver 2a4a63ef Fix docs duplicated autoclass definition 14d081ac [CI] Stop gating with manila-tempest-minimal-dsvm-lvm 63867a3b [NetApp] Improve create share from snapshot functionality 8f8ddfd6 [ZFSonLinux] Create share from snapshot in different backends 3e51ea34 Remove experimental flag from share groups feature 6c47b193 Create share from snapshot in another pool or backend 252a7e81 [Unity] Manage/unmanage share server/share/snap 2c30fed4 Remove provisioned calculation on non thin provision backends 5f80a24f Delete type access list when deleting types dceced6d Add new quota for share replicas 470bab7c Prevent share type deletion if linked to group types c0ee00f2 Increase MANILA_SERVICE_VM_FLAVOR_DISK 35e82746 Support query user message by timestamp 4d53f3ec Revert "Remove provisioned calculation on non thin provision backends" 3fdd9983 Hacking: Fix W605 27808af1 Hacking: Fix E731 3be50ced Hacking: Fix E741 8098045f Hacking: Fix E305 0c6b39d9 Hacking: Fix E117 7022c8df Hacking: Fix E226 28bb6501 Hacking: Fix E241 8730b163 Hacking: Fix F601 aac66559 Hacking: Fix F841 8c1e23c2 Hacking: Fix F632 3ac1870e Update hacking for Python3 cd9292b9 Remove provisioned calculation on non thin provision backends a4d41598 Cleanup Python 2.7 support 8c582d87 If only .pyc exist, the extension API will be disabled cb016333 [ci] Stop requiring neutron-tempest-plugin 84daeb48 Enforce policy checks for share export locations 6f79bb6c Fix URLs in code and documentation 14b75b1f [NetApp] cDOT to set valid QoS during migration 50881770 Enable the use scheduler creating share from snapshot flag 9250e02b [NetApp] Fix driver to honor standard extra specs 947315f0 share_networks: enable project_only API only 0aafb1c4 Cleanup docs building bf15efe3 Update devstack repository URL ef6b9a0c Fix database loading for some resources 8595a594 Fix release note for LP 1853940's bugfix 26645f5d Add opt doc and reno for noop interface driver be149c4c Add asynchronous error info into messages when share extend error 3e82f118 Use psycopg2-binary for test-requirements 6aec28f1 Introduce noop interface driver e7858ad0 Refactor route clearing to linux interface a8f9174c clear_outdated_routes: reduce neutron calls e8adbf3c generic: Refactor network functions to l3_init e224b83d Use StrOpt for instance type 54c5667e Improve share list speed using lazy='subquery' acfd0f33 Store ganesha logs and configs 0103c3aa [Unity]: Failed to delete cifs share if wrong access set 5c858bc5 Fix over-quota exception of snapshot creation 37a9e538 Don't send heartbeats if driver not initializing correctly 3039a30a Fix missing parameter in the log message 73b0bccd Fix a wrong comma in log message edfde7ed Add manila-specs link to readme.rst 7874ea98 fix a typo a7aa8470 Fix error that failed to get image for booting server 417071f1 Make extra_specs value as case-insensitive ddfb0798 VNX/Powermax: Make it work under python3 cb95b6f6 [ussuri][goal] Drop python2.7 support 75127d82 PowerMax and VNX Manila - Read only policy is not working correctly 572be43b [NetApp] Fix share replica failing for 'transfer in progress' error 24337fe7 Document max Train-release API version f50c5bec [Unity] Add release note and tests for IPv6 fix 4cc1ce60 Fix invalid assert statement de2d9417 Fix share network update erroneously returns success c9d8506f [Unity] Sync Unity related Docs 37575eda Enable glusterfs-native ci 75f108b0 [NetApp] Allow extension/shrinking of NetApp replicated share 1ac6f5f8 add document,source,bugs,blueprints links to readme c79edcbf update readme links 09c6e159 Imported Translations from Zanata 579487ca Update master for stable/train 700c1a02 Remove backend spec from share type while creating replica 8c7c9e40 [Infortrend] Add Infortrend Manila Doc Diffstat (except docs and test files) ------------------------------------- .gitreview | 1 + .zuul.yaml | 28 +- CONTRIBUTING.rst | 24 +- HACKING.rst | 3 +- README.rst | 25 +- api-ref/source/parameters.yaml | 20 +- api-ref/source/samples/share-create-response.json | 1 + .../samples/share-instances-list-response.json | 15 + .../samples/share-show-instance-response.json | 1 + api-ref/source/samples/share-show-response.json | 1 + .../samples/shares-list-detailed-response.json | 2 + api-ref/source/share-instances.inc | 2 + api-ref/source/shares.inc | 5 + contrib/ci/post_test_hook.sh | 1 + contrib/ci/pre_test_hook.sh | 2 + devstack/README.rst | 4 +- devstack/plugin.sh | 6 +- devstack/settings | 7 +- devstack/upgrade/resources.sh | 20 +- devstack/upgrade/settings | 8 +- .../share_back_ends_feature_support_mapping.rst | 4 +- .../configuration/shared-file-systems/drivers.rst | 3 +- .../drivers/dell-emc-unity-driver.rst | 473 ++++++++----- .../drivers/infortrend-nas-driver.rst | 85 +++ .../configuration/tables/manila-infortrend.inc | 34 + .../development-environment-devstack.rst | 14 +- .../contributor/samples/container_local.conf | 6 +- .../contributor/samples/zfsonlinux_local.conf | 6 +- lower-constraints.txt | 17 +- manila/api/common.py | 64 +- manila/api/extensions.py | 10 +- manila/api/openstack/__init__.py | 2 +- manila/api/openstack/api_version_request.py | 10 +- manila/api/openstack/rest_api_version_history.rst | 22 +- manila/api/v1/limits.py | 3 +- manila/api/v1/share_servers.py | 2 +- manila/api/v2/messages.py | 59 +- manila/api/v2/quota_sets.py | 27 +- manila/api/v2/share_export_locations.py | 5 +- manila/api/v2/share_group_snapshots.py | 99 ++- manila/api/v2/share_group_type_specs.py | 69 +- manila/api/v2/share_group_types.py | 107 ++- manila/api/v2/share_groups.py | 90 ++- manila/api/v2/share_instance_export_locations.py | 8 +- manila/api/v2/share_networks.py | 33 +- manila/api/views/limits.py | 25 +- manila/api/views/quota_class_sets.py | 6 + manila/api/views/quota_sets.py | 6 + manila/api/views/share_instance.py | 15 + manila/api/views/share_network_subnets.py | 2 +- manila/api/views/shares.py | 13 + manila/cmd/status.py | 1 + manila/common/constants.py | 4 + manila/compute/nova.py | 12 + manila/db/api.py | 17 +- .../1f0bd302c1a6_add_availability_zones_table.py | 2 +- ...547b381_add_progress_field_to_share_instance.py | 62 ++ manila/db/sqlalchemy/api.py | 270 ++++++-- manila/db/sqlalchemy/models.py | 22 +- manila/db/sqlalchemy/query.py | 1 + manila/db/sqlalchemy/utils.py | 51 ++ manila/exception.py | 17 +- manila/hacking/checks.py | 44 +- manila/manager.py | 9 + manila/message/api.py | 10 +- manila/message/message_field.py | 31 +- manila/network/linux/interface.py | 52 +- manila/network/linux/ovs_lib.py | 20 +- manila/network/neutron/neutron_network_plugin.py | 8 +- manila/quota.py | 14 +- manila/scheduler/drivers/filter.py | 27 +- manila/scheduler/evaluator/evaluator.py | 3 +- manila/scheduler/filters/create_from_snapshot.py | 71 ++ manila/scheduler/filters/extra_specs_ops.py | 5 + manila/scheduler/host_manager.py | 21 +- manila/scheduler/weighers/host_affinity.py | 65 ++ manila/service.py | 8 + manila/share/api.py | 292 +++++--- manila/share/driver.py | 125 +++- manila/share/drivers/cephfs/driver.py | 2 +- manila/share/drivers/container/storage_helper.py | 2 +- .../drivers/dell_emc/common/enas/connector.py | 4 +- .../drivers/dell_emc/common/enas/xml_api_parser.py | 2 +- manila/share/drivers/dell_emc/driver.py | 107 ++- .../dell_emc/plugins/powermax/connection.py | 21 +- .../dell_emc/plugins/powermax/object_manager.py | 26 +- .../share/drivers/dell_emc/plugins/unity/client.py | 8 +- .../drivers/dell_emc/plugins/unity/connection.py | 188 +++++- .../share/drivers/dell_emc/plugins/unity/utils.py | 37 ++ .../drivers/dell_emc/plugins/vnx/connection.py | 14 +- .../drivers/dell_emc/plugins/vnx/object_manager.py | 26 +- manila/share/drivers/ganesha/__init__.py | 2 +- manila/share/drivers/ganesha/manager.py | 18 +- manila/share/drivers/generic.py | 6 +- manila/share/drivers/glusterfs/__init__.py | 2 +- manila/share/drivers/glusterfs/common.py | 8 +- manila/share/drivers/glusterfs/glusterfs_native.py | 6 +- manila/share/drivers/glusterfs/layout.py | 2 +- manila/share/drivers/glusterfs/layout_directory.py | 2 +- manila/share/drivers/glusterfs/layout_volume.py | 14 +- manila/share/drivers/hdfs/hdfs_native.py | 2 +- manila/share/drivers/helpers.py | 2 +- manila/share/drivers/hitachi/hnas/driver.py | 14 +- manila/share/drivers/hpe/hpe_3par_driver.py | 7 +- manila/share/drivers/huawei/base.py | 2 +- manila/share/drivers/huawei/huawei_nas.py | 2 +- manila/share/drivers/huawei/v3/connection.py | 2 +- manila/share/drivers/ibm/gpfs.py | 8 +- manila/share/drivers/infinidat/infinibox.py | 2 +- manila/share/drivers/infortrend/infortrend_nas.py | 6 +- manila/share/drivers/inspur/as13000/as13000_nas.py | 2 +- manila/share/drivers/inspur/instorage/instorage.py | 2 +- manila/share/drivers/lvm.py | 8 +- manila/share/drivers/maprfs/maprfs_native.py | 2 +- .../share/drivers/netapp/dataontap/client/api.py | 1 + .../netapp/dataontap/client/client_cmode.py | 107 ++- .../netapp/dataontap/cluster_mode/data_motion.py | 11 +- .../netapp/dataontap/cluster_mode/drv_multi_svm.py | 3 + .../dataontap/cluster_mode/drv_single_svm.py | 3 + .../netapp/dataontap/cluster_mode/lib_base.py | 498 ++++++++++++-- .../netapp/dataontap/cluster_mode/lib_multi_svm.py | 60 +- manila/share/drivers/netapp/options.py | 8 +- manila/share/drivers/nexenta/ns4/nexenta_nas.py | 2 +- manila/share/drivers/nexenta/ns5/nexenta_nas.py | 2 +- manila/share/drivers/qnap/qnap.py | 2 +- manila/share/drivers/service_instance.py | 82 +-- manila/share/drivers/tegile/tegile.py | 2 +- manila/share/drivers/veritas/veritas_isa.py | 13 +- manila/share/drivers/windows/windows_smb_helper.py | 2 +- manila/share/drivers/zfsonlinux/driver.py | 37 +- manila/share/drivers/zfssa/zfssashare.py | 2 +- manila/share/manager.py | 473 +++++++++---- manila/share_group/api.py | 2 +- manila/test.py | 10 +- manila/testing/README.rst | 1 - .../api/v2/test_share_instance_export_locations.py | 3 +- .../api/v2/test_share_replica_export_locations.py | 3 +- .../api/v2/test_share_snapshot_export_locations.py | 3 +- ...est_share_snapshot_instance_export_locations.py | 3 +- .../migrations/alembic/migrations_data_checks.py | 31 +- .../network/test_standalone_network_plugin.py | 3 +- .../scheduler/filters/test_create_from_snapshot.py | 92 +++ .../scheduler/filters/test_extra_specs_ops.py | 5 + .../drivers/container/test_container_helper.py | 5 +- .../drivers/container/test_protocol_helper.py | 5 +- .../share/drivers/container/test_storage_helper.py | 6 +- .../share/drivers/dell_emc/common/enas/fakes.py | 14 +- .../drivers/dell_emc/common/enas/test_connector.py | 13 +- .../drivers/dell_emc/common/enas/test_utils.py | 5 +- .../share/drivers/dell_emc/common/enas/utils.py | 2 +- .../drivers/dell_emc/plugins/isilon/test_isilon.py | 3 +- .../dell_emc/plugins/isilon/test_isilon_api.py | 4 +- .../dell_emc/plugins/powermax/test_connection.py | 57 +- .../plugins/powermax/test_object_manager.py | 2 +- .../drivers/dell_emc/plugins/unity/__init__.py | 2 +- .../dell_emc/plugins/unity/fake_exceptions.py | 4 + .../dell_emc/plugins/unity/mocked_manila.yaml | 43 +- .../dell_emc/plugins/unity/mocked_unity.yaml | 89 +++ .../drivers/dell_emc/plugins/unity/res_mock.py | 18 +- .../drivers/dell_emc/plugins/unity/test_client.py | 10 +- .../dell_emc/plugins/unity/test_connection.py | 152 ++++- .../drivers/dell_emc/plugins/unity/test_utils.py | 49 ++ .../share/drivers/dell_emc/plugins/unity/utils.py | 3 +- .../dell_emc/plugins/vnx/test_connection.py | 55 +- .../dell_emc/plugins/vnx/test_object_manager.py | 3 +- .../drivers/glusterfs/test_glusterfs_native.py | 5 +- .../drivers/glusterfs/test_layout_directory.py | 2 +- .../share/drivers/glusterfs/test_layout_volume.py | 8 +- .../share/drivers/hitachi/hnas/test_driver.py | 3 +- .../share/drivers/hpe/test_hpe_3par_constants.py | 1 + .../share/drivers/hpe/test_hpe_3par_driver.py | 10 +- .../share/drivers/hpe/test_hpe_3par_mediator.py | 10 +- .../share/drivers/infinidat/test_infinidat.py | 13 +- .../drivers/infortrend/test_infortrend_nas.py | 4 +- .../drivers/inspur/as13000/test_as13000_nas.py | 21 +- .../drivers/inspur/instorage/test_instorage.py | 7 +- .../share/drivers/netapp/dataontap/client/fakes.py | 43 +- .../drivers/netapp/dataontap/client/test_api.py | 12 +- .../netapp/dataontap/client/test_client_base.py | 3 +- .../netapp/dataontap/client/test_client_cmode.py | 104 ++- .../dataontap/cluster_mode/test_data_motion.py | 2 +- .../cluster_mode/test_driver_interfaces.py | 3 +- .../netapp/dataontap/cluster_mode/test_lib_base.py | 732 ++++++++++++++++++++- .../dataontap/cluster_mode/test_lib_multi_svm.py | 109 ++- .../dataontap/cluster_mode/test_lib_single_svm.py | 3 +- .../dataontap/cluster_mode/test_performance.py | 3 +- .../netapp/dataontap/protocols/test_cifs_cmode.py | 2 +- .../netapp/dataontap/protocols/test_nfs_cmode.py | 2 +- .../share/drivers/nexenta/ns4/test_jsonrpc.py | 5 +- .../share/drivers/nexenta/ns4/test_nexenta_nas.py | 57 +- .../share/drivers/nexenta/ns5/test_jsonrpc.py | 2 +- .../share/drivers/nexenta/ns5/test_nexenta_nas.py | 92 +-- .../share/drivers/veritas/test_veritas_isa.py | 2 +- .../share/drivers/windows/test_service_instance.py | 2 +- .../drivers/windows/test_windows_smb_driver.py | 6 +- .../drivers/windows/test_windows_smb_helper.py | 2 +- .../share/drivers/windows/test_windows_utils.py | 3 +- .../share/drivers/windows/test_winrm_helper.py | 3 +- .../post.yaml | 13 + .../post.yaml | 13 + .../run.yaml | 2 - .../post.yaml | 15 - .../manila-tempest-minimal-dsvm-dummy-py2/run.yaml | 82 --- .../manila-tempest-minimal-dsvm-lvm/run-ipv6.yaml | 2 - .../manila-tempest-minimal-dsvm-lvm/run.yaml | 2 - .../post.yaml | 13 + ...t-another-pool-or-backend-98d61fe753b85632.yaml | 14 + ...eplicas-and-replicas-size-565ffca315afb6f0.yaml | 8 + ...user-message-by-timestamp-c0a02b3b3e337e12.yaml | 5 + ...extraspec-for-replication-d611d2227997ae3e.yaml | 8 + ...or-share-export-locations-a5cea1ec123b1469.yaml | 6 + ...-active-share-group-types-83809532d06ef0dd.yaml | 6 + ...xtend-of-replicated-share-2c9709180d954308.yaml | 4 + ...alid-qos-during-migration-4405fff02bd6fa83.yaml | 5 + ...to-honour-std-extra-specs-d32fae4e9411b503.yaml | 4 + ...nity-cannot-use-mgmt-ipv6-9407710a3fc7f4aa.yaml | 5 + ...powermax-read-only-policy-585c29c5ff020007.yaml | 6 + ...5147-vnx-read-only-policy-75b0f414ea5ef471.yaml | 6 + ...fail-to-delete-cifs-share-c502a10ae306e506.yaml | 4 + ...update-unexpected-success-eba8f40db392c467.yaml | 6 + ...lica-update-check-failure-90aa964417e7734c.yaml | 9 + ...r-when-share-extend-error-a0c458204b395994.yaml | 5 + ...eat-if-driver-not-initial-9c3cee39e8c725d1.yaml | 7 + ...etapp-fix-shrinking-error-48bcfffe694f5e81.yaml | 7 + ...shot-over-quota-exception-bb6691612af03ddf.yaml | 5 + ...-1859785-share-list-speed-6b09e7717624e037.yaml | 7 + ...x-share-network-retrieval-31768dcda5aeeaaa.yaml | 7 + ...-backref-by-eager-loading-2d897976e7598625.yaml | 5 + ...sion-API-cannot-be-loaded-172cb9153ebd4b56.yaml | 7 + ...thin-provisioned-backends-1da2cc33d365ba4f.yaml | 7 + ...oject-access-when-deleted-4fcd49ba6e6c40bd.yaml | 8 + ...ax-wrong-export-locations-e9763631c621656f.yaml | 6 + ...er-peer-with-same-vserver-8bc65816f1764784.yaml | 10 + ...872872-fix-quota-checking-b06fd372be143101.yaml | 7 + ...73-fix-consume-from-share-eea5941de17a5bcc.yaml | 8 + ...server-peer-intra-cluster-966398cf3a621edd.yaml | 10 + ...44046-fix-image-not-found-629415d50cd6042a.yaml | 7 + .../drop-python2-support-e160ff36811a5964.yaml | 6 + ...ra_specs_case_insensitive-e9d4ca10d94f2307.yaml | 4 + ...shrinking-data-loss-state-edc87ba2fd7e32d8.yaml | 7 + ...ver-noop-interface-driver-24abcf7af1e08ff9.yaml | 9 + ...uate-share-groups-feature-5f751b49ccc62969.yaml | 10 + ...rom-snapshot-another-pool-330639b57aa5f04d.yaml | 7 + ...er-share-snapshot-support-6a0bbbed74da13c7.yaml | 4 + ...-snapshot-another-backend-44296f572681be35.yaml | 7 + releasenotes/source/index.rst | 1 + .../source/locale/de/LC_MESSAGES/releasenotes.po | 132 ++++ releasenotes/source/train.rst | 6 + requirements.txt | 9 +- setup.cfg | 8 +- setup.py | 8 - test-requirements.txt | 7 +- tools/check_logging.sh | 6 +- tools/install_venv.py | 1 + tox.ini | 64 +- 407 files changed, 8986 insertions(+), 2691 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 60e5007c..1d393ab2 100644 --- a/requirements.txt +++ b/requirements.txt @@ -10 +10 @@ Babel!=2.4.0,>=2.3.4 # BSD -eventlet!=0.18.3,!=0.20.1,>=0.18.2 # MIT +eventlet>=0.22.0,!=0.23.0,!=0.25.0 # MIT @@ -12 +11,0 @@ greenlet>=0.4.10 # MIT -ipaddress>=1.0.17;python_version<'3.3' # PSF @@ -20 +19 @@ oslo.log>=3.36.0 # Apache-2.0 -oslo.messaging>=5.29.0 # Apache-2.0 +oslo.messaging>=6.4.0 # Apache-2.0 @@ -26 +25 @@ oslo.serialization!=2.19.1,>=2.18.0 # Apache-2.0 -oslo.service!=1.28.1,>=1.24.0 # Apache-2.0 +oslo.service>=2.1.1 # Apache-2.0 @@ -28 +27 @@ oslo.upgradecheck>=0.1.0 # Apache-2.0 -oslo.utils>=3.33.0 # Apache-2.0 +oslo.utils>=3.40.2 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index 3737aa35..b3de8f18 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -6 +6 @@ -hacking!=0.13.0,<0.14,>=0.12.0 # Apache-2.0 +hacking>=3.0,<3.1.0 # Apache-2.0 @@ -12 +11,0 @@ fixtures>=3.0.0 # Apache-2.0/BSD -mock>=2.0.0 # BSD @@ -16 +15 @@ oslotest>=3.2.0 # Apache-2.0 -# Do not remove 'PyMySQL' and 'psycopg2' dependencies. They are used +# Do not remove 'PyMySQL' and 'psycopg2-binary' dependencies. They are used @@ -20 +19 @@ PyMySQL>=0.7.6 # MIT License -psycopg2>=2.6.2 # LGPL/ZPL +psycopg2-binary>=2.8.5 # LGPL/ZPL