We are jazzed to announce the release of: manila 13.0.0: Shared Storage for OpenStack This release is part of the xena release series. The source is available from: https://opendev.org/openstack/manila Download the package from: https://tarballs.openstack.org/manila/ Please report issues through: https://bugs.launchpad.net/manila/+bugs For more details, please see below. Changes in manila 12.0.0..13.0.0 -------------------------------- 1991dc75 [doc] Add Xena max api version annotation de72cd47 Optimize the query logic for share network list 9f3c566a [NetApp] Add FlexGroup volume support 04a3db2f Share server migration enhancements 74d5a1b2 [NetApp] Share server migration through SVM migrate 7e7ec733 Add Share Affinity/Anti-Affinity Scheduler Filters 556c3615 [NetApp] Add readable replication type support 903aab19 Replace retrying with tenacity b5bc9bd9 [Optimise] Use ThredGroup to manage periodic tasks 58031e36 [NetApp] Fix list of mandatory services for CIFS share creation fb221d05 [doc] add since and before parameter to message-list cli a745e9c7 [NetApp] Fixed scoped account replica delete 6ca10003 Add config option reserved_share_from_snapshot_percentage. cdbc428b Extend share will go through scheduler 3f97376c Add missing [oslo_reports] options c1eaf108 Add missing oslo.service options 5bd44e0b Change cifs value from string to list for Dell manila drivers 7f35a177 Use oslo-config-generator conf to load options from libraries 68e37835 handle replica state on migration complete e6e4ac26 [Pure Storage] Honour the share_name_template parameter 18668d24 Early validate for CIFS without security service. 76cfc940 Migrate all quota parameters to [quota] section. c409caae Use tox 3.1.1 fixes e032c13b Add generic fuzzy matching logic to the database layer 46f47a3f tests: Remove use of 'oslo_db.sqlalchemy.test_base' bf2c40e3 Update api-ref documentation 87382e14 Replace deprecated scheduler filter module name 727da0ff Use List for allowed_origin 40ed0dd1 Add Pure Storage FlashBlade to Manila Admin docs cf4af616 Deprecate create snapshot from share group in CephFS c03f96ff Replace deprecated import of ABCs from collections 657fa5b1 Add missing share-type user message 8ee8ee15 Replace assertDictMatch with assertDictEqual method in tests e5d0c0e7 Pass sync_backref=False to relationship call 52f2ebe6 Replace oslo_utils.fnmatch with fnmatch 1161a56a Fix ipaddress issues in the infinidat driver daf7b3aa Adds a clear error message to operator-set limits 854b1dc9 TrivialFix: Fix the filter name in config helper 9eb37eca Add Pure Storage FlashBlade driver 3ed02db0 Add Ceph version check 04e06968 Handle service client authorization errors a4765cff Remove duplicate line in release note 4fbacf1d Filter shares by share type "extra_specs" 205f3d82 fixes availability zone filter when creating a share from snapshot 0339802a init_host should be called before RPC consumer is created 4bfea794 Fix PDF build 9974f047 Changed minversion in tox to 3.18.0 fac7fc52 Remove references to sys.version_info 865aac4a Update IRC references df3382d9 Add documentation for per share gigabytes quotas 3b6ea369 [devstack] Drop manila-tempest-plugin installation 6ace54c2 Fix with_entities usage in db queries 95d60c0d Fix API reference of share snapshot creation cadfe04b Replace deprecated SQLAlchemy "with_lockmode" be298058 Fix api error message for snapshot creation failure 6185e660 Drop support for SQLite < 3.7 2cdcc5cf optimize share size check 992ec825 Updates CephFS drivers docs 63e25524 [Glusterfs] Fix create share from snapshot failed 59842d6a setup.cfg: Replace dashes with underscores 5af3b8e6 Remove deprecated config and auth 5ba3117f Don't run periodic_share_replica_update() on active replicas 29a943fd Reuse _set_instances_share_data for replicas. 3ea5d50a Direct mgr commands to the mgr daemon 05256bef Add documentation for share server limits 290de55a PowerMax Manila - version change for Wallaby dede92d7 Document policy rule using the description parameter 41192047 [doc] Annotate max api microversion in Wallaby f5fae7df Add Python3 xena unit tests 1522add3 Update master for stable/wallaby 256c18d6 Add api reference for share server migration d9d9fbcd [doc] clean up compute client options Diffstat (except docs and test files) ------------------------------------- api-ref/source/index.rst | 1 + api-ref/source/parameters.yaml | 218 ++- api-ref/source/quota-classes.inc | 5 + api-ref/source/quota-sets.inc | 9 + .../samples/quota-classes-show-response.json | 3 +- .../samples/quota-classes-update-response.json | 3 +- .../source/samples/quota-show-detail-response.json | 6 +- api-ref/source/samples/quota-show-response.json | 3 +- api-ref/source/samples/quota-update-request.json | 3 +- api-ref/source/samples/quota-update-response.json | 3 +- .../samples/share-actions-extend-request.json | 3 +- api-ref/source/samples/share-create-request.json | 4 + .../share-server-migration-cancel-request.json | 3 + ...rver-migration-check-compatibility-request.json | 9 + ...ver-migration-check-compatibility-response.json | 18 + .../share-server-migration-complete-request.json | 3 + .../share-server-migration-complete-response.json | 3 + ...hare-server-migration-get-progress-request.json | 3 + ...are-server-migration-get-progress-response.json | 5 + .../share-server-migration-start-request.json | 9 + api-ref/source/share-actions.inc | 1 + api-ref/source/share-server-migration.inc | 289 +++ api-ref/source/share-types.inc | 50 +- api-ref/source/shares.inc | 1 + api-ref/source/snapshots.inc | 2 +- api-ref/source/user-messages.inc | 6 + contrib/ci/pre_test_hook.sh | 2 - devstack/plugin.sh | 20 - devstack/settings | 2 +- .../share_back_ends_feature_support_mapping.rst | 8 + ...ared-file-systems-manage-and-unmanage-share.rst | 2 + ...shared-file-systems-share-server-management.rst | 22 + .../configuration/shared-file-systems/drivers.rst | 1 + .../drivers/purestorage-flashblade-driver.rst | 123 ++ .../configuration/shared-file-systems/overview.rst | 2 + .../shared-file-systems/samples/sample_policy.rst | 11 +- .../tables/manila-purestorage-flashblade.inc | 18 + etc/oslo-config-generator/manila.conf | 13 +- lower-constraints.txt | 4 +- manila/api/auth.py | 37 - manila/api/openstack/api_version_request.py | 3 +- manila/api/openstack/rest_api_version_history.rst | 14 +- manila/api/v1/share_snapshots.py | 25 +- manila/api/v1/shares.py | 54 +- manila/api/v2/share_networks.py | 62 +- manila/api/v2/share_servers.py | 3 + manila/api/v2/shares.py | 24 +- manila/common/client_auth.py | 5 +- manila/common/config.py | 11 - manila/compute/nova.py | 25 +- manila/data/helper.py | 10 +- manila/data/manager.py | 1 - manila/data/utils.py | 2 +- manila/db/api.py | 38 +- manila/db/sqlalchemy/api.py | 227 ++- manila/db/sqlalchemy/models.py | 2 + ...dd-explicit-error-message-c33c7b75a7e49257.yaml | 7 + manila/exception.py | 11 +- manila/image/glance.py | 5 +- manila/manager.py | 14 +- manila/message/message_field.py | 12 + manila/network/__init__.py | 1 - manila/network/neutron/api.py | 23 +- manila/network/neutron/neutron_network_plugin.py | 11 +- manila/network/standalone_network_plugin.py | 18 +- manila/opts.py | 18 +- manila/policies/base.py | 32 +- manila/policies/shares.py | 11 + manila/quota.py | 109 +- ...y-services-for-cifs-share-0c524831e8fc6175.yaml | 6 + manila/scheduler/drivers/filter.py | 51 +- manila/scheduler/filters/affinity.py | 121 ++ manila/scheduler/filters/capacity.py | 6 +- manila/scheduler/host_manager.py | 19 +- manila/scheduler/manager.py | 36 +- manila/scheduler/rpcapi.py | 17 +- manila/scheduler/utils.py | 2 + manila/scheduler/weighers/capacity.py | 6 +- manila/service.py | 38 +- manila/share/api.py | 204 ++- manila/share/driver.py | 51 +- manila/share/drivers/cephfs/driver.py | 80 +- manila/share/drivers/container/driver.py | 3 + .../drivers/container/security_service_helper.py | 3 +- manila/share/drivers/container/storage_helper.py | 5 +- manila/share/drivers/dell_emc/common/enas/utils.py | 2 +- manila/share/drivers/dell_emc/driver.py | 3 + manila/share/drivers/dell_emc/plugins/base.py | 1 + .../drivers/dell_emc/plugins/isilon/isilon.py | 1 + .../dell_emc/plugins/powermax/connection.py | 18 +- .../dell_emc/plugins/powermax/object_manager.py | 32 +- .../drivers/dell_emc/plugins/unity/connection.py | 20 +- .../share/drivers/dell_emc/plugins/unity/utils.py | 3 +- .../drivers/dell_emc/plugins/vnx/connection.py | 15 +- .../drivers/dell_emc/plugins/vnx/object_manager.py | 32 +- manila/share/drivers/generic.py | 14 +- manila/share/drivers/glusterfs/__init__.py | 5 +- manila/share/drivers/glusterfs/common.py | 2 - manila/share/drivers/glusterfs/glusterfs_native.py | 5 +- manila/share/drivers/glusterfs/layout_volume.py | 34 +- manila/share/drivers/hdfs/hdfs_native.py | 5 +- manila/share/drivers/hitachi/hnas/driver.py | 14 +- manila/share/drivers/hitachi/hnas/ssh.py | 8 +- manila/share/drivers/hitachi/hsp/driver.py | 4 + manila/share/drivers/hitachi/hsp/rest.py | 4 +- manila/share/drivers/hpe/hpe_3par_driver.py | 51 +- manila/share/drivers/huawei/v3/connection.py | 9 +- manila/share/drivers/ibm/gpfs.py | 16 +- manila/share/drivers/infinidat/infinibox.py | 5 +- manila/share/drivers/infortrend/driver.py | 3 + manila/share/drivers/inspur/as13000/as13000_nas.py | 3 + manila/share/drivers/inspur/instorage/instorage.py | 4 + manila/share/drivers/lvm.py | 7 +- .../share/drivers/netapp/dataontap/client/api.py | 491 +++++- .../drivers/netapp/dataontap/client/client_base.py | 9 +- .../netapp/dataontap/client/client_cmode.py | 646 ++++++- .../netapp/dataontap/client/rest_endpoints.py | 49 + .../netapp/dataontap/cluster_mode/data_motion.py | 173 +- .../netapp/dataontap/cluster_mode/drv_multi_svm.py | 12 +- .../dataontap/cluster_mode/drv_single_svm.py | 7 +- .../netapp/dataontap/cluster_mode/lib_base.py | 1168 ++++++++++--- .../netapp/dataontap/cluster_mode/lib_multi_svm.py | 734 +++++++- .../dataontap/cluster_mode/lib_single_svm.py | 22 +- .../netapp/dataontap/cluster_mode/performance.py | 6 + .../drivers/netapp/dataontap/protocols/base.py | 21 +- .../netapp/dataontap/protocols/cifs_cmode.py | 45 +- .../netapp/dataontap/protocols/nfs_cmode.py | 41 +- manila/share/drivers/netapp/options.py | 55 +- manila/share/drivers/netapp/utils.py | 89 +- manila/share/drivers/nexenta/ns4/jsonrpc.py | 2 +- .../drivers/nexenta/ns4/nexenta_nfs_helper.py | 5 +- manila/share/drivers/nexenta/ns5/nexenta_nas.py | 3 + manila/share/drivers/nexenta/options.py | 1 - manila/share/drivers/purestorage/__init__.py | 0 manila/share/drivers/purestorage/flashblade.py | 477 +++++ manila/share/drivers/qnap/api.py | 2 +- manila/share/drivers/qnap/qnap.py | 12 +- manila/share/drivers/quobyte/quobyte.py | 5 +- manila/share/drivers/tegile/tegile.py | 5 +- manila/share/drivers/veritas/veritas_isa.py | 1 + manila/share/drivers/windows/winrm_helper.py | 2 +- manila/share/drivers/zadara/zadara.py | 3 + manila/share/drivers/zfsonlinux/driver.py | 10 +- manila/share/drivers/zfsonlinux/utils.py | 2 +- manila/share/hook.py | 18 +- manila/share/manager.py | 195 ++- manila/share/migration.py | 2 +- manila/test.py | 63 +- .../share/drivers/container/test_storage_helper.py | 15 +- .../drivers/dell_emc/plugins/unity/res_mock.py | 1 + .../dell_emc/plugins/unity/test_connection.py | 1 + .../drivers/glusterfs/test_glusterfs_native.py | 1 + .../share/drivers/glusterfs/test_layout_volume.py | 13 +- .../share/drivers/hitachi/hnas/test_driver.py | 2 + .../share/drivers/hpe/test_hpe_3par_driver.py | 5 + .../share/drivers/infinidat/test_infinidat.py | 1 + .../drivers/infortrend/test_infortrend_nas.py | 4 +- .../drivers/inspur/as13000/test_as13000_nas.py | 3 + .../drivers/inspur/instorage/test_instorage.py | 5 + .../share/drivers/netapp/dataontap/client/fakes.py | 277 +++ .../drivers/netapp/dataontap/client/test_api.py | 206 ++- .../netapp/dataontap/client/test_client_base.py | 37 +- .../netapp/dataontap/client/test_client_cmode.py | 1014 +++++++++-- .../dataontap/cluster_mode/test_data_motion.py | 234 ++- .../netapp/dataontap/cluster_mode/test_lib_base.py | 1848 ++++++++++++++++---- .../dataontap/cluster_mode/test_lib_multi_svm.py | 1206 ++++++++++--- .../dataontap/cluster_mode/test_lib_single_svm.py | 74 + .../dataontap/cluster_mode/test_performance.py | 10 +- .../netapp/dataontap/protocols/test_base.py | 20 + .../netapp/dataontap/protocols/test_cifs_cmode.py | 42 +- .../netapp/dataontap/protocols/test_nfs_cmode.py | 29 +- .../share/drivers/nexenta/ns4/test_nexenta_nas.py | 13 +- .../share/drivers/nexenta/ns5/test_jsonrpc.py | 2 +- .../share/drivers/nexenta/ns5/test_nexenta_nas.py | 3 + .../share/drivers/purestorage/test_flashblade.py | 359 ++++ .../share/drivers/veritas/test_veritas_isa.py | 1 + manila/utils.py | 97 +- manila/volume/cinder.py | 29 +- .../add-flashblade-driver-de20b758a8ce2640.yaml | 6 + .../notes/add-quotas-section-0e1e638a8f14d26e.yaml | 23 + ...-from-snapshot-percentage-2d913ae1fc533690.yaml | 10 + ...er-migration-enhancements-bbbc98a7fb419700.yaml | 6 + .../notes/affinity-filter-747d3d7c51157172.yaml | 14 + ...ix-rpc-init-host-with-rpc-6e76afa553b4f2af.yaml | 6 + ...will-go-through-scheduler-3a29093756dc88c1.yaml | 7 + ...subvolume-group-snapshots-344efbb9ba74e05c.yaml | 8 + ...atching-logic-in-database-d83917727d12677d.yaml | 7 + ...urity-service-association-f48aecbbc47418cd.yaml | 8 + ...t-unauthorized-exceptions-b2ebc08a072f7e12.yaml | 6 + ...hare-from-snapshot-failed-053a583522a6fc0e.yaml | 6 + ...ic-of-share-network-query-f314ec3010c06045.yaml | 6 + ...irect-mgr-commands-monmgr-5e8babb4a1067e92.yaml | 11 + ...ound-replica-parent-share-d8e50659c02b941a.yaml | 5 + ...c-task-for-active-replica-030a982af92f8a62.yaml | 6 + ...y-view-only-relationships-807d406cf8fac06c.yaml | 5 + ...hot-support-api-error-msg-eaf5fd2b1df97d15.yaml | 10 + ...ate-on-migration-complete-4fb4d8ba59b58505.yaml | 9 + ...ing-shares-by-extra-specs-b79235301306bcf2.yaml | 5 + ...59-add-ceph-version-check-88eee324bc6134ea.yaml | 7 + ...paddress-hosts-invocation-80d419d7e62a5f51.yaml | 6 + ...delete-for-scoped-account-8fa193c0424af9b1.yaml | 7 + ...anila-fix-cifs-value-type-f65e162ee27d3e67.yaml | 5 + ...0-share-type-user-message-902275047410bdbf.yaml | 7 + ...ation-through-svm-migrate-c1e29fce19758324.yaml | 5 + .../netapp-flexgroup-support-9b3f30afb94d3a86.yaml | 40 + .../netapp-readable-replica-cb7d5460ad7b3b0e.yaml | 6 + ...precated-options-and-auth-4d497e03ad47e872.yaml | 163 ++ releasenotes/source/index.rst | 1 + releasenotes/source/wallaby.rst | 6 + requirements.txt | 4 +- setup.cfg | 12 +- tools/install_venv.py | 1 - tools/install_venv_common.py | 4 - tox.ini | 26 +- zuul.d/grenade-jobs.yaml | 1 - zuul.d/project.yaml | 8 +- 279 files changed, 12590 insertions(+), 2659 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 2c4b275c..c37b4a76 100644 --- a/requirements.txt +++ b/requirements.txt @@ -37 +37 @@ requests>=2.23.0 # Apache-2.0 -retrying!=1.3.0,>=1.2.3 # Apache-2.0 +tenacity>=6.3.1 # Apache-2.0 @@ -40 +40 @@ six>=1.15.0 # MIT -SQLAlchemy>=1.3.1 # MIT +SQLAlchemy>=1.3.17 # MIT