We exuberantly announce the release of: manila 17.0.0: Shared Storage for OpenStack This release is part of the bobcat release series. The source is available from: https://opendev.org/openstack/manila Download the package from: https://tarballs.openstack.org/manila/ Please report issues through: https://bugs.launchpad.net/manila/+bugs For more details, please see below. Changes in manila 16.0.0..17.0.0 -------------------------------- 58ff7c1bd TrivialFix: Fix typo in release note 3eb34c3ce Add preferred info to ceph nfs export locations ee8af9010 Implement Ensure Shares in the CephFS driver 389a2ea1e Support reapplying rules during ensuring bd471d5d9 Dell PowerStore and PowerFlex Manila drivers enhancement 926f030e4 Fix openstack-tox-py311 job 4b57e249c Revert "Improve scheduler performance when thin provisioning" f1e255b4d Add default to read_deleted in context's from_dict 6c9d990a8 Add NetApp Active IQ scheduler weigher 51cc6d40d Follow-up access rules restrictions change 3a2d220f8 Update Share backup APIs and add api ref 0f82690dd Allow restricting access rules fields and deletion d96e0c450 TrivialFix: Don't warn on legitimate all_projects usage ac8a9a238 Adds a new Manila driver for Dell PowerFlex storage backend f641577d8 Resource Locks: Support for share deletion lock 94b71a5fa Include share_type information in notifications 09555c80d Adds a new Manila driver for Dell PowerStore storage backend 5a4404f05 Turn off global venv in rally jobs e88585264 Improve scheduler performance when thin provisioning bb7a06bf3 [RFE] NetApp share server migration get progress 234d26cde Set "updated_at" field on access rules 3497062d4 [DOC] Add Snapshot Metadata Documentation f6725f7c1 Validate provider_location while managing snapshot 7705b74a7 [api-ref] add provider_location to snapshots 0b99fdaa9 Implement share backup b4cc96d5f NetApp: Improve REST API cover and fix internals a93449983 [NetApp] Fix share server migration c88aac595 [API] Validate display name/description length 0553eb78b [NetApp] Recreate security cert during vserver create. 8896534bb [NetApp] Fixed replica promotion to updated autosize attributes 456b90898 Fix error message from share server API 69efb9ae5 [NetApp] Fix NetApp driver create from snapshot da23b652f Update timedelta and old schedules as per netapp_snapmirror_schedule 0e7812657 Add count info in 'snapshot list' API 945579aef Handle access rules on share replicas. ca90c87c4 skip periodic update on replicas in 'error_deleting' 435180530 [Doc] Annotate max api microversion in Antelope 37278df33 Fix duplicate entries in share_server_backend_details 5daf9bd6c Stop overriding auth/identity options of tempest 21356fee2 [DOC] Add doc for Scheduler Hints e9f4bf747 [DOC] Add doc for Share Transfer 3d1641c2f Add pre-commit 23e6493de Remove trailing spaces, convert dos2unix 7a4a81b53 Add max share extend size limited by share_type 52445fde2 Update the generic driver 'Known restrictions' section de0a0e632 [api-ref] Enhance quotas per share types doc 70ecf89cd Enhance quota documentation 8eb38ac41 onlyHostFilter: Fix follow-up suggestions. a372e5309 Report PortLimitExceeded error to customer a0eea6af5 Imported Translations from Zanata e34e8f7fc sqlalchemy: add generic repr to base model e53a461c5 db: Migrate "share metadata" APIs to enginefacade 60c64d4d9 db: Migrate "share network subnet metadata" APIs to enginefacade 3ec91a799 db: Migrate "share network subnet" APIs to enginefacade 56ab50416 db: Migrate "share network" APIs to enginefacade 1f9f5c1bf db: Migrate "security service" APIs to enginefacade c4306e04b db: Migrate "share server" APIs to enginefacade 2b7b10012 db: Migrate "availability zone" APIs to enginefacade ef6b3f0a9 db: Migrate "driver private data" APIs to enginefacade 943446605 db: Migrate "network allocation" APIs to enginefacade 3c4cdf904 db: Migrate 'purge_deleted_records' API to enginefacade d233a023f db: Migrate "share type extra specs" APIs to enginefacade ecef9a548 db: Migrate "share type access" APIs to enginefacade d82297262 db: Migrate "share type" APIs to enginefacade cd3b7355a db: Migrate "async operation" APIs to enginefacade a9fc22841 db: Migrate remaining quota APIs to enginefacade 2984c7145 db: Migrate quota sync APIs to enginefacade 15b4b39eb db: Migrate "share group", "share group type" APIs to enginefacade 57872ad5f db: Migrate 'share_resources_host_update' helper API to enginefacade 1bc5fc797 Use DLM when creating service network 8931cdc17 [DOC] Add api reference to share network subnet metadata 99b00c982 fix to get soft-deleted objects on db model query 818f4e1d0 Change the default value for `is_public` for share group type creation ec1979bdc Move skip level job to manila-grenade-skip-level-always fe0a35638 add reno to allowlist_externals 6ac66c196 Pure Storage - bump version numbers for 2023.2 (Bobcat) e1b924138 [doc] Add sample dummy driver config 86e0e3887 adds share server uuid on migration cancel 9ddddeeea [NetApp] Fix non-disruptive migration cifs shares 8ec468756 [coordination] backend_url should be secret 1a603682a Fix Share Network Subnet Metadata policy error 729aad4b2 Remove TripleO job 7f3f6dcbe Update master for stable/2023.1 38b13bb40 NetApp ONTAP: Fix SnapMirror snapshots not being cleaned up Diffstat (except docs and test files) ------------------------------------- .pre-commit-config.yaml | 39 + api-ref/source/index.rst | 4 + api-ref/source/limits.inc | 4 + api-ref/source/parameters.yaml | 510 +- api-ref/source/quota-classes.inc | 8 + api-ref/source/quota-sets.inc | 19 + api-ref/source/resource-locks.inc | 325 + api-ref/source/samples/limits-response.json | 6 +- .../samples/quota-classes-show-response.json | 4 +- .../samples/quota-classes-update-response.json | 4 +- .../source/samples/quota-show-detail-response.json | 9 +- api-ref/source/samples/quota-show-response.json | 4 +- api-ref/source/samples/quota-update-response.json | 4 +- .../samples/resource-lock-create-request.json | 8 + .../samples/resource-lock-create-response.json | 24 + .../samples/resource-lock-get-all-response.json | 48 + .../source/samples/resource-lock-get-response.json | 24 + .../samples/resource-lock-update-request.json | 5 + .../samples/resource-lock-update-response.json | 24 + .../share-actions-grant-access-request.json | 5 +- .../share-actions-revoke-access-request.json | 3 +- .../samples/share-backup-create-request.json | 8 + .../samples/share-backup-create-response.json | 15 + .../samples/share-backup-reset-status-request.json | 5 + .../samples/share-backup-restore-request.json | 3 + .../samples/share-backup-restore-response.json | 6 + .../source/samples/share-backup-show-response.json | 15 + .../samples/share-backup-update-request.json | 6 + .../samples/share-backup-update-response.json | 15 + .../share-backups-list-detailed-response.json | 30 + .../samples/share-backups-list-response.json | 16 + ...add-security-service-response-with-subnets.json | 52 +- ...share-network-create-response-with-subnets.json | 56 +- ...ove-security-service-response-with-subnets.json | 56 +- .../share-network-show-response-with-subnets.json | 54 +- .../share-network-subnet-create-request.json | 14 +- .../share-network-subnet-create-response.json | 36 +- .../share-network-subnet-list-response.json | 72 +- .../share-network-subnet-set-metadata-request.json | 5 + ...share-network-subnet-set-metadata-response.json | 9 + ...hare-network-subnet-show-metadata-response.json | 6 + .../share-network-subnet-show-response.json | 36 +- ...are-network-subnet-update-metadata-request.json | 7 + ...re-network-subnet-update-metadata-response.json | 7 + ...etwork-subnet-update-null-metadata-request.json | 3 + ...twork-subnet-update-null-metadata-response.json | 3 + ...share-network-update-response-with-subnets.json | 56 +- ...tworks-list-detailed-response-with-subnets.json | 132 +- .../share-server-migration-cancel-request.json | 6 +- ...rver-migration-check-compatibility-request.json | 18 +- ...ver-migration-check-compatibility-response.json | 36 +- .../share-server-migration-complete-request.json | 6 +- .../share-server-migration-complete-response.json | 6 +- ...hare-server-migration-get-progress-request.json | 6 +- ...are-server-migration-get-progress-response.json | 10 +- .../share-server-migration-start-request.json | 18 +- ...show-network-subnet-metadata-item-response.json | 5 + .../samples/shares-list-detailed-response.json | 2 + .../samples/snapshot-set-metadata-request.json | 9 + .../samples/snapshot-set-metadata-response.json | 9 + .../snapshot-show-metadata-item-response.json | 5 + .../samples/snapshot-show-metadata-response.json | 6 + .../samples/snapshot-update-metadata-request.json | 7 + .../samples/snapshot-update-metadata-response.json | 7 + .../snapshot-update-null-metadata-request.json | 3 + .../snapshot-update-null-metadata-response.json | 3 + api-ref/source/share-access-rules.inc | 12 + api-ref/source/share-actions.inc | 15 + api-ref/source/share-backups.inc | 477 ++ api-ref/source/share-metadata.inc | 8 +- api-ref/source/share-network-subnets-metadata.inc | 257 + api-ref/source/shares.inc | 9 + api-ref/source/snapshot-metadata.inc | 262 + api-ref/source/snapshots.inc | 6 +- bindep.txt | 9 +- devstack/plugin.sh | 23 +- .../share_back_ends_feature_support_mapping.rst | 16 + .../admin/shared-file-systems-crud-share.rst | 18 + .../shared-file-systems-share-replication.rst | 10 +- .../configuration/shared-file-systems/drivers.rst | 2 + .../drivers/dell-emc-powerflex-driver.rst | 160 + .../drivers/dell-emc-powerstore-driver.rst | 186 + .../development-environment-devstack.rst | 27 +- manila/api/common.py | 10 + manila/api/openstack/api_version_request.py | 8 +- manila/api/openstack/rest_api_version_history.rst | 23 +- manila/api/v1/share_servers.py | 5 +- manila/api/v1/share_snapshots.py | 41 +- manila/api/v1/share_unmanage.py | 7 + manila/api/v1/shares.py | 124 +- manila/api/v2/quota_sets.py | 7 +- manila/api/v2/resource_locks.py | 205 + manila/api/v2/router.py | 13 + manila/api/v2/share_accesses.py | 75 +- manila/api/v2/share_backups.py | 258 + manila/api/v2/share_snapshots.py | 7 + manila/api/v2/shares.py | 9 + manila/api/views/limits.py | 12 +- manila/api/views/quota_class_sets.py | 6 + manila/api/views/quota_sets.py | 6 + manila/api/views/resource_locks.py | 72 + manila/api/views/share_accesses.py | 9 + manila/api/views/share_backups.py | 90 + manila/api/views/share_snapshots.py | 12 +- manila/api/views/shares.py | 8 +- manila/common/constants.py | 50 +- manila/context.py | 4 +- manila/coordination.py | 1 + manila/data/backup_driver.py | 42 + manila/data/drivers/__init__.py | 0 manila/data/drivers/nfs.py | 74 + manila/data/helper.py | 81 +- manila/data/manager.py | 630 +- manila/data/rpcapi.py | 19 +- manila/db/api.py | 171 +- .../2d708a9a3ba9_backup_change_az_to_az_id.py | 94 + .../alembic/versions/9afbe2df4945_add_backup.py | 91 + .../versions/cb20f743ca7b_add_resource_locks.py | 65 + manila/db/sqlalchemy/api.py | 3420 +++++----- manila/db/sqlalchemy/models.py | 85 + manila/exception.py | 43 +- manila/lock/__init__.py | 0 manila/lock/api.py | 228 + manila/message/message_field.py | 8 + manila/policies/__init__.py | 4 + manila/policies/base.py | 42 + manila/policies/resource_lock.py | 181 + manila/policies/share_backup.py | 197 + manila/policies/shares.py | 12 + manila/policy.py | 9 + manila/quota.py | 16 +- manila/scheduler/filters/host.py | 3 +- manila/scheduler/weighers/netapp_aiq.py | 355 + manila/share/access.py | 25 +- manila/share/api.py | 303 +- manila/share/driver.py | 76 +- manila/share/drivers/cephfs/driver.py | 120 +- manila/share/drivers/dell_emc/driver.py | 10 +- .../drivers/dell_emc/plugins/powerflex/__init__.py | 0 .../dell_emc/plugins/powerflex/connection.py | 391 ++ .../dell_emc/plugins/powerflex/object_manager.py | 388 ++ .../dell_emc/plugins/powerstore/__init__.py | 0 .../drivers/dell_emc/plugins/powerstore/client.py | 412 ++ .../dell_emc/plugins/powerstore/connection.py | 512 ++ manila/share/drivers/ganesha/__init__.py | 6 + .../share/drivers/macrosan/macrosan_constants.py | 88 +- manila/share/drivers/macrosan/macrosan_helper.py | 1090 +-- manila/share/drivers/macrosan/macrosan_nas.py | 372 +- manila/share/drivers/macrosan/rest_helper.py | 1336 ++-- .../netapp/dataontap/client/client_cmode.py | 155 +- .../netapp/dataontap/client/client_cmode_rest.py | 430 +- .../drivers/netapp/dataontap/client/rest_api.py | 2 + .../netapp/dataontap/client/rest_endpoints.py | 5 + .../netapp/dataontap/cluster_mode/data_motion.py | 52 + .../netapp/dataontap/cluster_mode/lib_base.py | 201 +- .../netapp/dataontap/cluster_mode/lib_multi_svm.py | 55 +- .../netapp/dataontap/protocols/cifs_cmode.py | 24 +- manila/share/drivers/netapp/options.py | 15 +- manila/share/drivers/purestorage/flashblade.py | 3 +- manila/share/drivers/service_instance.py | 3 +- manila/share/manager.py | 270 +- manila/share/rpcapi.py | 26 +- manila/share/share_types.py | 26 +- manila/share/utils.py | 2 + .../migrations/alembic/migrations_data_checks.py | 31 + .../drivers/dell_emc/plugins/powerflex/__init__.py | 0 .../mockup/create_filesystem_response.json | 3 + .../mockup/create_nfs_export_response.json | 3 + .../mockup/create_nfs_snapshot_response.json | 3 + .../mockup/get_fileystem_id_response.json | 5 + .../mockup/get_fsid_from_export_name_response.json | 5 + .../get_fsid_from_snapshot_name_response.json | 5 + .../mockup/get_nas_server_id_response.json | 5 + .../mockup/get_nfs_export_id_response.json | 5 + .../mockup/get_nfs_export_name_response.json | 20 + .../mockup/get_storage_pool_id_response.json | 1 + .../mockup/get_storage_pool_spare_percentage.json | 98 + .../mockup/get_storage_pool_statistic.json | 381 ++ .../plugins/powerflex/mockup/login_response.json | 10 + .../dell_emc/plugins/powerflex/test_connection.py | 558 ++ .../plugins/powerflex/test_object_manager.py | 458 ++ .../dell_emc/plugins/powerstore/__init__.py | 0 .../powerstore/mockup/clone_snapshot_response.json | 3 + .../mockup/create_filesystem_response.json | 3 + .../mockup/create_nfs_export_response.json | 3 + .../mockup/create_smb_share_response.json | 3 + .../mockup/create_snapshot_response.json | 3 + .../powerstore/mockup/get_cluster_id_response.json | 5 + .../mockup/get_fileystem_id_response.json | 5 + .../mockup/get_fsid_from_export_name_response.json | 5 + .../mockup/get_fsid_from_share_name_response.json | 5 + .../mockup/get_nas_server_id_response.json | 5 + .../mockup/get_nas_server_interfaces_response.json | 10 + .../get_nas_server_smb_netbios_response.json | 11 + .../mockup/get_nfs_export_id_response.json | 5 + .../mockup/get_nfs_export_name_response.json | 3 + .../mockup/get_smb_share_id_response.json | 5 + .../resize_filesystem_shrink_failure_response.json | 12 + ...retreive_cluster_capacity_metrics_response.json | 6914 ++++++++++++++++++++ .../dell_emc/plugins/powerstore/test_client.py | 674 ++ .../dell_emc/plugins/powerstore/test_connection.py | 1013 +++ .../dell_emc/plugins/unity/mocked_unity.yaml | 6 +- .../share/drivers/macrosan/test_macrosan_nas.py | 4500 ++++++------- .../share/drivers/netapp/dataontap/client/fakes.py | 187 +- .../netapp/dataontap/client/test_client_cmode.py | 102 +- .../dataontap/client/test_client_cmode_rest.py | 1529 ++++- .../dataontap/cluster_mode/test_data_motion.py | 55 + .../netapp/dataontap/cluster_mode/test_lib_base.py | 178 +- .../dataontap/cluster_mode/test_lib_multi_svm.py | 31 +- .../drivers/netapp/dataontap/protocols/fakes.py | 4 +- .../netapp/dataontap/protocols/test_cifs_cmode.py | 23 +- ...sibility-and-delete-locks-52a7ef235813d147.yaml | 13 + ...nt-info-in-share-snapshot-eee90f1471f7a5c4.yaml | 4 + .../notes/add-quotas-section-0e1e638a8f14d26e.yaml | 6 +- ...ype-info-to-notifications-7fb4597642a6e8e5.yaml | 5 + ...g-shares-against-deletion-5a715292e720a254.yaml | 9 + ...l-powerflex-manila-driver-2c496483242e555a.yaml | 5 + ...-powerstore-manila-driver-263489b0d0b10e2e.yaml | 5 + ...tive-iq-scheduler-weigher-df0a6709a63a1f6f.yaml | 10 + ...d-security-services-error-7e5e7981fcbf2b53.yaml | 0 ...ixed-cifs-share-migration-752fde9631fb077a.yaml | 8 + ...omote-autosize-attributes-c180bb7db328bece.yaml | 7 + ...-snapshots-not-cleaned-up-63cc98cd468adbd1.yaml | 9 + ...-old-snapmirror-schedules-b565d4163663ffa0.yaml | 10 + ...e-access-rules-on-replica-c7304ae55c68857f.yaml | 8 + ...-network-subnet-non-admin-463347a723069997.yaml | 6 + ...x-read-deleted-sqlalchemy-cda2dca772ce8d0a.yaml | 6 + ...play-name-and-description-827d4ccb777ea632.yaml | 8 + ...p-error-deleting-replicas-aa2ef4154d5e38f6.yaml | 6 + ...re-server-backend-details-adf45b417d45b437.yaml | 8 + ...vider-location-validation-b6d1e977f50643bb.yaml | 6 + ...t-updated_at-access-rules-a382a3e352f3ef7d.yaml | 5 + ...preferred-export-location-d1f228a51df8c8b4.yaml | 24 + ...hfs-support-ensure-shares-b72fe18381af274a.yaml | 17 + .../emc-unity-manila-support-d4f5a410501cfdae.yaml | 22 +- ...rver-migration-is-failing-eee991ccbab4cd5a.yaml | 6 + .../fix_create_from_snapshot-5d8e470b46aac67d.yaml | 6 + ..._share_server_api_2025649-f818f594e97c59e6.yaml | 6 + ...wei-pool-disktype-support-0a52ba5d44da55f9.yaml | 10 +- ...share-extend-size-on-type-0528be9a5c27678b.yaml | 5 + ...y-certificate-for-vserver-aba543211ae6b811.yaml | 8 + ...app-ontap-rest-api-client-4c83c7b931f950cf.yaml | 4 +- .../netapp-svm-get-progress-596cd387c66dea1b.yaml | 5 + .../powermax-rebrand-manila-a46a0c2ac0aa77ed.yaml | 2 +- ...xceeded-error-to-customer-528990dc9574688f.yaml | 7 + .../notes/share-backup-d5f68ba6f9aef776.yaml | 6 + ...-snapshot-another-backend-44296f572681be35.yaml | 2 +- releasenotes/source/2023.1.rst | 6 + releasenotes/source/index.rst | 1 + .../locale/en_GB/LC_MESSAGES/releasenotes.po | 70 +- requirements.txt | 1 + setup.cfg | 3 + tools/test-setup.sh | 2 +- tox.ini | 3 +- zuul.d/grenade-jobs.yaml | 23 +- zuul.d/project.yaml | 12 +- 299 files changed, 32842 insertions(+), 6515 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 0f8e3aa7d..8c7844a50 100644 --- a/requirements.txt +++ b/requirements.txt @@ -44,0 +45 @@ SQLAlchemy>=1.3.17 # MIT +SQLAlchemy-Utils>=0.38.3 # BSD License