We are glad to announce the release of: cinder 8.0.0: OpenStack Block Storage This release is part of the mitaka release series. For more details, please see below. 8.0.0 ^^^^^ New Features ************ * Added support for creating a consistency group from a source consistency group in the HPE 3PAR driver. * Disable standard capabilities based on 3PAR licenses. * Added snapshot manage/unmanage support to the HPE 3PAR driver. * Added replication v2.1 support to the Dell Storage Center drivers. * Added v2.1 replication support in Huawei Cinder driver. * Added support for creating, deleting, and updating consistency groups for NetApp 7mode and CDOT backends. * Added support for taking, deleting, and restoring a cgsnapshot for NetApp 7mode and CDOT backends. * Added backend driver for Coho Data storage. * Added cinder backup driver for Google Cloud Storage. * Added driver for Tegile IntelliFlash arrays. * Added ability to backup snapshots. * Support balanced FC port selection for Huawei drivers. * HTTP connector for the Cinder Brocade FC Zone plugin. This connector allows for communication between the Brocade FC zone plugin and the switch to be over HTTP or HTTPs. To make use of this connector, the user would add a configuration setting in the fabric block for a Brocade switch with the name as 'fc_southbound_protocol' with a value as 'HTTP' or 'HTTPS'. * Support for configuring Fibre Channel zoning on Brocade switches through Cinder Fibre Channel Zone Manager and Brocade Fibre Channel zone plugin. To zone in a Virtual Fabric, set the configuration option 'fc_virtual_fabric_id' for the fabric. * The consistency group API now returns volume type IDs. * Added support for API microversions, as well as /v3 API endpoint. * Retype support added to CloudByte iSCSI driver. * All Datera DataFabric backed volume-types will now use API version 2 with Datera DataFabric * It is now possible to delete a volume and its snapshots by passing an additional argument to volume delete, "cascade=True". * New config option to enable discard (trim/unmap) support for any backend. * Added backend driver for DISCO storage. * Cinder FC Zone Manager Friendly Zone Names This feature adds support for Fibre Channel user friendly zone names if implemented by the volume driver. If the volume driver passes the host name and storage system to the Fibre Channel Zone Manager in the conn_info structure, the zone manager will use these names in structuring the zone name to provide a user friendly zone name. * Added backend driver for Fujitsu ETERNUS DX (FC). * Added backend driver for Fujitsu ETERNUS DX (iSCSI). * Added manage/unmanage snapshot support for Huawei drivers. * Added manage/unmanage volume support for Huawei drivers. * Support cinder_img_volume_type property in glance image metadata to specify volume type. * Consistency group support has been added to the LeftHand backend driver. * Added snapshot manage/unmanage support to the HPE LeftHand driver. * Added iSCSI CHAP uni-directional authentication for NetApp drivers. * Support for Consistency Groups in the NetApp E-Series Volume Driver. * Added backend driver for Nexenta Edge iSCSI storage. * Added backend driver for NexentaStor5 iSCSI storage. * Added backend driver for NexentaStor5 NFS storage. * Manage and unmanage support has been added to the Nimble backend driver. * Added additional metrics reported to the scheduler for Pure Volume Drivers for better filtering and weighing functions. * Added config option to enable/disable automatically calculation an over-subscription ratio max for Pure Volume Drivers. When disabled the drivers will now respect the max_oversubscription_ratio config option. * New config option for Pure Storage volume drivers pure_eradicate_on_delete. When enabled will permanantly eradicate data instead of placing into pending eradication state. * Added Cheesecake (v2.1) replication support to the Pure Storage Volume drivers. * Added Migrate and Extend for Nexenta NFS driver. * Added Retype functionality to Nexenta iSCSI and NFS drivers. * Added v2.1 replication support to the HPE 3PAR driver. * Added v2.1 replication support to the HPE LeftHand driver. * Added replication v2.1 support to the IBM Storwize driver. * Added RPC backward compatibility layer similar to the one implemented in Nova. This means that Cinder services can be upgraded one-by-one without breakage. After all the services are upgraded SIGHUP signals should be issued to all the services to signal them to reload cached minimum RPC versions. Alternative is of course restart of them. Please note that cinder-api service doesn't support SIGHUP yet. Please also take into account that all the rolling upgrades capabilities are considered tech preview, as we don't have a CI testing it yet. * Added Consistency Group support in ScaleIO driver. * Added support for manage/unmanage volume in the ScaleIO driver. * Added QoS support in ScaleIO driver. * cinder-backup service is now decoupled from cinder-volume, which allows more flexible scaling. * Split nested quota support into a separate driver. In order to use nested quotas, change the following config "quota_driver = cinder.quota.NestedDbQuotaDriver" after running the following admin API "os-quota-sets/validate_setup_for_nested_quota_use" command to ensure the existing quota values make sense to nest. * Added multiple management IP support to Storwize SVC driver. * Added multiple pools support to Storwize SVC driver. * Added support for ZeroMQ messaging driver in cinder single backend config. * Locks may use Tooz as abstraction layer now, to support distributed lock managers and prepare Cinder to better support HA configurations. * The updated_at timestamp is now returned in listing detail. * Added support for manage volume in the VMware VMDK driver. * Configrable migration rate in VNX driver via metadata * Adds v2.1 replication support in VNX Cinder driver. * Cloning of consistency group added to EMC VNX backend driver. * Added replication v2.1 support to the IBM XIV/DS8K driver. * Support for creating a consistency group from consistency group in XtremIO. * Volume manage/unmanage support for Oracle ZFSSA iSCSI and NFS drivers. Known Issues ************ * Cinder services are now automatically downgrading RPC messages to be understood by the oldest version of a service among all the deployment. Disabled and dead services are also taken into account. It is important to keep service list up to date, without old, unused records. This can be done using "cinder-manage service remove" command. Once situation is cleaned up services should be either restarted or "SIGHUP" signal should be issued to their processes to force them to reload version pins. Please note that cinder-api does not support "SIGHUP" signal. Upgrade Notes ************* * It is required to copy new rootwrap.d/volume.filters file into /etc/cinder/rootwrap.d directory. * Violin Memory 6000 array series drivers are removed. * Adding or removing volume_type_access from any project during DB migration 62 must not be performed. * When running PostgreSQL it is required to upgrade and restart all the cinder-api services along with DB migration 62. * Users of the Datera Cinder driver are now required to use Datera DataFabric version 1.0+. Versions before 1.0 will not be able to utilize this new driver since they still function on v1 of the Datera DataFabric API * The VMware VMDK driver now enforces minimum vCenter version of 5.1. * If during a *live* upgrade from Liberty a backup service will be killed while processing a restore request it may happen that such backup status won't be automatically cleaned up on the service restart. Such orphaned backups need to be cleaned up manually. * When performing a *live* upgrade from Liberty it may happen that retype calls will reserve additional quota. As by default quota reservations are invalidated after 24 hours (config option "reservation_expire=86400"), we recommend either decreasing that time or watching for unused quota reservations manually during the upgrade process. * HP drivers have been rebranded to HPE. Existing configurations will continue to work with the legacy name, but will need to be updated by the next release. * The deprecated HP CLIQ proxy driver has now been removed. * Users of the ibmnas driver should switch to using the IBM GPFS driver to enable Cinder access to IBM NAS resources. For details configuring the IBM GPFS driver, see the GPFS config reference. - http://docs.openstack.org/liberty/config-reference/content/GPFS- driver.html * Removed deprecated LVMISCSIDriver and LVMISERDriver. These should be switched to use the LVMVolumeDriver with the desired iscsi_helper configuration set to the desired iSCSI helper. * Removed the deprecated NPIV options for the Storwize backend driver. * Backend driver for Scality SRB has been removed. * Rename Huawei18000ISCSIDriver and Huawei18000FCDriver to HuaweiISCSIDriver and HuaweiFCDriver. * Starting from Mitaka release Cinder is having a tech preview of rolling upgrades support. * Removed force_delete option from ScaleIO configuration. * As cinder-backup was strongly reworked in this release, the recommended upgrade order when executing live (rolling) upgrade is c-api->c-sch->c-vol->c-bak. * Nested quotas will no longer be used by default, but can be configured by setting "quota_driver = cinder.quota.NestedDbQuotaDriver" * Removed storwize_svc_connection_protocol config setting. Users will now need to set different values for volume_driver in cinder.conf. FC:volume_driver = cinder.volume.drivers.ibm.storwize_svc.storwize_ svc_fc.StorwizeSVCFCDriver iSCSI:volume_driver = cinder.volume.driv ers.ibm.storwize_svc.storwize_svc_iscsi.StorwizeSVCISCSIDriver * The VMware VMDK driver for ESX server has been removed. Deprecation Notes ***************** * datera_api_token -- this has been replaced by san_login and san_password * The XML API has been marked deprecated and will be removed in a future release. * Deprecated IBM driver _multipath_enabled config flags. Security Issues *************** * Pure Storage Volume Drivers can now utilize driver_ssl_cert_verify and driver_ssl_cert_path config options to allow for secure https requests to the FlashArray. Bug Fixes ********* * Fixed bug causing snapshot creation to fail on systems with LC_NUMERIC set to locale using ',' as decimal separator. * Cinder will now correctly read Keystone's endpoint for quota calls from keystone_authtoken.auth_uri instead of keymgr.encryption_auth_url config option. * Fixed service state reporting when backup manager is unable to initialize one of the backup drivers. * Consistency group creation previously scheduled at the pool level. Now it is fixed to schedule at the backend level as designed. * Removed the need for deployers to run tox for config reference generation. * upload-to-image using Image API v2 now correctly handles custom image properties. * Enabled a cloud operator to correctly manage policy for volume type operations. To permit volume type operations for specific user, you can for example do as follows. * Add "storage_type_admin" role. * Add "admin_or_storage_type_admin" rule to "policy.json", e.g. ""admin_or_storage_type_admin": "is_admin:True or role:storage_type_admin"," * Modify rule for types_manage and volume_type_access, e.g. ""volume_extension:types_manage": "rule:admin_or_storage_type_admin", "volume_extension:volume_type_access:addProjectAccess": "rule:admin_or_storage_type_admin", "volume_extension:volume_type_access:removeProjectAccess": "rule:admin_or_storage_type_admin"," * Fixed issue where Pure Volume Drivers would ignore reserved_percentage config option. * Allow for eradicating Pure Storage volumes, snapshots, and pgroups when deleting their Cinder counterpart. * Corrected quota usage when transferring a volume between tenants. * Previously the only way to remove volumes in error states from a consistency-group was to delete the consistency group and create it again. Now it is possible to remove volumes in error and error_deleting states. * Fix for Tintri image direct clone feature. Fix for the bug 1400966 prevents user from specifying image "nfs share location" as location value for an image. Now, in order to use Tintri image direct clone, user can specify "provider_location" in image metadata to specify image nfs share location. NFS share which hosts images should be specified in a file using tintri_image_shares_config config option. * Filtering volumes by their display name now correctly handles display names with single and double quotes. Other Notes *********** * Due to the ibmnas (SONAS) driver being rendered redundant by the addition of NFS capabilities to the IBM GPFS driver, the ibmnas driver is being removed in the Mitaka release. Changes in cinder 8.0.0.0rc1..8.0.0 ----------------------------------- 73b9976 Huawei: Fix getting admin_metadata 2adc8bb Imported Translations from Zanata e2cf243 NexentaStor4 iSCSI: convert blocksize to str da28ab6 Imported Translations from Zanata 9a8f9ee Imported Translations from Zanata 4dbb274 XtremIO handle errors in terminate_connection: ee4dc38 Imported Translations from Zanata 9d90a0a Imported Translations from Zanata 5424566 Imported Translations from Zanata ae388af Imported Translations from Zanata f9ad35a Imported Translations from Zanata c1e6472 Report 2.0 as supported version of RPC APIs 37c0556 Fix volume RPC API methods related to backups 755253e Imported Translations from Zanata a6b4a84 Imported Translations from Zanata 16a1d80 Imported Translations from Zanata d292fe1 Dell SC: create_cgsnapshot returning wrong structure 50e124e Imported Translations from Zanata cf686d8 Fix race condition when toggling SP 6138aca Huawei: Record and check LUN wwn 691db5a SMBFS: fix parsing volume type extra specs and metadata 38fc0b4 VMware: Bump driver version e784fcf Update .gitreview for stable/mitaka Diffstat (except docs and test files) ------------------------------------- .gitreview | 1 + cinder/backup/manager.py | 8 +- cinder/exception.py | 5 + cinder/locale/cinder-log-error.pot | 493 +- cinder/locale/cinder-log-info.pot | 554 +- cinder/locale/cinder-log-warning.pot | 433 +- cinder/locale/cinder.pot | 1354 +-- cinder/locale/cs/LC_MESSAGES/cinder-log-error.po | 7 +- cinder/locale/cs/LC_MESSAGES/cinder-log-info.po | 35 +- cinder/locale/cs/LC_MESSAGES/cinder-log-warning.po | 20 +- cinder/locale/cs/LC_MESSAGES/cinder.po | 24 +- cinder/locale/de/LC_MESSAGES/cinder.po | 2616 ++++- cinder/locale/es/LC_MESSAGES/cinder.po | 2641 ++++- cinder/locale/fr/LC_MESSAGES/cinder.po | 2770 ++++- cinder/locale/it/LC_MESSAGES/cinder-log-error.po | 995 +- cinder/locale/it/LC_MESSAGES/cinder-log-info.po | 3773 +++++++ cinder/locale/it/LC_MESSAGES/cinder.po | 59 +- cinder/locale/ja/LC_MESSAGES/cinder.po | 10677 +++++++++++++++++++ .../locale/ko_KR/LC_MESSAGES/cinder-log-error.po | 3500 ++++++ cinder/locale/ko_KR/LC_MESSAGES/cinder-log-info.po | 3593 +++++++ cinder/locale/ko_KR/LC_MESSAGES/cinder.po | 2496 ++++- cinder/locale/pt_BR/LC_MESSAGES/cinder.po | 2568 ++++- cinder/locale/ru/LC_MESSAGES/cinder.po | 2535 ++++- .../locale/tr_TR/LC_MESSAGES/cinder-log-error.po | 7 +- cinder/locale/tr_TR/LC_MESSAGES/cinder-log-info.po | 12 +- cinder/locale/zh_CN/LC_MESSAGES/cinder.po | 88 +- cinder/locale/zh_TW/LC_MESSAGES/cinder.po | 101 +- cinder/scheduler/manager.py | 8 +- .../drivers/dell/dell_storagecenter_common.py | 8 +- cinder/volume/drivers/emc/emc_vnx_cli.py | 80 +- cinder/volume/drivers/emc/xtremio.py | 45 +- cinder/volume/drivers/huawei/constants.py | 3 + cinder/volume/drivers/huawei/huawei_driver.py | 182 +- cinder/volume/drivers/huawei/huawei_utils.py | 13 + cinder/volume/drivers/huawei/replication.py | 15 +- cinder/volume/drivers/huawei/rest_client.py | 7 +- cinder/volume/drivers/nexenta/iscsi.py | 3 +- cinder/volume/drivers/smbfs.py | 38 +- cinder/volume/drivers/vmware/vmdk.py | 3 +- cinder/volume/manager.py | 8 +- cinder/volume/rpcapi.py | 14 +- 47 files changed, 40089 insertions(+), 2043 deletions(-)