April 2016 - OpenStack-announce - lists.openstack.org

[release][searchlight] searchlight 0.2.0 release (mitaka)
by no-reply＠openstack.org 07 Apr '16

07 Apr '16

We are eager to announce the release of: searchlight 0.2.0: OpenStack Search Service This release is part of the mitaka release series. For more details, please see below. 0.2.0 ^^^^^ Adds cinder plugins for volumes and snapshots. Added separation of administrator-only data at an index level, which allows full faceting and searching of sensitive data by those with access to it. In order to allow policy files to more be useful in Searchlight, we now support limited control over individual resource types via oslo policy control. Remove the 'index' API. It is currently a passthrough to elasticsearch, allowing direct index access and bypassing any document transforms. As such it is dangerous, and only marginally useful. Administrators wishing to do this should do so directly in Elasticsearch. Swift plugin for searchlight Ability added to reindex data while allowing indexing of notifications, and therefore returning accurate search results during the indexing operation. A fix for a couple of parent-child plugin relationship issues related to initial indexing. Child plugins can no longer be indexed separately from their parents. Config options for searchlight-api and searchlight-listener are grouped under config groups [api] and [listener]. The default config file for searchlight was searchlight-api.conf despite the fact that this config file was used by both the API and the listener processes. Therefore, we decided to rename the default config file to searchlight.conf. This change also prompted us to to follow the convention used by many other projects and simplify searchlight-api-paste.ini to api-paste.ini. New Features ************ * Cinder plugins for volumes and snapshots. * Plugins with sensitive, administrator-only data are indexed twice; once with that data and once without. Searches are directed to the appropriate version depending on the context of the user. * Adds neutron plugins for networks, subnets, ports and routers. * Policy rules can now be specified per resource type and per operation per resource type. * Removes the /index api and related tests. If an admin needs to directly modify data in Elasticsearch they should do so in Elasticsearch. * Three resource types are introduced for swift plugin. OS::Swift:Account ->OS::Swift::Container -->OS::Swift::Object * Reindexing of data now takes place in a separate Elasticsearch index. During indexing, incoming events are processed into both the old and new indices. Once indexing is complete, an Elasticsearch alias is used to switch searches seamlessly onto the new index, at which time the old one is removed. * Plugin configuration refers to *resource_group_name* rather than *index_name* to represent groups of resources separate from the logical Elasticsearch index. This setting is used to determine index and alias names. Known Issues ************ * Backups cannot currently be implemented because the cinder API does not provide enough information for RBAC. They will be added when that is resolved. * Neutron resources do not provide dates (created_at or updated_at). created_at is left empty; updated_at is taken from the server (and will be adjusted to use the notification timestamp at a later time) * RBAC is still separate from policy restriction; this is targeted for the Newton release. * The Swift service currently doesn't send notifications. Follow the swift plugin documentation for current solutions. * Reindexing must now take place across all resource types that share the index (it is not possible to re-index a specific resource type). This is a limitation that Elasticsearch 2.x would likely have forced upon us anyway. A subsequent patch will allow more efficient reindexing for associated resource types. Upgrade Notes ************* * Options 'bind_host', 'bind_port', 'backlog', 'tcp_keepidle', 'ca_file', 'cert_file', 'key_file', 'workers', 'max_header_line', 'public_endpoint', and 'http_keepalive' are moved to [api] group. Options 'listener_workers' is renamed to 'workers' and moved to [listener] group. Options 'host' and 'http_timeout' are removed since they are not currently used anywhere. * During an upgrade to Mitaka, operators must rename the previous configured searchlight-api.conf to searchlight.conf and searchlight- api-paste.ini to api-paste.ini. Security Issues *************** * Removes the admin-only '/index' api, which allowed an unnecessary amount of access to Elasticsearch. Bug Fixes ********* * Child plugins cannot be indexed on their own, only as a result of indexing their parent. This fixes an issue whereby indexing only a parent plugin could leave orphaned children (or vice versa). * Applies mappings for parent/child plugins simultaneously. Under elasticsearch 2.x, child mappings must be created at the same time or before parents, not the other way round. * The workers for listener was always 1, so config listener_workers was not work as expected. Now operators can set 'workers' under group [listener] to running multiple listener processes. Changes in searchlight 0.2.0.0rc1..0.2.0 ---------------------------------------- 2a44b63 Backward compatibility with designate v1 api 4abf961 Disable oslo_config file discovery in tests bcc8243 Increase heap for elasticsearch in func tests 1e80553 Fix _is_multiple_alias_exception signature 574a095 Add missing zero-downtime indexing documentation bb5ff07 Re-indexing optimization for doc_type 25ca131 Add missing mitaka release notes 531447d Zero Downtime Re-indexing Error Handling. b1d339b Don't index DHCP ports a5ccab8 Update .gitreview for stable/mitaka Diffstat (except docs and test files) ------------------------------------- .gitreview | 1 + .../bp-index-role-separation-535e01ba3bb2252e.yaml | 11 + ...-zero-downtime-reindexing-a607d52b8711d845.yaml | 24 + searchlight/cmd/manage.py | 116 ++-- searchlight/elasticsearch/plugins/base.py | 5 + .../plugins/designate/notification_handlers.py | 119 +++- .../elasticsearch/plugins/designate/recordsets.py | 1 - .../elasticsearch/plugins/designate/zones.py | 2 +- .../plugins/neutron/notification_handlers.py | 12 + searchlight/elasticsearch/plugins/neutron/ports.py | 6 + searchlight/elasticsearch/plugins/utils.py | 210 +++++-- 22 files changed, 2186 insertions(+), 118 deletions(-)

1 0

[release][trove] trove 5.0.0 release (mitaka)
by no-reply＠openstack.org 07 Apr '16

07 Apr '16

We are eager to announce the release of: trove 5.0.0: OpenStack DBaaS This release is part of the mitaka release series. For more details, please see below. 5.0.0 ^^^^^ New Features ************ * Support has been added for Cassandra backup and resture using the Nodetool utility. * Implement configuration groups for Cassandra 2.1. You can now manage configuration of Cassandra datastores using the Trove configuration groups capability. * This patch set implements the following functionality for Cassandra datastore. create/delete/get user list users change password grant/revoke/list access update attributes create/delete database list databases Notes on Cassandra users In Cassandra only SUPERUSERS can create other users and grant permissions to database resources. Trove uses the 'os_admin' superuser to perform its administrative tasks. It proactively removes the built-in 'cassandra' superuser on prepare. The users it creates are all 'normal' (NOSUPERUSER) accounts. The permissions it can grant are also limited to non- superuser operations. This is to prevent anybody from creating a new superuser via the Trove API. Updatable attributes include username and password. The configuration template had to be updated to enable authentication and authorization support (original configuration allowed anonymous connections). Default implementations used are authenticator org.apache.cassandra.auth.PasswordAuthenticator authorizer org.apache.cassandra.auth.CassandraAuthorizer The superuser password is set to a random Trove password which is then stored in a Trove- read-only file in '~/.cassandra/cqlshrc' which is also the default location for client settings. Notes on Cassandra keyspaces Cassandra stores replicas on multiple nodes to ensure reliability and fault tolerance. All replicas are equally important; there is no primary or master. A replication strategy determines the nodes where replicas are placed. The total number of replicas across the cluster is referred to as the replication factor. The above 'create database' implementation uses 'SimpleStrategy' with just a single replica on the guest machine. This is a very simplistic configuration only good for the most basic applications and demonstration purposes. SimpleStrategy is for a single data center only. The following system keyspaces have been included in the default 'ignore_dbs' configuration list and therefore excluded from all database operations 'system', 'system_auth', 'system_traces' Notes on user rename Cassandra does not have a native way for renaming users. The reason why Cassandra itself does not implement rename is apparently just lack of demand for that feature. We implement it by creating a new user, transferring permissions and dropping the old one (which also removes its existing permissions). I asked about the sanity of this rename approach on the Cassandra mailing list and IRC channel and there should not be anything inherently wrong with the proposed procedure. This method, however, requires the user to always provide a password. Additional notes Trove uses the official open-source Python driver for Cassandra to connect to the database and execute queries. The connection is implemented in CassandraConnection. It is now also used to obtain the current database status as opposed to the original method of parsing output of the client tool. The 'common/operating_system' module was extended with two new functions for reading/writing ini- style and YAML configuration files to/from Python dicts. Unit tests were added to 'guestagent/test_operating_system'. The existing Manager unit tests were extended to include the added functionality. Also includes some minor improvements to comments and log messages. Used the existing operating_system interface to update file ownership. The system module was removed and its contents moved to the Application class. This is to reduce the number of files and help facilitate overriding. * Support has been added for CouchDB Backup and Restore. * Support has been added for CouchDB database and user functions. * Support has been added for DB2 Express-C Backup and Restore. * Additional Ceilometer notifications have been provided by Trove including create, end, error notifications for all state-changing API calls. * OpenStack Trove now supports clustering for Cassandra datastores. You can access clustering capabilities through the Trove cluster API. * OpenStack Trove now supports superuser access for the Cassandra datastore via the root-enable and root-disable API's. * OpenStack Trove now supports clustering for MariaDB datastores. You can access clustering capabilities through the Trove cluster API. * Implements replication based on GTIDs for MariaDB. Adds GTID replication strategy for MariaDB. Implements MariaDB specific GTID handling in guestagent. Configures MariaDB config template to support bin logging. Adds MariaDB helper overrides to eliminate configuration group tests from scenario tests. * A new feature called 'module management' has been added to Trove. Users can now create, update, list and delete modules. A module is a file that is provided to Trove, and when a database instance is launched, that file is deposited on the guest instance. This feature can be used for depositing files like, for example, license files onto guest database instances. * Support has been added for Percona XtraBackup version 2.3. * Adding the ability to root enable a pxc cluster. * The adds support for pxc to grow a cluster. * api and taskmanager support for shrinking a cluster * validate that the networks given are the same for each instance in the cluster. * make sure to add the existing networks on an instance in the cluster. * add new Error task for grow and shrink. * nova client version configuration changed to a string option rather than an int option because the nova microversions change nova api output. This was needed for the network interfaces on existing instances. * testing for grow and shrink cluster * Implemented configuration groups capability for Vertica datastores. * Implemented grow and shrink for clusters of Vertica datastore. The number of nodes in the cluster must be greater than the number required to satisfy the min_ksafety configuration setting. * Vertica comes with a User Defined Load function that takes a URL as a load source. This can be used to load files that are stored in Swift. As this is a common use case, it is valuable to enable this by default. This can be done in the post-prepare method for Vertica. A new UDL_LIBS list has been added that describes any UDLs to be loaded into the database. This change only has one entry - the curl function. Deprecation Notes ***************** * Dropping support for python 2.6 Security Issues *************** * Fixes bug 1507841, provides a configuration setting to enable Role Based Access Control (RBAC) for MongoDB clusters. If mongodb.cluster_secure is set to False (default is True) then RBAC will be disabled. Bug Fixes ********* * If given, apply the configuration overrides in prepare, just before creating initial users and/or databases. Failure to apply the given configuration should flip the instance into a failed state. Default implementation saves the overrides and restarts the database service to apply the changes. Datastores that do not require restart may potentially override the base implementation in 'apply_overrides_on_prepare()'. * The guest log code raises a non-serializable exception if the given Swift endpoint is invalid. This causes an ambiguous "Circular reference detected" error on the guest, and a timeout on the caller. This case is now caught and the correct exception raised. * Fixes bug 1526024, a failure in growing a mongodb cluster because of a problem in the way in which passwords were synchronized with new query routers. * Generate trove events for the current period, and not a future period. * Filter ignored users in the original query before the result gets paginated (like in list_databases). * Mongo cluster grow operations were not creating instances with the provided az and nic values. These should be used if the caller provided them. * Fix bug 1537986 which corrects the pagination in the mysql user list command. When internal users (ignore_users) are eliminated from the list, the pagination was not correctly handled. * Fixes bug 1558794. The 2.3 version of Percona XtraBackup performs some additional validations of the command line options passed to innobackupex. The Trove code now complies with the new validations being performed. Other Notes *********** * Added CORS support. * Refactor the datastore guest manager code. * Starting with 1.0.0 osprofiler release config options needed for its workability are consolidated inside osprofiler itself. Changes in trove 5.0.0.0rc1..5.0.0 ---------------------------------- 4e3e804 Trove's tox tests should respect upper-constraints.txt 18331be Address change in Route v2.3 f34581a Update .gitreview for stable/mitaka Diffstat (except docs and test files) ------------------------------------- .gitreview | 1 + tox.ini | 26 +++++++++++++++++++++++++- trove/common/extensions.py | 5 +++-- 3 files changed, 29 insertions(+), 3 deletions(-)

1 0

[release][sahara] sahara-dashboard 4.0.0 release (mitaka)
by no-reply＠openstack.org 07 Apr '16

07 Apr '16

We are jazzed to announce the release of: sahara-dashboard 4.0.0: Sahara Management Dashboard This release is part of the mitaka release series. For more details, please see below. Changes in sahara-dashboard 4.0.0.0rc1..4.0.0 --------------------------------------------- 8109bab Imported Translations from Zanata dc1dd53 Imported Translations from Zanata c003095 Update .gitreview for stable/mitaka Diffstat (except docs and test files) ------------------------------------- .gitreview | 1 + sahara_dashboard/locale/ja/LC_MESSAGES/django.po | 6 +- .../locale/ko_KR/LC_MESSAGES/django.po | 5 +- sahara_dashboard/locale/ru/LC_MESSAGES/django.po | 1953 ++++++++++++++++++++ sahara_dashboard/locale/ru/LC_MESSAGES/djangojs.po | 91 + 5 files changed, 2051 insertions(+), 5 deletions(-)

1 0

[release][mistral] mistral-extra 2.0.0 release (mitaka)
by no-reply＠openstack.org 07 Apr '16

07 Apr '16

We are happy to announce the release of: mistral-extra 2.0.0: Mistral Extras This release is part of the mitaka release series. For more details, please see below. Changes in mistral-extra 2.0.0.0rc1..2.0.0 ------------------------------------------ 450013a Update .gitreview for stable/mitaka Diffstat (except docs and test files) ------------------------------------- .gitreview | 1 + 1 file changed, 1 insertion(+)

1 0

[release][zaqar] zaqar 2.0.0 release (mitaka)
by no-reply＠openstack.org 07 Apr '16

07 Apr '16

We are amped to announce the release of: zaqar 2.0.0: OpenStack Queuing and Notification Service This release is part of the mitaka release series. For more details, please see below. Changes in zaqar 2.0.0.0rc1..2.0.0 ---------------------------------- da85355 Validate PUT of reserved queue attributes metadata 89c20fb Warn on upcoming deprecations for v1.0 and v1.1 05efac8 Update .gitreview for stable/mitaka Diffstat (except docs and test files) ------------------------------------- .gitreview | 1 + .../unit/transport/wsgi/v1/test_validation.py | 16 +++++++++ .../unit/transport/wsgi/v1_1/test_validation.py | 39 ++++++++++++++++++++++ zaqar/transport/wsgi/v1_0/__init__.py | 9 +++++ zaqar/transport/wsgi/v1_0/metadata.py | 14 +++++--- zaqar/transport/wsgi/v1_1/__init__.py | 10 ++++++ zaqar/transport/wsgi/v1_1/queues.py | 16 +++++---- zaqar/transport/wsgi/v2_0/queues.py | 17 ++++------ 9 files changed, 103 insertions(+), 21 deletions(-)

1 0

[release][murano] murano-agent 2.0.0 release (mitaka)
by no-reply＠openstack.org 07 Apr '16

07 Apr '16

We are jazzed to announce the release of: murano-agent 2.0.0: Python Murano Agent This release is part of the mitaka release series. For more details, please see below. Changes in murano-agent 2.0.0.0rc1..2.0.0 ----------------------------------------- 8738324 Restores SIGPIPE on script processes a333528 Update .gitreview for stable/mitaka Diffstat (except docs and test files) ------------------------------------- .gitreview | 1 + muranoagent/executors/application/__init__.py | 20 +++++++++++++------- 2 files changed, 14 insertions(+), 7 deletions(-)

1 0

[release][neutron] neutron-vpnaas 8.0.0 release (mitaka)
by no-reply＠openstack.org 07 Apr '16

07 Apr '16

We are satisfied to announce the release of: neutron-vpnaas 8.0.0: OpenStack Networking VPN as a Service This release is part of the mitaka release series. For more details, please see below. 8.0.0 ^^^^^ Generation of sample Neutron VPNaaS configuration files. New Features ************ * Neutron VPNaaS no longer includes static example configuration files. Instead, use tools/generate_config_file_samples.sh to generate them. The files are generated with a .sample extension. Changes in neutron-vpnaas 8.0.0.0rc2..8.0.0 ------------------------------------------- a1b1260 Constraint requirements using mitaka upper-constraints.txt file Diffstat (except docs and test files) ------------------------------------- tools/tox_install.sh | 2 +- tox.ini | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-)

1 0

[release][mistral] mistral 2.0.0 release (mitaka)
by no-reply＠openstack.org 07 Apr '16

07 Apr '16

We are delighted to announce the release of: mistral 2.0.0: Mistral Project This release is part of the mitaka release series. For more details, please see below. 2.0.0 ^^^^^ Pre-installed Mistral docker image is now available to get quick idea of Mistral. Tempest plugin has been implemented. Now Mistral tests can be run from Mistral repo as well as from Tempest repo. Actions of several OpenStack services are supported out of the box in Mitaka, including Barbican, Cinder(V2), Swift, Trove, Zaqar and Mistral. New Features ************ * Add support for workflow sharing feature. users of one project can share workflows to other projects using this feature. (https://specs.openstack.org/openstack/mistral- specs/specs/mitaka/approved/mistral-workflow-resource-sharing.html) Upgrade Notes ************* * During an upgrade to Mitaka, operators or administrators need to run "python tools/get_action_list.py <service name>" command to generate service action names and values for updating "mistral/actions/openstack/mapping.json", then, run "python tools/sync_db.py" to populate database. Please note, some services like Neutron, Swift, Zaqar don't support the command yet. Deprecation Notes ***************** * Usage of workflow name in the system(e.g. creating executions/cron- triggers , workfow CRUD operations, etc.) is deprecated, please use workflow UUID instead. The workflow sharing feature can only be used with workflow UUID. Security Issues *************** * [bug 1521802 (https://bugs.launchpad.net/mistral/+bug/1521802)] Fixing the problem that sometimes sub-workflow executions were run/saved under the wrong tenant in cron trigger periodic task in multi-tenancy deployment. Bug Fixes ********* * [bug 1518012 (https://bugs.launchpad.net/mistral/+bug/1518012)] [bug 1513456 (https://bugs.launchpad.net/mistral/+bug/1513456)] Fix concurrency issues by using READ_COMMITTED This release note describes bugs: * #1513456 - task stuck in RUNNING state when all action executions are finished regarding the problem and the fix. * #1518012- WF execution stays in RUNNING although task and action executions are in SUCCESS. This fix does not require any action from Mistral users and does not have any implications other than the bug fix. The state of a workflow execution was not updated even when all task executions were completed if some tasks finished at the same time as other tasks. Because we were using our connections with transaction isolation level = REPEATABLE_READ - Each process was using a snapshot of the DB created at the first read statement in that transaction. When a task finished and evaluated the state of all the other tasks it did not see the up-to-date state of those tasks - and so, because not all tasks were completed - the task did not change the workflow execution state. Similar behavior happened with multiple action executions under same task. On completion, each action execution checked the status of the other action executions and did not see the up-to-date state of these action execution - causing task execution to stay in RUNNING state. The solution is to change DB transaction isolation level from REPEATABLE_READ to READ_COMMITTED so process A can see changes committed in other transactions even if process A is in the middle of a transaction. A short explanation regarding the different isolation levels: * REPEATABLE_READ - while in transaction, the first read operation to the DB creates a snapshot of the entire DB so you are guarantee that all the data in the DB will remain the same until the end of the transaction. REPEATABLE_READ example: * ConnectionA selects from tableA in a transaction. * ConnectionB deletes all rows from tableB in a transaction. * ConnectionB commits. * ConnectionA loops over the rows of tableA and fetches from tableB using the tableA_tableB_FK - ConnectionA will get rows from tableB. * READ_COMMITTED - while in a transaction, every query to the DB will get the committed data. READ_COMMITTED example: * ConnectionA starts a transaction. * ConnectionB starts a transaction. * ConnectionA insert row to tableA and commits. * ConnectionB insert row to tableA. * ConnectionB selects tableA and gets two rows. * ConnectionB commits / rollback. Two good articles about isolation levels are: * Differences between READ-COMMITTED and REPEATABLE-READ transaction isolation levels (https://www.percona.com/blog/2015/01/14/mysql-performance- implications-of-innodb-isolation-modes/). * MySQL performance implications of InnoDB isolation modes (https://www.percona.com/blog/2012/08/28/differences-between- read-committed-and-repeatable-read-transaction-isolation- levels/). Changes in mistral 2.0.0.0rc2..2.0.0 ------------------------------------ 1293ea5 Fixing issue with different versions of oslo_messaging Diffstat (except docs and test files) ------------------------------------- mistral/engine/rpc.py | 59 ++++++++++++++++++++++++++++++++++++--------------- 1 file changed, 42 insertions(+), 17 deletions(-)

1 0

[release][neutron] neutron-lbaas 8.0.0 release (mitaka)
by no-reply＠openstack.org 07 Apr '16

07 Apr '16

We are pumped to announce the release of: neutron-lbaas 8.0.0: OpenStack Networking Load Balancing as a Service This release is part of the mitaka release series. For more details, please see below. 8.0.0 ^^^^^ Generation of sample Neutron LBaaS configuration files. New Features ************ * Neutron LBaaS no longer includes static example configuration files. Instead, use tools/generate_config_file_samples.sh to generate them. The files are generated with a .sample extension. Known Issues ************ * CLI update does not allow clearing session_persistence. In the process of fixing the session_persistence update bug, we discovered that the CLI for updating LBaaS v2 pools does not allow one to clear the session_persistence for a pool once set. A fix for this is being prepared, but in the mean time, the following work- arounds are possible if a given pool's session_persistence parameter needs to be changed: * The pool can be deleted and recreated without session_persistence. * A tenant can update the session persistence by talking directly to the API using curl. Bug Fixes ********* * session_persistence on a LBaaSv2 pool is no longer deleted when other pool parameters are updated via the CLI or API. Changes in neutron-lbaas 8.0.0.0rc2..8.0.0 ------------------------------------------ 19b18f0 Constraint requirements using mitaka upper-constraints.txt file Diffstat (except docs and test files) ------------------------------------- tools/tox_install.sh | 2 +- tox.ini | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-)

1 0

[release] cinder 8.0.0 release (mitaka)
by no-reply＠openstack.org 07 Apr '16

07 Apr '16

We are glad to announce the release of: cinder 8.0.0: OpenStack Block Storage This release is part of the mitaka release series. For more details, please see below. 8.0.0 ^^^^^ New Features ************ * Added support for creating a consistency group from a source consistency group in the HPE 3PAR driver. * Disable standard capabilities based on 3PAR licenses. * Added snapshot manage/unmanage support to the HPE 3PAR driver. * Added replication v2.1 support to the Dell Storage Center drivers. * Added v2.1 replication support in Huawei Cinder driver. * Added support for creating, deleting, and updating consistency groups for NetApp 7mode and CDOT backends. * Added support for taking, deleting, and restoring a cgsnapshot for NetApp 7mode and CDOT backends. * Added backend driver for Coho Data storage. * Added cinder backup driver for Google Cloud Storage. * Added driver for Tegile IntelliFlash arrays. * Added ability to backup snapshots. * Support balanced FC port selection for Huawei drivers. * HTTP connector for the Cinder Brocade FC Zone plugin. This connector allows for communication between the Brocade FC zone plugin and the switch to be over HTTP or HTTPs. To make use of this connector, the user would add a configuration setting in the fabric block for a Brocade switch with the name as 'fc_southbound_protocol' with a value as 'HTTP' or 'HTTPS'. * Support for configuring Fibre Channel zoning on Brocade switches through Cinder Fibre Channel Zone Manager and Brocade Fibre Channel zone plugin. To zone in a Virtual Fabric, set the configuration option 'fc_virtual_fabric_id' for the fabric. * The consistency group API now returns volume type IDs. * Added support for API microversions, as well as /v3 API endpoint. * Retype support added to CloudByte iSCSI driver. * All Datera DataFabric backed volume-types will now use API version 2 with Datera DataFabric * It is now possible to delete a volume and its snapshots by passing an additional argument to volume delete, "cascade=True". * New config option to enable discard (trim/unmap) support for any backend. * Added backend driver for DISCO storage. * Cinder FC Zone Manager Friendly Zone Names This feature adds support for Fibre Channel user friendly zone names if implemented by the volume driver. If the volume driver passes the host name and storage system to the Fibre Channel Zone Manager in the conn_info structure, the zone manager will use these names in structuring the zone name to provide a user friendly zone name. * Added backend driver for Fujitsu ETERNUS DX (FC). * Added backend driver for Fujitsu ETERNUS DX (iSCSI). * Added manage/unmanage snapshot support for Huawei drivers. * Added manage/unmanage volume support for Huawei drivers. * Support cinder_img_volume_type property in glance image metadata to specify volume type. * Consistency group support has been added to the LeftHand backend driver. * Added snapshot manage/unmanage support to the HPE LeftHand driver. * Added iSCSI CHAP uni-directional authentication for NetApp drivers. * Support for Consistency Groups in the NetApp E-Series Volume Driver. * Added backend driver for Nexenta Edge iSCSI storage. * Added backend driver for NexentaStor5 iSCSI storage. * Added backend driver for NexentaStor5 NFS storage. * Manage and unmanage support has been added to the Nimble backend driver. * Added additional metrics reported to the scheduler for Pure Volume Drivers for better filtering and weighing functions. * Added config option to enable/disable automatically calculation an over-subscription ratio max for Pure Volume Drivers. When disabled the drivers will now respect the max_oversubscription_ratio config option. * New config option for Pure Storage volume drivers pure_eradicate_on_delete. When enabled will permanantly eradicate data instead of placing into pending eradication state. * Added Cheesecake (v2.1) replication support to the Pure Storage Volume drivers. * Added Migrate and Extend for Nexenta NFS driver. * Added Retype functionality to Nexenta iSCSI and NFS drivers. * Added v2.1 replication support to the HPE 3PAR driver. * Added v2.1 replication support to the HPE LeftHand driver. * Added replication v2.1 support to the IBM Storwize driver. * Added RPC backward compatibility layer similar to the one implemented in Nova. This means that Cinder services can be upgraded one-by-one without breakage. After all the services are upgraded SIGHUP signals should be issued to all the services to signal them to reload cached minimum RPC versions. Alternative is of course restart of them. Please note that cinder-api service doesn't support SIGHUP yet. Please also take into account that all the rolling upgrades capabilities are considered tech preview, as we don't have a CI testing it yet. * Added Consistency Group support in ScaleIO driver. * Added support for manage/unmanage volume in the ScaleIO driver. * Added QoS support in ScaleIO driver. * cinder-backup service is now decoupled from cinder-volume, which allows more flexible scaling. * Split nested quota support into a separate driver. In order to use nested quotas, change the following config "quota_driver = cinder.quota.NestedDbQuotaDriver" after running the following admin API "os-quota-sets/validate_setup_for_nested_quota_use" command to ensure the existing quota values make sense to nest. * Added multiple management IP support to Storwize SVC driver. * Added multiple pools support to Storwize SVC driver. * Added support for ZeroMQ messaging driver in cinder single backend config. * Locks may use Tooz as abstraction layer now, to support distributed lock managers and prepare Cinder to better support HA configurations. * The updated_at timestamp is now returned in listing detail. * Added support for manage volume in the VMware VMDK driver. * Configrable migration rate in VNX driver via metadata * Adds v2.1 replication support in VNX Cinder driver. * Cloning of consistency group added to EMC VNX backend driver. * Added replication v2.1 support to the IBM XIV/DS8K driver. * Support for creating a consistency group from consistency group in XtremIO. * Volume manage/unmanage support for Oracle ZFSSA iSCSI and NFS drivers. Known Issues ************ * Cinder services are now automatically downgrading RPC messages to be understood by the oldest version of a service among all the deployment. Disabled and dead services are also taken into account. It is important to keep service list up to date, without old, unused records. This can be done using "cinder-manage service remove" command. Once situation is cleaned up services should be either restarted or "SIGHUP" signal should be issued to their processes to force them to reload version pins. Please note that cinder-api does not support "SIGHUP" signal. Upgrade Notes ************* * It is required to copy new rootwrap.d/volume.filters file into /etc/cinder/rootwrap.d directory. * Violin Memory 6000 array series drivers are removed. * Adding or removing volume_type_access from any project during DB migration 62 must not be performed. * When running PostgreSQL it is required to upgrade and restart all the cinder-api services along with DB migration 62. * Users of the Datera Cinder driver are now required to use Datera DataFabric version 1.0+. Versions before 1.0 will not be able to utilize this new driver since they still function on v1 of the Datera DataFabric API * The VMware VMDK driver now enforces minimum vCenter version of 5.1. * If during a *live* upgrade from Liberty a backup service will be killed while processing a restore request it may happen that such backup status won't be automatically cleaned up on the service restart. Such orphaned backups need to be cleaned up manually. * When performing a *live* upgrade from Liberty it may happen that retype calls will reserve additional quota. As by default quota reservations are invalidated after 24 hours (config option "reservation_expire=86400"), we recommend either decreasing that time or watching for unused quota reservations manually during the upgrade process. * HP drivers have been rebranded to HPE. Existing configurations will continue to work with the legacy name, but will need to be updated by the next release. * The deprecated HP CLIQ proxy driver has now been removed. * Users of the ibmnas driver should switch to using the IBM GPFS driver to enable Cinder access to IBM NAS resources. For details configuring the IBM GPFS driver, see the GPFS config reference. - http://docs.openstack.org/liberty/config-reference/content/GPFS- driver.html * Removed deprecated LVMISCSIDriver and LVMISERDriver. These should be switched to use the LVMVolumeDriver with the desired iscsi_helper configuration set to the desired iSCSI helper. * Removed the deprecated NPIV options for the Storwize backend driver. * Backend driver for Scality SRB has been removed. * Rename Huawei18000ISCSIDriver and Huawei18000FCDriver to HuaweiISCSIDriver and HuaweiFCDriver. * Starting from Mitaka release Cinder is having a tech preview of rolling upgrades support. * Removed force_delete option from ScaleIO configuration. * As cinder-backup was strongly reworked in this release, the recommended upgrade order when executing live (rolling) upgrade is c-api->c-sch->c-vol->c-bak. * Nested quotas will no longer be used by default, but can be configured by setting "quota_driver = cinder.quota.NestedDbQuotaDriver" * Removed storwize_svc_connection_protocol config setting. Users will now need to set different values for volume_driver in cinder.conf. FC:volume_driver = cinder.volume.drivers.ibm.storwize_svc.storwize_ svc_fc.StorwizeSVCFCDriver iSCSI:volume_driver = cinder.volume.driv ers.ibm.storwize_svc.storwize_svc_iscsi.StorwizeSVCISCSIDriver * The VMware VMDK driver for ESX server has been removed. Deprecation Notes ***************** * datera_api_token -- this has been replaced by san_login and san_password * The XML API has been marked deprecated and will be removed in a future release. * Deprecated IBM driver _multipath_enabled config flags. Security Issues *************** * Pure Storage Volume Drivers can now utilize driver_ssl_cert_verify and driver_ssl_cert_path config options to allow for secure https requests to the FlashArray. Bug Fixes ********* * Fixed bug causing snapshot creation to fail on systems with LC_NUMERIC set to locale using ',' as decimal separator. * Cinder will now correctly read Keystone's endpoint for quota calls from keystone_authtoken.auth_uri instead of keymgr.encryption_auth_url config option. * Fixed service state reporting when backup manager is unable to initialize one of the backup drivers. * Consistency group creation previously scheduled at the pool level. Now it is fixed to schedule at the backend level as designed. * Removed the need for deployers to run tox for config reference generation. * upload-to-image using Image API v2 now correctly handles custom image properties. * Enabled a cloud operator to correctly manage policy for volume type operations. To permit volume type operations for specific user, you can for example do as follows. * Add "storage_type_admin" role. * Add "admin_or_storage_type_admin" rule to "policy.json", e.g. ""admin_or_storage_type_admin": "is_admin:True or role:storage_type_admin"," * Modify rule for types_manage and volume_type_access, e.g. ""volume_extension:types_manage": "rule:admin_or_storage_type_admin", "volume_extension:volume_type_access:addProjectAccess": "rule:admin_or_storage_type_admin", "volume_extension:volume_type_access:removeProjectAccess": "rule:admin_or_storage_type_admin"," * Fixed issue where Pure Volume Drivers would ignore reserved_percentage config option. * Allow for eradicating Pure Storage volumes, snapshots, and pgroups when deleting their Cinder counterpart. * Corrected quota usage when transferring a volume between tenants. * Previously the only way to remove volumes in error states from a consistency-group was to delete the consistency group and create it again. Now it is possible to remove volumes in error and error_deleting states. * Fix for Tintri image direct clone feature. Fix for the bug 1400966 prevents user from specifying image "nfs share location" as location value for an image. Now, in order to use Tintri image direct clone, user can specify "provider_location" in image metadata to specify image nfs share location. NFS share which hosts images should be specified in a file using tintri_image_shares_config config option. * Filtering volumes by their display name now correctly handles display names with single and double quotes. Other Notes *********** * Due to the ibmnas (SONAS) driver being rendered redundant by the addition of NFS capabilities to the IBM GPFS driver, the ibmnas driver is being removed in the Mitaka release. Changes in cinder 8.0.0.0rc1..8.0.0 ----------------------------------- 73b9976 Huawei: Fix getting admin_metadata 2adc8bb Imported Translations from Zanata e2cf243 NexentaStor4 iSCSI: convert blocksize to str da28ab6 Imported Translations from Zanata 9a8f9ee Imported Translations from Zanata 4dbb274 XtremIO handle errors in terminate_connection: ee4dc38 Imported Translations from Zanata 9d90a0a Imported Translations from Zanata 5424566 Imported Translations from Zanata ae388af Imported Translations from Zanata f9ad35a Imported Translations from Zanata c1e6472 Report 2.0 as supported version of RPC APIs 37c0556 Fix volume RPC API methods related to backups 755253e Imported Translations from Zanata a6b4a84 Imported Translations from Zanata 16a1d80 Imported Translations from Zanata d292fe1 Dell SC: create_cgsnapshot returning wrong structure 50e124e Imported Translations from Zanata cf686d8 Fix race condition when toggling SP 6138aca Huawei: Record and check LUN wwn 691db5a SMBFS: fix parsing volume type extra specs and metadata 38fc0b4 VMware: Bump driver version e784fcf Update .gitreview for stable/mitaka Diffstat (except docs and test files) ------------------------------------- .gitreview | 1 + cinder/backup/manager.py | 8 +- cinder/exception.py | 5 + cinder/locale/cinder-log-error.pot | 493 +- cinder/locale/cinder-log-info.pot | 554 +- cinder/locale/cinder-log-warning.pot | 433 +- cinder/locale/cinder.pot | 1354 +-- cinder/locale/cs/LC_MESSAGES/cinder-log-error.po | 7 +- cinder/locale/cs/LC_MESSAGES/cinder-log-info.po | 35 +- cinder/locale/cs/LC_MESSAGES/cinder-log-warning.po | 20 +- cinder/locale/cs/LC_MESSAGES/cinder.po | 24 +- cinder/locale/de/LC_MESSAGES/cinder.po | 2616 ++++- cinder/locale/es/LC_MESSAGES/cinder.po | 2641 ++++- cinder/locale/fr/LC_MESSAGES/cinder.po | 2770 ++++- cinder/locale/it/LC_MESSAGES/cinder-log-error.po | 995 +- cinder/locale/it/LC_MESSAGES/cinder-log-info.po | 3773 +++++++ cinder/locale/it/LC_MESSAGES/cinder.po | 59 +- cinder/locale/ja/LC_MESSAGES/cinder.po | 10677 +++++++++++++++++++ .../locale/ko_KR/LC_MESSAGES/cinder-log-error.po | 3500 ++++++ cinder/locale/ko_KR/LC_MESSAGES/cinder-log-info.po | 3593 +++++++ cinder/locale/ko_KR/LC_MESSAGES/cinder.po | 2496 ++++- cinder/locale/pt_BR/LC_MESSAGES/cinder.po | 2568 ++++- cinder/locale/ru/LC_MESSAGES/cinder.po | 2535 ++++- .../locale/tr_TR/LC_MESSAGES/cinder-log-error.po | 7 +- cinder/locale/tr_TR/LC_MESSAGES/cinder-log-info.po | 12 +- cinder/locale/zh_CN/LC_MESSAGES/cinder.po | 88 +- cinder/locale/zh_TW/LC_MESSAGES/cinder.po | 101 +- cinder/scheduler/manager.py | 8 +- .../drivers/dell/dell_storagecenter_common.py | 8 +- cinder/volume/drivers/emc/emc_vnx_cli.py | 80 +- cinder/volume/drivers/emc/xtremio.py | 45 +- cinder/volume/drivers/huawei/constants.py | 3 + cinder/volume/drivers/huawei/huawei_driver.py | 182 +- cinder/volume/drivers/huawei/huawei_utils.py | 13 + cinder/volume/drivers/huawei/replication.py | 15 +- cinder/volume/drivers/huawei/rest_client.py | 7 +- cinder/volume/drivers/nexenta/iscsi.py | 3 +- cinder/volume/drivers/smbfs.py | 38 +- cinder/volume/drivers/vmware/vmdk.py | 3 +- cinder/volume/manager.py | 8 +- cinder/volume/rpcapi.py | 14 +- 47 files changed, 40089 insertions(+), 2043 deletions(-)

1 0