[release-announce] tempest 19.0.0 (rocky)

no-reply at openstack.org no-reply at openstack.org
Thu Aug 16 14:38:24 UTC 2018


We are gleeful to announce the release of:

tempest 19.0.0: OpenStack Integration Testing

This release is part of the rocky release series.

Download the package from:

    https://pypi.org/project/tempest

For more details, please see below.

19.0.0
^^^^^^


Prelude
*******

This release is to tag the Tempest for OpenStack Rocky release. After
this release, Tempest will support below OpenStack Releases:

   * Rocky

   * Queens

   * Pike

   * Ocata

Current development of Tempest is for OpenStack Stein development
cycle. Every Tempest commit is also tested against master during the
Stein cycle. However, this does not necessarily mean that using
Tempest as of this tag will work against a Stein (or future release)
cloud. To be on safe side, use this tag to test the OpenStack Rocky
release.


New Features
************

* Add "v3-ext/OS-ENDPOINT-POLICY" API calls to support creation,
  deletion and retrieval of associations between service endpoints and
  policies. Such associations enable an endpoint to request its
  policy.

* Add "enable_service", "disable_service" , "disable_log_reason",
  "freeze_host" and "thaw_host" API endpoints to volume v3
  "services_client".

* Add a new parameter called "bug_type" to
  "tempest.lib.decorators.related_bug" and
  "tempest.lib.decorators.skip_because" decorators, which accepts 2
  values:

  * launchpad

  * storyboard

  This offers the possibility of tracking bugs related to tests using
  launchpad or storyboard references. The default value is launchpad
  for backward compatibility.

  Passing in a non-digit "bug" value to either decorator will raise a
  "InvalidParam" exception (previously "ValueError").

* Add update flavor API to compute flavors_client library.

* [blueprint application-credentials
  (https://blueprints.launchpad.net/keystone/+spec/application-
  credentials)] Tempest can test keystone's application credentials
  interface. A new client library is added for application
  credentials, and a new config option, "[identity-feature-
  enabled]/application_credentials", can control whether the
  application credentials feature is tested (defaults to False,
  indicating the feature is not enabled in the cloud under test).

* Add "project_tags_client" to the identity v3 library. This feature
  enables the possibility of invoking the following API actions:

  * update_project_tag

  * list_project_tags

  * update_all_project_tags

  * check_project_tag_existence

  * delete_project_tag

  * delete_all_project_tags

* The "update_service" API is added to the "services_client" compute
  library. This API is introduced in microversion 2.53 and supersedes
  the following APIs:

  * "PUT /os-services/disable" ("disable_service")

  * "PUT /os-services/disable-log-reason" ("disable_log_reason")

  * "PUT /os-services/enable" ("enable_service")

  * "PUT /os-services/force-down" ("update_forced_down")

* New string configuration option "vnc_server_header" is added to
  "compute-feature-enabled" section. It offers to provide VNC server
  name that is to be expected in the responce header. For example,
  obvious at hand names is 'WebSockify', 'nginx'.

* Adds volume service clients for v3 APIs. As v3 base API should be
  identical to v2 APIs, we just copy all existing v2 service client
  for v3 API.


Upgrade Notes
*************

* Cinder CLI calls have now been updated to use the "--os-endpoint-
  type" option instead of "--endpoint-type". The latter had been
  deprecated in Cinder and has been removed in the Rocky release.

* Remove deprecated config option "allow_tenant_isolation" from
  "auth" and "compute" groups. Use "use_dynamic_credentials" directly
  instead of the removed option.

* The volume config option "catalog_type" default is changed to
  "volumev3" which is v3 API endpoint configured in devstack. With
  this change Tempest will be testing v3 API as default. User who want
  to test v2 API can still test by configuring the "catalog_type" to
  v2 endpoint.


Deprecation Notes
*****************

* The v2 volume API has been deprecated since Pike release. Volume
  v3 API is current and Tempest volume tests can be run against v2 or
  v3 API based on config option "CONF.volume.catalog_type". If
  catalog_type is "volumev2", then all the volume tests will run
  against v2 API. If catalog_type is "volumev3" which is default in
  Tempest, then all the volume tests will run against v3 API. That
  makes below config options unusable in Tempest which used to select
  the target volume API for volume tests.

  * "CONF.volume-feature-enabled.api_v2"

  * "CONF.volume-feature-enabled.api_v3"

  Tempest deprecate the above two config options in Rocky release and
  will be removed in future. Alternatively "CONF.volume.catalog_type"
  can be used to run the Tempest against volume v2 or v3 API.

* Deprecates the volume service clients for v2 APIs. Volume v2 APIs
  are deprecated in all supported stable branches, so it's time to
  deprecate the tempest service clients for v2 APIs and remove in
  future release.


Security Issues
***************

* The x-subject-token of a response header is ommitted from log, but
  clients specify the same token on a request header on Keystone API
  and that was not omitted. In this release, that has been omitted for
  a security reason.


Bug Fixes
*********

* Fix show_image_file interface in v2 ImagesClient: Bug#1756264. The
  expected success code of show_image_file is changed from "200" to
  "[200, 204, 206]".

* Fix VNC server response header issue when it is behind reverse
  proxy

Changes in tempest 18.0.0..19.0.0
---------------------------------

8316f96 Fix python pkg format issue
3662499 Fix 'ref' format errors in README file
94743a1 Add releasenote to tag the Tempest for Rocky release
f2f4384 Deprecate volume api selection config option
54ea756 Fix disabled_reason's type in services schema
71d6c78 Add server schema for microversion 2.63
e2b4d85 Add server schema for microversion 2.57
eb05a24 Add server schema for microversion 2.54
6b2ca54 Fill servers schema gap in microversion 2.47/2.48
fc37012 trivial: Fix some compute api_schema formatting nits
ac4e444 Fill quota schema for microversion 2.36/2.57
4af2c82 Fill aggregate schema for microversion 2.41
68bf375 Fixing test "test_verify_glance_version_no_v2_with_v1_1"
8b83826 Remove api_version setting from volume v3/v2 service client
d5f6e16 Add comment for schema change in microversion 2.13
ec26042 Fill schema gap in flavors.py
a944504 Added tempest_black_regex to skip tempest tests
1a6c15a Add comment for schema change in microversion 2.19
6c682ff Make volume client alias with _latest suffix
a2260de Adding links to git reference in docs
ab7d790 Pass "access_point" server to get_remote_client
10326c7 Convert tempest-scenario-all job to tempest-slow
1e53a94 Fix typo xpvnc in get_remote_console schema
459a7a5 use fqdn for zuul projects
2e354d7 Use --os-endpoint-type for Cinder CLI
2b47ccb Check API extension 'filter-validation'
313dcc1 Add server schema for microversion 2.26
df03731 Dynamic width count for plugin registry table column
4803e29 Add more information for InvalidCredentials exception
e612431 Add server schema for microversion 2.19
432e2bd Add server schema for microversion 2.16
79d8b0f Log server console output during create/get timestamp
cc97220 Fill server schema for microversion 2.9
8013413 Modify limits fields according to microversion
4d011af Hacking checks for negative test cases
15d7565 Add server schema for microversion 2.6
fe2058b Fill servers schema for microversion 2.3
2cdc78f Fix broken image api ref url
1290e49 Move server groups schema into its own file
3b8ddfe Move all volume v2 service client unit tests to v3 dir
4e2a957 Skip verifying empty devices in test_tagged_attachment until bug is fixed
e913e46 Avoid server_check_teardown exception breaking tearDown
3b26b9f Removing unused attributes from test_run.py
992237d refactor: Prepare test_list_projects for pre-prov
15140ee Use a smaller number for checking console log length
be7be1b Move creating server group from resource_setup to setUp
86b0e4c Make instance_action_events.traceback a non-required field
c6e5128 Add server tags schema in servers.py
32eb7c1 Move volume v2 service client unit tests to v3 dir
feab4d1 Remove unused class variables
fcda77b Replace volume size with configured value
1bf4394 Remove unnecessary body assignment
0f02c1c Skip list FIP test for neutron new behaviour
ec1b111 Add irrelevant-files to nova-multiattach job in .zuul.yaml
bcb7117 Do not check flavor.id after Microversion 2.46
e495cd2 trivial: Fix typos in the documentation page
95a3169 Correct the usage on listing neutron ports
389b562 Set max_microversion 2.43 for virtual_interfaces tests
2902a7b Omit X-Subject-Token from log
5a7e97e Cap additional nova-network tests at Queens
eb70a96 Add additional log of meta_data devices content
408a97b Create port with port_vnic_type and port_profile from config
f89ab81 docs: Add information on test removal/interop to REVIEWING
7d8c281 Added storyboard integration to tempest.lib decorators
372bfd3 Use the same timeout as in the legacy job
553d7cb Remove deprecated allow_tenant_isolation option
99585f3 Port tempest-scenario-all to zuul v3
0c42d3f remove skip for test_connectivity_between_vms_on_different_networks
c384bc4 trivial: Fix typos in the test_removal documentation page
c0348ee Add update_service to compute services_client library
46920b8 docs: Add HACKING information about test attributes
8db0707 Rename scenario job and make it voting
a3c5a79 Move live migration tests out of scenario job
b031d30 Merge volume message list and show testcases
23adcc1 Add api refs for volume snapshots client and network agents client
10c28b8 Move unset_flavor_extra_specs to extra specs file
d201cd3 Add compute microversion 2.61 schema in flavors_client
0ec74c4 Add extra_msg and server parameter to check_vm_connectivity
dd09bd9 trivial: fix some incorrect compute microversion references
285b3f8 Move test_tokens test to static
7f4a621 Mark raw strings as such
a6353c4 tox: Silence warnings from stdlib libraries
d99030e Adding additional assertions for retype test
5972362 refactor: Combine nearly duplicate group tests together
d441507 refactor: Add setup_test_group to identity admin base test class
87a7182 no force_tenant_isolation in endpoint tests
e027dd3 Add related bug info for resize test
a3a67d4 Adding test case for migration policy 'never'
e5107be Update image creation error msg to mention the correct image type
1444606 Run nova-live-migration job in check as n-v
0691ee5 Improve Tempest workspace manager unit test coverage
16d9cf0 Cleanup v18.0.0 release notes' prelude
b4fb438 Cleanup networks resources at test level
9594233 Fix some typos on the types and encryption types client
247841e Move Stable branch Policy Doc outside of coding guide
91e8852 Add api ref links for snapshots and volume types clients
408cf57 Add extra apis to volume v3 services client
04e1d67 Fix volume backup test
d1be501 Add status check for creating volume backup
8827d38 Fix TestInterfaceWaiters
1fa4464 Add new schema for Nova microversion 2.63
7d2b636 Filter out implied roles
145a0e0 Move nova cell v1 job to check pipeline
1604a38 Revert "Add server name check for multiple creations"
781fe07 Fix typos replace seperate with separate
a08b4e6 Delete a cg-snapshot following updated volumes
373f985 Move skip condition under skip_checks method
14e5e48 Cap nova-network tests at Queens
05232f5 Remove volume v2 service client warning
cc59f9d Fix race condition in device tag testing
e1f990b Adding a note for test case test_volume_boot_pattern().
d903e1d Fix tests for call_until_true function.
5aeb551 trivial: Fix reno typos
db84920 Replace Chinese quotes with English quotes
688f36e Write tempest-multinode-full as zuulv3 native
7f6f0c1 Add api ref links for network agents_client
c460c42 Remove force_tenant_isolation from Cinder tests
e0d43e3 Fix test_http test case.
3317370 To cleanup the awaiting-state volume
210f184 Document branch support policy for extended maint branches
010c0b0 Remove python 2.6 docref
7ba2272 Use inline literal markup for options in releasenotes
112b844 Switch to use primary credential in volume backup tests
2766ca8 Modify quota set fields according to microversion
1afb44b Add cinder v2 experimental job
0a83c71 Fix indentation in README.rst
e3e7b27 Refactor random naming
d539465 Add compute microversion 2.57 schema in servers_client
c50cc24 Assert volume deletion in test_image_defined_boot_from_volume
b6b2bba Integration tests for tagged attach
a77c7d6 Improve use of RemoteClient in device tagging test
3306d42 Add wait_for_interface_detach method
df0d6d7 Add tests for wait_for_interface_status
a90ade0 Add test to shelve the paused server: bug# 1745529
b59f458 Add server name check for multiple creations
85a4b0a Add compute microversion 2.54 schema in servers_client
6d593b9 Remove test_get_service_by_service_and_host_name
de676ba Move volume v2 service clients to v3 dir
89c213f Volume Service Testing: default to v3 endpoints
a7aac72 Use assertTrue and assertFalse vs assertEqual
e496598 Cleanup ignored_list_T110.txt
402df09 Migrate legacy scenario job to tempest in-tree
3b79f17 Check status code when downloading empty file
e20e6a8 Backup and restore scenario
f4413c4 Add service tagging for 'test_iscsi_volume'
591fe21 Add nova-live-migration to experimental queue jobs
a8ace72 Fill update, rebuild, list API response schema for 2.47
7c189a0 Fill update, rebuild API response schema for 2.26
c71c287 Fill update, rebuild API response schema for 2.19
eac627b Fill update, rebuild API response schema for 2.9
e3a2251 Add test Migrating a volume from created snapshot
c32ee7d Replacing get_vnc_console with get_remote_console after microversion 2.6
34b5503 Fix listing servers by invalid status after V2.38
40891d2 Do not pass disk_over_commit after Microversion 2.25
cac5115 Trivial docstring cleanup in TestServerAdvancedOps
814a87c Modify the empty list ensure method
52c5d28 Add 2.55 schema & update flavor API in flavors_client
263bfd8 Follow the new PTI for document build
ff03e22 Add job to run tempest-full with Python 3.6
0e52d4e Add tests for application credentials
2d6bcaa Fix code to pass pep8 Tox environment.
95b68be Skip puppet-* projects for plugin search
66b9aed Add common method to check the microversion compatibility
3f5c139 Trivial: Fix the comment of TempestConfigPrivate
b289f8a Improve patch and patchobject Base test case method attributes.
cb19769 Fix test_snapshot_list_param_marker when using predefined user
e2fbd41 Use new encryption provider constants
2db6c27 Cleanup and rename test_create_ebs_image_and_check_boot
a3b2d8e Add identity v3 project tags client
82b6aeb VNC harcoded server name removed
30d8b8e Replace list_hypervisors with list_services
f22f7de Removing the skip decorator as bug 1687044 was already resolved
8c9d436 Fix TypeError in _unshelve_server
18610f9 Fix a plural mistake REVIEWING.rst
98cf467 Fix a capitalization mistake in README.rst
356f059 Docs: Elaborate on feature flag in HACKING file
50325e2 Don't use hypervisor_hostname as compute hostname
f642a13 Set max_microversion 2.35 for nova floating ip bulk tests
daba94f Set max_microversion 2.35 for nova network tests
2856ad5 Fix image_id KeyError in test_create_backup
0549a2e Set max_microversion 2.35 for nova tenant network tests
95d7525 Set max_microversion 2.35 for nova security group tests
f778600 Updated from global requirements
a2bffbd [Trivial]Add coverage for creating snapshot from non-blank volume
3f219f5 Run all scenario in parallel
aacf6e8 Do not fail on stackviz issues
88c7ea8 Replacing deprecated list_hosts with list_hypervisors
8b3dc86 Add verbose option for stdout in subunit_describe_call
fd5a14b Fix expected response code of show_image_file
641f43b Set max_microversion 2.38 for nova image-metadata tests
1382e97 Fix typos in release notes
4b1b9df Fix test_host_name_is_same_as_server_name
6f96078 Add project_tags identity feature flag
20b9538 Updated from global requirements
34afeb2 Skip adding host to aggregate with az if host already in other zone
e739804 Set max_microversion 2.42 for hosts tests
17f7371 Updated from global requirements
fa64e6f Update links in README
fdee065 Rename duplicated class name AttachVolumeMultiAttachTest
17cc37e Remove unnecessary indentations in releasenotes index
b191b05 Add release notes page for 17.1.0 & 17.2.0
01ff7c6 Add volume-attached resize revert server test
44f666b Add nova-cells-v1 to experimental queue jobs
fe3a03f Update port profile only if defined
26a7e5a Use create_test_server wrapper for server creation
4c9d365 [Trivial]Add coverage for extending non-blank volume
36214c5 Do not use skip_checks in TestVolumeBootPattern
05a2fa0 Add release notes page for 18.0.0
ac140fe Use fetch-subunit-output role
f8ff1ff Update image using 'owner' parameter
ef1a16d Add support for blacklist file for Zuul jobs
aa5dd9a Connect to default ports if none are specified
03a463b Add a negative test about attaching a in-use volume to the different server
8032b2e Disable warnings as errors for sphinx
11b2800 Fix create_volume_snapshot under scenario
98f8f08 Remove force_tenant_isolation from FloatingIPAdminTestJSON
39d0380 Stop running plugin-sanity job for doc and req changes
1269c61 Keystone v3-ext/OS-ENDPOINT-POLICY endpoints implementation.
589f315 Add network internal connectivity check to VMs


Diffstat (except docs and test files)
-------------------------------------

.zuul.yaml                                         | 354 +++++++++++++++++----
HACKING.rst                                        |  73 ++++-
README.rst                                         |  31 +-
REVIEWING.rst                                      |  41 ++-
playbooks/devstack-tempest.yaml                    |   2 +-
playbooks/post-tempest.yaml                        |   7 +-
...2.0-service_client_config-8a1d7b4de769c633.yaml |   2 +-
...ntent-type-without-spaces-b2c9b91b257814f3.yaml |   4 +-
...empest-run-combine-option-e94c1049ba8985d5.yaml |   6 +-
...create-server-tags-client-8c0042a77e859af6.yaml |   2 +-
...e-resources-prefix-option-ad490c0a30a0266b.yaml |   2 +-
..._security_disabled-option-d0ffaeb2e7817707.yaml |   4 +-
...ion-config-options-part-2-5cd17b6e0e6cb8a3.yaml |   2 +-
...-to-policy-client-library-b8279c18335588c9.yaml |   6 +
...volume-v3-services-client-bf9b235cf5a611fe.yaml |   6 +
.../notes/add-load-list-cmd-35a4a2e6ea0a36fd.yaml  |   4 +-
...ort-profile-config-option-2610b2fa67027960.yaml |  12 +-
.../add-save-state-option-5ea67858cbaca969.yaml    |   3 +-
...-to-network-quotas-client-3fffd302cc5d335f.yaml |   4 +-
...in-skip-because-decorator-3e139aa8a4f7970f.yaml |  17 +
...kwargs-in-call-until-true-a91k592h5a64exf7.yaml |   2 +-
...or--api-to-flavors-client-a859542fe54aab7c.yaml |   4 +
...p-application-credentials-df69b1f617db1bb9.yaml |   9 +
...nder-use-os-endpoint-type-c11f63fd468ceb4c.yaml |   6 +
...mpare-header-version-func-de5139b2161b3627.yaml |   2 +-
...-selection-config-options-b95c5c0ccbf38916.yaml |  19 ++
...-image-file-expected-code-92d97342d0f6d60e.yaml |   6 +
...ty-v3-project-tags-client-36683c6a8644e54b.yaml |  12 +
..._X-Subject-Token_from_log-1bf5fef88c80334b.yaml |   7 +
...w_tenant_isolation-option-03f0d998eb498d44.yaml |   6 +
...ib-compute-update-service-6019d2dcfe4a1c5d.yaml |  11 +
.../tempest-rocky-release-0fc3312053923380.yaml    |  16 +
.../tempest-run-fix-updates-564b41706decbba1.yaml  |   4 +-
...-delete-directory-feature-74d6d157a5a05561.yaml |   2 +-
...coded-server-name-removed-6f8d1e90a175dc08.yaml |  10 +
...g-default-to-v3-endpoints-20b86895a590925d.yaml |   8 +
...volume-v3-service-clients-a863a6336af56cca.yaml |  12 +
releasenotes/source/index.rst                      |  27 +-
releasenotes/source/v17.1.0.rst                    |   6 +
releasenotes/source/v17.2.0.rst                    |   6 +
releasenotes/source/v18.0.0.rst                    |   6 +
requirements.txt                                   |   6 +-
roles/process-stackviz/README.rst                  |   6 +-
roles/process-stackviz/defaults/main.yaml          |   2 +-
roles/process-stackviz/tasks/main.yaml             |   6 +-
roles/run-tempest/README.rst                       |  23 ++
roles/run-tempest/defaults/main.yaml               |   1 +
roles/run-tempest/tasks/main.yaml                  |  18 +-
setup.cfg                                          |   6 -
tempest/README.rst                                 |  10 +-
tempest/api/compute/admin/test_aggregates.py       |  64 +++-
.../api/compute/admin/test_aggregates_negative.py  |  27 +-
.../compute/admin/test_auto_allocate_network.py    |   4 +-
.../compute/admin/test_flavors_microversions.py    |  51 +++
.../api/compute/admin/test_floating_ips_bulk.py    |   4 +
tempest/api/compute/admin/test_hosts.py            |   2 +
tempest/api/compute/admin/test_hosts_negative.py   |   2 +
tempest/api/compute/admin/test_live_migration.py   |   4 +-
.../compute/admin/test_live_migration_negative.py  |   7 +-
tempest/api/compute/admin/test_migrations.py       |   2 +-
tempest/api/compute/admin/test_networks.py         |   1 +
tempest/api/compute/admin/test_quotas.py           | 142 ++++++---
tempest/api/compute/admin/test_quotas_negative.py  |  13 +-
.../admin/test_security_group_default_rules.py     |   1 +
tempest/api/compute/admin/test_security_groups.py  |   1 +
tempest/api/compute/admin/test_servers.py          |  13 +-
tempest/api/compute/admin/test_services.py         |  12 -
.../api/compute/admin/test_services_negative.py    |  45 ++-
tempest/api/compute/admin/test_volume_swap.py      |   4 +-
tempest/api/compute/base.py                        | 115 +++++--
tempest/api/compute/images/test_image_metadata.py  |   1 +
.../compute/images/test_image_metadata_negative.py |   1 +
.../images/test_images_oneserver_negative.py       |   5 +-
.../api/compute/keypairs/test_keypairs_negative.py |   2 +-
tempest/api/compute/limits/test_absolute_limits.py |  31 +-
.../limits/test_absolute_limits_negative.py        |   8 +-
tempest/api/compute/security_groups/base.py        |   1 +
tempest/api/compute/servers/test_create_server.py  |  11 +-
tempest/api/compute/servers/test_device_tagging.py | 231 ++++++++++----
.../compute/servers/test_list_server_filters.py    |   2 +-
.../compute/servers/test_list_servers_negative.py  |  14 +-
tempest/api/compute/servers/test_novnc.py          |  47 ++-
tempest/api/compute/servers/test_server_actions.py | 100 ++++--
tempest/api/compute/servers/test_server_group.py   |  12 +-
tempest/api/compute/servers/test_servers.py        |  51 +++
.../compute/servers/test_servers_microversions.py  |  66 ++++
.../api/compute/servers/test_servers_negative.py   |   7 +-
.../api/compute/servers/test_virtual_interfaces.py |   7 +-
.../servers/test_virtual_interfaces_negative.py    |   5 +
tempest/api/compute/test_networks.py               |   2 +
tempest/api/compute/test_quotas.py                 |  19 +-
tempest/api/compute/test_tenant_networks.py        |   1 +
.../compute/volumes/test_attach_volume_negative.py |  13 +
tempest/api/identity/admin/v2/test_tenants.py      |  14 +-
.../admin/v3/test_application_credentials.py       |  48 +++
tempest/api/identity/admin/v3/test_domains.py      |   6 +-
tempest/api/identity/admin/v3/test_endpoints.py    |   4 +
.../identity/admin/v3/test_endpoints_negative.py   |   5 +-
tempest/api/identity/admin/v3/test_groups.py       |  66 ++--
.../api/identity/admin/v3/test_list_projects.py    |  28 +-
tempest/api/identity/admin/v3/test_project_tags.py |  66 ++++
tempest/api/identity/admin/v3/test_projects.py     |  15 +-
tempest/api/identity/admin/v3/test_roles.py        |  15 +-
tempest/api/identity/admin/v3/test_tokens.py       |  30 +-
tempest/api/identity/base.py                       |  44 +++
tempest/api/identity/v2/test_users.py              |   2 +-
.../identity/v3/test_application_credentials.py    |  85 +++++
tempest/api/identity/v3/test_tokens.py             |  25 ++
tempest/api/identity/v3/test_users.py              |   2 +-
tempest/api/image/v1/test_images.py                |  12 +-
tempest/api/image/v2/admin/test_images.py          |  18 ++
tempest/api/image/v2/test_images.py                |  11 +
.../admin/test_external_network_extension.py       |  12 +-
.../admin/test_floating_ips_admin_actions.py       |   1 -
tempest/api/network/admin/test_negative_quotas.py  |   2 +-
tempest/api/network/test_floating_ips.py           |  13 +-
tempest/api/network/test_ports.py                  |  61 ++--
tempest/api/network/test_routers.py                |  61 +++-
tempest/api/volume/admin/test_group_snapshots.py   |  51 +++
tempest/api/volume/admin/test_multi_backend.py     |   7 +-
tempest/api/volume/admin/test_user_messages.py     |  22 +-
tempest/api/volume/admin/test_volume_hosts.py      |   4 +-
tempest/api/volume/admin/test_volume_quotas.py     |  70 ++--
.../volume/admin/test_volume_quotas_negative.py    |  19 +-
tempest/api/volume/admin/test_volume_retype.py     | 180 +++++++++++
.../admin/test_volume_retype_with_migration.py     | 107 -------
.../volume/admin/test_volume_services_negative.py  |  64 ++++
.../admin/test_volume_snapshot_quotas_negative.py  |  19 +-
tempest/api/volume/admin/test_volumes_backup.py    |  35 +-
tempest/api/volume/base.py                         |  71 ++---
tempest/api/volume/test_volume_absolute_limits.py  |   8 +-
tempest/api/volume/test_volume_transfers.py        |  15 +-
tempest/api/volume/test_volumes_backup.py          |  10 +-
tempest/api/volume/test_volumes_extend.py          |   7 +-
tempest/api/volume/test_volumes_negative.py        |   9 +-
tempest/api/volume/test_volumes_snapshots.py       |  16 +-
tempest/api/volume/test_volumes_snapshots_list.py  |  10 +-
.../api/volume/test_volumes_snapshots_negative.py  |   4 +-
tempest/clients.py                                 |  90 ++++--
tempest/cmd/account_generator.py                   |   1 +
tempest/cmd/cleanup_service.py                     |  29 +-
tempest/cmd/init.py                                |   4 +-
tempest/cmd/run.py                                 |   2 +-
tempest/cmd/subunit_describe_calls.py              |  22 +-
tempest/cmd/verify_tempest_config.py               |   1 +
tempest/common/compute.py                          |  16 +-
tempest/common/credentials_factory.py              |   1 +
tempest/common/custom_matchers.py                  |   4 +-
tempest/common/utils/__init__.py                   |   1 +
tempest/common/waiters.py                          |  21 ++
tempest/config.py                                  |  48 ++-
tempest/hacking/checks.py                          |  45 ++-
tempest/hacking/ignored_list_T110.txt              |   1 -
.../api_schema/response/compute/v2_1/flavors.py    |  10 +-
.../response/compute/v2_1/flavors_extra_specs.py   |   8 +-
.../response/compute/v2_1/server_groups.py         |  65 ++++
.../api_schema/response/compute/v2_1/servers.py    |  57 +---
.../api_schema/response/compute/v2_11/services.py  |   7 +
.../response/compute/v2_13/server_groups.py        |  37 +++
.../api_schema/response/compute/v2_13/servers.py   |  34 --
.../api_schema/response/compute/v2_16/servers.py   |  12 +-
.../api_schema/response/compute/v2_19/servers.py   |  20 +-
.../api_schema/response/compute/v2_26/servers.py   |  28 +-
.../api_schema/response/compute/v2_3/servers.py    |  11 +-
.../api_schema/response/compute/v2_36/__init__.py  |   0
.../api_schema/response/compute/v2_36/limits.py    |  35 ++
.../api_schema/response/compute/v2_36/quotas.py    |  54 ++++
.../api_schema/response/compute/v2_39/__init__.py  |   0
.../api_schema/response/compute/v2_39/limits.py    |  29 ++
.../api_schema/response/compute/v2_41/__init__.py  |   0
.../response/compute/v2_41/aggregates.py           |  54 ++++
.../api_schema/response/compute/v2_47/servers.py   |  31 +-
.../api_schema/response/compute/v2_48/servers.py   |  16 +
.../api_schema/response/compute/v2_53/__init__.py  |   0
.../api_schema/response/compute/v2_53/services.py  |  71 +++++
.../api_schema/response/compute/v2_54/__init__.py  |   0
.../api_schema/response/compute/v2_54/servers.py   |  57 ++++
.../api_schema/response/compute/v2_55/__init__.py  |   0
.../api_schema/response/compute/v2_55/flavors.py   | 120 +++++++
.../api_schema/response/compute/v2_57/__init__.py  |   0
.../api_schema/response/compute/v2_57/limits.py    |  30 ++
.../api_schema/response/compute/v2_57/quotas.py    |  53 +++
.../api_schema/response/compute/v2_57/servers.py   |  61 ++++
.../api_schema/response/compute/v2_6/servers.py    |  11 +-
.../api_schema/response/compute/v2_61/__init__.py  |   0
.../api_schema/response/compute/v2_61/flavors.py   | 106 ++++++
.../api_schema/response/compute/v2_63/__init__.py  |   0
.../api_schema/response/compute/v2_63/servers.py   |  75 +++++
.../api_schema/response/compute/v2_9/servers.py    |  26 ++
tempest/lib/base.py                                |   5 +-
tempest/lib/cli/base.py                            |   2 +-
tempest/lib/cli/output_parser.py                   |   6 +-
tempest/lib/cmd/check_uuid.py                      |  15 +-
tempest/lib/common/dynamic_creds.py                |  10 +-
tempest/lib/common/jsonschema_validator.py         |  18 ++
tempest/lib/common/rest_client.py                  |   2 +
tempest/lib/common/thread.py                       |  29 ++
tempest/lib/decorators.py                          |  69 +++-
tempest/lib/services/clients.py                    |   6 +-
tempest/lib/services/compute/aggregates_client.py  |  17 +-
tempest/lib/services/compute/flavors_client.py     |  41 ++-
tempest/lib/services/compute/limits_client.py      |  12 +-
tempest/lib/services/compute/quotas_client.py      |  11 +
.../lib/services/compute/server_groups_client.py   |   6 +-
tempest/lib/services/compute/servers_client.py     |  12 +-
tempest/lib/services/compute/services_client.py    |  32 +-
tempest/lib/services/identity/v3/__init__.py       |  20 +-
.../identity/v3/application_credentials_client.py  |  83 +++++
.../lib/services/identity/v3/policies_client.py    | 112 +++++++
.../services/identity/v3/project_tags_client.py    |  80 +++++
tempest/lib/services/identity/v3/token_client.py   |  10 +-
tempest/lib/services/image/v2/images_client.py     |  12 +-
tempest/lib/services/network/agents_client.py      |  55 +++-
.../services/volume/v1/encryption_types_client.py  |   4 +-
.../services/volume/v2/availability_zone_client.py |  15 +-
tempest/lib/services/volume/v2/backups_client.py   | 107 +------
.../lib/services/volume/v2/capabilities_client.py  |  22 +-
.../services/volume/v2/encryption_types_client.py  |  78 +----
.../lib/services/volume/v2/extensions_client.py    |  18 +-
tempest/lib/services/volume/v2/hosts_client.py     |  36 +--
tempest/lib/services/volume/v2/limits_client.py    |  20 +-
tempest/lib/services/volume/v2/qos_client.py       | 122 +------
.../lib/services/volume/v2/quota_classes_client.py |  39 +--
tempest/lib/services/volume/v2/quotas_client.py    |  52 +--
.../services/volume/v2/scheduler_stats_client.py   |  25 +-
tempest/lib/services/volume/v2/services_client.py  |  22 +-
.../services/volume/v2/snapshot_manage_client.py   |  21 +-
tempest/lib/services/volume/v2/snapshots_client.py | 199 +-----------
tempest/lib/services/volume/v2/transfers_client.py |  71 +----
tempest/lib/services/volume/v2/types_client.py     | 193 +----------
.../lib/services/volume/v2/volume_manage_client.py |  25 +-
tempest/lib/services/volume/v2/volumes_client.py   | 340 +-------------------
tempest/lib/services/volume/v3/__init__.py         |  35 +-
.../services/volume/v3/availability_zone_client.py |  27 ++
tempest/lib/services/volume/v3/backups_client.py   | 100 +++++-
tempest/lib/services/volume/v3/base_client.py      |   1 -
.../lib/services/volume/v3/capabilities_client.py  |  34 ++
.../services/volume/v3/encryption_types_client.py  |  90 ++++++
.../lib/services/volume/v3/extensions_client.py    |  29 ++
.../services/volume/v3/group_snapshots_client.py   |   1 -
.../lib/services/volume/v3/group_types_client.py   |   1 -
tempest/lib/services/volume/v3/groups_client.py    |   1 -
tempest/lib/services/volume/v3/hosts_client.py     |  47 +++
tempest/lib/services/volume/v3/limits_client.py    |  30 ++
tempest/lib/services/volume/v3/messages_client.py  |   1 -
tempest/lib/services/volume/v3/qos_client.py       | 131 ++++++++
.../lib/services/volume/v3/quota_classes_client.py |  49 +++
tempest/lib/services/volume/v3/quotas_client.py    |  63 ++++
.../services/volume/v3/scheduler_stats_client.py   |  36 +++
tempest/lib/services/volume/v3/services_client.py  | 102 ++++++
.../services/volume/v3/snapshot_manage_client.py   |  31 ++
tempest/lib/services/volume/v3/snapshots_client.py | 196 +++++++++++-
tempest/lib/services/volume/v3/transfers_client.py |  82 +++++
tempest/lib/services/volume/v3/types_client.py     | 204 ++++++++++++
tempest/lib/services/volume/v3/versions_client.py  |   1 -
.../lib/services/volume/v3/volume_manage_client.py |  35 ++
tempest/lib/services/volume/v3/volumes_client.py   | 332 ++++++++++++++++++-
tempest/scenario/manager.py                        | 139 +++++---
tempest/scenario/test_aggregates_basic_ops.py      |  10 +-
tempest/scenario/test_encrypted_cinder_volumes.py  |   6 +-
.../scenario/test_network_advanced_server_ops.py   |  20 +-
tempest/scenario/test_network_basic_ops.py         |  71 +++--
tempest/scenario/test_network_v6.py                |   8 +-
tempest/scenario/test_security_groups_basic_ops.py |   3 +-
tempest/scenario/test_server_advanced_ops.py       |   1 -
tempest/scenario/test_shelve_instance.py           |   6 +-
tempest/scenario/test_snapshot_pattern.py          |   6 +-
tempest/scenario/test_stamp_pattern.py             |   6 +-
tempest/scenario/test_volume_backup_restore.py     |  94 ++++++
tempest/scenario/test_volume_boot_pattern.py       |  70 ++--
tempest/scenario/test_volume_migrate_attached.py   |   8 +-
tempest/test.py                                    |  12 +-
.../lib/services/compute/test_flavors_client.py    |  35 ++
.../lib/services/compute/test_services_client.py   |  69 ++++
.../v3/test_application_credentials_client.py      | 156 +++++++++
.../services/identity/v3/test_policies_client.py   |  88 +++++
.../identity/v3/test_project_tags_client.py        | 104 ++++++
.../volume/v2/test_availability_zone_client.py     |  51 ---
.../lib/services/volume/v2/test_backups_client.py  | 117 -------
.../services/volume/v2/test_capabilities_client.py |  77 -----
.../volume/v2/test_encryption_types_client.py      | 103 ------
.../services/volume/v2/test_extensions_client.py   |  70 ----
.../lib/services/volume/v2/test_hosts_client.py    |  97 ------
.../lib/services/volume/v2/test_limits_client.py   |  59 ----
.../volume/v2/test_quota_classes_client.py         |  71 -----
.../lib/services/volume/v2/test_quotas_client.py   |  86 -----
.../volume/v2/test_scheduler_stats_client.py       |  83 -----
.../volume/v2/test_snapshot_manage_client.py       |  83 -----
.../services/volume/v2/test_snapshots_client.py    | 222 -------------
.../services/volume/v2/test_transfers_client.py    | 158 ---------
.../volume/v2/test_volume_manage_client.py         | 111 -------
.../lib/services/volume/v2/test_volumes_client.py  | 127 --------
.../volume/v3/test_availability_zone_client.py     |  51 +++
.../lib/services/volume/v3/test_backups_client.py  |  89 ++++++
.../services/volume/v3/test_capabilities_client.py |  77 +++++
.../volume/v3/test_encryption_types_client.py      | 103 ++++++
.../services/volume/v3/test_extensions_client.py   |  70 ++++
.../lib/services/volume/v3/test_hosts_client.py    |  97 ++++++
.../lib/services/volume/v3/test_limits_client.py   |  59 ++++
.../volume/v3/test_quota_classes_client.py         |  71 +++++
.../lib/services/volume/v3/test_quotas_client.py   |  86 +++++
.../volume/v3/test_scheduler_stats_client.py       |  83 +++++
.../lib/services/volume/v3/test_services_client.py | 214 +++++++++++++
.../volume/v3/test_snapshot_manage_client.py       |  83 +++++
.../services/volume/v3/test_snapshots_client.py    | 222 +++++++++++++
.../services/volume/v3/test_transfers_client.py    | 158 +++++++++
.../volume/v3/test_volume_manage_client.py         | 111 +++++++
.../lib/services/volume/v3/test_volumes_client.py  |  99 ++++++
tools/check_logs.py                                |   3 +-
tools/generate-tempest-plugins-list.py             |  15 +-
tools/generate-tempest-plugins-list.sh             |  34 +-
tox.ini                                            |  24 +-
339 files changed, 9379 insertions(+), 4297 deletions(-)


Requirements updates
--------------------

diff --git a/requirements.txt b/requirements.txt
index 76db574..7520d42 100644
--- a/requirements.txt
+++ b/requirements.txt
@@ -10,2 +10,2 @@ netaddr>=0.7.18 # BSD
-oslo.concurrency>=3.25.0 # Apache-2.0
-oslo.config>=5.1.0 # Apache-2.0
+oslo.concurrency>=3.26.0 # Apache-2.0
+oslo.config>=5.2.0 # Apache-2.0
@@ -18 +18 @@ fixtures>=3.0.0 # Apache-2.0/BSD
-PyYAML>=3.10 # MIT
+PyYAML>=3.12 # MIT






More information about the Release-announce mailing list