[release-announce] [quality] tempest 17.0.0 (pike)

30 Aug 2017

We are ecstatic to announce the release of:

tempest 17.0.0: OpenStack Integration Testing

This release is part of the pike release series.

Download the package from:

    https://pypi.python.org/pypi/tempest

For more details, please see below.

17.0.0
^^^^^^


Prelude
*******

This release marks the start of support for the Pike release in
Tempest.


New Features
************

* Add create_group_from_source to groups_client in the volume
  service library.

* Implement the *rest_client* method *is_resource_deleted* in the
  network security group client.

* The "list_backups" method of the v2 "BackupsClient" class now has
  an additional "**params" argument that enables passing additional
  information in the query string of the HTTP request.

* Add show volume image metadata API to v2 volumes_client library.
  This feature enables the possibility to show volume's image
  metadata.

* Add update_group to groups_client in the volume service library.

* Add group_snapshots client for the volume service as library. Add
  tempest tests for create group snapshot, delete group snapshot, show
  group snapshot, and list group snapshots volume APIs.

* Add list_group_type and show_group_type in the group_types client
  for the volume service. Add tests for create/delete/show/list group
  types.

* The credentials_factory.py module is now marked as stable for
  Tempest plugins. It provides helpers that can be used by Tempest
  plugins to obtain test credentials for their test cases in a format
  that honors the Tempest configuration in use. Credentials may be
  provisioned on the fly during the test run, or they can be setup in
  advance and fed to test via a YAML file; they can be setup for
  identity v2 or identity v3.

* Add the "disable_log_reason" and the "update_forced_down" API
  endpoints to the compute "services_client". Add '2.11' compute
  validation schema for compute services API.

* Enhances the v3 identity client with the "check_token_existence"
  endpoint, allowing users to check the existence of tokens

* The tempest module tempest.common.dynamic creds which is used for
  dynamically allocating credentials has been migrated into tempest
  lib.

* Define below object storage service clients as libraries. Add new
  service clients to the library interface so the other projects can
  use these modules as stable libraries without any maintenance
  changes.

     * bulk_middleware_client

     * capabilities_client

* The tempest module tempest.common.preprov_creds which is used to
  provide credentials from a list of preprovisioned resources has been
  migrated into tempest lib at tempest.lib.common.preprov_creds.

* The InvalidTestResource exception class from tempest.exceptions
  has been migrated into tempest.lib.exceptions

* The tempest module tempest.common.fixed_network which provided
  utilities for finding fixed networks by and helpers for picking the
  network to use when multiple tenant networks are available has been
  migrated into tempest lib at tempest.lib.common.fixed_network.

* When registering service clients from installed plugins, all
  registrations are now processed, even if one or more fails. All
  exceptions encountered during the registration process are recorded.
  If at least one exception was encountered, the registration process
  fails and all interim errors are reported.

* The __repr__ method is now implemented for the base
  *tempest.Exception* class, its implementation is identical to
  __str__: it reports the error message merged with input parameters.

* Add a new identity catalog client. At this point, the new client
  contains a single functionality, "show_catalog", which returns a
  catalog object.


Upgrade Notes
*************

* Tempest checks a volume delete by waiting for NotFound(404) on
  show_volume(). Sometime a volume delete fails and the volume status
  becomes error_deleting which means the delete is failed. So Tempest
  doesn't need to wait anymore. A new release of Tempest raises an
  exception DeleteErrorException instead of waiting.


Deprecation Notes
*****************

* Remove the support of python3.4, because in Ubuntu Xenial only
  python3.5 is available (python3.4 is restricted to <= Mitaka).


Bug Fixes
*********

* Add more accurate ip version check in addresses schema which will
  limit the ip version value in [4, 6].

* Add a missing return statement to the retype_volume API in the v2
  volumes_client library: Bug#1703997

  This changes the response body from None to an empty dictionary.

* Fix RemoteClient default ssh_shell_prologue: Bug#1707478

  The default ssh_shell_proloque has been modified from specifying
  erroneous PATH=$$PATH:/sbin to PATH=$PATH:/sbin.


Other Notes
***********

* OpenStack Releases supported after this release are **Pike**,
  **Ocata**, and **Newton**. The release under current development of
  this tag is Queens, meaning that every Tempest commit is also tested
  against master during the Queens cycle. However, this does not
  necessarily mean that using Tempest as of this tag will work against
  a Queens (or future release) cloud.

Changes in tempest 16.1.0..17.0.0
---------------------------------

35976ed Add release not to mark the start of Pike support
11289db Use skip_checks instead of skipUnless
e61e237 Add support for IPV6 tests in tempest.
c1ebf65 Add params to upload_volume command
ba12307 Updated from global requirements
75498ba check is_admin_available for force_tenant_isolation in test.py
15429d8 [TrivialFix] Add bug reference to releasenote
1bc06aa Added unit tests for blacklist and whitelist
70d7a11 Use networks floatingips client to associate fips
fcd8246 Use skip_checks if all testcases have same skip conditions
c7b143f Do not use self.name for volume name field
4b97446 Fix for resetting volume status
ded5972 Test shared and non-shared external networks
cd36841 Move test decorators to common
f5869b4 Use a non admin privileges for retyping a volume
8bd00e3 TrivialFix for flake8 and docs build in tox.ini
d8152de Fix RemoteClient having bad default ssh_shell_prologue
8163584 Remove unnecessary schema check of ip address
d12e548 Test nonexistent volume type extra_spec name instead of id
f0e8beb Add detail specific fields check in list_backups
138d279 [TrivialFix]Remove unnecessary value taking
15ee1ff [TrivialFix] Remove unused statements in compute tests
cc4ef74 Add comments for test module of tempest.test.idempotent_id
05c8692 Updated from global requirements
5fdfc9b Fix unit test that break isolation
311104e Remove unused variable assignment
565e7a3 Remove unused assignment
95760ce Add compute test for ServerGroupAntiAffinityFilter
d474f33 Resolve TODO in test: 'test_available_volume_retype_with_migration'
8871fca Stop passing around dicts in validation resources
557320e Add docstring for validation resources
463a8a6 Fix client usage in validation resources
1fa7a60 Drop validation resources dependency from CONF
20e512b Update and replace http with https for doc links in tempest
284d311 [Trivialfix]Fix typos in tempest
f6bae31 Remove unnecessary class Inheritance
fc0efda Remove unnecessary resource_setup in DvrRoutersNegativeTest
d095847 Do not run test_create_server_with_scheduler_hint_group twice
5026c50 add detaches to attachment test
5805d32 Volume and group on same backend in update_group
6491738 Do not create server in test_list_servers_filter_by_exist_host
e5ccb16 Remove unused global variable
cfa1cd5 Do not print empty list in assertNotEmpty
68cb44d Py3: Finish the python3 port
575a5cf Refactor test_user_update
17347f0 Mark credentials_factory stable for plugins
f9f8789 Remove dependency to identity v2
a6b3015 Make sure test use the latest volume clients
9ee9860 Add Tests for Groups Volume APIs - Part 4
88eb677 Move schedule filter check to compute module
009a1f6 Remove usage of credentials_factory.AdminManager
ca5c308 Increase unit test coverage for v2 images client
850f14d Fix microversion doc for implemented microversion tests
d56edc3 Add Tests for Groups Volume APIs - Part 3
b33dd46 Fix verify config API version checks
fa85cd0 Add unit test for volume availability zone client
860e032 Remove redundant comments in credentials_factory.py
2d7b40a Add release notes for client registration changes
6176f1b TrivialFix: Remove the unused import code
f0599b1 Add test for showing volume image metadata
1bf32eb Moved releasenotes from tempest package to proper location
01512d2 Do not call another testcase in one testcase
9b0f2d2 Remove unnecessary assertIsNotNone check
78c9139 Remove unnecessary checks already coverd in schema
628642b Remove _list_assertions from test_roles.py
8786ea8 Remove unnecessary asserting for 'id' in body
eb83b0f Fix broken api links in lib/services
3bc93b2 Judge skip conditions in skip_checks instead of in resource_setup
c6a7905 Fix disable_ssl_certificate_validation values if ca_certificates file is defined
39bea7b Remove unnecessary usage of instance variable
15b3842 TrivialFix: Remove the unused import code
bc2ae86 Unsupported 'message' Exception attribute in PY3
7d216dc Updated firewalls deafult port reference to Newton
bd9dd8e Make verify_tempest_config workspace aware
7664afe Fixed the broken links for api microversion
4ddc5ee TrivialFix: Correct reST field lists in docstrings
368390b Updated from global requirements
ff50cc5 Try to register all service clients
2712737 Remove support for py34
b282eb7 Fix some nits in object storage clients release notes
0f1e5cf Import data_utils from tempest.lib.common.utils
41ed715 Add Tests for Groups Volume APIs - Part 2
8e87ccb Revert "Remove tempest.common data_utils"
97f6a84 Move object storage capabilities_client to lib interface
64485cc Remove deprecated test.related_bug decorator
5b7f6b9 Move object storage bulk_middleware_client to lib interface
00c3588 Complete credentials_factory docstrings
ace26ab Add unit test for volume limits client
1ec2cac Add unit test for volume extensions client
17d8a48 Fix object storage capabilities client return value
e2fd3d5 Updated from global requirements
6891411 Add Tests for Create/Delete/Show/List Group Types
841b75e Add better docs on credential providers
b19c55d Migrate the preprov creds module to tempest lib
c51b712 Migrate the dynamic creds module to tempest lib
bf6605f Ensure test for Neutron GET / uses right URL
872ca87 [DOC BLD FIX] Correct reST field lists in docstrings
609298c Fix object storage bulk middleware client return value
dcd9100 Remove creds providers dependency from clients
d850882 Added return statement to retype_volume in v2 volumes_client
9958b17 Add volume backed instance coverage to API tests
12972ae Fix account generator unit tests
d199caf Make credentials_factory a bit nicer
e98720a Update the documention for doc migration
7628cb2 Unix style line ending
1c39a2f test_boot_server_from_encrypted_volume_luks skip condition
bf549a4 Add unit tests for volume and snapshot manage clients
7814b04 Updated from global requirements
f3e247d Cleanup the orchestration client init and attr
708821c Remove unused clients from testcases
d69d1b5 Move multi-nic tests to dedicated module
d029516 create test to verify catalog standardization
73ed1f3 Generic method for creating a volume snapshot
ff5f0c1 Handle volume API version enablement
a27f15f Fix instance_action_events response schema for finish_time and result
e3d1065 Using fixtures instead of deprecated mockpatch module
5dcb541 Refactor volume clone tests
ba135d9 Remove unused tenant_cidr from test_routers.py
72a6a39 Use cls instead of self in classmethod
ac2bb52 Remove unused LOG from clients.py
aa516f8 Add flag to generate tempest plugin list
74a56ab Doc: fix markups, capitalization and add 2 REVIEWING advices
ef40daa Add a page for release 16.1 to release notes
b7affe4 Added script for doing tempest plugin sanity
a2df0f5 Add 'params' argument to v2 list_backups API
08344ff Supplement unit tests for volume transfers client
fe399fd Extra compute services_client API endpoints
5b68f50 Dynamic creds does not support create subnet with ipv6
2bbc492 Tidy up releasenotes
0994120 Add negative test for live migration
1e8a0ed Enhance tempest client for keystone v3 token APIs.
361c29b Fix class name for test extensions
4723fde Raise exception when error_deleting
bd65bbb Remove tempest.common data_utils


Diffstat (except docs and test files)
-------------------------------------

HACKING.rst                                        |  59 +-
README.rst                                         |  58 +-
REVIEWING.rst                                      |  26 +-
bindep.txt                                         |   2 +-
...ported-openstack-releases-b88db468695348f6.yaml |  13 -
...Tempest-library-interface-0eb680b810139a50.yaml |  11 -
.../10.0.0-start-using-reno-ed9518126fd0e1a3.yaml  |   3 -
...ported-openstack-releases-b88db468695348f6.yaml |  13 +
...Tempest-library-interface-0eb680b810139a50.yaml |  11 +
.../10.0.0-start-using-reno-ed9518126fd0e1a3.yaml  |   3 +
...roversion-testing-support-2ceddd2255670932.yaml |   3 -
...pute-microversion-support-e0b23f960f894b9b.yaml |   3 -
...ported-openstack-releases-1e5d7295d939d439.yaml |  12 -
...roversion-testing-support-2ceddd2255670932.yaml |   3 +
...pute-microversion-support-e0b23f960f894b9b.yaml |   3 +
...ported-openstack-releases-1e5d7295d939d439.yaml |  12 +
...ported-openstack-releases-f10aac381d933dd1.yaml |  12 -
...d-network-versions-client-d90e8334e1443f5c.yaml |   4 -
.../12.1.0-add-scope-to-auth-b5a82493ea89f41e.yaml |   7 -
.../12.1.0-add-tempest-run-3d0aaf69c2ca4115.yaml   |   4 -
....0-add-tempest-workspaces-228a2ba4690b5589.yaml |   5 -
...dd_subunit_describe_calls-5498a37e6cd66c4b.yaml |   8 -
.../notes/12.1.0-bug-1486834-7ebca15836ae27a9.yaml |   7 -
...entity-clients-as-library-e663c6132fcac6c2.yaml |  13 -
...-image-clients-as-library-86d17caa26ce3961.yaml |  15 -
...1.0-new-test-utils-module-adf34468c4d52719.yaml |  11 -
...t-scenarios-functionality-01308e6d4307f580.yaml |  11 -
...remove-integrated-horizon-bb57551c1e5f5be3.yaml |   7 -
...gacy-credential-providers-3d653ac3ba1ada2b.yaml |   5 -
...routers-client-as-library-25a363379da351f6.yaml |   6 -
...-support-chunked-encoding-d71f53225f68edf3.yaml |   9 -
...nfig-dir-location-changes-12260255871d3a2b.yaml |  12 -
...httptimeout-in-restclient-ax78061900e3f3d7.yaml |   7 -
...-add-new-identity-clients-3c3afd674a395bde.yaml |  13 -
.../12.2.0-clients_module-16f3025f515bf9ec.yaml    |  18 -
.../12.2.0-nova_cert_default-90eb7c1e3cde624a.yaml |   8 -
...rvice-client-registration-00b19a2dd4935ba0.yaml |  12 -
.../12.2.0-remove-javelin-276f62d04f7e4a1d.yaml    |   5 -
...2.0-service_client_config-8a1d7b4de769c633.yaml |   6 -
...volume-clients-as-library-9a3444dd63c134b3.yaml |  18 -
...ported-openstack-releases-f10aac381d933dd1.yaml |  12 +
...d-network-versions-client-d90e8334e1443f5c.yaml |   4 +
.../12.1.0-add-scope-to-auth-b5a82493ea89f41e.yaml |   7 +
.../12.1.0-add-tempest-run-3d0aaf69c2ca4115.yaml   |   4 +
....0-add-tempest-workspaces-228a2ba4690b5589.yaml |   5 +
...dd_subunit_describe_calls-5498a37e6cd66c4b.yaml |   8 +
.../12/12.1.0-bug-1486834-7ebca15836ae27a9.yaml    |   7 +
...entity-clients-as-library-e663c6132fcac6c2.yaml |  13 +
...-image-clients-as-library-86d17caa26ce3961.yaml |  15 +
...1.0-new-test-utils-module-adf34468c4d52719.yaml |  11 +
...t-scenarios-functionality-01308e6d4307f580.yaml |  11 +
...remove-integrated-horizon-bb57551c1e5f5be3.yaml |   7 +
...gacy-credential-providers-3d653ac3ba1ada2b.yaml |   5 +
...routers-client-as-library-25a363379da351f6.yaml |   6 +
...-support-chunked-encoding-d71f53225f68edf3.yaml |   9 +
...nfig-dir-location-changes-12260255871d3a2b.yaml |  12 +
...httptimeout-in-restclient-ax78061900e3f3d7.yaml |   7 +
...-add-new-identity-clients-3c3afd674a395bde.yaml |  13 +
.../12/12.2.0-clients_module-16f3025f515bf9ec.yaml |  18 +
.../12.2.0-nova_cert_default-90eb7c1e3cde624a.yaml |   8 +
...rvice-client-registration-00b19a2dd4935ba0.yaml |  12 +
.../12/12.2.0-remove-javelin-276f62d04f7e4a1d.yaml |   5 +
...2.0-service_client_config-8a1d7b4de769c633.yaml |   6 +
...volume-clients-as-library-9a3444dd63c134b3.yaml |  18 +
...entity-clients-as-library-5f7ndha733nwdsn9.yaml |  15 -
...lume-clients-as-a-library-d05b6bc35e66c6ef.yaml |  16 -
...te-get_ipv6_addr_by_EUI64-4673f07677289cf6.yaml |   4 -
...until-true-to-tempest-lib-c9ea70dd6fe9bd15.yaml |   5 -
...0-start-of-newton-support-3ebb274f300f28eb.yaml |  13 -
...pest-cleanup-nostandalone-39df2aafb2545d35.yaml |   5 -
...volume-clients-as-library-660811011be29d1a.yaml |   6 -
...entity-clients-as-library-5f7ndha733nwdsn9.yaml |  15 +
...lume-clients-as-a-library-d05b6bc35e66c6ef.yaml |  16 +
...te-get_ipv6_addr_by_EUI64-4673f07677289cf6.yaml |   4 +
...until-true-to-tempest-lib-c9ea70dd6fe9bd15.yaml |   5 +
...0-start-of-newton-support-3ebb274f300f28eb.yaml |  13 +
...pest-cleanup-nostandalone-39df2aafb2545d35.yaml |   5 +
...volume-clients-as-library-660811011be29d1a.yaml |   6 +
...der-abstract-class-to-lib-70ff513221f8a871.yaml |   6 -
...red_client-to-tempest.lib-4d4af33f969c576f.yaml |   5 -
...ation-to-versions-clients-acbc78292e24b014.yaml |   6 -
.../14.0.0-add-image-clients-af94564fb34ddca6.yaml |   9 -
...ments-client-as-a-library-d34b4fdf376984ad.yaml |   6 -
...d-service-provider-client-cbba77d424a30dd3.yaml |   4 -
...-port-parameter-to-client-6d16c374ac4456c1.yaml |   4 -
...ecate-nova-api-extensions-df16b02485dae203.yaml |   7 -
...-cinder-v3-to-lib-service-be3ba0c20753b594.yaml |   7 -
...0-new-volume-limit-client-517c17d9090f4df4.yaml |   3 -
....0-remove-bootable-option-024f8944c056a3e0.yaml |   6 -
...e-negative-test-generator-1653f4c0f86ccf75.yaml |   4 -
...volume-clients-as-library-309030c7a16e62ab.yaml |  12 -
...der-abstract-class-to-lib-70ff513221f8a871.yaml |   6 +
...red_client-to-tempest.lib-4d4af33f969c576f.yaml |   5 +
...ation-to-versions-clients-acbc78292e24b014.yaml |   6 +
.../14.0.0-add-image-clients-af94564fb34ddca6.yaml |   9 +
...ments-client-as-a-library-d34b4fdf376984ad.yaml |   6 +
...d-service-provider-client-cbba77d424a30dd3.yaml |   4 +
...-port-parameter-to-client-6d16c374ac4456c1.yaml |   4 +
...ecate-nova-api-extensions-df16b02485dae203.yaml |   7 +
...-cinder-v3-to-lib-service-be3ba0c20753b594.yaml |   7 +
...0-new-volume-limit-client-517c17d9090f4df4.yaml |   3 +
....0-remove-bootable-option-024f8944c056a3e0.yaml |   6 +
...e-negative-test-generator-1653f4c0f86ccf75.yaml |   4 +
...volume-clients-as-library-309030c7a16e62ab.yaml |  12 +
...y-v3-clients-as-a-library-d34b4fdf376984ad.yaml |   6 -
...s-to-roles-client-library-edf96408ad9ba82e.yaml |   6 -
...-manage-client-as-library-a76ffdba9d8d01cb.yaml |   8 -
..._security_disabled-option-2d3d87f6bd11d03a.yaml |   8 -
...-feature-enabled.reseller-84800a8232fe217f.yaml |   8 -
...e_enabled.volume_services-dbe024ea067d5ab2.yaml |   8 -
....0.0-jsonschema-validator-2377ba131e12d3c7.yaml |   5 -
...croversion-config-options-eaee6a7d2f8390a8.yaml |   9 -
...validation-config-options-e3d1b89ce074d71c.yaml |  25 -
...t-scenario-config-options-414e0c5442e967e9.yaml |   6 -
...ed-network-config-options-f9ce276231578fe6.yaml |  11 -
...y-v3-clients-as-a-library-d34b4fdf376984ad.yaml |   6 +
...s-to-roles-client-library-edf96408ad9ba82e.yaml |   6 +
...-manage-client-as-library-a76ffdba9d8d01cb.yaml |   8 +
..._security_disabled-option-2d3d87f6bd11d03a.yaml |   8 +
...-feature-enabled.reseller-84800a8232fe217f.yaml |   8 +
...e_enabled.volume_services-dbe024ea067d5ab2.yaml |   8 +
....0.0-jsonschema-validator-2377ba131e12d3c7.yaml |   5 +
...croversion-config-options-eaee6a7d2f8390a8.yaml |   9 +
...validation-config-options-e3d1b89ce074d71c.yaml |  25 +
...t-scenario-config-options-414e0c5442e967e9.yaml |   6 +
...ed-network-config-options-f9ce276231578fe6.yaml |  11 +
...s-to-roles-client-library-178d4a6000dec72d.yaml |   7 -
...rameter-to-volumes-client-ff4f7f12795003a4.yaml |   7 -
...ulate-client-as-a-library-ed76baf25f02c3ca.yaml |   3 -
...ntent-type-without-spaces-b2c9b91b257814f3.yaml |   9 -
...-list-auth-project-client-5905076d914a3943.yaml |   6 -
...-list-glance-api-versions-ec5fc8081fc8a0ae.yaml |   6 -
...to-servers-client-library-088df48f6d81f4be.yaml |   6 -
...ersion-to-identity-client-944cb7396088a575.yaml |   6 -
...-version-to-volume-client-4769dd1bd4ab9c5e.yaml |   6 -
...d-quota-sets-detail-kwarg-74b72183295b3ce7.yaml |   6 -
...tempest-lib-remote-client-adbeb3f42a36910b.yaml |  11 -
...empest-run-combine-option-e94c1049ba8985d5.yaml |   6 -
...o-encryption-types-client-f3093532a0bcf9a1.yaml |   6 -
...-manage-client-as-library-78ab198a1dc1bd41.yaml |   9 -
...create-server-tags-client-8c0042a77e859af6.yaml |   8 -
...e-deactivate_image-config-7a282c471937bbcb.yaml |   6 -
...vr_extra_resources-config-8c319d6dab7f7e5c.yaml |   7 -
...pi-version-config-options-8370b63aea8e14cf.yaml |  10 -
...e-resources-prefix-option-ad490c0a30a0266b.yaml |  10 -
...kip_unless_attr-decorator-450a1ed727494724.yaml |   5 -
...p_unless_config-decorator-64c32d588043ab12.yaml |   5 -
...ated-cinder-api-v1-option-df7d5a54d93db5cf.yaml |  12 -
...precate_client_parameters-cb8d069e62957f7e.yaml |   6 -
...ce-clients-bugfix-1667354-73d2c3c8fedc08bf.yaml |   7 -
.../notes/16.0.0-mitaka-eol-88ff8355fff81b55.yaml  |  13 -
...e-call_until_true-of-test-de9c13bc8f969921.yaml |   6 -
..._security_disabled-option-d0ffaeb2e7817707.yaml |   5 -
...ion-config-options-part-2-5cd17b6e0e6cb8a3.yaml |  11 -
...vr_extra_resources-option-e8c441c38eab7ddd.yaml |   8 -
...-identity-reseller-option-4411c7e3951f1094.yaml |   4 -
...-sahara-service-available-44a642aa9c634ab4.yaml |   7 -
...e_enabled.volume_services-c6aa142cc1021297.yaml |   5 -
...6.0.0-use-keystone-v3-api-935860d30ddbb8e9.yaml |   5 -
...0-volume-transfers-client-e5ed3f5464c0cdc0.yaml |  18 -
...s-to-roles-client-library-178d4a6000dec72d.yaml |   7 +
...rameter-to-volumes-client-ff4f7f12795003a4.yaml |   7 +
...ulate-client-as-a-library-ed76baf25f02c3ca.yaml |   3 +
...ntent-type-without-spaces-b2c9b91b257814f3.yaml |   9 +
...-list-auth-project-client-5905076d914a3943.yaml |   6 +
...-list-glance-api-versions-ec5fc8081fc8a0ae.yaml |   6 +
...to-servers-client-library-088df48f6d81f4be.yaml |   6 +
...ersion-to-identity-client-944cb7396088a575.yaml |   6 +
...-version-to-volume-client-4769dd1bd4ab9c5e.yaml |   6 +
...d-quota-sets-detail-kwarg-74b72183295b3ce7.yaml |   6 +
...tempest-lib-remote-client-adbeb3f42a36910b.yaml |  11 +
...empest-run-combine-option-e94c1049ba8985d5.yaml |   6 +
...o-encryption-types-client-f3093532a0bcf9a1.yaml |   6 +
...-manage-client-as-library-78ab198a1dc1bd41.yaml |   9 +
...create-server-tags-client-8c0042a77e859af6.yaml |   8 +
...e-deactivate_image-config-7a282c471937bbcb.yaml |   6 +
...vr_extra_resources-config-8c319d6dab7f7e5c.yaml |   7 +
...pi-version-config-options-8370b63aea8e14cf.yaml |  10 +
...e-resources-prefix-option-ad490c0a30a0266b.yaml |  10 +
...kip_unless_attr-decorator-450a1ed727494724.yaml |   5 +
...p_unless_config-decorator-64c32d588043ab12.yaml |   5 +
...ated-cinder-api-v1-option-df7d5a54d93db5cf.yaml |  12 +
...precate_client_parameters-cb8d069e62957f7e.yaml |   6 +
...ce-clients-bugfix-1667354-73d2c3c8fedc08bf.yaml |   7 +
.../16/16.0.0-mitaka-eol-88ff8355fff81b55.yaml     |  13 +
...e-call_until_true-of-test-de9c13bc8f969921.yaml |   6 +
..._security_disabled-option-d0ffaeb2e7817707.yaml |   5 +
...ion-config-options-part-2-5cd17b6e0e6cb8a3.yaml |  11 +
...vr_extra_resources-option-e8c441c38eab7ddd.yaml |   8 +
...-identity-reseller-option-4411c7e3951f1094.yaml |   4 +
...-sahara-service-available-44a642aa9c634ab4.yaml |   7 +
...e_enabled.volume_services-c6aa142cc1021297.yaml |   5 +
...6.0.0-use-keystone-v3-api-935860d30ddbb8e9.yaml |   5 +
...0-volume-transfers-client-e5ed3f5464c0cdc0.yaml |  18 +
...ersion-check-in-addresses-x491ac6d9abaxa12.yaml |   4 +
...esource-deleted-sg-client-f4a7a7a54ff024d7.yaml |   5 +
...ms-to-v2-list-backups-api-c088d2b4bfe90247.yaml |   6 +
...rn-value-to-retype-volume-a401aa619aaa2457.yaml |   7 +
...-api-to-v2-volumes-client-ee3c027f35276561.yaml |   5 +
...redentials-factory-stable-c8037bd9ae642482.yaml |  10 +
...efault-ssh-shell-prologue-33e99343d086f601.yaml |   7 +
.../notes/identity_client-635275d43abbb807.yaml    |   5 +
.../migrate-dynamic-creds-ecebb47528080761.yaml    |   5 +
...orage-as-stable-interface-42014c7b43ecb254.yaml |  10 +
.../migrate-preprov-creds-ef61a046ee1ec604.yaml    |  11 +
...registration-enhancements-e09131742391225b.yaml |  12 +
...-error-deleting-on-volume-18d0d0c5886212dd.yaml |   8 +
.../remove-support-of-py34-7d59fdb431fefe24.yaml   |   5 +
.../start-of-pike-support-f2a1b7ea8e8b0311.yaml    |  11 +
...t-identity-catalog-client-f5c8589a9d7c1eb5.yaml |   5 +
releasenotes/source/index.rst                      |   1 +
releasenotes/source/v16.1.0.rst                    |   6 +
requirements.txt                                   |  10 +-
setup.cfg                                          |   3 +-
tempest/README.rst                                 |  15 +-
tempest/api/README.rst                             |   5 +-
tempest/api/compute/admin/test_agents.py           |   4 +-
tempest/api/compute/admin/test_aggregates.py       |   1 -
.../compute/admin/test_auto_allocate_network.py    |  11 +-
tempest/api/compute/admin/test_create_server.py    |   2 -
tempest/api/compute/admin/test_fixed_ips.py        |   7 +-
.../api/compute/admin/test_fixed_ips_negative.py   |   9 +-
tempest/api/compute/admin/test_flavors.py          |   4 +-
tempest/api/compute/admin/test_flavors_access.py   |   4 +-
.../compute/admin/test_flavors_access_negative.py  |   4 +-
.../api/compute/admin/test_flavors_extra_specs.py  |   4 +-
.../admin/test_flavors_extra_specs_negative.py     |   4 +-
.../api/compute/admin/test_floating_ips_bulk.py    |   4 +-
tempest/api/compute/admin/test_hosts.py            |   5 -
tempest/api/compute/admin/test_hypervisor.py       |  15 +-
.../admin/test_live_block_migration_negative.py    |  49 --
tempest/api/compute/admin/test_live_migration.py   |  55 +-
.../compute/admin/test_live_migration_negative.py  |  63 ++
tempest/api/compute/admin/test_quotas.py           |   4 +-
tempest/api/compute/admin/test_quotas_negative.py  |   6 +-
tempest/api/compute/admin/test_security_groups.py  |   4 +-
tempest/api/compute/admin/test_servers.py          |  27 +-
tempest/api/compute/admin/test_servers_negative.py |   1 -
.../compute/admin/test_servers_on_multinodes.py    |  43 +-
tempest/api/compute/admin/test_volume_swap.py      |   4 +-
tempest/api/compute/base.py                        |  22 +-
.../api/compute/certificates/test_certificates.py  |   9 +-
.../api/compute/flavors/test_flavors_negative.py   |   4 +-
.../floating_ips/test_floating_ips_actions.py      |   8 +-
.../test_floating_ips_actions_negative.py          |  10 +-
.../compute/floating_ips/test_list_floating_ips.py |   7 +-
.../test_list_floating_ips_negative.py             |   5 +-
tempest/api/compute/keypairs/test_keypairs.py      |   8 -
tempest/api/compute/security_groups/base.py        |  10 +-
.../security_groups/test_security_group_rules.py   |   8 +-
.../test_security_group_rules_negative.py          |   9 -
.../security_groups/test_security_groups.py        |   8 -
.../test_security_groups_negative.py               |  14 -
.../api/compute/servers/test_attach_interfaces.py  |  10 +-
tempest/api/compute/servers/test_create_server.py  | 123 +---
.../servers/test_create_server_multi_nic.py        | 120 ++++
tempest/api/compute/servers/test_delete_server.py  |   4 +-
tempest/api/compute/servers/test_device_tagging.py |   4 +-
.../compute/servers/test_list_server_filters.py    |   4 +-
tempest/api/compute/servers/test_novnc.py          |   2 +-
tempest/api/compute/servers/test_server_actions.py |  19 +-
.../api/compute/servers/test_server_addresses.py   |   9 +-
.../servers/test_server_addresses_negative.py      |   6 +-
tempest/api/compute/servers/test_server_group.py   |  23 +-
.../api/compute/servers/test_server_metadata.py    |   5 +-
.../compute/servers/test_server_rescue_negative.py |   6 +-
tempest/api/compute/servers/test_server_tags.py    |   4 +-
.../api/compute/servers/test_servers_negative.py   |   6 +-
.../api/compute/servers/test_virtual_interfaces.py |  11 +-
.../servers/test_virtual_interfaces_negative.py    |   4 +-
tempest/api/compute/test_extensions.py             |   6 +-
tempest/api/compute/test_quotas.py                 |   4 +-
tempest/api/compute/test_tenant_networks.py        |   4 +-
tempest/api/compute/volumes/test_attach_volume.py  |  16 +-
.../api/compute/volumes/test_volume_snapshots.py   |   7 +-
tempest/api/compute/volumes/test_volumes_get.py    |   4 -
tempest/api/identity/admin/v2/test_services.py     |   1 -
tempest/api/identity/admin/v3/test_domains.py      |   2 -
.../api/identity/admin/v3/test_domains_negative.py |   1 -
.../api/identity/admin/v3/test_endpoint_groups.py  |  10 +-
tempest/api/identity/admin/v3/test_endpoints.py    |   1 -
tempest/api/identity/admin/v3/test_inherits.py     |  15 +-
tempest/api/identity/admin/v3/test_policies.py     |   1 -
tempest/api/identity/admin/v3/test_roles.py        |  32 +-
tempest/api/identity/admin/v3/test_services.py     |   1 -
tempest/api/identity/admin/v3/test_tokens.py       |   3 +-
tempest/api/identity/admin/v3/test_trusts.py       |  25 +-
tempest/api/identity/admin/v3/test_users.py        |  35 +-
tempest/api/identity/base.py                       |   1 +
tempest/api/identity/v2/test_ec2_credentials.py    |   4 +-
tempest/api/identity/v3/test_catalog.py            |  41 ++
tempest/api/image/v2/test_images.py                |   2 +-
tempest/api/network/admin/test_agent_management.py |   4 +-
.../api/network/admin/test_dhcp_agent_scheduler.py |   4 +-
.../admin/test_floating_ips_admin_actions.py       |   4 +-
.../api/network/admin/test_l3_agent_scheduler.py   |   4 +-
.../api/network/admin/test_metering_extensions.py  |   4 +-
tempest/api/network/admin/test_negative_quotas.py  |   4 +-
tempest/api/network/admin/test_quotas.py           |   4 +-
tempest/api/network/admin/test_routers.py          |  21 +-
tempest/api/network/admin/test_routers_dvr.py      |  12 +-
tempest/api/network/admin/test_routers_negative.py |   6 +-
tempest/api/network/test_allowed_address_pair.py   |   9 +-
tempest/api/network/test_extensions.py             |   6 +-
tempest/api/network/test_extra_dhcp_options.py     |   6 +-
tempest/api/network/test_floating_ips.py           |   4 +-
tempest/api/network/test_floating_ips_negative.py  |   4 +-
tempest/api/network/test_networks.py               |  40 +-
tempest/api/network/test_ports.py                  |   8 +-
tempest/api/network/test_routers.py                |   8 +-
tempest/api/network/test_routers_negative.py       |  13 +-
tempest/api/network/test_security_groups.py        |   4 +-
.../api/network/test_security_groups_negative.py   |   4 +-
tempest/api/network/test_service_providers.py      |   4 +-
tempest/api/network/test_subnetpools_extensions.py |   4 +-
tempest/api/network/test_tags.py                   |   6 +-
tempest/api/object_storage/base.py                 |   5 +-
tempest/api/object_storage/test_account_bulk.py    |  49 +-
tempest/api/object_storage/test_account_quotas.py  |   7 +-
.../object_storage/test_account_quotas_negative.py |   7 +-
.../api/object_storage/test_account_services.py    |   5 +-
.../test_account_services_negative.py              |   1 -
.../object_storage/test_container_acl_negative.py  |   1 -
.../api/object_storage/test_container_quotas.py    |   8 +-
.../test_container_services_negative.py            |   2 +-
.../api/object_storage/test_container_staticweb.py |  14 +-
tempest/api/object_storage/test_container_sync.py  |   1 -
.../test_container_sync_middleware.py              |   4 +-
tempest/api/object_storage/test_crossdomain.py     |   4 +-
tempest/api/object_storage/test_object_formpost.py |   4 +-
.../test_object_formpost_negative.py               |   6 +-
tempest/api/object_storage/test_object_services.py |   5 +-
tempest/api/object_storage/test_object_slo.py      |  10 +-
tempest/api/object_storage/test_object_temp_url.py |  18 +-
.../test_object_temp_url_negative.py               |  10 +-
tempest/api/object_storage/test_object_version.py  |  16 +-
tempest/api/volume/admin/test_group_types.py       |  54 ++
tempest/api/volume/admin/test_groups.py            | 259 +++++++-
tempest/api/volume/admin/test_volume_quotas.py     |   2 +-
.../admin/test_volume_retype_with_migration.py     |   4 +-
.../api/volume/admin/test_volume_type_access.py    |   2 +-
.../test_volume_types_extra_specs_negative.py      |  10 +-
tempest/api/volume/admin/test_volumes_actions.py   |  15 +-
tempest/api/volume/admin/test_volumes_backup.py    |   3 +-
tempest/api/volume/base.py                         |   3 +
tempest/api/volume/test_image_metadata.py          |  14 +-
tempest/api/volume/test_versions.py                |   2 +-
tempest/api/volume/test_volumes_actions.py         |  12 +-
tempest/api/volume/test_volumes_backup.py          |   9 +-
tempest/api/volume/test_volumes_clone.py           |  28 +-
tempest/api/volume/test_volumes_get.py             |   4 +-
tempest/api/volume/test_volumes_list.py            |  17 +-
tempest/api/volume/test_volumes_negative.py        |   8 +-
tempest/api/volume/test_volumes_snapshots.py       |   6 +-
tempest/clients.py                                 | 119 ++--
tempest/cmd/account_generator.py                   |  14 +-
tempest/cmd/cleanup.py                             |   8 +-
tempest/cmd/cleanup_service.py                     |  12 +-
tempest/cmd/run.py                                 |   4 +-
tempest/cmd/subunit_describe_calls.py              |   7 +-
tempest/cmd/verify_tempest_config.py               |  97 ++-
tempest/common/compute.py                          |  51 +-
tempest/common/credentials_factory.py              | 167 ++++--
tempest/common/dynamic_creds.py                    | 455 --------------
tempest/common/fixed_network.py                    | 127 ----
tempest/common/preprov_creds.py                    | 372 ------------
tempest/common/utils/__init__.py                   |  92 +++
tempest/common/utils/linux/remote_client.py        |   2 +-
tempest/common/validation_resources.py             | 352 +++++++----
tempest/common/waiters.py                          |   5 +-
tempest/exceptions.py                              |  11 +-
tempest/hacking/checks.py                          |  13 +
.../response/compute/v2_1/parameter_types.py       |   2 +-
.../api_schema/response/compute/v2_1/servers.py    |   9 +-
.../api_schema/response/compute/v2_1/services.py   |  22 +
.../api_schema/response/compute/v2_11/__init__.py  |   0
.../api_schema/response/compute/v2_11/services.py  |  46 ++
tempest/lib/common/cred_provider.py                |   8 +-
tempest/lib/common/dynamic_creds.py                | 477 +++++++++++++++
tempest/lib/common/fixed_network.py                | 127 ++++
tempest/lib/common/http.py                         |   3 +-
tempest/lib/common/preprov_creds.py                | 374 ++++++++++++
tempest/lib/common/rest_client.py                  |   2 +-
tempest/lib/common/utils/linux/remote_client.py    |   2 +-
tempest/lib/exceptions.py                          |   7 +
tempest/lib/services/clients.py                    |  23 +-
tempest/lib/services/compute/services_client.py    |  37 +-
tempest/lib/services/identity/v3/__init__.py       |  17 +-
tempest/lib/services/identity/v3/catalog_client.py |  29 +
.../services/identity/v3/endpoint_groups_client.py | 156 ++---
.../lib/services/identity/v3/identity_client.py    |   7 +
.../lib/services/network/security_groups_client.py |   8 +
tempest/lib/services/network/versions_client.py    |   5 +-
tempest/lib/services/object_storage/__init__.py    |   0
.../object_storage/bulk_middleware_client.py       |  62 ++
.../services/object_storage/capabilities_client.py |  31 +
tempest/lib/services/volume/v1/backups_client.py   |   5 +
tempest/lib/services/volume/v2/backups_client.py   |  18 +-
tempest/lib/services/volume/v2/volumes_client.py   |  20 +-
tempest/lib/services/volume/v3/__init__.py         |   9 +-
.../services/volume/v3/group_snapshots_client.py   |  88 +++
.../lib/services/volume/v3/group_types_client.py   |  29 +
tempest/lib/services/volume/v3/groups_client.py    |  25 +
tempest/lib/services/volume/v3/snapshots_client.py |  21 +
tempest/scenario/README.rst                        |   6 +-
tempest/scenario/manager.py                        |  25 +-
tempest/scenario/test_aggregates_basic_ops.py      |   4 +-
tempest/scenario/test_encrypted_cinder_volumes.py  |   6 +-
tempest/scenario/test_minimum_basic.py             |   4 +-
.../scenario/test_network_advanced_server_ops.py   |  20 +-
tempest/scenario/test_network_basic_ops.py         |  30 +-
tempest/scenario/test_network_v6.py                |  18 +-
tempest/scenario/test_object_storage_basic_ops.py  |   6 +-
tempest/scenario/test_security_groups_basic_ops.py |  23 +-
tempest/scenario/test_server_advanced_ops.py       |   6 +-
tempest/scenario/test_server_basic_ops.py          |   4 +-
tempest/scenario/test_server_multinode.py          |   4 +-
tempest/scenario/test_shelve_instance.py           |   6 +-
tempest/scenario/test_snapshot_pattern.py          |   4 +-
tempest/scenario/test_stamp_pattern.py             |  22 +-
tempest/scenario/test_volume_boot_pattern.py       |  34 +-
tempest/scenario/test_volume_migrate_attached.py   |  12 +-
tempest/services/object_storage/__init__.py        |   6 +-
.../object_storage/bulk_middleware_client.py       |  62 --
.../services/object_storage/capabilities_client.py |  31 -
tempest/test.py                                    | 154 ++---
.../lib/common/utils/linux/test_remote_client.py   |   2 +-
.../lib/services/compute/test_services_client.py   |  56 +-
.../services/identity/v3/test_catalog_client.py    |  86 +++
.../identity/v3/test_endpoint_groups_client.py     | 324 +++++-----
.../services/identity/v3/test_identity_client.py   |   8 +
.../identity/v3/test_oauth_token_client.py         |   6 +-
.../lib/services/image/v2/test_images_client.py    | 110 ++++
.../object_storage/test_bulk_middleware_client.py  |  66 ++
.../object_storage/test_capabilities_client.py     |  54 ++
.../volume/v2/test_availability_zone_client.py     |  51 ++
.../lib/services/volume/v2/test_backups_client.py  | 117 ++++
.../services/volume/v2/test_extensions_client.py   |  70 +++
.../lib/services/volume/v2/test_limits_client.py   |  59 ++
.../volume/v2/test_snapshot_manage_client.py       |  83 +++
.../services/volume/v2/test_transfers_client.py    | 123 +++-
.../volume/v2/test_volume_manage_client.py         | 111 ++++
.../lib/services/volume/v2/test_volumes_client.py  |  54 ++
.../volume/v3/test_group_snapshots_client.py       | 141 +++++
.../services/volume/v3/test_group_types_client.py  |  67 +++
.../lib/services/volume/v3/test_groups_client.py   |  50 ++
test-requirements.txt                              |   6 +-
tools/tempest-plugin-sanity.sh                     | 122 ++++
tox.ini                                            |  15 +-
498 files changed, 8087 insertions(+), 4791 deletions(-)


Requirements updates
--------------------

diff --git a/requirements.txt b/requirements.txt
index 259a4cf..36b9efa 100644
--- a/requirements.txt
+++ b/requirements.txt
@@ -5 +5 @@ pbr!=2.1.0,>=2.0.0 # Apache-2.0
-cliff>=2.6.0 # Apache-2.0
+cliff>=2.8.0 # Apache-2.0
@@ -8 +8 @@ testtools>=1.4.0 # MIT
-paramiko>=2.0 # LGPLv2.1+
+paramiko>=2.0.0 # LGPLv2.1+
@@ -13,2 +13,2 @@ oslo.config!=4.3.0,!=4.4.0,>=4.0.0 # Apache-2.0
-oslo.log>=3.22.0 # Apache-2.0
-oslo.serialization>=1.10.0 # Apache-2.0
+oslo.log>=3.30.0 # Apache-2.0
+oslo.serialization!=2.19.1,>=1.10.0 # Apache-2.0
@@ -18 +18 @@ fixtures>=3.0.0 # Apache-2.0/BSD
-PyYAML>=3.10.0 # MIT
+PyYAML>=3.10 # MIT
diff --git a/test-requirements.txt b/test-requirements.txt
index 6a5ea03..29f0865 100644
--- a/test-requirements.txt
+++ b/test-requirements.txt
@@ -7,3 +7,3 @@ sphinx>=1.6.2 # BSD
-openstackdocstheme>=1.11.0 # Apache-2.0
-reno!=2.3.1,>=1.8.0 # Apache-2.0
-mock>=2.0 # BSD
+openstackdocstheme>=1.16.0 # Apache-2.0
+reno>=2.5.0 # Apache-2.0
+mock>=2.0.0 # BSD

    

[release-announce] [quality] tempest 17.0.0 (pike)

no-reply＠openstack.org