We are ecstatic to announce the release of: tempest 17.0.0: OpenStack Integration Testing This release is part of the pike release series. Download the package from: https://pypi.python.org/pypi/tempest For more details, please see below. 17.0.0 ^^^^^^ Prelude ******* This release marks the start of support for the Pike release in Tempest. New Features ************ * Add create_group_from_source to groups_client in the volume service library. * Implement the *rest_client* method *is_resource_deleted* in the network security group client. * The "list_backups" method of the v2 "BackupsClient" class now has an additional "**params" argument that enables passing additional information in the query string of the HTTP request. * Add show volume image metadata API to v2 volumes_client library. This feature enables the possibility to show volume's image metadata. * Add update_group to groups_client in the volume service library. * Add group_snapshots client for the volume service as library. Add tempest tests for create group snapshot, delete group snapshot, show group snapshot, and list group snapshots volume APIs. * Add list_group_type and show_group_type in the group_types client for the volume service. Add tests for create/delete/show/list group types. * The credentials_factory.py module is now marked as stable for Tempest plugins. It provides helpers that can be used by Tempest plugins to obtain test credentials for their test cases in a format that honors the Tempest configuration in use. Credentials may be provisioned on the fly during the test run, or they can be setup in advance and fed to test via a YAML file; they can be setup for identity v2 or identity v3. * Add the "disable_log_reason" and the "update_forced_down" API endpoints to the compute "services_client". Add '2.11' compute validation schema for compute services API. * Enhances the v3 identity client with the "check_token_existence" endpoint, allowing users to check the existence of tokens * The tempest module tempest.common.dynamic creds which is used for dynamically allocating credentials has been migrated into tempest lib. * Define below object storage service clients as libraries. Add new service clients to the library interface so the other projects can use these modules as stable libraries without any maintenance changes. * bulk_middleware_client * capabilities_client * The tempest module tempest.common.preprov_creds which is used to provide credentials from a list of preprovisioned resources has been migrated into tempest lib at tempest.lib.common.preprov_creds. * The InvalidTestResource exception class from tempest.exceptions has been migrated into tempest.lib.exceptions * The tempest module tempest.common.fixed_network which provided utilities for finding fixed networks by and helpers for picking the network to use when multiple tenant networks are available has been migrated into tempest lib at tempest.lib.common.fixed_network. * When registering service clients from installed plugins, all registrations are now processed, even if one or more fails. All exceptions encountered during the registration process are recorded. If at least one exception was encountered, the registration process fails and all interim errors are reported. * The __repr__ method is now implemented for the base *tempest.Exception* class, its implementation is identical to __str__: it reports the error message merged with input parameters. * Add a new identity catalog client. At this point, the new client contains a single functionality, "show_catalog", which returns a catalog object. Upgrade Notes ************* * Tempest checks a volume delete by waiting for NotFound(404) on show_volume(). Sometime a volume delete fails and the volume status becomes error_deleting which means the delete is failed. So Tempest doesn't need to wait anymore. A new release of Tempest raises an exception DeleteErrorException instead of waiting. Deprecation Notes ***************** * Remove the support of python3.4, because in Ubuntu Xenial only python3.5 is available (python3.4 is restricted to <= Mitaka). Bug Fixes ********* * Add more accurate ip version check in addresses schema which will limit the ip version value in [4, 6]. * Add a missing return statement to the retype_volume API in the v2 volumes_client library: Bug#1703997 This changes the response body from None to an empty dictionary. * Fix RemoteClient default ssh_shell_prologue: Bug#1707478 The default ssh_shell_proloque has been modified from specifying erroneous PATH=$$PATH:/sbin to PATH=$PATH:/sbin. Other Notes *********** * OpenStack Releases supported after this release are **Pike**, **Ocata**, and **Newton**. The release under current development of this tag is Queens, meaning that every Tempest commit is also tested against master during the Queens cycle. However, this does not necessarily mean that using Tempest as of this tag will work against a Queens (or future release) cloud. Changes in tempest 16.1.0..17.0.0 --------------------------------- 35976ed Add release not to mark the start of Pike support 11289db Use skip_checks instead of skipUnless e61e237 Add support for IPV6 tests in tempest. c1ebf65 Add params to upload_volume command ba12307 Updated from global requirements 75498ba check is_admin_available for force_tenant_isolation in test.py 15429d8 [TrivialFix] Add bug reference to releasenote 1bc06aa Added unit tests for blacklist and whitelist 70d7a11 Use networks floatingips client to associate fips fcd8246 Use skip_checks if all testcases have same skip conditions c7b143f Do not use self.name for volume name field 4b97446 Fix for resetting volume status ded5972 Test shared and non-shared external networks cd36841 Move test decorators to common f5869b4 Use a non admin privileges for retyping a volume 8bd00e3 TrivialFix for flake8 and docs build in tox.ini d8152de Fix RemoteClient having bad default ssh_shell_prologue 8163584 Remove unnecessary schema check of ip address d12e548 Test nonexistent volume type extra_spec name instead of id f0e8beb Add detail specific fields check in list_backups 138d279 [TrivialFix]Remove unnecessary value taking 15ee1ff [TrivialFix] Remove unused statements in compute tests cc4ef74 Add comments for test module of tempest.test.idempotent_id 05c8692 Updated from global requirements 5fdfc9b Fix unit test that break isolation 311104e Remove unused variable assignment 565e7a3 Remove unused assignment 95760ce Add compute test for ServerGroupAntiAffinityFilter d474f33 Resolve TODO in test: 'test_available_volume_retype_with_migration' 8871fca Stop passing around dicts in validation resources 557320e Add docstring for validation resources 463a8a6 Fix client usage in validation resources 1fa7a60 Drop validation resources dependency from CONF 20e512b Update and replace http with https for doc links in tempest 284d311 [Trivialfix]Fix typos in tempest f6bae31 Remove unnecessary class Inheritance fc0efda Remove unnecessary resource_setup in DvrRoutersNegativeTest d095847 Do not run test_create_server_with_scheduler_hint_group twice 5026c50 add detaches to attachment test 5805d32 Volume and group on same backend in update_group 6491738 Do not create server in test_list_servers_filter_by_exist_host e5ccb16 Remove unused global variable cfa1cd5 Do not print empty list in assertNotEmpty 68cb44d Py3: Finish the python3 port 575a5cf Refactor test_user_update 17347f0 Mark credentials_factory stable for plugins f9f8789 Remove dependency to identity v2 a6b3015 Make sure test use the latest volume clients 9ee9860 Add Tests for Groups Volume APIs - Part 4 88eb677 Move schedule filter check to compute module 009a1f6 Remove usage of credentials_factory.AdminManager ca5c308 Increase unit test coverage for v2 images client 850f14d Fix microversion doc for implemented microversion tests d56edc3 Add Tests for Groups Volume APIs - Part 3 b33dd46 Fix verify config API version checks fa85cd0 Add unit test for volume availability zone client 860e032 Remove redundant comments in credentials_factory.py 2d7b40a Add release notes for client registration changes 6176f1b TrivialFix: Remove the unused import code f0599b1 Add test for showing volume image metadata 1bf32eb Moved releasenotes from tempest package to proper location 01512d2 Do not call another testcase in one testcase 9b0f2d2 Remove unnecessary assertIsNotNone check 78c9139 Remove unnecessary checks already coverd in schema 628642b Remove _list_assertions from test_roles.py 8786ea8 Remove unnecessary asserting for 'id' in body eb83b0f Fix broken api links in lib/services 3bc93b2 Judge skip conditions in skip_checks instead of in resource_setup c6a7905 Fix disable_ssl_certificate_validation values if ca_certificates file is defined 39bea7b Remove unnecessary usage of instance variable 15b3842 TrivialFix: Remove the unused import code bc2ae86 Unsupported 'message' Exception attribute in PY3 7d216dc Updated firewalls deafult port reference to Newton bd9dd8e Make verify_tempest_config workspace aware 7664afe Fixed the broken links for api microversion 4ddc5ee TrivialFix: Correct reST field lists in docstrings 368390b Updated from global requirements ff50cc5 Try to register all service clients 2712737 Remove support for py34 b282eb7 Fix some nits in object storage clients release notes 0f1e5cf Import data_utils from tempest.lib.common.utils 41ed715 Add Tests for Groups Volume APIs - Part 2 8e87ccb Revert "Remove tempest.common data_utils" 97f6a84 Move object storage capabilities_client to lib interface 64485cc Remove deprecated test.related_bug decorator 5b7f6b9 Move object storage bulk_middleware_client to lib interface 00c3588 Complete credentials_factory docstrings ace26ab Add unit test for volume limits client 1ec2cac Add unit test for volume extensions client 17d8a48 Fix object storage capabilities client return value e2fd3d5 Updated from global requirements 6891411 Add Tests for Create/Delete/Show/List Group Types 841b75e Add better docs on credential providers b19c55d Migrate the preprov creds module to tempest lib c51b712 Migrate the dynamic creds module to tempest lib bf6605f Ensure test for Neutron GET / uses right URL 872ca87 [DOC BLD FIX] Correct reST field lists in docstrings 609298c Fix object storage bulk middleware client return value dcd9100 Remove creds providers dependency from clients d850882 Added return statement to retype_volume in v2 volumes_client 9958b17 Add volume backed instance coverage to API tests 12972ae Fix account generator unit tests d199caf Make credentials_factory a bit nicer e98720a Update the documention for doc migration 7628cb2 Unix style line ending 1c39a2f test_boot_server_from_encrypted_volume_luks skip condition bf549a4 Add unit tests for volume and snapshot manage clients 7814b04 Updated from global requirements f3e247d Cleanup the orchestration client init and attr 708821c Remove unused clients from testcases d69d1b5 Move multi-nic tests to dedicated module d029516 create test to verify catalog standardization 73ed1f3 Generic method for creating a volume snapshot ff5f0c1 Handle volume API version enablement a27f15f Fix instance_action_events response schema for finish_time and result e3d1065 Using fixtures instead of deprecated mockpatch module 5dcb541 Refactor volume clone tests ba135d9 Remove unused tenant_cidr from test_routers.py 72a6a39 Use cls instead of self in classmethod ac2bb52 Remove unused LOG from clients.py aa516f8 Add flag to generate tempest plugin list 74a56ab Doc: fix markups, capitalization and add 2 REVIEWING advices ef40daa Add a page for release 16.1 to release notes b7affe4 Added script for doing tempest plugin sanity a2df0f5 Add 'params' argument to v2 list_backups API 08344ff Supplement unit tests for volume transfers client fe399fd Extra compute services_client API endpoints 5b68f50 Dynamic creds does not support create subnet with ipv6 2bbc492 Tidy up releasenotes 0994120 Add negative test for live migration 1e8a0ed Enhance tempest client for keystone v3 token APIs. 361c29b Fix class name for test extensions 4723fde Raise exception when error_deleting bd65bbb Remove tempest.common data_utils Diffstat (except docs and test files) ------------------------------------- HACKING.rst | 59 +- README.rst | 58 +- REVIEWING.rst | 26 +- bindep.txt | 2 +- ...ported-openstack-releases-b88db468695348f6.yaml | 13 - ...Tempest-library-interface-0eb680b810139a50.yaml | 11 - .../10.0.0-start-using-reno-ed9518126fd0e1a3.yaml | 3 - ...ported-openstack-releases-b88db468695348f6.yaml | 13 + ...Tempest-library-interface-0eb680b810139a50.yaml | 11 + .../10.0.0-start-using-reno-ed9518126fd0e1a3.yaml | 3 + ...roversion-testing-support-2ceddd2255670932.yaml | 3 - ...pute-microversion-support-e0b23f960f894b9b.yaml | 3 - ...ported-openstack-releases-1e5d7295d939d439.yaml | 12 - ...roversion-testing-support-2ceddd2255670932.yaml | 3 + ...pute-microversion-support-e0b23f960f894b9b.yaml | 3 + ...ported-openstack-releases-1e5d7295d939d439.yaml | 12 + ...ported-openstack-releases-f10aac381d933dd1.yaml | 12 - ...d-network-versions-client-d90e8334e1443f5c.yaml | 4 - .../12.1.0-add-scope-to-auth-b5a82493ea89f41e.yaml | 7 - .../12.1.0-add-tempest-run-3d0aaf69c2ca4115.yaml | 4 - ....0-add-tempest-workspaces-228a2ba4690b5589.yaml | 5 - ...dd_subunit_describe_calls-5498a37e6cd66c4b.yaml | 8 - .../notes/12.1.0-bug-1486834-7ebca15836ae27a9.yaml | 7 - ...entity-clients-as-library-e663c6132fcac6c2.yaml | 13 - ...-image-clients-as-library-86d17caa26ce3961.yaml | 15 - ...1.0-new-test-utils-module-adf34468c4d52719.yaml | 11 - ...t-scenarios-functionality-01308e6d4307f580.yaml | 11 - ...remove-integrated-horizon-bb57551c1e5f5be3.yaml | 7 - ...gacy-credential-providers-3d653ac3ba1ada2b.yaml | 5 - ...routers-client-as-library-25a363379da351f6.yaml | 6 - ...-support-chunked-encoding-d71f53225f68edf3.yaml | 9 - ...nfig-dir-location-changes-12260255871d3a2b.yaml | 12 - ...httptimeout-in-restclient-ax78061900e3f3d7.yaml | 7 - ...-add-new-identity-clients-3c3afd674a395bde.yaml | 13 - .../12.2.0-clients_module-16f3025f515bf9ec.yaml | 18 - .../12.2.0-nova_cert_default-90eb7c1e3cde624a.yaml | 8 - ...rvice-client-registration-00b19a2dd4935ba0.yaml | 12 - .../12.2.0-remove-javelin-276f62d04f7e4a1d.yaml | 5 - ...2.0-service_client_config-8a1d7b4de769c633.yaml | 6 - ...volume-clients-as-library-9a3444dd63c134b3.yaml | 18 - ...ported-openstack-releases-f10aac381d933dd1.yaml | 12 + ...d-network-versions-client-d90e8334e1443f5c.yaml | 4 + .../12.1.0-add-scope-to-auth-b5a82493ea89f41e.yaml | 7 + .../12.1.0-add-tempest-run-3d0aaf69c2ca4115.yaml | 4 + ....0-add-tempest-workspaces-228a2ba4690b5589.yaml | 5 + ...dd_subunit_describe_calls-5498a37e6cd66c4b.yaml | 8 + .../12/12.1.0-bug-1486834-7ebca15836ae27a9.yaml | 7 + ...entity-clients-as-library-e663c6132fcac6c2.yaml | 13 + ...-image-clients-as-library-86d17caa26ce3961.yaml | 15 + ...1.0-new-test-utils-module-adf34468c4d52719.yaml | 11 + ...t-scenarios-functionality-01308e6d4307f580.yaml | 11 + ...remove-integrated-horizon-bb57551c1e5f5be3.yaml | 7 + ...gacy-credential-providers-3d653ac3ba1ada2b.yaml | 5 + ...routers-client-as-library-25a363379da351f6.yaml | 6 + ...-support-chunked-encoding-d71f53225f68edf3.yaml | 9 + ...nfig-dir-location-changes-12260255871d3a2b.yaml | 12 + ...httptimeout-in-restclient-ax78061900e3f3d7.yaml | 7 + ...-add-new-identity-clients-3c3afd674a395bde.yaml | 13 + .../12/12.2.0-clients_module-16f3025f515bf9ec.yaml | 18 + .../12.2.0-nova_cert_default-90eb7c1e3cde624a.yaml | 8 + ...rvice-client-registration-00b19a2dd4935ba0.yaml | 12 + .../12/12.2.0-remove-javelin-276f62d04f7e4a1d.yaml | 5 + ...2.0-service_client_config-8a1d7b4de769c633.yaml | 6 + ...volume-clients-as-library-9a3444dd63c134b3.yaml | 18 + ...entity-clients-as-library-5f7ndha733nwdsn9.yaml | 15 - ...lume-clients-as-a-library-d05b6bc35e66c6ef.yaml | 16 - ...te-get_ipv6_addr_by_EUI64-4673f07677289cf6.yaml | 4 - ...until-true-to-tempest-lib-c9ea70dd6fe9bd15.yaml | 5 - ...0-start-of-newton-support-3ebb274f300f28eb.yaml | 13 - ...pest-cleanup-nostandalone-39df2aafb2545d35.yaml | 5 - ...volume-clients-as-library-660811011be29d1a.yaml | 6 - ...entity-clients-as-library-5f7ndha733nwdsn9.yaml | 15 + ...lume-clients-as-a-library-d05b6bc35e66c6ef.yaml | 16 + ...te-get_ipv6_addr_by_EUI64-4673f07677289cf6.yaml | 4 + ...until-true-to-tempest-lib-c9ea70dd6fe9bd15.yaml | 5 + ...0-start-of-newton-support-3ebb274f300f28eb.yaml | 13 + ...pest-cleanup-nostandalone-39df2aafb2545d35.yaml | 5 + ...volume-clients-as-library-660811011be29d1a.yaml | 6 + ...der-abstract-class-to-lib-70ff513221f8a871.yaml | 6 - ...red_client-to-tempest.lib-4d4af33f969c576f.yaml | 5 - ...ation-to-versions-clients-acbc78292e24b014.yaml | 6 - .../14.0.0-add-image-clients-af94564fb34ddca6.yaml | 9 - ...ments-client-as-a-library-d34b4fdf376984ad.yaml | 6 - ...d-service-provider-client-cbba77d424a30dd3.yaml | 4 - ...-port-parameter-to-client-6d16c374ac4456c1.yaml | 4 - ...ecate-nova-api-extensions-df16b02485dae203.yaml | 7 - ...-cinder-v3-to-lib-service-be3ba0c20753b594.yaml | 7 - ...0-new-volume-limit-client-517c17d9090f4df4.yaml | 3 - ....0-remove-bootable-option-024f8944c056a3e0.yaml | 6 - ...e-negative-test-generator-1653f4c0f86ccf75.yaml | 4 - ...volume-clients-as-library-309030c7a16e62ab.yaml | 12 - ...der-abstract-class-to-lib-70ff513221f8a871.yaml | 6 + ...red_client-to-tempest.lib-4d4af33f969c576f.yaml | 5 + ...ation-to-versions-clients-acbc78292e24b014.yaml | 6 + .../14.0.0-add-image-clients-af94564fb34ddca6.yaml | 9 + ...ments-client-as-a-library-d34b4fdf376984ad.yaml | 6 + ...d-service-provider-client-cbba77d424a30dd3.yaml | 4 + ...-port-parameter-to-client-6d16c374ac4456c1.yaml | 4 + ...ecate-nova-api-extensions-df16b02485dae203.yaml | 7 + ...-cinder-v3-to-lib-service-be3ba0c20753b594.yaml | 7 + ...0-new-volume-limit-client-517c17d9090f4df4.yaml | 3 + ....0-remove-bootable-option-024f8944c056a3e0.yaml | 6 + ...e-negative-test-generator-1653f4c0f86ccf75.yaml | 4 + ...volume-clients-as-library-309030c7a16e62ab.yaml | 12 + ...y-v3-clients-as-a-library-d34b4fdf376984ad.yaml | 6 - ...s-to-roles-client-library-edf96408ad9ba82e.yaml | 6 - ...-manage-client-as-library-a76ffdba9d8d01cb.yaml | 8 - ..._security_disabled-option-2d3d87f6bd11d03a.yaml | 8 - ...-feature-enabled.reseller-84800a8232fe217f.yaml | 8 - ...e_enabled.volume_services-dbe024ea067d5ab2.yaml | 8 - ....0.0-jsonschema-validator-2377ba131e12d3c7.yaml | 5 - ...croversion-config-options-eaee6a7d2f8390a8.yaml | 9 - ...validation-config-options-e3d1b89ce074d71c.yaml | 25 - ...t-scenario-config-options-414e0c5442e967e9.yaml | 6 - ...ed-network-config-options-f9ce276231578fe6.yaml | 11 - ...y-v3-clients-as-a-library-d34b4fdf376984ad.yaml | 6 + ...s-to-roles-client-library-edf96408ad9ba82e.yaml | 6 + ...-manage-client-as-library-a76ffdba9d8d01cb.yaml | 8 + ..._security_disabled-option-2d3d87f6bd11d03a.yaml | 8 + ...-feature-enabled.reseller-84800a8232fe217f.yaml | 8 + ...e_enabled.volume_services-dbe024ea067d5ab2.yaml | 8 + ....0.0-jsonschema-validator-2377ba131e12d3c7.yaml | 5 + ...croversion-config-options-eaee6a7d2f8390a8.yaml | 9 + ...validation-config-options-e3d1b89ce074d71c.yaml | 25 + ...t-scenario-config-options-414e0c5442e967e9.yaml | 6 + ...ed-network-config-options-f9ce276231578fe6.yaml | 11 + ...s-to-roles-client-library-178d4a6000dec72d.yaml | 7 - ...rameter-to-volumes-client-ff4f7f12795003a4.yaml | 7 - ...ulate-client-as-a-library-ed76baf25f02c3ca.yaml | 3 - ...ntent-type-without-spaces-b2c9b91b257814f3.yaml | 9 - ...-list-auth-project-client-5905076d914a3943.yaml | 6 - ...-list-glance-api-versions-ec5fc8081fc8a0ae.yaml | 6 - ...to-servers-client-library-088df48f6d81f4be.yaml | 6 - ...ersion-to-identity-client-944cb7396088a575.yaml | 6 - ...-version-to-volume-client-4769dd1bd4ab9c5e.yaml | 6 - ...d-quota-sets-detail-kwarg-74b72183295b3ce7.yaml | 6 - ...tempest-lib-remote-client-adbeb3f42a36910b.yaml | 11 - ...empest-run-combine-option-e94c1049ba8985d5.yaml | 6 - ...o-encryption-types-client-f3093532a0bcf9a1.yaml | 6 - ...-manage-client-as-library-78ab198a1dc1bd41.yaml | 9 - ...create-server-tags-client-8c0042a77e859af6.yaml | 8 - ...e-deactivate_image-config-7a282c471937bbcb.yaml | 6 - ...vr_extra_resources-config-8c319d6dab7f7e5c.yaml | 7 - ...pi-version-config-options-8370b63aea8e14cf.yaml | 10 - ...e-resources-prefix-option-ad490c0a30a0266b.yaml | 10 - ...kip_unless_attr-decorator-450a1ed727494724.yaml | 5 - ...p_unless_config-decorator-64c32d588043ab12.yaml | 5 - ...ated-cinder-api-v1-option-df7d5a54d93db5cf.yaml | 12 - ...precate_client_parameters-cb8d069e62957f7e.yaml | 6 - ...ce-clients-bugfix-1667354-73d2c3c8fedc08bf.yaml | 7 - .../notes/16.0.0-mitaka-eol-88ff8355fff81b55.yaml | 13 - ...e-call_until_true-of-test-de9c13bc8f969921.yaml | 6 - ..._security_disabled-option-d0ffaeb2e7817707.yaml | 5 - ...ion-config-options-part-2-5cd17b6e0e6cb8a3.yaml | 11 - ...vr_extra_resources-option-e8c441c38eab7ddd.yaml | 8 - ...-identity-reseller-option-4411c7e3951f1094.yaml | 4 - ...-sahara-service-available-44a642aa9c634ab4.yaml | 7 - ...e_enabled.volume_services-c6aa142cc1021297.yaml | 5 - ...6.0.0-use-keystone-v3-api-935860d30ddbb8e9.yaml | 5 - ...0-volume-transfers-client-e5ed3f5464c0cdc0.yaml | 18 - ...s-to-roles-client-library-178d4a6000dec72d.yaml | 7 + ...rameter-to-volumes-client-ff4f7f12795003a4.yaml | 7 + ...ulate-client-as-a-library-ed76baf25f02c3ca.yaml | 3 + ...ntent-type-without-spaces-b2c9b91b257814f3.yaml | 9 + ...-list-auth-project-client-5905076d914a3943.yaml | 6 + ...-list-glance-api-versions-ec5fc8081fc8a0ae.yaml | 6 + ...to-servers-client-library-088df48f6d81f4be.yaml | 6 + ...ersion-to-identity-client-944cb7396088a575.yaml | 6 + ...-version-to-volume-client-4769dd1bd4ab9c5e.yaml | 6 + ...d-quota-sets-detail-kwarg-74b72183295b3ce7.yaml | 6 + ...tempest-lib-remote-client-adbeb3f42a36910b.yaml | 11 + ...empest-run-combine-option-e94c1049ba8985d5.yaml | 6 + ...o-encryption-types-client-f3093532a0bcf9a1.yaml | 6 + ...-manage-client-as-library-78ab198a1dc1bd41.yaml | 9 + ...create-server-tags-client-8c0042a77e859af6.yaml | 8 + ...e-deactivate_image-config-7a282c471937bbcb.yaml | 6 + ...vr_extra_resources-config-8c319d6dab7f7e5c.yaml | 7 + ...pi-version-config-options-8370b63aea8e14cf.yaml | 10 + ...e-resources-prefix-option-ad490c0a30a0266b.yaml | 10 + ...kip_unless_attr-decorator-450a1ed727494724.yaml | 5 + ...p_unless_config-decorator-64c32d588043ab12.yaml | 5 + ...ated-cinder-api-v1-option-df7d5a54d93db5cf.yaml | 12 + ...precate_client_parameters-cb8d069e62957f7e.yaml | 6 + ...ce-clients-bugfix-1667354-73d2c3c8fedc08bf.yaml | 7 + .../16/16.0.0-mitaka-eol-88ff8355fff81b55.yaml | 13 + ...e-call_until_true-of-test-de9c13bc8f969921.yaml | 6 + ..._security_disabled-option-d0ffaeb2e7817707.yaml | 5 + ...ion-config-options-part-2-5cd17b6e0e6cb8a3.yaml | 11 + ...vr_extra_resources-option-e8c441c38eab7ddd.yaml | 8 + ...-identity-reseller-option-4411c7e3951f1094.yaml | 4 + ...-sahara-service-available-44a642aa9c634ab4.yaml | 7 + ...e_enabled.volume_services-c6aa142cc1021297.yaml | 5 + ...6.0.0-use-keystone-v3-api-935860d30ddbb8e9.yaml | 5 + ...0-volume-transfers-client-e5ed3f5464c0cdc0.yaml | 18 + ...ersion-check-in-addresses-x491ac6d9abaxa12.yaml | 4 + ...esource-deleted-sg-client-f4a7a7a54ff024d7.yaml | 5 + ...ms-to-v2-list-backups-api-c088d2b4bfe90247.yaml | 6 + ...rn-value-to-retype-volume-a401aa619aaa2457.yaml | 7 + ...-api-to-v2-volumes-client-ee3c027f35276561.yaml | 5 + ...redentials-factory-stable-c8037bd9ae642482.yaml | 10 + ...efault-ssh-shell-prologue-33e99343d086f601.yaml | 7 + .../notes/identity_client-635275d43abbb807.yaml | 5 + .../migrate-dynamic-creds-ecebb47528080761.yaml | 5 + ...orage-as-stable-interface-42014c7b43ecb254.yaml | 10 + .../migrate-preprov-creds-ef61a046ee1ec604.yaml | 11 + ...registration-enhancements-e09131742391225b.yaml | 12 + ...-error-deleting-on-volume-18d0d0c5886212dd.yaml | 8 + .../remove-support-of-py34-7d59fdb431fefe24.yaml | 5 + .../start-of-pike-support-f2a1b7ea8e8b0311.yaml | 11 + ...t-identity-catalog-client-f5c8589a9d7c1eb5.yaml | 5 + releasenotes/source/index.rst | 1 + releasenotes/source/v16.1.0.rst | 6 + requirements.txt | 10 +- setup.cfg | 3 +- tempest/README.rst | 15 +- tempest/api/README.rst | 5 +- tempest/api/compute/admin/test_agents.py | 4 +- tempest/api/compute/admin/test_aggregates.py | 1 - .../compute/admin/test_auto_allocate_network.py | 11 +- tempest/api/compute/admin/test_create_server.py | 2 - tempest/api/compute/admin/test_fixed_ips.py | 7 +- .../api/compute/admin/test_fixed_ips_negative.py | 9 +- tempest/api/compute/admin/test_flavors.py | 4 +- tempest/api/compute/admin/test_flavors_access.py | 4 +- .../compute/admin/test_flavors_access_negative.py | 4 +- .../api/compute/admin/test_flavors_extra_specs.py | 4 +- .../admin/test_flavors_extra_specs_negative.py | 4 +- .../api/compute/admin/test_floating_ips_bulk.py | 4 +- tempest/api/compute/admin/test_hosts.py | 5 - tempest/api/compute/admin/test_hypervisor.py | 15 +- .../admin/test_live_block_migration_negative.py | 49 -- tempest/api/compute/admin/test_live_migration.py | 55 +- .../compute/admin/test_live_migration_negative.py | 63 ++ tempest/api/compute/admin/test_quotas.py | 4 +- tempest/api/compute/admin/test_quotas_negative.py | 6 +- tempest/api/compute/admin/test_security_groups.py | 4 +- tempest/api/compute/admin/test_servers.py | 27 +- tempest/api/compute/admin/test_servers_negative.py | 1 - .../compute/admin/test_servers_on_multinodes.py | 43 +- tempest/api/compute/admin/test_volume_swap.py | 4 +- tempest/api/compute/base.py | 22 +- .../api/compute/certificates/test_certificates.py | 9 +- .../api/compute/flavors/test_flavors_negative.py | 4 +- .../floating_ips/test_floating_ips_actions.py | 8 +- .../test_floating_ips_actions_negative.py | 10 +- .../compute/floating_ips/test_list_floating_ips.py | 7 +- .../test_list_floating_ips_negative.py | 5 +- tempest/api/compute/keypairs/test_keypairs.py | 8 - tempest/api/compute/security_groups/base.py | 10 +- .../security_groups/test_security_group_rules.py | 8 +- .../test_security_group_rules_negative.py | 9 - .../security_groups/test_security_groups.py | 8 - .../test_security_groups_negative.py | 14 - .../api/compute/servers/test_attach_interfaces.py | 10 +- tempest/api/compute/servers/test_create_server.py | 123 +--- .../servers/test_create_server_multi_nic.py | 120 ++++ tempest/api/compute/servers/test_delete_server.py | 4 +- tempest/api/compute/servers/test_device_tagging.py | 4 +- .../compute/servers/test_list_server_filters.py | 4 +- tempest/api/compute/servers/test_novnc.py | 2 +- tempest/api/compute/servers/test_server_actions.py | 19 +- .../api/compute/servers/test_server_addresses.py | 9 +- .../servers/test_server_addresses_negative.py | 6 +- tempest/api/compute/servers/test_server_group.py | 23 +- .../api/compute/servers/test_server_metadata.py | 5 +- .../compute/servers/test_server_rescue_negative.py | 6 +- tempest/api/compute/servers/test_server_tags.py | 4 +- .../api/compute/servers/test_servers_negative.py | 6 +- .../api/compute/servers/test_virtual_interfaces.py | 11 +- .../servers/test_virtual_interfaces_negative.py | 4 +- tempest/api/compute/test_extensions.py | 6 +- tempest/api/compute/test_quotas.py | 4 +- tempest/api/compute/test_tenant_networks.py | 4 +- tempest/api/compute/volumes/test_attach_volume.py | 16 +- .../api/compute/volumes/test_volume_snapshots.py | 7 +- tempest/api/compute/volumes/test_volumes_get.py | 4 - tempest/api/identity/admin/v2/test_services.py | 1 - tempest/api/identity/admin/v3/test_domains.py | 2 - .../api/identity/admin/v3/test_domains_negative.py | 1 - .../api/identity/admin/v3/test_endpoint_groups.py | 10 +- tempest/api/identity/admin/v3/test_endpoints.py | 1 - tempest/api/identity/admin/v3/test_inherits.py | 15 +- tempest/api/identity/admin/v3/test_policies.py | 1 - tempest/api/identity/admin/v3/test_roles.py | 32 +- tempest/api/identity/admin/v3/test_services.py | 1 - tempest/api/identity/admin/v3/test_tokens.py | 3 +- tempest/api/identity/admin/v3/test_trusts.py | 25 +- tempest/api/identity/admin/v3/test_users.py | 35 +- tempest/api/identity/base.py | 1 + tempest/api/identity/v2/test_ec2_credentials.py | 4 +- tempest/api/identity/v3/test_catalog.py | 41 ++ tempest/api/image/v2/test_images.py | 2 +- tempest/api/network/admin/test_agent_management.py | 4 +- .../api/network/admin/test_dhcp_agent_scheduler.py | 4 +- .../admin/test_floating_ips_admin_actions.py | 4 +- .../api/network/admin/test_l3_agent_scheduler.py | 4 +- .../api/network/admin/test_metering_extensions.py | 4 +- tempest/api/network/admin/test_negative_quotas.py | 4 +- tempest/api/network/admin/test_quotas.py | 4 +- tempest/api/network/admin/test_routers.py | 21 +- tempest/api/network/admin/test_routers_dvr.py | 12 +- tempest/api/network/admin/test_routers_negative.py | 6 +- tempest/api/network/test_allowed_address_pair.py | 9 +- tempest/api/network/test_extensions.py | 6 +- tempest/api/network/test_extra_dhcp_options.py | 6 +- tempest/api/network/test_floating_ips.py | 4 +- tempest/api/network/test_floating_ips_negative.py | 4 +- tempest/api/network/test_networks.py | 40 +- tempest/api/network/test_ports.py | 8 +- tempest/api/network/test_routers.py | 8 +- tempest/api/network/test_routers_negative.py | 13 +- tempest/api/network/test_security_groups.py | 4 +- .../api/network/test_security_groups_negative.py | 4 +- tempest/api/network/test_service_providers.py | 4 +- tempest/api/network/test_subnetpools_extensions.py | 4 +- tempest/api/network/test_tags.py | 6 +- tempest/api/object_storage/base.py | 5 +- tempest/api/object_storage/test_account_bulk.py | 49 +- tempest/api/object_storage/test_account_quotas.py | 7 +- .../object_storage/test_account_quotas_negative.py | 7 +- .../api/object_storage/test_account_services.py | 5 +- .../test_account_services_negative.py | 1 - .../object_storage/test_container_acl_negative.py | 1 - .../api/object_storage/test_container_quotas.py | 8 +- .../test_container_services_negative.py | 2 +- .../api/object_storage/test_container_staticweb.py | 14 +- tempest/api/object_storage/test_container_sync.py | 1 - .../test_container_sync_middleware.py | 4 +- tempest/api/object_storage/test_crossdomain.py | 4 +- tempest/api/object_storage/test_object_formpost.py | 4 +- .../test_object_formpost_negative.py | 6 +- tempest/api/object_storage/test_object_services.py | 5 +- tempest/api/object_storage/test_object_slo.py | 10 +- tempest/api/object_storage/test_object_temp_url.py | 18 +- .../test_object_temp_url_negative.py | 10 +- tempest/api/object_storage/test_object_version.py | 16 +- tempest/api/volume/admin/test_group_types.py | 54 ++ tempest/api/volume/admin/test_groups.py | 259 +++++++- tempest/api/volume/admin/test_volume_quotas.py | 2 +- .../admin/test_volume_retype_with_migration.py | 4 +- .../api/volume/admin/test_volume_type_access.py | 2 +- .../test_volume_types_extra_specs_negative.py | 10 +- tempest/api/volume/admin/test_volumes_actions.py | 15 +- tempest/api/volume/admin/test_volumes_backup.py | 3 +- tempest/api/volume/base.py | 3 + tempest/api/volume/test_image_metadata.py | 14 +- tempest/api/volume/test_versions.py | 2 +- tempest/api/volume/test_volumes_actions.py | 12 +- tempest/api/volume/test_volumes_backup.py | 9 +- tempest/api/volume/test_volumes_clone.py | 28 +- tempest/api/volume/test_volumes_get.py | 4 +- tempest/api/volume/test_volumes_list.py | 17 +- tempest/api/volume/test_volumes_negative.py | 8 +- tempest/api/volume/test_volumes_snapshots.py | 6 +- tempest/clients.py | 119 ++-- tempest/cmd/account_generator.py | 14 +- tempest/cmd/cleanup.py | 8 +- tempest/cmd/cleanup_service.py | 12 +- tempest/cmd/run.py | 4 +- tempest/cmd/subunit_describe_calls.py | 7 +- tempest/cmd/verify_tempest_config.py | 97 ++- tempest/common/compute.py | 51 +- tempest/common/credentials_factory.py | 167 ++++-- tempest/common/dynamic_creds.py | 455 -------------- tempest/common/fixed_network.py | 127 ---- tempest/common/preprov_creds.py | 372 ------------ tempest/common/utils/__init__.py | 92 +++ tempest/common/utils/linux/remote_client.py | 2 +- tempest/common/validation_resources.py | 352 +++++++---- tempest/common/waiters.py | 5 +- tempest/exceptions.py | 11 +- tempest/hacking/checks.py | 13 + .../response/compute/v2_1/parameter_types.py | 2 +- .../api_schema/response/compute/v2_1/servers.py | 9 +- .../api_schema/response/compute/v2_1/services.py | 22 + .../api_schema/response/compute/v2_11/__init__.py | 0 .../api_schema/response/compute/v2_11/services.py | 46 ++ tempest/lib/common/cred_provider.py | 8 +- tempest/lib/common/dynamic_creds.py | 477 +++++++++++++++ tempest/lib/common/fixed_network.py | 127 ++++ tempest/lib/common/http.py | 3 +- tempest/lib/common/preprov_creds.py | 374 ++++++++++++ tempest/lib/common/rest_client.py | 2 +- tempest/lib/common/utils/linux/remote_client.py | 2 +- tempest/lib/exceptions.py | 7 + tempest/lib/services/clients.py | 23 +- tempest/lib/services/compute/services_client.py | 37 +- tempest/lib/services/identity/v3/__init__.py | 17 +- tempest/lib/services/identity/v3/catalog_client.py | 29 + .../services/identity/v3/endpoint_groups_client.py | 156 ++--- .../lib/services/identity/v3/identity_client.py | 7 + .../lib/services/network/security_groups_client.py | 8 + tempest/lib/services/network/versions_client.py | 5 +- tempest/lib/services/object_storage/__init__.py | 0 .../object_storage/bulk_middleware_client.py | 62 ++ .../services/object_storage/capabilities_client.py | 31 + tempest/lib/services/volume/v1/backups_client.py | 5 + tempest/lib/services/volume/v2/backups_client.py | 18 +- tempest/lib/services/volume/v2/volumes_client.py | 20 +- tempest/lib/services/volume/v3/__init__.py | 9 +- .../services/volume/v3/group_snapshots_client.py | 88 +++ .../lib/services/volume/v3/group_types_client.py | 29 + tempest/lib/services/volume/v3/groups_client.py | 25 + tempest/lib/services/volume/v3/snapshots_client.py | 21 + tempest/scenario/README.rst | 6 +- tempest/scenario/manager.py | 25 +- tempest/scenario/test_aggregates_basic_ops.py | 4 +- tempest/scenario/test_encrypted_cinder_volumes.py | 6 +- tempest/scenario/test_minimum_basic.py | 4 +- .../scenario/test_network_advanced_server_ops.py | 20 +- tempest/scenario/test_network_basic_ops.py | 30 +- tempest/scenario/test_network_v6.py | 18 +- tempest/scenario/test_object_storage_basic_ops.py | 6 +- tempest/scenario/test_security_groups_basic_ops.py | 23 +- tempest/scenario/test_server_advanced_ops.py | 6 +- tempest/scenario/test_server_basic_ops.py | 4 +- tempest/scenario/test_server_multinode.py | 4 +- tempest/scenario/test_shelve_instance.py | 6 +- tempest/scenario/test_snapshot_pattern.py | 4 +- tempest/scenario/test_stamp_pattern.py | 22 +- tempest/scenario/test_volume_boot_pattern.py | 34 +- tempest/scenario/test_volume_migrate_attached.py | 12 +- tempest/services/object_storage/__init__.py | 6 +- .../object_storage/bulk_middleware_client.py | 62 -- .../services/object_storage/capabilities_client.py | 31 - tempest/test.py | 154 ++--- .../lib/common/utils/linux/test_remote_client.py | 2 +- .../lib/services/compute/test_services_client.py | 56 +- .../services/identity/v3/test_catalog_client.py | 86 +++ .../identity/v3/test_endpoint_groups_client.py | 324 +++++----- .../services/identity/v3/test_identity_client.py | 8 + .../identity/v3/test_oauth_token_client.py | 6 +- .../lib/services/image/v2/test_images_client.py | 110 ++++ .../object_storage/test_bulk_middleware_client.py | 66 ++ .../object_storage/test_capabilities_client.py | 54 ++ .../volume/v2/test_availability_zone_client.py | 51 ++ .../lib/services/volume/v2/test_backups_client.py | 117 ++++ .../services/volume/v2/test_extensions_client.py | 70 +++ .../lib/services/volume/v2/test_limits_client.py | 59 ++ .../volume/v2/test_snapshot_manage_client.py | 83 +++ .../services/volume/v2/test_transfers_client.py | 123 +++- .../volume/v2/test_volume_manage_client.py | 111 ++++ .../lib/services/volume/v2/test_volumes_client.py | 54 ++ .../volume/v3/test_group_snapshots_client.py | 141 +++++ .../services/volume/v3/test_group_types_client.py | 67 +++ .../lib/services/volume/v3/test_groups_client.py | 50 ++ test-requirements.txt | 6 +- tools/tempest-plugin-sanity.sh | 122 ++++ tox.ini | 15 +- 498 files changed, 8087 insertions(+), 4791 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 259a4cf..36b9efa 100644 --- a/requirements.txt +++ b/requirements.txt @@ -5 +5 @@ pbr!=2.1.0,>=2.0.0 # Apache-2.0 -cliff>=2.6.0 # Apache-2.0 +cliff>=2.8.0 # Apache-2.0 @@ -8 +8 @@ testtools>=1.4.0 # MIT -paramiko>=2.0 # LGPLv2.1+ +paramiko>=2.0.0 # LGPLv2.1+ @@ -13,2 +13,2 @@ oslo.config!=4.3.0,!=4.4.0,>=4.0.0 # Apache-2.0 -oslo.log>=3.22.0 # Apache-2.0 -oslo.serialization>=1.10.0 # Apache-2.0 +oslo.log>=3.30.0 # Apache-2.0 +oslo.serialization!=2.19.1,>=1.10.0 # Apache-2.0 @@ -18 +18 @@ fixtures>=3.0.0 # Apache-2.0/BSD -PyYAML>=3.10.0 # MIT +PyYAML>=3.10 # MIT diff --git a/test-requirements.txt b/test-requirements.txt index 6a5ea03..29f0865 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -7,3 +7,3 @@ sphinx>=1.6.2 # BSD -openstackdocstheme>=1.11.0 # Apache-2.0 -reno!=2.3.1,>=1.8.0 # Apache-2.0 -mock>=2.0 # BSD +openstackdocstheme>=1.16.0 # Apache-2.0 +reno>=2.5.0 # Apache-2.0 +mock>=2.0.0 # BSD