We are pleased to announce the release of: tempest 20.0.0: OpenStack Integration Testing This release is part of the stein release series. Download the package from: https://pypi.org/project/tempest For more details, please see below. 20.0.0 ^^^^^^ Prelude ******* This release is to tag the Tempest for OpenStack Stein release. This release marks the start of Stein release support in Tempest and the end of support for Ocata in Tempest. After this release, Tempest will support below OpenStack Releases: * Stein * Rocky * Queens * Pike Current development of Tempest is for OpenStack Train development cycle. Every Tempest commit is also tested against master during the Train cycle. However, this does not necessarily mean that using Tempest as of this tag will work against a Train (or future release) cloud. To be on safe side, use this tag to test the OpenStack Stein release. New Features ************ * Add basic read-only Placement client to Tempest to make possible the testing of the placement based bandwidth allocation feature. The following API calls are available for tempest from now: * GET /allocation_candidates * GET /allocations/{consumer_uuid} Add new config group "placement", with the config options: * "endpoint_type" to use for communication with placement service. * "catalog_type" of the placement service. * "region" as the placement region name to use. * "min_microversion" and "max_microversion" as the range between placement API requests are sent. * Add a new config setting "immutable_user_source" in the "[identity- feature-enabled]" group that defaults to false. This setting, combined with the usage of the "@testtools.skipIf()" decorator, will allow tests that require user creation, deletion, or modification to skip instead of failing in environments that are LDAP-backed. In such environments, the user source is read-only, so this feature flag is needed to allow such tests to gracefully skip without having to blacklist them. * Add support of OSProfiler library for profiling and distributed tracing of OpenStack. A new config option "key" in section "profiler" is added, the option sets the secret key used to enable profiling in OpenStack services. The value needs to correspond to the one specified in [profiler]/hmac_keys option of OpenStack services. (https://docs.openstack.org/osprofiler/) * A new parameter "follow_redirects" has been added to the class "RestClient", which is passed through to "ClosingHttp" or "ClosingProxyHttp" respectively. The default value is "True" which corresponds to the previous behaviour of following up to five redirections before returning a response. Setting "follow_redirects = False" allows to disable this behaviour, so that any redirect that is received is directly returned to the caller. This allows tests to verify that an API is responding with a redirect. * Adds the new method to AgentsClient that implements agent deletion according to the API [0]. [0] https://developer.openstack.org/api- ref/network/v2/index.html#delete-agent * The "tempest.lib.decorators.attr" decorator now supports a "condition" kwarg which can be used to conditionally apply the attr to the test function if the condition evaluates to True. * Add "show_version" function to the "NetworkVersionsClient" client. This allows the possibility of getting details for Networking API. Upgrade Notes ************* * Changed the default value of 'api_v1' config option in the 'image- feature-enabled' group to False from True, because glance v1 APIs are deprecated. Please set True explicitly on the option if still testing glance v1 APIs. * The "tempest-full", "tempest-full-py3" and "tempest-slow" zuul v3 job configurations now set "ENABLE_VOLUME_MULTIATTACH: true" in the "devstack_localrc" variables section. If you have a plugin job configuration that inherits from one of these jobs and the backend cinder volume driver or nova compute driver do not support volume multiattach then you should override and set this variable to "ENABLE_VOLUME_MULTIATTACH: false" in your job configuration. * Below config option was deprecated for removal since juno release. It's time to remove it as all supported stable branches and Tempest plugins are good to handle it. * "[volume_feature_enabled].api_v1" Also Tempest removes the below corresponding service clients alias from client.py which were being set based on above removed config option. * self.backups_client * self.encryption_types_client * self.snapshots_client * self.volume_availability_zone_client * self.volume_hosts_client * self.volume_limits_client * self.volume_qos_client * self.volume_quotas_client * self.volume_services_client * self.volume_types_client * self.volumes_client * self.volumes_extension_client * "tempest.lib.common.utils.misc.find_test_caller" was deprecated during Kilo release cycle in favor of "tempest.lib.common.utils.test_utils.find_test_caller". The deprecated version of "find_test_caller" is removed. * "CONF.validation.run_validation" default enabled. This option required to be set "true" in order to run api tests stability when the guest cooperation required. For example when the guest needs react on Volume/Interface detach. The ssh test makes sure the VM is alive and ready when the detach needs to happen. The option was enabled on the gate for a long time. Deprecation Notes ***************** * The "scheduler_available_filters" option is being deprecated in favor of "scheduler_enabled_filters". The new name is more indicative of what the option means. "scheduler_enabled_filters"'s default value is set to the default value of Nova's "enabled_filters". "scheduler_available_filters"'s default was *all*. There was confusion around this value. Sometimes it was understood to mean the default Nova filters are enabled, other times it was understood to mean all filters are enabled. While *all* is still allowed for "scheduler_enabled_filters" for backwards compatibility, it is strongly recommended to provide an explicit list of filters that matches what's configured in nova.conf. Bug Fixes ********* * [bug 1616892 (https://bugs.launchpad.net/tempest/+bug/1616892)] Tempest now allows tests to verify that an API responds with a redirect. * Fixed bug #1791007. "tempest workspace register" and "tempest workspace rename" CLI will error if None or empty string is passed in --name arguments. Earlier both CLI used to accept the None or empty string as name which was confusing. * Fixed bug #1799883. "tempest workspace register" and "tempest workspace move" CLI will now validate the value of the "--path" CLI argument and raise an exception if it is None or empty string. Earlier both CLI actions were accepting None or empty path which was confusing. * Fixed bug #1808473. "tempest run" CLI will error if a non-exist config file is input to parameter --config-file. Earlier non-exist config value was silently getting ignored and the default config file was used instead which used to give false behavior to the user on using the passed config file. * Patch https://review.openstack.org/#/c/499575/ introduced support creating Neutron port with certain capabilities. Currently capabilities list interpreted as string this change fix it. tempest.conf [network] port_profile = capabilities:[switchdev] result: {'capabilities':'[switchdev]'} expected: {'capabilities': ['switchdev']} Changes in tempest 19.0.0..20.0.0 --------------------------------- a955095f8 Add releasenote to tag the Tempest for Stein release 4c7b79ac3 Default gabbi_tempest_path to empty string 21491dff8 Checking config file actually exist or not in tempest run bd89841dc Update v3 identity inherits tests to work w/ pre-prov c44eadc7b immutable user source: v3 test_roles c3f07b441 Immutable user source: v3 test_inherits ea5efd5c3 Use credentials domain instead of creating new one 3858ced89 Set ENABLE_VOLUME_MULTIATTACH=true on tempest-slow subnode localrc 3e7752c93 Make type decorator compatible with unicode strings 19cb7836d Remove LOG in misc.py 6e30995bc allow create_server with vnic_type and port_profile from kwargs 40fcb9ba2 Add autopep8 to tox.ini aa6f7df0b Add py37 tox env a066fcdc2 Remove unused and duplicate nodeset defined in Tempest 28edda63f Move tempest-tox-plugin-sanity-check to Bionic 59a93d1bb Fix openstack-dev ML ref in test removal process. edcc172db Remove admin test_l3_agent_scheduler API test module 92b87a5a4 Update json module to jsonutils 13c588373 Set concurrency default value 8d94885df no force_tenant_isolation in DefaultDomainTestJSON a7c4c1449 stestr expects --concurrency to be an int f786405da doc: fix compute API microversion list format c2a0eb986 Update neutron quota_driver path 00945fb93 Make tempest-slow run on stable branch also 42c9a8d00 Make tempest-multinode-full job for stable branch 00e477729 Use rand_password() for password when creating user 97b1ad78a Improved tempest plugin sanity check script 1f6cc860f Fix typo e68199802 Add NetworkSubnetPools to tempest cleanup f83799a7f add python 3.7 unit test job 470aca738 Add unit tests for tempest cleanup 5a884bfbb Fix tempest cleanup 1291bb473 Add profiler support into Tempest 4986d0da5 Update v3 identity group tests to work w/ pre-prov 9968315d4 Conditionally mark test_attach_detach_volume as slow 2999963ff Allow decorators.attr to be conditional b4763ef57 Mark test_server_connectivity_reboot as slow 4b8a7b863 Mark test_volume_boot_pattern as slow 9e43fd8bb Remove deprecated services from cleanup 8b9980b49 Normalize endpoint path in oauth client 5639a970c Update v3 project tests to work w/ pre-prov 566237c0a Immutable user source: v3 test_groups e4c8a6a4a Update regions tests to work w/ pre-prov 6caf3fabb Fix tempest cleanup for python3 7581e99a0 Enable volume multiattach tests in tempest-full/slow jobs e0d85b205 Make interop check job as voting b37903cdd Fix tempest cleanup AttributeError 9e0ac6cac Current naming convention is uninformative. e5d93a4a5 Add tempest-slow-py3 job definition 0df2f91d1 Add tempest-multinode-full-py3 job definition ebc2186e7 Convert result of hosts.values() to list always 199e02290 Raise renew_delay in TestNetworkBasicOps:test_subnet_details f853ef7a2 Skip test_subnet_details slow test until bug 1813198 is fixed 91d92424b Fix E117 for pycodestyle (pep8) 2.5.0 d8d0d6e95 Remove warnings.simplefilter to suppress ResourceWarning 71c823771 Adding missing tests for regex and black-regex in tempest run 9334ddb6e Add black-list based tests for tempest run command 2efbea13d Fix invalid exception module usage 5a276eab4 Add whitelist based tests for tempest run command. 3a3ca64eb Update v3 identity project tag test to work w/ pre-prov acd6ecdbd Log the result of command in get_nic_name_by_ip ceb882169 Add placement client for basic GET operations 0fedb410e Ensure volume is deleted after build error 07a572ca1 Fix verify-config KeyError ee1bf68b1 Immutable user source: v3 test_projects 08d95debc Update v3 identity domain configuration tests to work w/ pre-prov 1d311619b Update v3 identity domain negative tests to work w/ pre-prov 29fc259cf Update v3 oauth consumers tests to work w/ pre-prov 7ece7d225 Add unittest for types_client 6cd3827e3 [Trivial fix]Remove unnecessary slash 3fa09d253 Remove unnecessary setUp d4885ff38 Move v3 project negative tests to work w/ pre-prov f01e9cba3 Move v3 identity endpoint group tests to work w/ pre-prov 314ff80b3 update spelling error 36fdd20cb Add missing ws seperator between words part 2 3c6b016f0 fix port_profile b294a17e3 Use renamed template 'integrated-gate-py3' ad4c9ddf3 Remove unnecessary line of code 11a2dd791 Immutable user source: test_default_project_id 109c4f15d Add irrelevant-files for grenade-py3 job af6d18aa0 Transfer respository to repository 023a683d3 Move nova-cells-v1 job to the experimental queue e973da9c8 Add device_owner to gateway port search criteria cf4fda383 Change openstack-dev to openstack-discuss 3e99c0432 Fixing ignored value of --config parameter in tempest account-generator 8a7aaa5bc Adding debugger in tox.ini 93f60940d Move test test_list_agents_non_admin to non-admin dir c7b0bc9f6 Check network connectivity of the instance before and after live migration c825424a5 Adding missing test cases of tempest workspace eac094a8c docs: Fix incorrect docstrings in reStructuredText format a07106683 Support immutable user source f9a4c77b8 Migrate tempest provided base jobs to bionic 6c95678a7 Handling invalid path of workspace register and move de6763768 Add missing ws seperator between words 4a4fbee8b Add a blank space between "eui_ip" and "when". f824fcf0d addCleanup should be immediately after the creating statement. 3c108d761 [Negative] Extend volume over quota limit a5c28bf7d Improve the user lock config options help message 26eda82c3 Refactor cleanups for test_trusts 99690f665 fix typos 8606c83b4 change http links to https links e80266a71 Add api ref link for import_backup 68273ac78 Fix required projects for sanity plugin check job d4cb10f14 Wait for IP add/remove in test_add_remove_fixed_ip 3588bb3f5 interfaces_by_fixed_ip no extra port ec4c66876 docs: Fix plugin registry generation failures 2979bff94 Pass tox_extra_args to Run tempest task f22e6ec65 docs: Include information about the list of supported projects 2dc72172e trivial: Don't run integration tests on tools/.* updates 595ae1698 Deprecate available filters in favor of enabled d13622f27 Replace deprecated "decodestring" bd8cc59dc Mark network slow test as slow f70df52fd [Trivial Fix] modify spelling error of "resource" 6fe405dc6 Update REVIEWING docs with fast-track approval process 087d4d05d Adding missing test cases in "test_run.py" dbf8a136e Add ipv6 tempest jobs 9b4c50cf6 GABBI_TEMPEST_PATH in tox passenv and devstack playbook ece4ae6e4 Adding missing test case of account generator resources 270c25a5e Do not check account unlock if lockout config is 0 b9b4f4f8c Fix assert logic in test_list_security_groups_list_all_tenants_filter 3cf7aa21f Set max microversion 2.35 for nova floatingip and securitygroup b11f85a7f Fix help message of user_unique_last_password_count d595c3606 Make connectivity test less backend dependent 9fca77147 Remove duplicate legacy-tempest-dsvm-multinode-full job 47b1437b9 Make tempest-full-py3 not run for unit tests change a485b094f Remove deprecated find_test_caller function a8f64e3f9 Import periodic-tempest-dsvm-oslo-latest-full-master job c5c7ba997 Change way how second NIC in guest OS is configured d6e047407 Convert job legacy-periodic-tempest-dsvm-all-master 692422bab Use remote_client from tempest.lib.common instead of tempest.common 390e4fa9f Convert legacy-tempest-dsvm-neutron-pg-full to Zuul v3 01fd01a56 Fix Zuul usage of tempest-full 3ffa54e44 Allow to create a rest_client not following redirects 20c181a93 Replace openSUSE experimental check with newer version 4e0715561 Run static account tests based on tempest-full-py3 9608ce3f4 Remove legacy-tempest-dsvm-cinder-v1 a9cc6c1a8 Add interop-tempest-consistency job in Tempest gate 65ed8331f Fix test_get_config_file to always work 864f37eb6 Handling invalid name of workspace register and rename. ebc7f5eda Adding missing test cases of "test_verify_tempest_config" 35d12caf2 Deprecate all-plugin 27ecc306d Optimize and enhance the code of "test_routers.py" a794e8530 Removing redundant spec value in account_generator.py ddd7bcb90 Use show_volume_type to check the result of update_volume_type b477594b3 Interface tests: wait for server to become SSHable c67bb194e Add test coverage CMD cleanup_service 709c8d36f Add delete_agent to AgentsClient c59d113a0 refactor v3 cred tests to work with pre-prov 53d94a82b Add response schema validation for volume qos-specs c45eb61de swift: container ACL - use ID's for tenant and user ff122de40 Cleanup irrelevant-files list in .zuul.yaml fb4d86370 Add missing test for "Show API v2 details" action a7365ae21 fix: Re-clarify unit test REVIEWING documentation d8e6135c3 Removing redundant "if test_resource.network" from account_generator.py 882b4ebbe Optimize test_volume_swap_with_multiattach for server status wait b57205330 Mark some slow tests as slow so they move out of the main job 6a6fe5912 Fixed test_compare_volume_stats_values false failures 2b35e5ac2 Rename TestQuotasClient to TestHostsClient b6a24a23d Make some test_list_projects tests work w/ pre-prov 05f3dfe5b fix tox python3 overrides 321c85c87 Adding unit test of setting config path for "tempest run" 42bcb55fa Fix docstring example in HACKING 489e90f1e Default enable run_validation a067405c4 Removing duplicate variable "parsed_args.config_file" 2a4641c05 Skip test_server_connectivity_cold_migration_revert until fixed 5b91aea1c Skip 3.19 test_reset_group_snapshot_status e094bbade Fix QuotasNegativeTest to use non dynamic credentials a2de09bc8 Fix an assert sequence in test_image_share_accept a9c528fa2 Follow devstack-plugin-ceph job rename dc7eeb43c Fix deprecated_name in the help message in config.py 55e0065ab Run tempest-full(-py3) in stable/rocky 2c9d9625d Do not pass device when calling compute.base.attach_volume 015a006bc Use openstack-tox-cover template 5f4c55d93 switch documentation job to new PTI 6db0b78f8 import zuul job settings from project-config dc68af740 Set CONF.image_feature_enabled.api_v1 default to False 6e7c86e11 Remove unnecessary response check in InstanceUsageAuditLogTestJSON 15eeb90b8 Update .mailmap for ghanshyam emails c7d65d1bd Add check for hypervisor state before getting uptime 345f64f28 trivial: Correct class name for BaseVolumeQuotasAdminTestJSON 2354ea603 Remove unused config.CONF ef967ea00 Remove unnecessary class variables 80d30b817 Bump up python version of unit test 823450339 Removing unnecessary else 8e3ecfd77 Add test for list snapshots with offset param 91d5fe057 Cleaning up a duplicated code 9d9ce95cc Update .mailmap email addresses 550bf417b Do not set microversion for server diagnostics negative test 6b76494ae Modify comment of scheduler_available_filters 676492a6c Fix nits and log from I996d257e089f0676e316f2b14207c343063ccf8e d7e05dd76 Prevent verify-config from IndexError fbde01e6b Add Tempest gate job for stable/rocky b0f65f6ae Remove unnecessary class variable in v3 snapshots_client 0d784ebf0 Migration tests in v2.6 should not repeat all migration tests. 7bc916dbd Use base.get_host_for_server to get server host ec4ff3b8d Remove unused compute.base.clear_resources 00b3bd55d Add server schema for microversion 2.8 cf35f6588 Fix comments in rest_client 5277c20fa add python 3.6 unit test job dfc11801f Add release notes page for version 19.0.0 e142f5460 Change schema hypervisor.cpu_info from string to object in 2.28 96fdba049 Fix typos in vnc-hardcoded-server-name-removed releasenotes 615e63b77 Set max microversion 2.43 for add_fixed_ip ff2c986da Remove deprecated option volume_feature_enabled.api_v1 906e284b7 Remove base class complex and confusing variable ca30e8c31 Delete snapshot in test_image_defined_boot_from_volume fde2167cf Add test for create volume from snap without size 79159f80a Fix to enable `--config-file` option 66275c249 Set max_microversion 2.35 for nova image tests a0c484632 Add etc/*.conf files to .gitignore fc42cc6be Bump hacking to 1.1.0 ac0b171b7 Switch to stestr in README.rst and the method name Diffstat (except docs and test files) ------------------------------------- .gitignore | 3 +- .mailmap | 12 +- .zuul.yaml | 528 +++++-- HACKING.rst | 53 +- README.rst | 27 +- REVIEWING.rst | 41 +- playbooks/devstack-tempest.yaml | 5 + ...sed-minimum-bw-allocation-27ed0938118752b6.yaml | 17 + ...table-user-source-support-dd17772a997075e0.yaml | 11 + ...d-profiler-config-options-db7c4ae6d338ee5c.yaml | 10 + .../notes/add-redirect-param-bea1f6fbce629c70.yaml | 16 + ...ents-client-delete-method-de1a7fb3f845999c.yaml | 7 + .../notes/bug-1791007-328a8b9a43bfb157.yaml | 8 + .../notes/bug-1799883-6ea95fc64f70c9ef.yaml | 7 + .../notes/bug-1808473-54ada26ab78e7b02.yaml | 7 + .../notes/conditional-attr-a8564ec5a70ec840.yaml | 6 + ...e-api-v1-default-to-false-39d5f2xafc534ab1.yaml | 7 + ...ort-profile-config-option-d67f5cb31f1bc34c.yaml | 17 + ...heduler-available-filters-cbca2017ba3cf2aa.yaml | 13 + ...enable-volume-multiattach-fd5e9bf0e96b56ce.yaml | 10 + .../network-show-version-18e1707a4df0a3d3.yaml | 7 + ...ted-volume-config-options-21c4412f3c600923.yaml | 24 + ...precated-find-test-caller-f4525cd043bfd1b6.yaml | 7 + ...t-default-run_validations-9640c41b6a4a9121.yaml | 10 + .../tempest-stein-release-18bad34136a2e6ef.yaml | 18 + ...coded-server-name-removed-6f8d1e90a175dc08.yaml | 6 +- releasenotes/source/index.rst | 1 + releasenotes/source/v19.0.0.rst | 6 + roles/run-tempest/README.rst | 11 + roles/run-tempest/defaults/main.yaml | 1 + roles/run-tempest/tasks/main.yaml | 2 +- setup.cfg | 2 +- tempest/README.rst | 2 +- tempest/api/compute/admin/test_aggregates.py | 21 +- tempest/api/compute/admin/test_delete_server.py | 3 - tempest/api/compute/admin/test_hypervisor.py | 16 +- .../compute/admin/test_instance_usage_audit_log.py | 20 +- tempest/api/compute/admin/test_keypairs_v210.py | 2 +- tempest/api/compute/admin/test_live_migration.py | 19 +- tempest/api/compute/admin/test_migrations.py | 6 +- tempest/api/compute/admin/test_security_groups.py | 19 +- .../admin/test_server_diagnostics_negative.py | 7 - .../compute/admin/test_servers_on_multinodes.py | 19 +- tempest/api/compute/admin/test_volume_swap.py | 32 +- tempest/api/compute/base.py | 28 +- tempest/api/compute/images/test_images.py | 5 +- tempest/api/compute/images/test_images_negative.py | 13 +- .../api/compute/images/test_images_oneserver.py | 30 +- .../images/test_images_oneserver_negative.py | 8 +- .../api/compute/images/test_list_image_filters.py | 1 + .../images/test_list_image_filters_negative.py | 1 + tempest/api/compute/images/test_list_images.py | 1 + .../api/compute/servers/test_attach_interfaces.py | 187 ++- tempest/api/compute/servers/test_delete_server.py | 3 +- tempest/api/compute/servers/test_device_tagging.py | 6 +- .../compute/servers/test_list_servers_negative.py | 2 +- tempest/api/compute/servers/test_novnc.py | 4 +- tempest/api/compute/servers/test_server_actions.py | 5 + .../api/compute/servers/test_server_personality.py | 12 + tempest/api/compute/servers/test_server_rescue.py | 20 +- .../compute/servers/test_server_rescue_negative.py | 6 +- .../api/compute/servers/test_servers_negative.py | 7 +- tempest/api/compute/volumes/test_attach_volume.py | 24 +- .../compute/volumes/test_attach_volume_negative.py | 4 +- tempest/api/identity/admin/v2/test_services.py | 6 +- tempest/api/identity/admin/v2/test_tenants.py | 2 +- .../admin/v3/test_application_credentials.py | 4 - tempest/api/identity/admin/v3/test_credentials.py | 16 +- .../identity/admin/v3/test_default_project_id.py | 13 +- .../identity/admin/v3/test_domain_configuration.py | 4 + tempest/api/identity/admin/v3/test_domains.py | 15 - .../api/identity/admin/v3/test_domains_negative.py | 4 + .../api/identity/admin/v3/test_endpoint_groups.py | 4 + tempest/api/identity/admin/v3/test_groups.py | 13 + tempest/api/identity/admin/v3/test_inherits.py | 39 +- .../api/identity/admin/v3/test_list_projects.py | 84 +- .../api/identity/admin/v3/test_oauth_consumers.py | 4 + tempest/api/identity/admin/v3/test_project_tags.py | 4 + tempest/api/identity/admin/v3/test_projects.py | 11 +- .../identity/admin/v3/test_projects_negative.py | 25 +- tempest/api/identity/admin/v3/test_regions.py | 4 + tempest/api/identity/admin/v3/test_roles.py | 33 +- tempest/api/identity/admin/v3/test_tokens.py | 4 +- tempest/api/identity/admin/v3/test_trusts.py | 18 +- tempest/api/identity/admin/v3/test_users.py | 8 + tempest/api/identity/v2/test_ec2_credentials.py | 9 +- .../identity/v3/test_application_credentials.py | 4 - tempest/api/identity/v3/test_domains.py | 39 + tempest/api/identity/v3/test_users.py | 7 + tempest/api/image/v2/test_images.py | 2 +- tempest/api/image/v2/test_images_member.py | 2 +- tempest/api/network/admin/test_agent_management.py | 15 +- .../api/network/admin/test_dhcp_agent_scheduler.py | 1 - .../api/network/admin/test_l3_agent_scheduler.py | 85 -- tempest/api/network/admin/test_negative_quotas.py | 34 +- tempest/api/network/admin/test_ports.py | 3 - tempest/api/network/admin/test_quotas.py | 2 +- tempest/api/network/admin/test_routers.py | 4 +- tempest/api/network/base.py | 6 - .../api/network/test_agent_management_negative.py | 28 + tempest/api/network/test_allowed_address_pair.py | 3 - tempest/api/network/test_dhcp_ipv6.py | 40 +- tempest/api/network/test_floating_ips.py | 4 +- tempest/api/network/test_networks.py | 2 +- tempest/api/network/test_ports.py | 5 +- tempest/api/network/test_routers.py | 59 +- tempest/api/network/test_routers_negative.py | 3 - tempest/api/network/test_security_groups.py | 3 - tempest/api/network/test_versions.py | 13 +- tempest/api/object_storage/test_container_acl.py | 12 +- .../api/object_storage/test_container_quotas.py | 5 +- .../api/volume/admin/test_backends_capabilities.py | 8 +- tempest/api/volume/admin/test_group_snapshots.py | 1 + tempest/api/volume/admin/test_volume_quotas.py | 15 +- .../volume/admin/test_volume_quotas_negative.py | 48 +- .../admin/test_volume_snapshot_quotas_negative.py | 10 +- tempest/api/volume/admin/test_volume_types.py | 9 +- tempest/api/volume/test_volumes_snapshots.py | 23 +- tempest/api/volume/test_volumes_snapshots_list.py | 8 + tempest/clients.py | 25 +- tempest/cmd/account_generator.py | 11 +- tempest/cmd/cleanup.py | 16 +- tempest/cmd/cleanup_service.py | 378 ++--- tempest/cmd/run.py | 21 +- tempest/cmd/subunit_describe_calls.py | 2 +- tempest/cmd/verify_tempest_config.py | 30 +- tempest/cmd/workspace.py | 17 +- tempest/common/compute.py | 63 +- tempest/common/identity.py | 5 +- tempest/common/utils/linux/remote_client.py | 1 + tempest/common/utils/net_utils.py | 1 - tempest/config.py | 157 +- tempest/hacking/checks.py | 8 +- .../api_schema/response/compute/v2_28/__init__.py | 0 .../response/compute/v2_28/hypervisors.py | 40 + .../api_schema/response/compute/v2_8/__init__.py | 0 .../api_schema/response/compute/v2_8/servers.py | 37 + .../api_schema/response/compute/v2_9/servers.py | 25 +- tempest/lib/api_schema/response/volume/qos.py | 123 ++ tempest/lib/auth.py | 2 +- tempest/lib/cmd/check_uuid.py | 6 +- tempest/lib/common/api_version_utils.py | 2 +- tempest/lib/common/fixed_network.py | 2 +- tempest/lib/common/http.py | 28 +- tempest/lib/common/jsonschema_validator.py | 7 +- tempest/lib/common/preprov_creds.py | 2 +- tempest/lib/common/profiler.py | 64 + tempest/lib/common/rest_client.py | 49 +- tempest/lib/common/utils/data_utils.py | 11 +- tempest/lib/common/utils/misc.py | 12 - tempest/lib/decorators.py | 9 +- tempest/lib/services/clients.py | 4 +- tempest/lib/services/compute/flavors_client.py | 2 +- tempest/lib/services/compute/hypervisor_client.py | 15 +- tempest/lib/services/compute/servers_client.py | 6 +- .../services/identity/v3/inherited_roles_client.py | 6 +- .../lib/services/identity/v3/oauth_token_client.py | 1 + tempest/lib/services/network/agents_client.py | 10 + tempest/lib/services/network/versions_client.py | 38 +- tempest/lib/services/placement/__init__.py | 18 + .../services/placement/base_placement_client.py | 43 + tempest/lib/services/placement/placement_client.py | 50 + tempest/lib/services/volume/v1/types_client.py | 9 +- tempest/lib/services/volume/v3/backups_client.py | 7 +- tempest/lib/services/volume/v3/qos_client.py | 21 +- tempest/lib/services/volume/v3/snapshots_client.py | 3 +- tempest/lib/services/volume/v3/types_client.py | 1 + tempest/lib/services/volume/v3/volumes_client.py | 2 +- tempest/scenario/manager.py | 52 +- tempest/scenario/test_encrypted_cinder_volumes.py | 11 +- tempest/scenario/test_minimum_basic.py | 1 + .../scenario/test_network_advanced_server_ops.py | 40 +- tempest/scenario/test_network_basic_ops.py | 128 +- tempest/scenario/test_network_v6.py | 29 + tempest/scenario/test_object_storage_basic_ops.py | 18 +- tempest/scenario/test_security_groups_basic_ops.py | 37 +- tempest/scenario/test_server_basic_ops.py | 2 +- tempest/scenario/test_volume_boot_pattern.py | 54 +- tempest/test.py | 10 +- tempest/test_discover/plugins.py | 1 + tempest/test_discover/test_discover.py | 2 +- .../lib/services/compute/test_images_client.py | 16 +- .../lib/services/identity/v2/test_token_client.py | 3 +- .../lib/services/identity/v3/test_token_client.py | 3 +- .../image/v2/test_resource_types_client.py | 14 +- .../lib/services/network/test_agents_client.py | 37 + .../lib/services/network/test_versions_client.py | 109 +- .../services/placement/test_placement_client.py | 89 ++ .../lib/services/volume/v3/test_hosts_client.py | 4 +- .../volume/v3/test_scheduler_stats_client.py | 2 +- .../lib/services/volume/v3/test_types_client.py | 281 ++++ test-requirements.txt | 2 +- tools/format.sh | 5 + tools/generate-tempest-plugins-list.py | 3 +- tools/generate-tempest-plugins-list.sh | 2 - tools/tempest-plugin-sanity.sh | 92 +- tox.ini | 46 +- 219 files changed, 5721 insertions(+), 1423 deletions(-) Requirements updates -------------------- diff --git a/test-requirements.txt b/test-requirements.txt index e33f2079d..196387cb7 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -4 +4 @@ -hacking!=0.13.0,<0.14,>=0.12.0 # Apache-2.0 +hacking>=1.1.0,<1.2.0 # Apache-2.0