We are jazzed to announce the release of: tempest 25.0.0: OpenStack Integration Testing This release is part of the victoria release series. The source is available from: https://opendev.org/openstack/tempest Download the package from: https://pypi.org/project/tempest Please report issues through: https://bugs.launchpad.net/tempest/+bugs For more details, please see below. 25.0.0 ^^^^^^ Prelude ******* This release is to tag the Tempest for OpenStack Victoria release. This release marks the start of Victoria release support in Tempest. After this release, Tempest will support below OpenStack Releases: * Victoria * Ussuri * Train * Stein Current development of Tempest is for OpenStack Wallaby development cycle. Every Tempest commit is also tested against master during the Wallaby cycle. However, this does not necessarily mean that using Tempest as of this tag will work against a Victoria (or future release) cloud. To be on safe side, use this tag to test the OpenStack Victoria release. New Features ************ * Add a new config option can_migrate_between_any_hosts in the compute-feature-enabled section, which can be set to False for environment with non homogeneous compute nodes, so that it can select a destination host for migrating automatically, otherwise the testcase may fail unexpectedly. e.g., if source host is with CPU "E5-2699 v4" and the selected target host is with CPU "E5-2670 v3", the live-migration will fail because of the downgrade issue. * Add glance image import APIs function to v2 images_client library. * stage_image_file * info_import * info_stores * image_import * [blueprint blueprint adopt-oslo-versioned-objects-for-db (https://blueprints.launchpad.net/neutron/+spec/adopt-oslo- versioned-objects-for-db)] Any reference to "tenant_id" in Network objects is replaced with "project_id". Upgrade Notes ************* * The following deprecated image scenario options are removed after a ~4 year deprecation period. * "ami_img_file" * "ari_img_file" * "aki_img_file" Starting Tempest 25.0.0 release, CONF.scenario.img_file need a full path for the image. CONF.scenario.img_dir was deprecated and will be removed in the next release. Till Tempest 25.0.0, old behavior is maintained and keep working but starting Tempest 26.0.0, you need to specify the full path in CONF.scenario.img_file config option. * "Member" role has been deprecated and replaced by "member". Therefore the default value of config option "[object- storage].operator_role" is changed to "member". (Fixes bug #1330132) * Remove the deprecated CLI "tempest-account-generator" in favor of "tempest account-generator" command. You can use "tempest account- generator" CLI to generate the accounts yaml file. Bug Fixes ********* * Fixed bug #1890060. tempest subunit_describe_calls --verbose not working with Cliff CLI. The subunit_describe_calls --verbose argument was a boolean and worked in the non Cliff CLI which is now deprecated, but does not work with cliff since --verbase is a standard cliff argument which is an int. Since the tool is in lib directory we cannot change the interface, so we add a new argument -a --all-stdout that will allow cliff CLI to support the feature in subunnit_describe_calls to print request and response headers and bodies to stdout. * is_resource_deleted method of v3 volumes_client might have returned a KeyError exception due to an incorrect accessing of a volume id in the case the volume was in error_deleting state. incorrect code - volume['id'] correct code - volume['volume']['id'] More details about the issue can be found at https://bugs.launchpad.net/tempest/+bug/1887980 * Concurrency parameter for account-generator command was accepting negative values and zero. The concurrency parameter now accepts only positive numbers. When a negative value or zero is passed to the program then the program ends and help is displayed. Other Notes *********** * New configuration options "CONF.glance.image_feature_enabled.image_import" has been introduced to enable the image import tests. If your glance deployement support image import functionality then you can enable the image import tests via this flag. Default value of this new config option is false. Changes in tempest 24.0.0..25.0.0 --------------------------------- c8d7a0101 Add releasenote to tag the Tempest for Victoria release 548e2d0b0 Use stable constraint in tox to release new tag for Victoria a09be7e01 Fix test_allowed_address_pair test case cleanup ae6311373 Need to have stable implementation of nova_volume_detach() and add missing docstrings 0c84f3ee2 Need to have stable tempest scenario manager 0976ae4ee Skip test_qos_min_bw_allocation_basic when not supported e866da9a1 Wait until dependent resource is deleted be8d51095 Use of single interface for creating image ff145e61c Use the networking-l2gw project new location 0539a64d1 Adding description for testcases - swift part2 6aa733e0f Improve unit tests for subunit_describe_calls 85535164b Adding description for testcases - swift part3 0a07a0e51 Fix and unskip test_list_servers_filtered_by_ip_regex 067bcd070 Adding description for testcases - volume part5 a56823734 Adding description for testcases - volume part4 735e169ff Adding description for testcases - compute part12 e354fa767 Adding description for testcases - compute part9 36ef089e1 Adding description for testcases - compute part7 4e726a669 Adding description for testcases - compute part6 8e3aacd7e Adding description for testcases - identity part2 a7635d717 Adding description for testcases - identity part5 b5603bc4f Adding description for testcases - compute part5 67b3d3893 Adding description for testcases - compute part4 fe7a983a3 Add default headers to the volume show_version request 1425ecd42 Add glance image import web-download tests a9af3ead3 Add new tests for check-uuid tool b9358201c Adding description for testcases - identity part3 fcfb31bcc Adding description for testcases - volume part2 4810d887f Adding description for testcases - network part1 0abb76f9a Adding description for testcases - network part3 7cff13079 Tempest tests for glance import workflow 14e2a4e42 Fix KeyError exc in volumes_client 8aea02153 Stop to use the __future__ module. 99b7c11af remote_client: Use blkid -L to find config drive by filesystem label 0aa0636a0 Fix tempest plugin cookicutter repo path b4e0e2c7e zuul: clean up some legacy jobs 93a047f42 Add response schema validation for volume backups e18335e1a Add skip flags for block level live migration e1eebfa84 Replace mock by unittest.mock in 2 forgotten cases 4f633edd9 Remove checking of Accept-Range header d89122be4 Document the process to pin the constraint in tox.ini 02af6a44c Remove deprecated scenario image options aaaafbb5b Fix pdf-doc build by skiping the sample file 42e111c7d object storage: fix and cleanup header checks 536d8284f Add unit tests for check_uuid.py 7cbe8b6b5 Add check_service_availability test 217eebd0b Fix pygments style 173c5c000 Unstable test_container_synchronization fba44537c Unstable test_server_connectivity_cold_migration_revert 4c709ecaa Use python3 venv instead of virtualenv cbf480ffa Fix request body for compute unshelve action API 8517b918a Fix test_get_service_by_invalid_params for microversion 2.75 58b053867 Fix the argument check for account-generator 99d4dae68 Change 'Member' role reference to 'member' 423ae450d Fix 404 when deleteing volume group d89c6cb4a Fix flavor swap default value for compute microversion 2.75 3cb4772db Add response schema validation for volumes fc7dd52a7 [compute] Blacklist test_create_second_image due to race c1449d4ff Remove any reference to "tenant_id" in network 1f4bf4933 Allow snapshot name with null a0e87dc58 Adding description for testcases - compute part3 7454db5d4 Add response schema validation for show_default_group_type da8d25849 Add response schema validation for volume groups 9f0c59aed Add response schema validation for volume group snapshots eee87b504 Cap jsonschema 3.2.0 as the minimal version 706723954 Sort roles in keystone token 2c8e8ae0e Add image "version" metadata in test_snapshot_pattern 05fc4f72b Adding description for testcases - network part2 adb162024 Add response schema validation for volume snapshots 126e996f0 Add response schema validation for volume pools 40e5eaa08 [Trivial]Do not use self in class method 19a487e5d Add response schema validation for volume group types e973452ce Add response schema validation for encryption types 0fbce1722 Switch to newer openstackdocstheme and reno versions eed8074e6 Use unittest.mock instead of third party mock 2fd745f97 compute: Fix boot from volume stable rescue tests 7ac89c977 Add explicit external network for test_create_router_set_gateway_with_fixed_ip 4bbe5b58e Add migration uuid API schema validation for 2.59 f4b5df6d1 Fix check_floating_ip_status utility's output 15d63094c Prevent raising exception if IP address is set in _hotplug_server 8d1974efa Bump hacking min version to 3.0.1 abda8712a test_server_rescue.py should use CONF.volume.volume_size a85788042 Improve logging in tempest cleanup 710e877e4 Fix redirect for doc section 2f273243f Don't use deprecated configparser.readfp de69845d7 Switch testing to Victoria testing runtime f62dbc1c2 Add tempest-cleanup ansible role 08a40ad12 Use ensure-pip for stackviz pip install da3bb61f1 Add index page for plugins documents 96800bb83 Add document for stable branch testing for tempest plugins e8f1876aa Update supported version doc tempest 8c5333b06 Move ceph job to voting 6a2be436f Make image_ssh_password a secret so it does not show in console 239258820 Adding description for testcases - identity part4 f8b8987c5 Move the grenade-py3 job to new zuulv3 grenade job name 6d6bf5e6e Add Tempest gate job for stable/ussuri 2ad7ca4c0 compute: Add stable device rescue tests with BFV instances 5d7b43c00 Add release notes page for version 24.0.0 d9654dae5 Fix typo in contributor guide ba416467e Remove the stable rocky from supported branch in Tempest master 99b085bdb Set TOX_CONSTRAINTS_FILE 06e1ba956 Use new encryption provider constants (reprise) 6726b74f4 Use the master constraint again in tox.ini 2ae7f55cb Adding description for testcases - image part2 e68f435b0 Adding description for testcases - image part1 abc06c36e Integrated gate storage/swift: blacklist more tests b774666aa run-tempest: save the result of tempest execution ddcd4f44a Remove the deprecated tempest-account-generator CLI 39f48588e Modify the fake data be86aec05 Change bytes to str in servers_client for python3 be052d619 Do not specify a host for live-migration for non homogeneous nodes b20c3a5cc Enable xindy for PDF build 40bbe0c91 Add response schema validation for volume limits Diffstat (except docs and test files) ------------------------------------- .gitignore | 2 +- .zuul.yaml | 55 +- HACKING.rst | 2 +- .../requirement_upper_constraint_for_tempest.rst | 56 ++ playbooks/devstack-tempest.yaml | 43 +- .../25/subunt-describe-call-verbose-arg-fix.yaml | 10 + ...-bug-in-v3-volumes_client-ff5d9b894f2257c8.yaml | 10 + ...ed-image-scenario-options-b573c60e873ab451.yaml | 15 + ...f-operator_role-to-member-f9c3abd2ebde23b7.yaml | 6 + ...pts-positive-numbers-only-33a366a297494ef7.yaml | 7 + .../notes/account_generator-6eb03f664a448c35.yaml | 7 + ...n-any-hosts-config-option-x8ah4f9737a28e9b.yaml | 9 + ...ge_import_testing_support-22ba4bcb9f2fb848.yaml | 17 + ...etwork-swap-to-project_id-a1d7fdf6c5e1cf44.yaml | 6 + .../tempest-victoria-release-27000c02edc5a112.yaml | 16 + releasenotes/source/conf.py | 8 +- releasenotes/source/index.rst | 1 + releasenotes/source/v24.0.0.rst | 6 + requirements.txt | 2 +- roles/process-stackviz/tasks/main.yaml | 13 +- roles/run-tempest/README.rst | 3 + roles/run-tempest/tasks/main.yaml | 4 +- roles/tempest-cleanup/README.rst | 33 ++ roles/tempest-cleanup/defaults/main.yaml | 3 + roles/tempest-cleanup/tasks/main.yaml | 31 ++ setup.cfg | 2 +- tempest/api/compute/admin/test_agents.py | 11 +- tempest/api/compute/admin/test_aggregates.py | 35 +- .../api/compute/admin/test_aggregates_negative.py | 28 +- .../api/compute/admin/test_availability_zone.py | 4 +- .../admin/test_availability_zone_negative.py | 10 +- tempest/api/compute/admin/test_create_server.py | 4 +- tempest/api/compute/admin/test_delete_server.py | 6 +- tempest/api/compute/admin/test_fixed_ips.py | 4 + .../api/compute/admin/test_fixed_ips_negative.py | 6 + tempest/api/compute/admin/test_flavors.py | 5 +- tempest/api/compute/admin/test_flavors_access.py | 10 +- .../compute/admin/test_flavors_access_negative.py | 8 +- .../compute/admin/test_flavors_microversions.py | 8 + .../api/compute/admin/test_floating_ips_bulk.py | 2 +- tempest/api/compute/admin/test_hosts.py | 24 +- tempest/api/compute/admin/test_hosts_negative.py | 40 +- tempest/api/compute/admin/test_hypervisor.py | 19 +- .../api/compute/admin/test_hypervisor_negative.py | 25 +- tempest/api/compute/admin/test_keypairs_v210.py | 9 + tempest/api/compute/admin/test_live_migration.py | 30 +- .../compute/admin/test_live_migration_negative.py | 5 +- tempest/api/compute/admin/test_quotas.py | 32 +- tempest/api/compute/admin/test_quotas_negative.py | 14 +- .../admin/test_server_diagnostics_negative.py | 6 +- tempest/api/compute/admin/test_servers.py | 32 +- tempest/api/compute/admin/test_servers_negative.py | 10 +- tempest/api/compute/admin/test_services.py | 11 +- .../api/compute/admin/test_services_negative.py | 3 + .../api/compute/admin/test_simple_tenant_usage.py | 7 +- .../admin/test_simple_tenant_usage_negative.py | 7 +- tempest/api/compute/base.py | 20 + .../api/compute/certificates/test_certificates.py | 5 +- tempest/api/compute/flavors/test_flavors.py | 23 +- .../floating_ips/test_floating_ips_actions.py | 18 +- .../test_floating_ips_actions_negative.py | 27 +- .../compute/floating_ips/test_list_floating_ips.py | 7 +- .../test_list_floating_ips_negative.py | 8 +- tempest/api/compute/images/test_image_metadata.py | 34 +- .../compute/images/test_image_metadata_negative.py | 20 +- tempest/api/compute/images/test_images.py | 6 + tempest/api/compute/images/test_images_negative.py | 32 +- tempest/api/compute/images/test_list_images.py | 14 +- tempest/api/compute/keypairs/test_keypairs.py | 13 +- .../api/compute/keypairs/test_keypairs_negative.py | 18 +- tempest/api/compute/keypairs/test_keypairs_v22.py | 4 + tempest/api/compute/limits/test_absolute_limits.py | 10 + .../limits/test_absolute_limits_negative.py | 6 +- .../security_groups/test_security_group_rules.py | 22 +- .../test_security_group_rules_negative.py | 52 +- .../security_groups/test_security_groups.py | 28 +- .../test_security_groups_negative.py | 43 +- .../api/compute/servers/test_attach_interfaces.py | 8 +- .../api/compute/servers/test_availability_zone.py | 2 +- tempest/api/compute/servers/test_create_server.py | 33 +- tempest/api/compute/servers/test_delete_server.py | 17 +- tempest/api/compute/servers/test_device_tagging.py | 24 + tempest/api/compute/servers/test_disk_config.py | 12 +- .../api/compute/servers/test_instance_actions.py | 13 +- .../servers/test_instance_actions_negative.py | 6 +- .../compute/servers/test_list_server_filters.py | 71 ++- tempest/api/compute/servers/test_novnc.py | 8 + .../servers/test_server_addresses_negative.py | 5 +- tempest/api/compute/servers/test_server_group.py | 12 +- .../api/compute/servers/test_server_personality.py | 17 +- tempest/api/compute/servers/test_server_rescue.py | 93 +++- .../compute/servers/test_server_rescue_negative.py | 9 +- tempest/api/compute/servers/test_server_tags.py | 5 + .../api/compute/servers/test_servers_negative.py | 135 +++-- tempest/api/compute/test_extensions.py | 5 +- tempest/api/compute/test_networks.py | 2 + tempest/api/compute/test_quotas.py | 7 +- tempest/api/compute/test_tenant_networks.py | 9 +- tempest/api/compute/volumes/test_attach_volume.py | 48 +- .../compute/volumes/test_attach_volume_negative.py | 15 +- .../api/identity/admin/v2/test_roles_negative.py | 78 ++- tempest/api/identity/admin/v2/test_services.py | 9 +- .../api/identity/admin/v2/test_tenant_negative.py | 42 +- tempest/api/identity/admin/v2/test_tenants.py | 18 +- tempest/api/identity/admin/v2/test_tokens.py | 5 +- .../api/identity/admin/v2/test_tokens_negative.py | 5 + tempest/api/identity/admin/v2/test_users.py | 23 +- .../api/identity/admin/v2/test_users_negative.py | 56 +- .../admin/v3/test_application_credentials.py | 2 + tempest/api/identity/admin/v3/test_credentials.py | 4 + .../identity/admin/v3/test_domain_configuration.py | 13 +- tempest/api/identity/admin/v3/test_domains.py | 11 +- .../api/identity/admin/v3/test_domains_negative.py | 16 +- .../api/identity/admin/v3/test_endpoint_groups.py | 4 + tempest/api/identity/admin/v3/test_endpoints.py | 5 + .../identity/admin/v3/test_endpoints_negative.py | 22 +- tempest/api/identity/admin/v3/test_groups.py | 7 +- tempest/api/identity/admin/v3/test_inherits.py | 8 + .../api/identity/admin/v3/test_list_projects.py | 16 +- tempest/api/identity/admin/v3/test_projects.py | 22 +- .../identity/admin/v3/test_projects_negative.py | 20 +- tempest/api/identity/admin/v3/test_regions.py | 8 +- tempest/api/identity/admin/v3/test_roles.py | 15 + tempest/api/identity/admin/v3/test_tokens.py | 13 +- tempest/api/identity/admin/v3/test_trusts.py | 31 +- .../api/identity/admin/v3/test_users_negative.py | 5 +- tempest/api/identity/v2/test_api_discovery.py | 5 +- tempest/api/identity/v2/test_extension.py | 3 +- tempest/api/identity/v2/test_tenants.py | 2 + tempest/api/identity/v2/test_tokens.py | 3 +- tempest/api/identity/v2/test_users.py | 2 + tempest/api/identity/v3/test_api_discovery.py | 15 +- .../identity/v3/test_application_credentials.py | 5 + tempest/api/identity/v3/test_domains.py | 2 + tempest/api/identity/v3/test_projects.py | 2 + tempest/api/identity/v3/test_tokens.py | 24 +- tempest/api/identity/v3/test_users.py | 4 + tempest/api/image/v1/test_image_members.py | 4 + .../api/image/v1/test_image_members_negative.py | 12 +- tempest/api/image/v1/test_images.py | 19 +- tempest/api/image/v1/test_images_negative.py | 16 +- tempest/api/image/v2/admin/test_images.py | 3 + tempest/api/image/v2/test_images.py | 120 ++++- tempest/api/image/v2/test_images_member.py | 7 + .../api/image/v2/test_images_member_negative.py | 3 + .../v2/test_images_metadefs_namespace_objects.py | 3 + .../test_images_metadefs_namespace_properties.py | 1 + .../v2/test_images_metadefs_namespace_tags.py | 2 + .../image/v2/test_images_metadefs_namespaces.py | 1 + .../v2/test_images_metadefs_resource_types.py | 1 + .../api/image/v2/test_images_metadefs_schema.py | 22 +- tempest/api/image/v2/test_images_negative.py | 18 +- tempest/api/image/v2/test_images_tags.py | 2 + tempest/api/image/v2/test_images_tags_negative.py | 5 +- tempest/api/image/v2/test_versions.py | 2 + .../api/network/admin/test_dhcp_agent_scheduler.py | 4 + .../admin/test_external_network_extension.py | 23 +- .../admin/test_external_networks_negative.py | 9 +- .../admin/test_floating_ips_admin_actions.py | 18 +- .../api/network/admin/test_metering_extensions.py | 11 +- tempest/api/network/admin/test_negative_quotas.py | 7 +- tempest/api/network/admin/test_ports.py | 13 + tempest/api/network/admin/test_quotas.py | 6 +- tempest/api/network/admin/test_routers.py | 53 +- tempest/api/network/admin/test_routers_dvr.py | 4 +- tempest/api/network/admin/test_routers_negative.py | 2 + tempest/api/network/test_allowed_address_pair.py | 14 +- tempest/api/network/test_dhcp_ipv6.py | 84 ++- tempest/api/network/test_extensions.py | 2 +- tempest/api/network/test_extra_dhcp_options.py | 4 +- tempest/api/network/test_floating_ips.py | 23 +- tempest/api/network/test_floating_ips_negative.py | 3 + tempest/api/network/test_networks.py | 43 +- tempest/api/network/test_networks_negative.py | 11 + tempest/api/network/test_ports.py | 61 ++- tempest/api/network/test_routers.py | 41 +- tempest/api/network/test_routers_negative.py | 10 + tempest/api/network/test_security_groups.py | 16 +- .../api/network/test_security_groups_negative.py | 28 +- tempest/api/network/test_service_providers.py | 2 + tempest/api/network/test_subnetpools_extensions.py | 1 + tempest/api/network/test_tags.py | 4 +- tempest/api/object_storage/test_account_bulk.py | 44 +- tempest/api/object_storage/test_account_quotas.py | 2 + .../test_account_services_negative.py | 3 +- tempest/api/object_storage/test_container_acl.py | 5 +- .../object_storage/test_container_acl_negative.py | 17 +- .../api/object_storage/test_container_services.py | 51 +- .../test_container_services_negative.py | 26 +- .../api/object_storage/test_container_staticweb.py | 5 + tempest/api/object_storage/test_container_sync.py | 2 +- tempest/api/object_storage/test_healthcheck.py | 2 + tempest/api/object_storage/test_object_formpost.py | 2 + .../test_object_formpost_negative.py | 3 + tempest/api/object_storage/test_object_slo.py | 13 +- tempest/api/object_storage/test_object_temp_url.py | 6 + .../test_object_temp_url_negative.py | 3 +- tempest/api/object_storage/test_object_version.py | 11 + tempest/api/volume/admin/test_groups.py | 10 + tempest/api/volume/admin/test_snapshot_manage.py | 1 + tempest/api/volume/admin/test_user_messages.py | 4 + tempest/api/volume/admin/test_volume_hosts.py | 3 + tempest/api/volume/admin/test_volume_manage.py | 2 + tempest/api/volume/admin/test_volume_pools.py | 4 + tempest/api/volume/admin/test_volume_quotas.py | 12 +- .../volume/admin/test_volume_quotas_negative.py | 4 + tempest/api/volume/admin/test_volume_retype.py | 23 + tempest/api/volume/admin/test_volume_services.py | 6 +- .../volume/admin/test_volume_services_negative.py | 6 + .../admin/test_volume_snapshot_quotas_negative.py | 3 + .../api/volume/admin/test_volume_type_access.py | 3 + tempest/api/volume/admin/test_volume_types.py | 1 - .../volume/admin/test_volume_types_extra_specs.py | 7 +- .../api/volume/admin/test_volume_types_negative.py | 9 +- tempest/api/volume/admin/test_volumes_actions.py | 17 +- tempest/api/volume/admin/test_volumes_backup.py | 4 - tempest/api/volume/admin/test_volumes_list.py | 3 +- tempest/api/volume/base.py | 7 +- tempest/api/volume/test_availability_zone.py | 2 +- tempest/api/volume/test_extensions.py | 3 +- tempest/api/volume/test_image_metadata.py | 2 + tempest/api/volume/test_snapshot_metadata.py | 5 +- tempest/api/volume/test_versions.py | 6 +- tempest/api/volume/test_volume_absolute_limits.py | 3 +- tempest/api/volume/test_volumes_actions.py | 14 +- tempest/api/volume/test_volumes_backup.py | 29 +- tempest/api/volume/test_volumes_get.py | 9 +- tempest/api/volume/test_volumes_list.py | 49 +- tempest/api/volume/test_volumes_negative.py | 58 +- tempest/api/volume/test_volumes_snapshots.py | 24 +- tempest/api/volume/test_volumes_snapshots_list.py | 41 +- .../api/volume/test_volumes_snapshots_negative.py | 11 +- tempest/cmd/account_generator.py | 63 +-- tempest/cmd/cleanup.py | 20 +- tempest/cmd/cleanup_service.py | 39 +- tempest/cmd/subunit_describe_calls.py | 28 +- tempest/cmd/verify_tempest_config.py | 8 +- tempest/common/custom_matchers.py | 18 +- tempest/config.py | 39 +- .../response/compute/v2_1/parameter_types.py | 7 + .../api_schema/response/compute/v2_59/__init__.py | 0 .../response/compute/v2_59/migrations.py | 36 ++ tempest/lib/api_schema/response/volume/backups.py | 229 ++++++++ .../api_schema/response/volume/encryption_types.py | 95 ++++ .../api_schema/response/volume/group_snapshots.py | 106 ++++ .../lib/api_schema/response/volume/group_types.py | 134 +++++ tempest/lib/api_schema/response/volume/groups.py | 164 ++++++ tempest/lib/api_schema/response/volume/limits.py | 55 ++ .../api_schema/response/volume/scheduler_stats.py | 79 +++ .../lib/api_schema/response/volume/snapshots.py | 198 +++++++ tempest/lib/api_schema/response/volume/volumes.py | 368 +++++++++++++ tempest/lib/common/dynamic_creds.py | 6 +- tempest/lib/common/rest_client.py | 49 +- tempest/lib/common/thread.py | 4 - tempest/lib/common/utils/linux/remote_client.py | 6 +- tempest/lib/services/compute/migrations_client.py | 5 +- tempest/lib/services/compute/servers_client.py | 17 +- tempest/lib/services/image/v2/images_client.py | 86 +++ tempest/lib/services/network/quotas_client.py | 26 + tempest/lib/services/volume/v3/backups_client.py | 21 +- .../services/volume/v3/encryption_types_client.py | 11 +- .../services/volume/v3/group_snapshots_client.py | 13 +- .../lib/services/volume/v3/group_types_client.py | 24 +- tempest/lib/services/volume/v3/groups_client.py | 18 +- tempest/lib/services/volume/v3/limits_client.py | 3 +- .../services/volume/v3/scheduler_stats_client.py | 5 +- tempest/lib/services/volume/v3/snapshots_client.py | 35 +- tempest/lib/services/volume/v3/versions_client.py | 5 +- tempest/lib/services/volume/v3/volumes_client.py | 63 ++- tempest/manager.py | 2 +- tempest/scenario/manager.py | 363 +++++++++---- tempest/scenario/test_encrypted_cinder_volumes.py | 2 +- .../scenario/test_minbw_allocation_placement.py | 7 +- tempest/scenario/test_minimum_basic.py | 2 +- .../scenario/test_network_advanced_server_ops.py | 2 +- tempest/scenario/test_network_basic_ops.py | 18 +- tempest/scenario/test_network_v6.py | 2 +- tempest/scenario/test_security_groups_basic_ops.py | 8 +- tempest/scenario/test_snapshot_pattern.py | 10 + tempest/scenario/test_volume_boot_pattern.py | 3 +- .../calls.subunit | Bin .../calls_subunit_expected.json | 87 +++ .../lib/common/utils/linux/test_remote_client.py | 2 +- .../services/compute/test_base_compute_client.py | 2 +- .../lib/services/compute/test_servers_client.py | 2 +- .../lib/services/compute/test_services_client.py | 2 +- .../lib/services/identity/v2/test_token_client.py | 3 +- .../lib/services/identity/v3/test_token_client.py | 3 +- .../lib/services/image/v2/test_images_client.py | 19 +- .../services/network/test_base_network_client.py | 2 +- .../lib/services/network/test_quotas_client.py | 12 +- .../network/test_security_group_rules_client.py | 2 +- .../network/test_security_groups_client.py | 2 +- .../services/object_storage/test_object_client.py | 2 +- .../lib/services/volume/v3/test_backups_client.py | 3 +- .../volume/v3/test_encryption_types_client.py | 4 +- .../services/volume/v3/test_group_types_client.py | 4 +- .../volume/v3/test_scheduler_stats_client.py | 12 +- .../lib/services/volume/v3/test_services_client.py | 2 +- .../volume/v3/test_snapshot_manage_client.py | 2 +- .../services/volume/v3/test_transfers_client.py | 2 +- .../volume/v3/test_volume_manage_client.py | 2 +- .../lib/services/volume/v3/test_volumes_client.py | 4 - test-requirements.txt | 4 +- tools/generate-tempest-plugins-list.py | 4 +- tools/generate-tempest-plugins-list.sh | 4 +- .../tempest-integrated-gate-compute-blacklist.txt | 6 + ...st-integrated-gate-object-storage-blacklist.txt | 7 +- .../tempest-integrated-gate-storage-blacklist.txt | 7 +- tools/tempest-plugin-sanity.sh | 6 +- tox.ini | 12 +- 351 files changed, 5774 insertions(+), 1596 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index bf38faed2..d8738f08c 100644 --- a/requirements.txt +++ b/requirements.txt @@ -6 +6 @@ cliff!=2.9.0,>=2.8.0 # Apache-2.0 -jsonschema>=2.6.0 # MIT +jsonschema>=3.2.0 # MIT diff --git a/test-requirements.txt b/test-requirements.txt index a50905fb7..17fa9f108 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -4,2 +4 @@ -hacking>=3.0,<3.1.0;python_version>='3.5' # Apache-2.0 -mock>=2.0.0 # BSD +hacking>=3.0.1,<3.1.0;python_version>='3.5' # Apache-2.0 @@ -7,0 +7 @@ oslotest>=3.2.0 # Apache-2.0 +pycodestyle>=2.0.0,<2.6.0 # MIT