[release-announce] tempest 20.0.0 (stein)

no-reply at openstack.org no-reply at openstack.org
Tue Mar 26 18:49:02 UTC 2019


We are pleased to announce the release of:

tempest 20.0.0: OpenStack Integration Testing

This release is part of the stein release series.

Download the package from:

    https://pypi.org/project/tempest

For more details, please see below.

20.0.0
^^^^^^


Prelude
*******

This release is to tag the Tempest for OpenStack Stein release. This
release marks the start of Stein release support in Tempest and the
end of support for Ocata in Tempest. After this release, Tempest will
support below OpenStack Releases:

   * Stein

   * Rocky

   * Queens

   * Pike

Current development of Tempest is for OpenStack Train development
cycle. Every Tempest commit is also tested against master during the
Train cycle. However, this does not necessarily mean that using
Tempest as of this tag will work against a Train (or future release)
cloud. To be on safe side, use this tag to test the OpenStack Stein
release.


New Features
************

* Add basic read-only Placement client to Tempest to make possible
  the testing of the placement based bandwidth allocation feature. The
  following API calls are available for tempest from now:

  * GET /allocation_candidates

  * GET /allocations/{consumer_uuid}

  Add new config group "placement", with the config options:

  * "endpoint_type" to use for communication with placement service.

  * "catalog_type" of the placement service.

  * "region" as the placement region name to use.

  * "min_microversion" and "max_microversion" as the range between
    placement API requests are sent.

* Add a new config setting "immutable_user_source" in the
  "[identity- feature-enabled]" group that defaults to false. This
  setting, combined with the usage of the "@testtools.skipIf()"
  decorator, will allow tests that require user creation, deletion, or
  modification to skip instead of failing in environments that are
  LDAP-backed. In such environments, the user source is read-only, so
  this feature flag is needed to allow such tests to gracefully skip
  without having to blacklist them.

* Add support of OSProfiler library for profiling and distributed
  tracing of OpenStack. A new config option "key" in section
  "profiler" is added, the option sets the secret key used to enable
  profiling in OpenStack services. The value needs to correspond to
  the one specified in [profiler]/hmac_keys option of OpenStack
  services.

   (https://docs.openstack.org/osprofiler/)

* A new parameter "follow_redirects" has been added to the class
  "RestClient", which is passed through to "ClosingHttp" or
  "ClosingProxyHttp" respectively. The default value is "True" which
  corresponds to the previous behaviour of following up to five
  redirections before returning a response. Setting "follow_redirects
  = False" allows to disable this behaviour, so that any redirect that
  is received is directly returned to the caller. This allows tests to
  verify that an API is responding with a redirect.

* Adds the new method to AgentsClient that implements agent deletion
  according to the API [0]. [0] https://developer.openstack.org/api-
  ref/network/v2/index.html#delete-agent

* The "tempest.lib.decorators.attr" decorator now supports a
  "condition" kwarg which can be used to conditionally apply the attr
  to the test function if the condition evaluates to True.

* Add "show_version" function to the "NetworkVersionsClient" client.
  This allows the possibility of getting details for Networking API.


Upgrade Notes
*************

* Changed the default value of 'api_v1' config option in the 'image-
  feature-enabled' group to False from True, because glance v1 APIs
  are deprecated. Please set True explicitly on the option if still
  testing glance v1 APIs.

* The "tempest-full", "tempest-full-py3" and "tempest-slow" zuul v3
  job configurations now set "ENABLE_VOLUME_MULTIATTACH: true" in the
  "devstack_localrc" variables section. If you have a plugin job
  configuration that inherits from one of these jobs and the backend
  cinder volume driver or nova compute driver do not support volume
  multiattach then you should override and set this variable to
  "ENABLE_VOLUME_MULTIATTACH: false" in your job configuration.

* Below config option was deprecated for removal since juno release.
  It's time to remove it as all supported stable branches and Tempest
  plugins are good to handle it.

  * "[volume_feature_enabled].api_v1"

  Also Tempest removes the below corresponding service clients alias
  from client.py which were being set based on above removed config
  option.

  * self.backups_client

  * self.encryption_types_client

  * self.snapshots_client

  * self.volume_availability_zone_client

  * self.volume_hosts_client

  * self.volume_limits_client

  * self.volume_qos_client

  * self.volume_quotas_client

  * self.volume_services_client

  * self.volume_types_client

  * self.volumes_client

  * self.volumes_extension_client

* "tempest.lib.common.utils.misc.find_test_caller" was deprecated
  during Kilo release cycle in favor of
  "tempest.lib.common.utils.test_utils.find_test_caller". The
  deprecated version of "find_test_caller" is removed.

* "CONF.validation.run_validation" default enabled. This option
  required to be set "true" in order to run api tests stability when
  the guest cooperation required. For example when the guest needs
  react on Volume/Interface detach. The ssh test makes sure the VM is
  alive and ready when the detach needs to happen. The option was
  enabled on the gate for a long time.


Deprecation Notes
*****************

* The "scheduler_available_filters" option is being deprecated in
  favor of "scheduler_enabled_filters". The new name is more
  indicative of what the option means. "scheduler_enabled_filters"'s
  default value is set to the default value of Nova's
  "enabled_filters". "scheduler_available_filters"'s default was
  *all*. There was confusion around this value. Sometimes it was
  understood to mean the default Nova filters are enabled, other times
  it was understood to mean all filters are enabled. While *all* is
  still allowed for "scheduler_enabled_filters" for backwards
  compatibility, it is strongly recommended to provide an explicit
  list of filters that matches what's configured in nova.conf.


Bug Fixes
*********

* [bug 1616892 (https://bugs.launchpad.net/tempest/+bug/1616892)]
  Tempest now allows tests to verify that an API responds with a
  redirect.

* Fixed bug #1791007. "tempest workspace register" and "tempest
  workspace rename" CLI will error if None or empty string is passed
  in --name arguments. Earlier both CLI used to accept the None or
  empty string as name which was confusing.

* Fixed bug #1799883. "tempest workspace register" and "tempest
  workspace move" CLI will now validate the value of the "--path" CLI
  argument and raise an exception if it is None or empty string.
  Earlier both CLI actions were accepting None or empty path which was
  confusing.

* Fixed bug #1808473. "tempest run" CLI will error if a non-exist
  config file is input to parameter --config-file. Earlier non-exist
  config value was silently getting ignored and the default config
  file was used instead which used to give false behavior to the user
  on using the passed config file.

* Patch https://review.openstack.org/#/c/499575/ introduced support
  creating Neutron port with certain capabilities. Currently
  capabilities list interpreted as string this change fix it.

  tempest.conf [network] port_profile = capabilities:[switchdev]

  result: {'capabilities':'[switchdev]'}

  expected: {'capabilities': ['switchdev']}

Changes in tempest 19.0.0..20.0.0
---------------------------------

a955095f8 Add releasenote to tag the Tempest for Stein release
4c7b79ac3 Default gabbi_tempest_path to empty string
21491dff8 Checking config file actually exist or not in tempest run
bd89841dc Update v3 identity inherits tests to work w/ pre-prov
c44eadc7b immutable user source: v3 test_roles
c3f07b441 Immutable user source: v3 test_inherits
ea5efd5c3 Use credentials domain instead of creating new one
3858ced89 Set ENABLE_VOLUME_MULTIATTACH=true on tempest-slow subnode localrc
3e7752c93 Make type decorator compatible with unicode strings
19cb7836d Remove LOG in misc.py
6e30995bc allow create_server with vnic_type and port_profile from kwargs
40fcb9ba2 Add autopep8 to tox.ini
aa6f7df0b Add py37 tox env
a066fcdc2 Remove unused and duplicate nodeset defined in Tempest
28edda63f Move tempest-tox-plugin-sanity-check to Bionic
59a93d1bb Fix openstack-dev ML ref in test removal process.
edcc172db Remove admin test_l3_agent_scheduler API test module
92b87a5a4 Update json module to jsonutils
13c588373 Set concurrency default value
8d94885df no force_tenant_isolation in DefaultDomainTestJSON
a7c4c1449 stestr expects --concurrency to be an int
f786405da doc: fix compute API microversion list format
c2a0eb986 Update neutron quota_driver path
00945fb93 Make tempest-slow run on stable branch also
42c9a8d00 Make tempest-multinode-full job for stable branch
00e477729 Use rand_password() for password when creating user
97b1ad78a Improved tempest plugin sanity check script
1f6cc860f Fix typo
e68199802 Add NetworkSubnetPools to tempest cleanup
f83799a7f add python 3.7 unit test job
470aca738 Add unit tests for tempest cleanup
5a884bfbb Fix tempest cleanup
1291bb473 Add profiler support into Tempest
4986d0da5 Update v3 identity group tests to work w/ pre-prov
9968315d4 Conditionally mark test_attach_detach_volume as slow
2999963ff Allow decorators.attr to be conditional
b4763ef57 Mark test_server_connectivity_reboot as slow
4b8a7b863 Mark test_volume_boot_pattern as slow
9e43fd8bb Remove deprecated services from cleanup
8b9980b49 Normalize endpoint path in oauth client
5639a970c Update v3 project tests to work w/ pre-prov
566237c0a Immutable user source: v3 test_groups
e4c8a6a4a Update regions tests to work w/ pre-prov
6caf3fabb Fix tempest cleanup for python3
7581e99a0 Enable volume multiattach tests in tempest-full/slow jobs
e0d85b205 Make interop check job as voting
b37903cdd Fix tempest cleanup AttributeError
9e0ac6cac Current naming convention is uninformative.
e5d93a4a5 Add tempest-slow-py3 job definition
0df2f91d1 Add tempest-multinode-full-py3 job definition
ebc2186e7 Convert result of hosts.values() to list always
199e02290 Raise renew_delay in TestNetworkBasicOps:test_subnet_details
f853ef7a2 Skip test_subnet_details slow test until bug 1813198 is fixed
91d92424b Fix E117 for pycodestyle (pep8) 2.5.0
d8d0d6e95 Remove warnings.simplefilter to suppress ResourceWarning
71c823771 Adding missing tests for regex and black-regex in tempest run
9334ddb6e Add black-list based tests for tempest run command
2efbea13d Fix invalid exception module usage
5a276eab4 Add whitelist based tests for tempest run command.
3a3ca64eb Update v3 identity project tag test to work w/ pre-prov
acd6ecdbd Log the result of command in get_nic_name_by_ip
ceb882169 Add placement client for basic GET operations
0fedb410e Ensure volume is deleted after build error
07a572ca1 Fix verify-config KeyError
ee1bf68b1 Immutable user source: v3 test_projects
08d95debc Update v3 identity domain configuration tests to work w/ pre-prov
1d311619b Update v3 identity domain negative tests to work w/ pre-prov
29fc259cf Update v3 oauth consumers tests to work w/ pre-prov
7ece7d225 Add unittest for types_client
6cd3827e3 [Trivial fix]Remove unnecessary slash
3fa09d253 Remove unnecessary setUp
d4885ff38 Move v3 project negative tests to work w/ pre-prov
f01e9cba3 Move v3 identity endpoint group tests to work w/ pre-prov
314ff80b3 update spelling error
36fdd20cb Add missing ws seperator between words part 2
3c6b016f0 fix port_profile
b294a17e3 Use renamed template 'integrated-gate-py3'
ad4c9ddf3 Remove unnecessary line of code
11a2dd791 Immutable user source: test_default_project_id
109c4f15d Add irrelevant-files for grenade-py3 job
af6d18aa0 Transfer respository  to repository
023a683d3 Move nova-cells-v1 job to the experimental queue
e973da9c8 Add device_owner to gateway port search criteria
cf4fda383 Change openstack-dev to openstack-discuss
3e99c0432 Fixing ignored value of --config parameter in tempest account-generator
8a7aaa5bc Adding debugger in tox.ini
93f60940d Move test test_list_agents_non_admin to non-admin dir
c7b0bc9f6 Check network connectivity of the instance before and after live migration
c825424a5 Adding missing test cases of tempest workspace
eac094a8c docs: Fix incorrect docstrings in reStructuredText format
a07106683 Support immutable user source
f9a4c77b8 Migrate tempest provided base jobs to bionic
6c95678a7 Handling invalid path of workspace register and move
de6763768 Add missing ws seperator between words
4a4fbee8b Add a blank space between "eui_ip" and "when".
f824fcf0d addCleanup should be immediately after the creating statement.
3c108d761 [Negative] Extend volume over quota limit
a5c28bf7d Improve the user lock config options help message
26eda82c3 Refactor cleanups for test_trusts
99690f665 fix typos
8606c83b4 change http links to https links
e80266a71 Add api ref link for import_backup
68273ac78 Fix required projects for sanity plugin check job
d4cb10f14 Wait for IP add/remove in test_add_remove_fixed_ip
3588bb3f5 interfaces_by_fixed_ip no extra port
ec4c66876 docs: Fix plugin registry generation failures
2979bff94 Pass tox_extra_args to Run tempest task
f22e6ec65 docs: Include information about the list of supported projects
2dc72172e trivial: Don't run integration tests on tools/.* updates
595ae1698 Deprecate available filters in favor of enabled
d13622f27 Replace deprecated "decodestring"
bd8cc59dc Mark network slow test as slow
f70df52fd [Trivial Fix] modify spelling error of "resource"
6fe405dc6 Update REVIEWING docs with fast-track approval process
087d4d05d Adding missing test cases in "test_run.py"
dbf8a136e Add ipv6 tempest jobs
9b4c50cf6 GABBI_TEMPEST_PATH in tox passenv and devstack playbook
ece4ae6e4 Adding missing test case of account generator resources
270c25a5e Do not check account unlock if lockout config is 0
b9b4f4f8c Fix assert logic in test_list_security_groups_list_all_tenants_filter
3cf7aa21f Set max microversion 2.35 for nova floatingip and securitygroup
b11f85a7f Fix help message of user_unique_last_password_count
d595c3606 Make connectivity test less backend dependent
9fca77147 Remove duplicate legacy-tempest-dsvm-multinode-full job
47b1437b9 Make tempest-full-py3 not run for unit tests change
a485b094f Remove deprecated find_test_caller function
a8f64e3f9 Import periodic-tempest-dsvm-oslo-latest-full-master job
c5c7ba997 Change way how second NIC in guest OS is configured
d6e047407 Convert job legacy-periodic-tempest-dsvm-all-master
692422bab Use remote_client from tempest.lib.common instead of tempest.common
390e4fa9f Convert legacy-tempest-dsvm-neutron-pg-full to Zuul v3
01fd01a56 Fix Zuul usage of tempest-full
3ffa54e44 Allow to create a rest_client not following redirects
20c181a93 Replace openSUSE experimental check with newer version
4e0715561 Run static account tests based on tempest-full-py3
9608ce3f4 Remove legacy-tempest-dsvm-cinder-v1
a9cc6c1a8 Add interop-tempest-consistency job in Tempest gate
65ed8331f Fix test_get_config_file to always work
864f37eb6 Handling invalid name of workspace register and rename.
ebc7f5eda Adding missing test cases of "test_verify_tempest_config"
35d12caf2 Deprecate all-plugin
27ecc306d Optimize and enhance the code of "test_routers.py"
a794e8530 Removing redundant spec value in account_generator.py
ddd7bcb90 Use show_volume_type to check the result of update_volume_type
b477594b3 Interface tests: wait for server to become SSHable
c67bb194e Add test coverage CMD cleanup_service
709c8d36f Add delete_agent to AgentsClient
c59d113a0 refactor v3 cred tests to work with pre-prov
53d94a82b Add response schema validation for volume qos-specs
c45eb61de swift: container ACL - use ID's for tenant and user
ff122de40 Cleanup irrelevant-files list in .zuul.yaml
fb4d86370 Add missing test for "Show API v2 details" action
a7365ae21 fix: Re-clarify unit test REVIEWING documentation
d8e6135c3 Removing redundant "if test_resource.network" from account_generator.py
882b4ebbe Optimize test_volume_swap_with_multiattach for server status wait
b57205330 Mark some slow tests as slow so they move out of the main job
6a6fe5912 Fixed test_compare_volume_stats_values false failures
2b35e5ac2 Rename TestQuotasClient to TestHostsClient
b6a24a23d Make some test_list_projects tests work w/ pre-prov
05f3dfe5b fix tox python3 overrides
321c85c87 Adding unit test of setting config path for "tempest run"
42bcb55fa Fix docstring example in HACKING
489e90f1e Default enable run_validation
a067405c4 Removing duplicate variable "parsed_args.config_file"
2a4641c05 Skip test_server_connectivity_cold_migration_revert until fixed
5b91aea1c Skip 3.19 test_reset_group_snapshot_status
e094bbade Fix QuotasNegativeTest to use non dynamic credentials
a2de09bc8 Fix an assert sequence in test_image_share_accept
a9c528fa2 Follow devstack-plugin-ceph job rename
dc7eeb43c Fix deprecated_name in the help message in config.py
55e0065ab Run tempest-full(-py3) in stable/rocky
2c9d9625d Do not pass device when calling compute.base.attach_volume
015a006bc Use openstack-tox-cover template
5f4c55d93 switch documentation job to new PTI
6db0b78f8 import zuul job settings from project-config
dc68af740 Set CONF.image_feature_enabled.api_v1 default to False
6e7c86e11 Remove unnecessary response check in InstanceUsageAuditLogTestJSON
15eeb90b8 Update .mailmap for ghanshyam emails
c7d65d1bd Add check for hypervisor state before getting uptime
345f64f28 trivial: Correct class name for BaseVolumeQuotasAdminTestJSON
2354ea603 Remove unused config.CONF
ef967ea00 Remove unnecessary class variables
80d30b817 Bump up python version of unit test
823450339 Removing unnecessary else
8e3ecfd77 Add test for list snapshots with offset param
91d5fe057 Cleaning up a duplicated code
9d9ce95cc Update .mailmap email addresses
550bf417b Do not set microversion for server diagnostics negative test
6b76494ae Modify comment of scheduler_available_filters
676492a6c Fix nits and log from I996d257e089f0676e316f2b14207c343063ccf8e
d7e05dd76 Prevent verify-config from IndexError
fbde01e6b Add Tempest gate job for stable/rocky
b0f65f6ae Remove unnecessary class variable in v3 snapshots_client
0d784ebf0 Migration tests in v2.6 should not repeat all migration tests.
7bc916dbd Use base.get_host_for_server to get server host
ec4ff3b8d Remove unused compute.base.clear_resources
00b3bd55d Add server schema for microversion 2.8
cf35f6588 Fix comments in rest_client
5277c20fa add python 3.6 unit test job
dfc11801f Add release notes page for version 19.0.0
e142f5460 Change schema hypervisor.cpu_info from string to object in 2.28
96fdba049 Fix typos in vnc-hardcoded-server-name-removed releasenotes
615e63b77 Set max microversion 2.43 for add_fixed_ip
ff2c986da Remove deprecated option volume_feature_enabled.api_v1
906e284b7 Remove base class complex and confusing variable
ca30e8c31 Delete snapshot in test_image_defined_boot_from_volume
fde2167cf Add test for create volume from snap without size
79159f80a Fix to enable `--config-file` option
66275c249 Set max_microversion 2.35 for nova image tests
a0c484632 Add etc/*.conf files to .gitignore
fc42cc6be Bump hacking to 1.1.0
ac0b171b7 Switch to stestr in README.rst and the method name


Diffstat (except docs and test files)
-------------------------------------

.gitignore                                         |    3 +-
.mailmap                                           |   12 +-
.zuul.yaml                                         |  528 +++++--
HACKING.rst                                        |   53 +-
README.rst                                         |   27 +-
REVIEWING.rst                                      |   41 +-
playbooks/devstack-tempest.yaml                    |    5 +
...sed-minimum-bw-allocation-27ed0938118752b6.yaml |   17 +
...table-user-source-support-dd17772a997075e0.yaml |   11 +
...d-profiler-config-options-db7c4ae6d338ee5c.yaml |   10 +
.../notes/add-redirect-param-bea1f6fbce629c70.yaml |   16 +
...ents-client-delete-method-de1a7fb3f845999c.yaml |    7 +
.../notes/bug-1791007-328a8b9a43bfb157.yaml        |    8 +
.../notes/bug-1799883-6ea95fc64f70c9ef.yaml        |    7 +
.../notes/bug-1808473-54ada26ab78e7b02.yaml        |    7 +
.../notes/conditional-attr-a8564ec5a70ec840.yaml   |    6 +
...e-api-v1-default-to-false-39d5f2xafc534ab1.yaml |    7 +
...ort-profile-config-option-d67f5cb31f1bc34c.yaml |   17 +
...heduler-available-filters-cbca2017ba3cf2aa.yaml |   13 +
...enable-volume-multiattach-fd5e9bf0e96b56ce.yaml |   10 +
.../network-show-version-18e1707a4df0a3d3.yaml     |    7 +
...ted-volume-config-options-21c4412f3c600923.yaml |   24 +
...precated-find-test-caller-f4525cd043bfd1b6.yaml |    7 +
...t-default-run_validations-9640c41b6a4a9121.yaml |   10 +
.../tempest-stein-release-18bad34136a2e6ef.yaml    |   18 +
...coded-server-name-removed-6f8d1e90a175dc08.yaml |    6 +-
releasenotes/source/index.rst                      |    1 +
releasenotes/source/v19.0.0.rst                    |    6 +
roles/run-tempest/README.rst                       |   11 +
roles/run-tempest/defaults/main.yaml               |    1 +
roles/run-tempest/tasks/main.yaml                  |    2 +-
setup.cfg                                          |    2 +-
tempest/README.rst                                 |    2 +-
tempest/api/compute/admin/test_aggregates.py       |   21 +-
tempest/api/compute/admin/test_delete_server.py    |    3 -
tempest/api/compute/admin/test_hypervisor.py       |   16 +-
.../compute/admin/test_instance_usage_audit_log.py |   20 +-
tempest/api/compute/admin/test_keypairs_v210.py    |    2 +-
tempest/api/compute/admin/test_live_migration.py   |   19 +-
tempest/api/compute/admin/test_migrations.py       |    6 +-
tempest/api/compute/admin/test_security_groups.py  |   19 +-
.../admin/test_server_diagnostics_negative.py      |    7 -
.../compute/admin/test_servers_on_multinodes.py    |   19 +-
tempest/api/compute/admin/test_volume_swap.py      |   32 +-
tempest/api/compute/base.py                        |   28 +-
tempest/api/compute/images/test_images.py          |    5 +-
tempest/api/compute/images/test_images_negative.py |   13 +-
.../api/compute/images/test_images_oneserver.py    |   30 +-
.../images/test_images_oneserver_negative.py       |    8 +-
.../api/compute/images/test_list_image_filters.py  |    1 +
.../images/test_list_image_filters_negative.py     |    1 +
tempest/api/compute/images/test_list_images.py     |    1 +
.../api/compute/servers/test_attach_interfaces.py  |  187 ++-
tempest/api/compute/servers/test_delete_server.py  |    3 +-
tempest/api/compute/servers/test_device_tagging.py |    6 +-
.../compute/servers/test_list_servers_negative.py  |    2 +-
tempest/api/compute/servers/test_novnc.py          |    4 +-
tempest/api/compute/servers/test_server_actions.py |    5 +
.../api/compute/servers/test_server_personality.py |   12 +
tempest/api/compute/servers/test_server_rescue.py  |   20 +-
.../compute/servers/test_server_rescue_negative.py |    6 +-
.../api/compute/servers/test_servers_negative.py   |    7 +-
tempest/api/compute/volumes/test_attach_volume.py  |   24 +-
.../compute/volumes/test_attach_volume_negative.py |    4 +-
tempest/api/identity/admin/v2/test_services.py     |    6 +-
tempest/api/identity/admin/v2/test_tenants.py      |    2 +-
.../admin/v3/test_application_credentials.py       |    4 -
tempest/api/identity/admin/v3/test_credentials.py  |   16 +-
.../identity/admin/v3/test_default_project_id.py   |   13 +-
.../identity/admin/v3/test_domain_configuration.py |    4 +
tempest/api/identity/admin/v3/test_domains.py      |   15 -
.../api/identity/admin/v3/test_domains_negative.py |    4 +
.../api/identity/admin/v3/test_endpoint_groups.py  |    4 +
tempest/api/identity/admin/v3/test_groups.py       |   13 +
tempest/api/identity/admin/v3/test_inherits.py     |   39 +-
.../api/identity/admin/v3/test_list_projects.py    |   84 +-
.../api/identity/admin/v3/test_oauth_consumers.py  |    4 +
tempest/api/identity/admin/v3/test_project_tags.py |    4 +
tempest/api/identity/admin/v3/test_projects.py     |   11 +-
.../identity/admin/v3/test_projects_negative.py    |   25 +-
tempest/api/identity/admin/v3/test_regions.py      |    4 +
tempest/api/identity/admin/v3/test_roles.py        |   33 +-
tempest/api/identity/admin/v3/test_tokens.py       |    4 +-
tempest/api/identity/admin/v3/test_trusts.py       |   18 +-
tempest/api/identity/admin/v3/test_users.py        |    8 +
tempest/api/identity/v2/test_ec2_credentials.py    |    9 +-
.../identity/v3/test_application_credentials.py    |    4 -
tempest/api/identity/v3/test_domains.py            |   39 +
tempest/api/identity/v3/test_users.py              |    7 +
tempest/api/image/v2/test_images.py                |    2 +-
tempest/api/image/v2/test_images_member.py         |    2 +-
tempest/api/network/admin/test_agent_management.py |   15 +-
.../api/network/admin/test_dhcp_agent_scheduler.py |    1 -
.../api/network/admin/test_l3_agent_scheduler.py   |   85 --
tempest/api/network/admin/test_negative_quotas.py  |   34 +-
tempest/api/network/admin/test_ports.py            |    3 -
tempest/api/network/admin/test_quotas.py           |    2 +-
tempest/api/network/admin/test_routers.py          |    4 +-
tempest/api/network/base.py                        |    6 -
.../api/network/test_agent_management_negative.py  |   28 +
tempest/api/network/test_allowed_address_pair.py   |    3 -
tempest/api/network/test_dhcp_ipv6.py              |   40 +-
tempest/api/network/test_floating_ips.py           |    4 +-
tempest/api/network/test_networks.py               |    2 +-
tempest/api/network/test_ports.py                  |    5 +-
tempest/api/network/test_routers.py                |   59 +-
tempest/api/network/test_routers_negative.py       |    3 -
tempest/api/network/test_security_groups.py        |    3 -
tempest/api/network/test_versions.py               |   13 +-
tempest/api/object_storage/test_container_acl.py   |   12 +-
.../api/object_storage/test_container_quotas.py    |    5 +-
.../api/volume/admin/test_backends_capabilities.py |    8 +-
tempest/api/volume/admin/test_group_snapshots.py   |    1 +
tempest/api/volume/admin/test_volume_quotas.py     |   15 +-
.../volume/admin/test_volume_quotas_negative.py    |   48 +-
.../admin/test_volume_snapshot_quotas_negative.py  |   10 +-
tempest/api/volume/admin/test_volume_types.py      |    9 +-
tempest/api/volume/test_volumes_snapshots.py       |   23 +-
tempest/api/volume/test_volumes_snapshots_list.py  |    8 +
tempest/clients.py                                 |   25 +-
tempest/cmd/account_generator.py                   |   11 +-
tempest/cmd/cleanup.py                             |   16 +-
tempest/cmd/cleanup_service.py                     |  378 ++---
tempest/cmd/run.py                                 |   21 +-
tempest/cmd/subunit_describe_calls.py              |    2 +-
tempest/cmd/verify_tempest_config.py               |   30 +-
tempest/cmd/workspace.py                           |   17 +-
tempest/common/compute.py                          |   63 +-
tempest/common/identity.py                         |    5 +-
tempest/common/utils/linux/remote_client.py        |    1 +
tempest/common/utils/net_utils.py                  |    1 -
tempest/config.py                                  |  157 +-
tempest/hacking/checks.py                          |    8 +-
.../api_schema/response/compute/v2_28/__init__.py  |    0
.../response/compute/v2_28/hypervisors.py          |   40 +
.../api_schema/response/compute/v2_8/__init__.py   |    0
.../api_schema/response/compute/v2_8/servers.py    |   37 +
.../api_schema/response/compute/v2_9/servers.py    |   25 +-
tempest/lib/api_schema/response/volume/qos.py      |  123 ++
tempest/lib/auth.py                                |    2 +-
tempest/lib/cmd/check_uuid.py                      |    6 +-
tempest/lib/common/api_version_utils.py            |    2 +-
tempest/lib/common/fixed_network.py                |    2 +-
tempest/lib/common/http.py                         |   28 +-
tempest/lib/common/jsonschema_validator.py         |    7 +-
tempest/lib/common/preprov_creds.py                |    2 +-
tempest/lib/common/profiler.py                     |   64 +
tempest/lib/common/rest_client.py                  |   49 +-
tempest/lib/common/utils/data_utils.py             |   11 +-
tempest/lib/common/utils/misc.py                   |   12 -
tempest/lib/decorators.py                          |    9 +-
tempest/lib/services/clients.py                    |    4 +-
tempest/lib/services/compute/flavors_client.py     |    2 +-
tempest/lib/services/compute/hypervisor_client.py  |   15 +-
tempest/lib/services/compute/servers_client.py     |    6 +-
.../services/identity/v3/inherited_roles_client.py |    6 +-
.../lib/services/identity/v3/oauth_token_client.py |    1 +
tempest/lib/services/network/agents_client.py      |   10 +
tempest/lib/services/network/versions_client.py    |   38 +-
tempest/lib/services/placement/__init__.py         |   18 +
.../services/placement/base_placement_client.py    |   43 +
tempest/lib/services/placement/placement_client.py |   50 +
tempest/lib/services/volume/v1/types_client.py     |    9 +-
tempest/lib/services/volume/v3/backups_client.py   |    7 +-
tempest/lib/services/volume/v3/qos_client.py       |   21 +-
tempest/lib/services/volume/v3/snapshots_client.py |    3 +-
tempest/lib/services/volume/v3/types_client.py     |    1 +
tempest/lib/services/volume/v3/volumes_client.py   |    2 +-
tempest/scenario/manager.py                        |   52 +-
tempest/scenario/test_encrypted_cinder_volumes.py  |   11 +-
tempest/scenario/test_minimum_basic.py             |    1 +
.../scenario/test_network_advanced_server_ops.py   |   40 +-
tempest/scenario/test_network_basic_ops.py         |  128 +-
tempest/scenario/test_network_v6.py                |   29 +
tempest/scenario/test_object_storage_basic_ops.py  |   18 +-
tempest/scenario/test_security_groups_basic_ops.py |   37 +-
tempest/scenario/test_server_basic_ops.py          |    2 +-
tempest/scenario/test_volume_boot_pattern.py       |   54 +-
tempest/test.py                                    |   10 +-
tempest/test_discover/plugins.py                   |    1 +
tempest/test_discover/test_discover.py             |    2 +-
.../lib/services/compute/test_images_client.py     |   16 +-
.../lib/services/identity/v2/test_token_client.py  |    3 +-
.../lib/services/identity/v3/test_token_client.py  |    3 +-
.../image/v2/test_resource_types_client.py         |   14 +-
.../lib/services/network/test_agents_client.py     |   37 +
.../lib/services/network/test_versions_client.py   |  109 +-
.../services/placement/test_placement_client.py    |   89 ++
.../lib/services/volume/v3/test_hosts_client.py    |    4 +-
.../volume/v3/test_scheduler_stats_client.py       |    2 +-
.../lib/services/volume/v3/test_types_client.py    |  281 ++++
test-requirements.txt                              |    2 +-
tools/format.sh                                    |    5 +
tools/generate-tempest-plugins-list.py             |    3 +-
tools/generate-tempest-plugins-list.sh             |    2 -
tools/tempest-plugin-sanity.sh                     |   92 +-
tox.ini                                            |   46 +-
219 files changed, 5721 insertions(+), 1423 deletions(-)


Requirements updates
--------------------

diff --git a/test-requirements.txt b/test-requirements.txt
index e33f2079d..196387cb7 100644
--- a/test-requirements.txt
+++ b/test-requirements.txt
@@ -4 +4 @@
-hacking!=0.13.0,<0.14,>=0.12.0 # Apache-2.0
+hacking>=1.1.0,<1.2.0 # Apache-2.0






More information about the Release-announce mailing list