March 2019 - Release-announce - lists.openstack.org

patrole 0.5.0 (stein)
by no-reply＠openstack.org 25 Mar '19

25 Mar '19

We are tickled pink to announce the release of: patrole 0.5.0: Patrole is a tool for verifying that Role-Based Access Control is being enforced across OpenStack deployments. This release is part of the stein release series. The source is available from: https://git.openstack.org/cgit/openstack/patrole Download the package from: https://tarballs.openstack.org/patrole/ Please report issues through launchpad: https://storyboard.openstack.org/#!/project/openstack/patrole For more details, please see below. 0.5.0 ^^^^^ Prelude ******* This release is to tag the Patrole for OpenStack Stein release. After this release, Patrole will support below OpenStack Releases: * Stein * Rocky * Queens * Pike Current development of Patrole is for OpenStack Train development cycle. Every Patrole commit is also tested against master during the Train cycle. However, this does not necessarily mean that using Patrole as of this tag will work against a Train (or future release) cloud. New Features ************ * The exception class "RbacMalformedException" has been broken up into the following discrete exceptions: * "RbacMissingAttributeResponseBody" - incomplete means that the response body (for show or list) is missing certain attributes * "RbacPartialResponseBody" - partial means that a list response only returned a subset of the possible results available. * "RbacEmptyResponseBody" - empty means that the show or list response body is entirely empty Each of the exception classes above deals with a different type of failure related to a soft authorization failure. This means that, rather than a 403 error code getting returned by the server, the response body is incomplete in some way. * Add new exception called "RbacOverrideRoleException". Used for safeguarding against false positives that might occur when the expected exception isn't raised inside the "override_role" context. Specifically, when: * "override_role" isn't called * an exception is raised before "override_role" context * an exception is raised after "override_role" context * Supporting the role inference rules API gives Patrole an ability of testing role chains, when one role implies the second which can also imply the third: "admin" implies "member" implies "reader" Now in a case of testing against an "admin" role ("[patole] rbac_test_roles" = "admin") the "rbac_rule_validation.action" calls the "rbac_utils.get_all_needed_roles" function to extend the roles and validates a policy rule against the full list of possible roles: ["admin", "member", "reader"] Here is few examples: ["admin"] >> ["admin", "member", "reader"] ["member"] >> ["member", "reader"] ["reader"] >> ["reader"] ["custom_role"] >> ["custom_role"] ["custom_role", "member"] >> ["custom_role", "member", "reader"] * We have replaced CONF.patrole.rbac_test_role with CONF.patrole.rbac_test_roles, where instead of single role we can specify list of roles to be assigned to test user. This way we may run rbac tests for scenarios that requires user to have more that a single role. * In order to implement the tests for plugins which do not maintain the "policy.json" with full list of the policy rules and provide policy file with only their own policy rules, the Patrole should be able to load and merge multiple policy files for any of the services. * Discovery all policy files for each of the services. The updated "discover_policy_files" function picks all candidate paths found out of the potential paths in the "[patrole].custom_policy_files" config option. Using "glob.glob()" function makes it possible to use the patterns like '*.json' to discover the policy files. * Loading and merging a data from multiple policy files. Patrole loads a data from each of the discovered policy files for a service and merge the data from all files. * In order to test the list actions which doesn't have its own policy, implemented the "override_role_and_validate_list" function. The function has two modes: * Validating the number of the resources in a "ResponseBody" before calling the "override_role" and after. # make sure at least one resource is available self.ntp_client.create_policy_dscp_marking_rule() # the list of resources available for a user with admin role admin_resources = self.ntp_client.list_dscp_marking_rules( policy_id=self.policy_id)["dscp_marking_rules"] with self.rbac_utils.override_role_and_validate_list( self, admin_resources=admin_resources) as ctx: # the list of resources available for a user with member role ctx.resources = self.ntp_client.list_dscp_marking_rules( policy_id=self.policy_id)["dscp_marking_rules"] * Validating that a resource, created before "override_role", is not present in a "ResponseBody". # the resource created by a user with admin role admin_resource_id = ( self.ntp_client.create_dscp_marking_rule() ["dscp_marking_rule"]["id']) with self.rbac_utils.override_role_and_validate_list( self, admin_resource_id=admin_resource_id) as ctx: # the list of resources available for a user wirh member role ctx.resources = self.ntp_client.list_dscp_marking_rules( policy_id=self.policy_id)["dscp_marking_rules"] * Merged "RbacUtils" and "RbacUtilsMixin" classes. Now there is only "RbacUtilsMixin" class. The new class still provides all functionality of the original "RbacUtils" class. New implementation simplifies the usage of the rbac utils: * there is no need in calling "cls.setup_rbac_utils()" function, because it happens automatically at the "setup_clients" step. * there is no "rbac_utils" variable, so if you need to call a "override_role" function, just do it using "self": with self.override_role(): ... * there is no need in "test_obj" variable for "override_role" function, because it can use "self". * A new policy feature flag called "[policy_feature_flag].removed_nova_policies_stein" has been added to Patrole's config to handle Nova API extension policies removed in Stein. The policy feature flag is applied to tests that validate response bodies for expected attributes previously returned for the following policies that passed authorization: * os_compute_api:os-config-drive * os_compute_api:os-extended-availability-zone * os_compute_api:os-extended-status * os_compute_api:os-extended-volumes * os_compute_api:os-keypairs * os_compute_api:os-server-usage * os_compute_api:os-flavor-rxtx * os_compute_api:os-flavor-access (only from /flavors APIs) * os_compute_api:image-size Note that not all removed policies are included above because test coverage is missing for them (like os_compute_api:os-security- groups). * Added new feature flag called "removed_keystone_policies_stein" under the configuration group "[policy-feature-enabled]" for skipping Keystone tests whose policies were removed in Stein. This feature flag is currently applied to credentials-related policies, e.g.: identity:[create|update|get|delete]_credential * The "requirements_authority" module now supports the following 3 cases: * logical or operation of roles (existing functionality) * logical and operation of roles (new functionality) * logical not operation of roles (new functionality) <service_foo>: <logical_or_example>: - <allowed_role_1> - <allowed_role_2> <logical_and_example>: - <allowed_role_3>, <allowed_role_4> <service_bar>: <logical_not_example>: - <!disallowed_role_5> Each item under "logical_or_example" is "logical OR"-ed together. Each role in the comma-separated string under "logical_and_example" is "logical AND"-ed together. And each item prefixed with "!" under "logical_not_example" is "logical negated". This allows for expressing many more complex cases using the "requirements_authority" YAML syntax. For example, the policy rule (i.e. what may exist in a "policy.yaml" file): "foo_rule: (role:a and not role:b) or role:c" May now be expressed using the YAML syntax as: foo_rule: - a, !b - c * Patrole will validate the deprecated policy rules (if applicable) alongside the current policy rule. Add "[patrole] validate_deprecated_rules" enabled by default to validate the deprecated rules. * Added new Cinder feature flag ("CONF.policy_feature_enabled.added_cinder_policies_stein") for the following newly introduced granular Cinder policies: * "volume_extension:volume_type_encryption:create" * "volume_extension:volume_type_encryption:get" * "volume_extension:volume_type_encryption:update" * "volume_extension:volume_type_encryption:delete" The corresponding Patrole test cases are modified to support the granularity. The test cases also support backward compatibility with the old single rule: "volume_extension:volume_type_encryption" The "rules" parameter in "rbac_rule_validation.action" decorator now also accepts a list of callables; each callable should return a policy action (str). * Patrole now supports parsing custom YAML policy files, the new policy file extension since Ocata. The function "_get_policy_data" has been renamed to "get_rules" and been changed to re-use "oslo_policy.policy.Rules.load" function. Upgrade Notes ************* * The exception class "RbacMalformedException" has been removed. Use one of the following exception classes instead: * "RbacMissingAttributeResponseBody" * "RbacPartialResponseBody" * "RbacEmptyResponseBody" * Remove usage of "cls.setup_rbac_utils()" function. * Remove usage of "self.rbac_utils" variable: with self.rbac_utils.override_role(self): convert to with self.override_role(): * Remove "test_obj" in usage of "override_role" context manager: with self.override_role(self): convert to with self.override_role(): * Remove deprecated "[patrole].enable_rbac" configuration option. To skip Patrole tests going forward, use an appropriate regex. * The following deprecated parameters in "rbac_rule_validation.action" decorator: * "rule" * "expected_error_code" have been removed. Use the non-deprecated versions instead: * "rules" * "expected_error_codes" Deprecation Notes ***************** * Patrole will only support the v3 Tempest roles client for role overriding operations. Support for the v2 version has been dropped because the Keystone v2 API is slated for removal. * Config parameter CONF.rbac_test_role is deprecated in favor of CONF.rbac_test_roles that implements a list of roles instead of single role. Bug Fixes ********* * Previously, the "rbac_rule_validation.action" decorator could catch expected exceptions with no regard to where the error happened. Such behavior could cause false-positive results. To prevent this from happening from now on, if an exception happens outside of the "override_role" context, it will cause "rbac_exceptions.RbacOverrideRoleException" to be raised. Changes in patrole 0.4.0..0.5.0 ------------------------------- 9cd0a43 Fix README for Duplicate implicit target name: "storyboard" 87d83ea Add releasenote to tag the Patrole for Stein release b2ebe49 Updates Launchpad references to Storyboard 1a53003 Compute test are failing due not explicitly passing Network information 2db8338 Do not use self in classmethod 4e79004 Add py36 and py37 tox envs 198ac02 add python 3.7 unit test job 78e7f57 Refactoring RbacUtils part 3 - documentation d3d77ef Refactoring RbacUtils part 2 api tests ace8ea3 Refactoring RbacUtils 11e0c66 Enable checks and gate for reader role 7a308a0 Fix Policy action "get_flavors" not found 2a0fb1f Fix Policy action "get_network_ip_availabilities" not found 19e3bec Support implied rules d16ccfb Fix Doc mistakes and add log to gitignore. 588e806 Fix instability with volume attachment RBAC tests 55e5dfe Fix OverPermission exception for keystone tests 427c74c Fix the misspelling of "available" cd2c5fd Requirements yaml expected service names to be lowercase 6da06ed Use the canonical URL for repositories (git.openstack.org) 0868ded dict_object.keys() is not required for *in* operator 89d5d18 Change openstack-dev to openstack-discuss 0a82474 Rbac tests for Neutron list actions 22e2971 Add tests to cover trunks subports 02f6606 Add List Available Zones test cases for RBAC. a78dcae Fix the branches variant for stable branch job f5c0dfb Migrate patrol jobs to bionic(Ubuntu LTS 18.04) e36a973 docs: Include information about the list of supported projects b5d01cc Add missing ws seperator between words a261a2f Add tests to cover network ip availability API b68763c Add tests to cover service_profile bab9e94 Helper for validating RBAC list actions 47c43cb docs: Use sphinx-apidoc library for autodoc generation 0710e5d Validate omission of expected_error_codes defaults to 403 825d794 trivial: Fix irrelevant-files regexes for unit tests 0464e81 requirements authority: Use better exception/return code 4d4cb1e Add documentation about white box/black box testing to HACKING d02a8d8 RequirementsAuthority multi role support enhancement 2a5f41e Fix error codes for test_delete_flavor_service_profile 74f8e7d refactor: Break up RbacMalformedException into discrete exceptions 596bebd Replace all volume client aliases with _latest suffix 0d3c743 zuul: Use all rather than all-plugin for tox_envlist bbbdd93 refactor: Rename PluginRbacTest => ExtRbacTest b688823 Define common irrelevant-files d771e34 Update min tox version to 2.0 d1a87c5 trivial: Add hacking checks to irrelevant-files in .zuul.yaml 1b49965 trivial: Correct base class name in hacking check e0f3550 Multi role RBAC validation c38aca7 Add feature flag for Keystone policies removed in Stein ecfbb57 pbr: Remove unused translation sections from setup.cfg 904a02b hacking: Add hacking rule for plugin rbac test class names cacbd21 fix: Rename test classes causing accidental skip 2238c69 Fix test_update_address_scope_shared 42f7e1c docs: Add multi-policy validation documentation bf524fb Deprecate use of v2 roles client in rbac_utils.py 28c9c3a Fix create_rbac_policy tenant_id and network_id usage 1daa06a Use tempest.common.identity.identity_utils for project management 6925095 Add volume create from image test 8dd5f19 Remove invalid exception RbacConflictingPolicies 0170c99 docs: Add sections about context_is_admin/custom policy checks 59f538f Replace rule/expected_error_code with non-deprecated versions 2a6d329 Add tests to cover auto_allocated_topology 5f25db5 Add tests to cover neutron-agents dcd153a Remove extra_attr kwarg from RbacMalformedResponse 26b7e09 Add developer test writing guide for Patrole tests b485953 Include README for neutron + plugin tests 433bf50 Add tests to cover policy_minimum_bandwidth_rule d646a4c Add tests to cover policy_bandwidth_limit_rule 8c04bd8 Add granularity for volume_extension:volume_type_encryption ef7047d Use oslo_policy.policy.Rules.load to load rules 9358f74 Add :special-members: directive to automodule in docs e9a1355 Include README in patrole_tempest_plugin/tests/api via symlink 062fb15 Add support for multiple policy files 194752f Remove deprecated patrole.enable_rbac configuration option a3c15da Use templates for cover and lower-constraints d720bad switch documentation job to new PTI 4635c6a import zuul job settings from project-config a3d7311 Remove unused config.CONF 24961a8 Add test for create_subnetpool:is_default 11376ab Limit exception handling to calls within override_role e3b2527 Adds tests to cover QOS policy 849acef Adds tests to cover address scopes 1bee142 Add periodic-stable entry to .zuul.yaml 22bb9b3 Add Patrole gate job for stable/rocky 56bb731 Add tests to cover policy_dscp_marking_rule f4cb74c add python 3.6 unit test job 0f73e7c Add bandit python security scanning to pep8 98437d4 Remove override of 'expected_error_codes' with defaults 0f45285 Remove the usage of deprecated arg 'expected_error_code' 031b182 Add tests to cover RBAC policies 6bffc5c Skip the deprecated API extensions policy tests bd15460 Add release notes page for v0.4.0 63d8602 Add tests to cover flavor_service_profile 04b2628 Add tests to cover trunks fcd6fcf Add waiters after creating volume transfer for related tests Diffstat (except docs and test files) ------------------------------------- .gitignore | 2 + .zuul.yaml | 110 ++-- HACKING.rst | 55 +- README.rst | 41 +- REVIEWING.rst | 54 +- devstack/README.rst | 2 +- devstack/plugin.sh | 43 +- etc/patrole.conf.sample | 40 +- patrole_tempest_plugin/config.py | 52 +- patrole_tempest_plugin/hacking/checks.py | 41 ++ patrole_tempest_plugin/policy_authority.py | 181 +++--- patrole_tempest_plugin/rbac_exceptions.py | 84 ++- patrole_tempest_plugin/rbac_rule_validation.py | 185 ++++-- patrole_tempest_plugin/rbac_utils.py | 431 ++++++++++--- patrole_tempest_plugin/requirements_authority.py | 62 +- .../api/compute/test_availability_zone_rbac.py | 14 +- .../api/compute/test_flavor_extra_specs_rbac.py | 20 +- .../api/compute/test_floating_ip_pools_rbac.py | 4 +- .../api/compute/test_floating_ips_bulk_rbac.py | 12 +- .../compute/test_instance_usages_audit_log_rbac.py | 8 +- .../api/compute/test_quota_class_sets_rbac.py | 22 +- .../api/compute/test_server_migrations_rbac.py | 8 +- .../test_server_misc_policy_actions_rbac.py | 212 ++++--- .../compute/test_server_volume_attachments_rbac.py | 140 ++++- .../api/compute/test_virtual_interfaces_rbac.py | 4 +- .../v3/test_application_credentials_rbac.py | 28 +- .../identity/v3/test_domain_configuration_rbac.py | 58 +- .../api/identity/v3/test_ep_filter_groups_rbac.py | 24 +- .../identity/v3/test_ep_filter_projects_rbac.py | 20 +- .../api/identity/v3/test_oauth_consumers_rbac.py | 20 +- .../api/identity/v3/test_oauth_tokens_rbac.py | 24 +- .../identity/v3/test_policy_association_rbac.py | 36 +- .../api/identity/v3/test_project_tags_rbac.py | 24 +- .../api/identity/v3/test_role_assignments_rbac.py | 8 +- .../api/identity/v3/test_tokens_negative_rbac.py | 15 +- .../api/image/test_image_namespace_objects_rbac.py | 16 +- .../image/test_image_namespace_property_rbac.py | 16 +- .../api/image/test_image_namespace_tags_rbac.py | 20 +- .../api/image/test_image_resource_types_rbac.py | 15 +- .../network/test_auto_allocated_topology_rbac.py | 42 +- .../api/network/test_availability_zones_rbac.py | 48 ++ .../api/network/test_dscp_marking_rule_rbac.py | 121 ++++ .../network/test_flavor_service_profile_rbac.py | 77 +++ .../api/network/test_metering_label_rules_rbac.py | 29 +- .../network/test_network_ip_availability_rbac.py | 64 ++ .../api/network/test_network_segments_rbac.py | 11 +- .../test_policy_bandwidth_limit_rule_rbac.py | 109 ++++ .../test_policy_minimum_bandwidth_rule_rbac.py | 112 ++++ .../api/network/test_service_providers_rbac.py | 4 +- .../api/volume/test_snapshots_actions_rbac.py | 12 +- .../api/volume/test_snapshots_metadata_rbac.py | 30 +- .../api/volume/test_volume_basic_crud_rbac.py | 41 +- .../api/volume/test_volume_types_access_rbac.py | 12 +- .../volume/test_volume_types_extra_specs_rbac.py | 20 +- .../api/volume/test_volumes_snapshots_rbac.py | 36 +- ...-into-discrete-exceptions-92aedb99d0a13f58.yaml | 25 + ...ors-only-in-override-role-f7109a73f5ff70e2.yaml | 19 + ...oles-client-in-rbac-utils-087eda0658d18fa9.yaml | 6 + .../notes/implied-roles-96a307a2b9fa2a40.yaml | 22 + .../notes/multi-role-rbac-7f597c004a558956.yaml | 11 + .../multiple-policy-files-9aa7f7583283739e.yaml | 17 + ...de-role-and-validate-list-d3b80f773674a652.yaml | 37 ++ .../patrole-stein-release-874b36f2fedcd2fb.yaml | 15 + .../rbac-utils-refactoring-2f4f1e3b52fcae14.yaml | 49 ++ ...d-api-extensions-policies-fca3d31c7f5f1f6c.yaml | 23 + ...enable-rbac-config-option-a5e46ce1053b7dea.yaml | 5 + ...pected-error-codes-params-52071a83113934fd.yaml | 13 + ...licies-stein-feature-flag-6cfebbf64ed525d7.yaml | 8 + ...hority-multi-role-support-0fe53fc49567e595.yaml | 37 ++ .../support-deprecated-roles-eae9dc742cb4fa33.yaml | 7 + ...yption-policy-granularity-141ac283b9c0778e.yaml | 19 + .../yaml-policy-file-support-278d3edf64f98d69.yaml | 7 + releasenotes/source/index.rst | 1 + releasenotes/source/v0.4.0.rst | 6 + setup.cfg | 16 +- test-requirements.txt | 1 + tox.ini | 14 +- 184 files changed, 6243 insertions(+), 2600 deletions(-) Requirements updates -------------------- diff --git a/test-requirements.txt b/test-requirements.txt index 9085c07..a08c27a 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -10,0 +11 @@ oslotest>=3.2.0 # Apache-2.0 +bandit>=1.5 # Apache-2.0

1 0

neutron-tempest-plugin 0.3.0 (stein)
by no-reply＠openstack.org 25 Mar '19

25 Mar '19

We contentedly announce the release of: neutron-tempest-plugin 0.3.0: Tempest plugin for Neutron Project This release is part of the stein release series. The source is available from: https://git.openstack.org/cgit/openstack/neutron-tempest-plugin Download the package from: https://tarballs.openstack.org/neutron-tempest-plugin/ Please report issues through launchpad: https://bugs.launchpad.net/neutron For more details, please see below. 0.3.0 ^^^^^ New Features ************ * Added a new method "delete_agent" to the AgentsClient class that implements agent deletion according to the neutron API. https://developer.openstack.org/api-ref/network/v2/index.html #delete-agent * Add new 'debtcollector' dependency with the purpose of deprecating methods that are going to be removed. Deprecation Notes ***************** * Deprecate method BaseTempestTestCase.create_and_associate_floatingip after replacing it with method BaseNetworkTest.create_floatingip. Changes in neutron-tempest-plugin 0.2.0..0.3.0 ---------------------------------------------- 0e8b686 Reenable tests cases in NetworkMigrationFromHA c1052e7 Remove test_port_resource_request_no_provider_net 8bbf899 add assert to ping test eaaf978 Add API test for network segment range extension 561cf62 Add logging of the test steps in NetworkWritableMtuTest 5b85ad8 Add tempest api tests for security groups RBAC 39f2532 Fix L3 agent scheduler tests in multinode environments 6b03ab1 Fix neutron-tempest-plugin tox pep8 setup 7451ad7 Log port details when FloatingIP port details test fails f238ed3 Added test_ports suite and a new test a92aa4e Allow NetworkWritableMtuTest to run on GENEVE (OVN) networks 7eb6725 Make provider network creation more error proof 2f90465 tests for port-resource-request 06ef854 Update test_trunk after adding new ip command tool. c2ed23d Add ip command tool for manually manage devices on VM. 5d0cea2 Keep stable branch jobs on Ubuntu Xenial f742a3d Remove unnecessary entries in resource prefix map f91dba5 Use self.create_port instead of client.create_port b8fbe0c Turn the list of extensions into multi-line b949913 Fix the extension list across jobs 0fab696 Remove deprecated extension "tag" and "tag-ext" db2e6c9 Test floatingip pools service plugin 158ddda Change openstack-dev to openstack-discuss e570de6 Update test cases after security group menthods improvements. 1582f71 Switch tempest plugin jobs to Python 3 1c9f40b Add scenario test for trunk E2E flow 49819a7 call remove_router_extra_routes only when extra_routes is enabled 5da7333 Test propagate_uplink_status on create port 0e04f8f Create wrapper tool for both local and remote shell command execution. 4c590d7 Improve security groups management. 6f9bb77 Fix race condition in test_security_groups 498a7f4 Fix execute_script method to avoid infinite wait. ee741b3 Add new test cases for network ip availability 47f6ae4 Make sure only one port_id is given. d54ae6c Enhance scenario test to cover network dns_domain 21f5342 Fix creating subnet without gateway d50fd0d Two fixes on test_list_available_zones f341b5b Add network availability zones client 5214b27 Move test cases from networking-midonet repository b1a3289 Add connectivity test via 2 routers and tenant networks da17f00 Use advanced image only when it's necessary dc9c6d6 test for minimum bw ingress direction b1c48b6 Remove test_rule_create_fail_for_direction_ingress aee61ac Fix flake8 E405 errors 8aaa73f Fix flake8 E265 errors ae328b9 Fix flake8 H404 errors 3e1d8f1 Update QoS scenario test 168e501 Fix raising TimeoutException in tests f31e3ee Migrate dvr multinode scenario to zuulv3 syntax 71bda86 Add guest image customization to DevStack plugin. af347da Wait for floating IP to be DOWN before checking port details 3dfa94c Refactor test cases after adding new params to create_floatingip. b600bea Add jobs for stable/rocky branch e137cd0 Mark NetworkMigrationFromHA scenario tests as unstable c9f5ec5 Update trunk tests to use create_trunk method. 2cbb10e Add release notes job to zuul template 6bf840f Fix bash cmd used in scenario trunk tests 299c4bd Add delete_agent to NetworkClientJSON 17bc8d8 Revert "Use nested virt in scenario jobs" 54f5592 Add tests to assert filter validation 12685c6 import zuul job settings from project-config 6f0644e Reuse SSH connections for executing multiple commands. e208962 Consolidate irrelevant-files in zuul config bf877c8 Deprecate BaseTempestTestCase.create_and_associate_floatingip method a69dcd5 Create floating IPs with additional parameters. 2de722e Cleanup Tempest tests legacy resources 7a5d022 Stop running designate scenario job on docs-only changes Diffstat (except docs and test files) ------------------------------------- .zuul.yaml | 466 ++++++++++++++++++--- README.rst | 1 + devstack/customize_image.sh | 158 +++++++ devstack/functions.sh | 87 ++++ devstack/plugin.sh | 10 + devstack/settings | 4 + .../api/admin/test_agent_availability_zone.py | 7 +- .../api/admin/test_agent_management.py | 4 +- .../test_extension_driver_port_security_admin.py | 4 +- .../api/admin/test_external_network_extension.py | 6 +- .../api/admin/test_floating_ips_admin_actions.py | 18 +- .../api/admin/test_l3_agent_scheduler.py | 26 +- .../api/admin/test_network_segment_range.py | 247 +++++++++++ neutron_tempest_plugin/api/admin/test_ports.py | 121 ++++++ .../api/admin/test_quotas_negative.py | 75 ++-- .../api/admin/test_routers_dvr.py | 9 +- .../api/admin/test_routers_ha.py | 11 +- .../api/admin/test_security_groups.py | 4 +- .../api/admin/test_shared_network_extension.py | 12 +- neutron_tempest_plugin/api/admin/test_tag.py | 48 +-- neutron_tempest_plugin/api/base.py | 241 +++++++++-- neutron_tempest_plugin/api/base_security_groups.py | 78 +--- neutron_tempest_plugin/api/clients.py | 4 +- .../api/test_allowed_address_pair.py | 23 +- .../api/test_auto_allocated_topology.py | 2 +- .../api/test_availability_zones.py | 30 ++ neutron_tempest_plugin/api/test_dhcp_ipv6.py | 4 +- .../api/test_extension_driver_port_security.py | 18 +- .../api/test_extra_dhcp_options.py | 9 +- .../api/test_flavors_extensions.py | 2 +- neutron_tempest_plugin/api/test_floating_ips.py | 64 ++- .../api/test_floating_ips_negative.py | 10 +- .../api/test_metering_extensions.py | 2 +- .../api/test_network_ip_availability.py | 130 +++--- neutron_tempest_plugin/api/test_networks.py | 7 +- .../api/test_networks_negative.py | 3 +- neutron_tempest_plugin/api/test_ports.py | 22 + neutron_tempest_plugin/api/test_qos.py | 22 +- neutron_tempest_plugin/api/test_revisions.py | 80 ++-- .../api/test_router_interface_fip.py | 120 ++++++ .../api/test_routers_negative.py | 4 +- neutron_tempest_plugin/api/test_security_groups.py | 254 ++++++++--- .../api/test_security_groups_negative.py | 50 ++- neutron_tempest_plugin/api/test_subnetpools.py | 12 +- neutron_tempest_plugin/api/test_subnets.py | 5 +- neutron_tempest_plugin/api/test_timestamp.py | 109 ++--- neutron_tempest_plugin/api/test_trunk.py | 282 ++++++------- neutron_tempest_plugin/api/test_trunk_details.py | 29 +- neutron_tempest_plugin/api/test_trunk_negative.py | 114 +++-- neutron_tempest_plugin/common/constants.py | 8 + neutron_tempest_plugin/common/ip.py | 316 ++++++++++++++ neutron_tempest_plugin/common/shell.py | 180 ++++++++ neutron_tempest_plugin/common/ssh.py | 204 ++++++++- neutron_tempest_plugin/common/utils.py | 20 +- neutron_tempest_plugin/config.py | 32 +- neutron_tempest_plugin/exceptions.py | 78 +++- .../scenario/admin/test_floatingip.py | 37 +- neutron_tempest_plugin/scenario/base.py | 53 ++- neutron_tempest_plugin/scenario/test_bgp.py | 232 ++++++++++ .../scenario/test_connectivity.py | 111 +++++ .../scenario/test_dns_integration.py | 10 +- neutron_tempest_plugin/scenario/test_fip64.py | 92 ++++ neutron_tempest_plugin/scenario/test_floatingip.py | 47 ++- .../scenario/test_internal_dns.py | 11 +- neutron_tempest_plugin/scenario/test_mtu.py | 54 ++- neutron_tempest_plugin/scenario/test_ports.py | 80 ++++ neutron_tempest_plugin/scenario/test_qos.py | 134 +++++- .../scenario/test_security_groups.py | 19 +- neutron_tempest_plugin/scenario/test_trunk.py | 466 ++++++++++++--------- .../services/network/json/network_client.py | 40 +- playbooks/dvr-multinode-scenario-pre-run.yaml | 3 + .../post.yaml | 15 - .../run.yaml | 60 --- ...ents-client-delete-method-de1a7fb3f845999c.yaml | 7 + .../mark-methods-removals-f8b230171c045a3e.yaml | 11 + releasenotes/source/README.rst | 34 ++ releasenotes/source/conf.py | 29 +- releasenotes/source/index.rst | 11 +- requirements.txt | 4 +- roles/multi-node-setup/README.rst | 23 + roles/multi-node-setup/defaults/main.yaml | 2 + roles/multi-node-setup/tasks/main.yaml | 17 + setup.cfg | 13 +- tools/customize_ubuntu_image | 16 +- tox.ini | 12 +- 85 files changed, 4256 insertions(+), 1273 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 5660c68..bb836d1 100644 --- a/requirements.txt +++ b/requirements.txt @@ -6 +6 @@ pbr!=2.1.0,>=2.0.0 # Apache-2.0 -neutron-lib>=1.18.0 # Apache-2.0 +neutron-lib>=1.25.0 # Apache-2.0 @@ -12,0 +13 @@ oslo.utils>=3.33.0 # Apache-2.0 +paramiko>=2.0.0 # LGPLv2.1+ @@ -18,0 +20 @@ eventlet!=0.18.3,!=0.20.1,>=0.18.2 # MIT +debtcollector>=1.2.0 # Apache-2.0

1 0

congress-tempest-plugin 0.2.0 (stein)
by no-reply＠openstack.org 25 Mar '19

25 Mar '19

We are amped to announce the release of: congress-tempest-plugin 0.2.0: Tempest Plugin for Congress project This release is part of the stein release series. The source is available from: https://git.openstack.org/cgit/openstack/congress-tempest-plugin Download the package from: https://tarballs.openstack.org/congress-tempest-plugin/ Please report issues through launchpad: https://bugs.launchpad.net/congress For more details, please see below. Changes in congress-tempest-plugin 0.1.0..0.2.0 ----------------------------------------------- 4d310aa Add python 3.6 to setup.cfg, in line with Stein target 3607a08 Move legacy job to bionic and stable on xenial fe86b9e Update nova server test for addiing created_at field 4390716 Add test for servers.addresses table in nova driver df0b7e5 Resolve test_datasource_db_sync_add_remove instability 2b4c0ba disable murano scenario test in queens-py35 job 842fe2a nova_servers_addresses_table feature flag 773f397 Update home-page f4bcf65 Add policy eval tests to vitrage webhook driver 4ca37b6 Change openstack-dev to openstack-discuss 6c2fadc Neutron driver test use admin 4b10bef Update hacking version 3d1a06d Update CI jobs in sync with migration in congress repo 0beba1d Fix queens py35 job 51dda09 add z3 support_builtins feature flag 52fecd0 Modify monasca-webhook test 54945ed Monasca webhook rocky schema feature flag e31aa96 tempest test for z3 builtins 63ee08f Add python 3.6 for test and remove pypy in tox df91e38 Removed older version of python added 3.5 be89877 Temporarily disable monasca webhook test e607d01 add queens & rocky check jobs 9e5813e Revert "temporarily disable nova driver tests" de69e03 temporarily disable nova driver tests a39a7a7 skipping some tests for queens 66692c8 import zuul job settings from project-config 7a260ce fix tox python3 overrides Diffstat (except docs and test files) ------------------------------------- .zuul.yaml | 168 ++++++++++++++++++- congress_tempest_plugin/config.py | 26 ++- congress_tempest_plugin/plugin.py | 6 +- .../scenario/congress_datasources/test_glancev2.py | 4 +- .../scenario/congress_datasources/test_monasca.py | 96 ++++++++++- .../scenario/congress_datasources/test_murano.py | 4 +- .../congress_datasources/test_neutronv2.py | 14 +- .../congress_datasources/test_neutronv2_qos.py | 5 +- .../scenario/congress_datasources/test_nova.py | 109 +++++++++++-- .../scenario/congress_datasources/test_vitrage.py | 178 +++++++++++++++------ .../legacy/congress-devstack-api-base/post.yaml | 80 +++++++++ .../legacy/congress-devstack-api-base/run.yaml | 105 ++++++++++++ .../congress-devstack-api-py27-queens/post.yaml | 80 +++++++++ .../congress-devstack-api-py27-queens/run.yaml | 90 +++++++++++ .../congress-devstack-api-py27-rocky/post.yaml | 80 +++++++++ .../congress-devstack-api-py27-rocky/run.yaml | 104 ++++++++++++ .../congress-devstack-api-py35-queens/post.yaml | 80 +++++++++ .../congress-devstack-api-py35-queens/run.yaml | 89 +++++++++++ .../congress-devstack-api-py35-rocky/post.yaml | 80 +++++++++ .../congress-devstack-api-py35-rocky/run.yaml | 88 ++++++++++ .../congress-devstack-py35-api-mysql/post.yaml | 80 +++++++++ .../congress-devstack-py35-api-mysql/run.yaml | 89 +++++++++++ .../legacy/congress-pe-replicated-base/post.yaml | 80 +++++++++ .../legacy/congress-pe-replicated-base/run.yaml | 90 +++++++++++ setup.cfg | 8 +- test-requirements.txt | 2 +- tox.ini | 11 +- 33 files changed, 1869 insertions(+), 108 deletions(-) Requirements updates -------------------- diff --git a/test-requirements.txt b/test-requirements.txt index 0543291..43a96a3 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -5 +5 @@ -hacking!=0.13.0,<0.14,>=0.12.0 # Apache-2.0 +hacking>=1.1.0,<1.2.0 # Apache-2.0

1 0

kuryr-tempest-plugin 0.4.1 (stein)
by no-reply＠openstack.org 25 Mar '19

25 Mar '19

We are delighted to announce the release of: kuryr-tempest-plugin 0.4.1: Kuryr Tempest Plugin This release is part of the stein release series. Download the package from: https://tarballs.openstack.org/kuryr-tempest-plugin/ For more details, please see below. Changes in kuryr-tempest-plugin 0.4.0..0.4.1 -------------------------------------------- 0d51e99 Test CRD podSelector update fc53fd0 Rerun test in a single thread if multi-thread failed 4673523 Service cleanup should be optional 5ed5aee Testing port_pool_min and port_pool_max bab0b85 Use assertTrue in checking pod connectivity 6f3f241 Working with noop for vif_pool_driver 2a19675 Checking connectivity from host to pod/service in the namespace Diffstat (except docs and test files) ------------------------------------- 5 files changed, 334 insertions(+), 32 deletions(-)

1 0

designate-tempest-plugin 0.6.0 (stein)
by no-reply＠openstack.org 25 Mar '19

25 Mar '19

We are excited to announce the release of: designate-tempest-plugin 0.6.0: OpenStack DNS As A Service (Designate) Functional Tests This release is part of the stein release series. Download the package from: https://tarballs.openstack.org/designate-tempest-plugin/ For more details, please see below. Changes in designate-tempest-plugin 0.5.0..0.6.0 ------------------------------------------------ 9a0a360 Properly quote TXT/SPF sample data 2da1d6e Fix deleting zones after tests 02fca4d Change openstack-dev to openstack-discuss fd1eb9b Delete created zone in recordset validation tests ba13329 fix tox python3 overrides 1e1c2f2 Re-enable tests that were disabled due to bug #1623576 d14f818 Fixing python 3 support for pep8 and doc 60e5372 Add test for quota set for invalid project 7462c37 switch documentation job to new PTI 7ce15eb import zuul job settings from project-config d64d8ae Use new tempest option to verify redirects Diffstat (except docs and test files) ------------------------------------- .zuul.yaml | 5 ++++ designate_tempest_plugin/config.py | 4 +++ designate_tempest_plugin/data_utils.py | 4 +-- .../services/dns/query/query_client.py | 3 +- .../services/dns/v2/json/recordset_client.py | 14 +++++++++ setup.cfg | 2 +- tox.ini | 4 ++- 27 files changed, 181 insertions(+), 77 deletions(-)

1 0

oslo.db 4.45.0 (stein)
by no-reply＠openstack.org 25 Mar '19

25 Mar '19

We joyfully announce the release of: oslo.db 4.45.0: Oslo Database library This release is part of the stein stable release series. The source is available from: https://git.openstack.org/cgit/openstack/oslo.db Download the package from: https://pypi.org/project/oslo.db Please report issues through launchpad: https://bugs.launchpad.net/oslo.db For more details, please see below. Changes in oslo.db 4.44.0..4.45.0 --------------------------------- 79b933b Bump psycopg lower-constraint to 2.7 Diffstat (except docs and test files) ------------------------------------- lower-constraints.txt | 2 +- setup.cfg | 2 +- test-requirements.txt | 2 +- 3 files changed, 3 insertions(+), 3 deletions(-) Requirements updates -------------------- diff --git a/test-requirements.txt b/test-requirements.txt index 98fdbe8..27a9e3f 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -18 +18 @@ PyMySQL>=0.7.6 # MIT License -psycopg2>=2.6.2 # LGPL/ZPL +psycopg2>=2.7.0 # LGPL/ZPL

1 0

keystone_tempest_plugin 0.2.0 (stein)
by no-reply＠openstack.org 25 Mar '19

25 Mar '19

We are jazzed to announce the release of: keystone_tempest_plugin 0.2.0: Tempest plugin keystone_tempest_plugin This release is part of the stein release series. The source is available from: http://git.openstack.org/cgit/openstack/keystone-tempest-plugin Download the package from: https://tarballs.openstack.org/keystone-tempest-plugin/ Please report issues through launchpad: http://bugs.launchpad.net/keystone_tempest_plugin For more details, please see below. Changes in keystone_tempest_plugin 0.1.0..0.2.0 ----------------------------------------------- db697d4 Update hacking version to latest ddc5109 Clean up the auto generated domain 958d34e Change openstack-dev to openstack-discuss 022bd1d Add python3 functional test job d7a7c90 [Trivial Fix] update home-page url 48f7e26 Import another job from project-config d070682 Rename keystone zuul jobs 807bd94 import zuul job settings from project-config Diffstat (except docs and test files) ------------------------------------- .zuul.yaml | 16 ++++++++++++++++ setup.cfg | 4 ++-- test-requirements.txt | 2 +- 5 files changed, 33 insertions(+), 4 deletions(-) Requirements updates -------------------- diff --git a/test-requirements.txt b/test-requirements.txt index 12132d9..6e99fe7 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -5 +5 @@ -hacking<0.13,>=0.12.0 # Apache-2.0 +hacking>=1.1.0,<1.2.0 # Apache-2.0

1 0

swift 2.21.0 (stein)
by no-reply＠openstack.org 25 Mar '19

25 Mar '19

We are happy to announce the release of: swift 2.21.0: OpenStack Object Storage This release is part of the stein release series. Download the package from: https://tarballs.openstack.org/swift/ For more details, please see below. 2.21.0 ^^^^^^ New Features ************ * Change the behavior of the EC reconstructor to perform a fragment rebuild to a handoff node when a primary peer responds with 507 to the REPLICATE request. This changes EC to match the existing behavior of replication when drives fail. After a rebalance of EC rings (potentially removing unmounted/failed devices), it's most IO efficient to run in handoffs_only mode to avoid unnecessary rebuilds. * O_TMPFILE support is now detected by attempting to use it instead of looking at the kernel version. This allows older kernels with backported patches to take advantage of the O_TMPFILE functionality. * Add slo_manifest_hook callback to allow other middlewares to impose additional constraints on or make edits to SLO manifests before being written. For example, a middleware could enforce minimum segment size or insert data segments. * Fixed an issue with multi-region EC policies that caused the EC reconstructor to constantly attempt cross-region rebuild traffic. * Fixed an issue where S3 API v4 signatures would not be validated against the body of the request, allowing a replay attack if request headers were captured by a malicious third party. * Display crypto data/metadata details in swift-object-info. * formpost can now accept a content-encoding parameter. * Fixed an issue where multipart uploads with the S3 API would sometimes report an error despite all segments being upload successfully. * Multipart object segments are now actually deleted when the multipart object is deleted via the S3 API. * Swift now returns a 503 (instead of a 500) when an account auto- create fails. * Fixed a bug where encryption would store the incorrect key metadata if the object name starts with a slash. * Fixed an issue where an object server failure during a client download could leave an open socket between the proxy and client. * Fixed an issue where deleted EC objects didn't have their on-disk directories cleaned up. This would cause extra resource usage on the object servers. * Fixed issue where bulk requests using xml and expect 100-continue would return a malformed HTTP response. * Various other minor bug fixes and improvements. Bug Fixes ********* * Fixed a cache invalidation issue related to GET and PUT requests to containers that would occasionally cause object PUTs to a container to 404 after the container had been successfully created. * Removed a race condition where a POST to an SLO could modify the X -Static-Large-Object metadata. * Fixed rare socket leak on range requests to erasure-coded objects. * Fix SLO delete for accounts with non-ASCII names. * Fixed an issue in COPY where concurrent requests may have copied the wrong data. * Fixed time skew when using X-Delete-After. * Send ETag header in 206 Partial Content responses to SLO reads. * Fix SLO delete for accounts with non-ASCII names. * Fixed an issue in COPY where concurrent requests may have copied the wrong data. * Fixed a bug in how Swift uses eventlet that was exposed under high concurrency. * Prevent PyKMIP's kmip_protocol logger from logging at DEBUG. Previously, some versions of PyKMIP would include all wire data when the root logger was configured to log at DEBUG; this could expose key material in logs. Only the kmip_keymaster was affected. * Fixed an issue where a failed drive could prevent the container sharder from making progress. * Fixed a bug in how Swift uses eventlet that was exposed under high concurrency. Changes in swift 2.20.0..2.21.0 ------------------------------- 179fa7ccd authors/changelog update for 2.21.0 release 64eec5fc9 Fix how we UTF-8-ify func tests fe3a20f2e Remove uncalled function adc568c97 Fix bulk responses when using xml and Expect 100-continue 585bf40cc Simplify empty suffix handling e5eb673cc Stop monkey-patching mimetools d6af42b6b Clean up how we walk through ranges in ECAppIter c9773bfd2 Add non-voting py37 unit test job 95da1d97b Fix py35 unit test job 53b56b655 crediting contributors to the un-landed hummingbird branch fa678949a Fix quoting for large objects a30a47775 Stop overwriting reserved term 74664af7e Fix a typo 13e7f3641 Do not use self in classmethod e1a12dc3d Refactor write_affinity DELETE handling d74885176 s3token: Add note about config change when upgrading from swift3 d185b607b docs: clean up SAIO formatting 860ae1e00 py3: port proxy account controller 8b519d1ab Clean up func tests ahead of py3 45994e4d3 py3: port object updater 4ac81ebbd py3: fix copying unicode names 5d4303edb manage-shard-ranges: nicer message if we can't get_info() 349c54998 py3: port object auditor 61e6ac0eb py3: port formpost middleware 04a0ff2e9 added changelog entries from stable releases 5409c4f34 Make test_multiphase_put_drains_extra_commit_junk_disconnect less flakey be3e21582 py3: display help if no subcommand provided to manage-shard-ranges baf18edc0 Clean up account-reaper a bit b4e470076 py3: port some more middleware tests 3be384c81 py3: port proxy container controller 575538b55 py3: port the container ce261b12e py3: port versioned_writes f4689dd22 probe tests: wait to start replicators until after verifying initial state db9c90584 py3: port copy middleware 1e3f8a0e5 Address some review comments 926a02413 Fix up flakey TestContainer.test_PUT_bad_metadata 78fb722ab Address some review comments 693f931a5 Fixing target for cross-ref 'get_data_dir' 002d21991 Make get_data/async/tmp_dir explicit 9b3ca9423 Fix decryption for broken objects ac01d186b Leave less garbage in /var/tmp bb1a2d456 Display crypto data/metadata details in swift-object-info ea8e545a2 Rebuild frags for unmounted disks 8a6159f67 Stop using duplicate dev IDs in write_fake_ring 828a241ca py3: adapt proxy base controller 43103319d encryption: Stop being cutesy with os.path.join() c6d213f82 Consolidate retry code in functest client 988e71923 py3: port object controller in proxy 90b161b74 Add content-encoding parameter to formpost middleware 3e2b8c95f Return 503 when account auto-create fails f319c412a Fix flakey symlink setup/teardown fb0e7837a Cleanup EC and SSYNC frag index parameters 2bd7b7a10 py3 object-server follow-ups dd379e7f5 func tests: Be willing to retry PUTs d3946d970 Fix flakey func test teardown 32d2af06e Fix flakey func test setup 61c9aa4bf probetests: make negative assertion more meaningful 7ed12fa6c Move KMIP conf validation out of _get_root_secret c0dbf5b88 sharding: Make replicator logging less scary b2b1f96b0 docs: clean up Object Versioning page 1f173fced s3api: fix up flakey LastModified assertions 5037ab577 Python3: fix test/unit/obj/test_replicator.py 9b6080536 py3: proxy some logger properties in LogAdapter 0e81ffd1e Fix socket leak on object-server death 066873183 Change how O_TMPFILE support is detected ca98b5b37 Quiet down a unittest c4363aa6e Python3: Fix test/unit/common/test_container_sync_realms.py 700fcc735 Remove duplicate statement 1d4309dd7 misc test cleanup ca4d6ec99 Save original index in the determine_chunk_destinations test 1d9204ac4 Use remote frag index to calculate suffix diff 5b5ed29ab py3: object server 3a8f5dbf9 Verify client input for v4 signatures 1a51604b2 s3api: Look for more indications of aws-chunked uploads b35fc4118 s3api: Delete multipart uploads via multi-delete 37693a4e1 Run ceph-s3-tests job less 0d29b01d2 py3: Port the acl, account_quotas, cname_lookup, container_sync 9856d6eb2 Add a comment about the module list for py3 in tox.ini 0f505ad96 py3: adapt the account server completely 02841ee0c fix documentation of default fcccb52ff s3api: Stop relying on container listings during multipart uploads de1c4f0d5 add an upgrade job from rocky 014511d31 s3api: Stop mangling Authorization header for v4 signatures 284bbdd39 Add slo_manifest_hook callback 43412c73d Treat all invalid frag indexes the same 53ae01b9c Modify the description content 39f6d5a5f Py3: Fix two unbound variables a563ba26f Implemented the fix to handle the HTTP request methods other than GET. Diffstat (except docs and test files) ------------------------------------- .mailmap | 2 +- .zuul.yaml | 37 +- AUTHORS | 6 +- CHANGELOG | 100 ++ api-ref/source/parameters.yaml | 2 +- etc/object-server.conf-sample | 9 + etc/proxy-server.conf-sample | 3 +- .../notes/2_15_2_release-6996eccabba558b4.yaml | 22 + .../notes/2_17_1_release-dd6e6879cbb94f85.yaml | 11 + .../notes/2_19_1_release-5072dd72557f5708.yaml | 16 + .../notes/2_21_0_release-d8ae33ef18b7be3a.yaml | 69 ++ swift/account/reaper.py | 90 +- swift/account/server.py | 23 +- swift/account/utils.py | 8 +- swift/cli/info.py | 14 + swift/cli/manage_shard_ranges.py | 24 +- swift/cli/recon.py | 5 +- swift/common/bufferedhttp.py | 8 + swift/common/constraints.py | 7 +- swift/common/container_sync_realms.py | 16 +- swift/common/db.py | 13 +- swift/common/db_replicator.py | 5 +- swift/common/exceptions.py | 4 + swift/common/middleware/bulk.py | 24 +- swift/common/middleware/copy.py | 19 +- swift/common/middleware/crypto/crypto_utils.py | 10 +- swift/common/middleware/crypto/keymaster.py | 59 +- swift/common/middleware/crypto/kmip_keymaster.py | 19 +- swift/common/middleware/dlo.py | 3 +- swift/common/middleware/formpost.py | 34 +- swift/common/middleware/proxy_logging.py | 2 + .../middleware/s3api/controllers/multi_delete.py | 26 +- .../middleware/s3api/controllers/multi_upload.py | 70 +- .../common/middleware/s3api/controllers/s3_acl.py | 2 +- swift/common/middleware/s3api/s3request.py | 75 +- swift/common/middleware/s3api/s3token.py | 19 + swift/common/middleware/slo.py | 19 +- swift/common/middleware/tempauth.py | 5 +- swift/common/middleware/versioned_writes.py | 58 +- swift/common/request_helpers.py | 46 +- swift/common/ring/ring.py | 68 +- swift/common/swob.py | 81 +- swift/common/utils.py | 78 +- swift/common/wsgi.py | 45 +- swift/container/backend.py | 20 +- swift/container/reconciler.py | 18 +- swift/container/replicator.py | 21 +- swift/container/server.py | 18 +- swift/container/sharder.py | 22 +- swift/obj/diskfile.py | 192 ++-- swift/obj/mem_diskfile.py | 3 + swift/obj/reconstructor.py | 166 +-- swift/obj/replicator.py | 6 +- swift/obj/server.py | 22 +- swift/obj/ssync_receiver.py | 19 +- swift/obj/ssync_sender.py | 23 +- swift/proxy/controllers/account.py | 6 +- swift/proxy/controllers/base.py | 79 +- swift/proxy/controllers/container.py | 19 +- swift/proxy/controllers/obj.py | 63 +- swift/proxy/server.py | 2 +- test/functional/__init__.py | 25 +- test/functional/s3api/test_multi_upload.py | 32 +- test/functional/swift_test_client.py | 168 ++-- test/functional/test_container.py | 41 +- test/functional/test_dlo.py | 5 +- test/functional/test_object.py | 34 +- test/functional/test_slo.py | 13 + test/functional/test_symlink.py | 7 +- test/probe/test_reconstructor_rebuild.py | 66 +- test/probe/test_replication_servers_working.py | 37 +- test/probe/test_sharder.py | 4 +- test/unit/__init__.py | 83 +- test/unit/account/test_reaper.py | 21 +- test/unit/account/test_server.py | 77 +- test/unit/cli/test_info.py | 145 +++ test/unit/cli/test_manage_shard_ranges.py | 67 +- .../common/middleware/crypto/test_encryption.py | 2 +- .../common/middleware/crypto/test_keymaster.py | 176 +++- .../middleware/crypto/test_kmip_keymaster.py | 58 +- test/unit/common/middleware/s3api/__init__.py | 5 +- test/unit/common/middleware/s3api/helpers.py | 5 +- .../common/middleware/s3api/test_multi_delete.py | 45 +- .../common/middleware/s3api/test_multi_upload.py | 171 ++-- test/unit/common/middleware/s3api/test_obj.py | 127 ++- test/unit/common/middleware/s3api/test_s3api.py | 31 +- .../unit/common/middleware/s3api/test_s3request.py | 80 +- test/unit/common/middleware/test_account_quotas.py | 6 +- test/unit/common/middleware/test_cname_lookup.py | 50 +- test/unit/common/middleware/test_container_sync.py | 34 +- test/unit/common/middleware/test_copy.py | 46 +- test/unit/common/middleware/test_formpost.py | 514 ++++++---- test/unit/common/middleware/test_name_check.py | 14 +- test/unit/common/middleware/test_quotas.py | 16 +- test/unit/common/middleware/test_ratelimit.py | 28 +- test/unit/common/middleware/test_read_only.py | 23 +- test/unit/common/middleware/test_recon.py | 68 +- test/unit/common/middleware/test_slo.py | 53 + test/unit/common/middleware/test_tempauth.py | 30 + .../common/middleware/test_versioned_writes.py | 2 +- test/unit/common/ring/test_ring.py | 4 + test/unit/common/test_container_sync_realms.py | 17 +- test/unit/common/test_db_replicator.py | 2 +- test/unit/common/test_swob.py | 18 + test/unit/common/test_utils.py | 86 +- test/unit/common/test_wsgi.py | 51 - test/unit/container/test_auditor.py | 12 +- test/unit/container/test_backend.py | 83 +- test/unit/container/test_reconciler.py | 22 +- test/unit/container/test_server.py | 194 ++-- test/unit/container/test_sharder.py | 73 +- test/unit/container/test_sync.py | 37 +- test/unit/container/test_updater.py | 47 +- test/unit/helpers.py | 34 +- test/unit/obj/common.py | 6 +- test/unit/obj/test_auditor.py | 44 +- test/unit/obj/test_diskfile.py | 164 +-- test/unit/obj/test_expirer.py | 3 +- test/unit/obj/test_reconstructor.py | 1058 ++++++++++++++------ test/unit/obj/test_replicator.py | 42 +- test/unit/obj/test_server.py | 839 ++++++++-------- test/unit/obj/test_ssync.py | 29 +- test/unit/obj/test_ssync_receiver.py | 35 +- test/unit/obj/test_ssync_sender.py | 44 +- test/unit/obj/test_updater.py | 24 +- test/unit/proxy/controllers/test_base.py | 80 +- test/unit/proxy/controllers/test_container.py | 5 +- test/unit/proxy/controllers/test_obj.py | 443 ++++---- test/unit/proxy/test_mem_server.py | 6 + test/unit/proxy/test_server.py | 286 ++++-- test/unit/proxy/test_sysmeta.py | 3 +- tox.ini | 51 +- 137 files changed, 5698 insertions(+), 3218 deletions(-)

1 0

manila 6.2.0 (queens)
by no-reply＠openstack.org 25 Mar '19

25 Mar '19

We are stoked to announce the release of: manila 6.2.0: Shared Storage for OpenStack This release is part of the queens stable release series. Download the package from: https://tarballs.openstack.org/manila/ For more details, please see below. 6.2.0 ^^^^^ Bug Fixes * The generic and LVM drivers have been fixed to always perform a filesystem check on newly created snapshots and derivative shares before attempting to assign a UUID to them. See Launchpad bug 1798219 (https://bugs.launchpad.net/manila/+bug/1798219) for more details. * Share type quotas, usages and reservations will now be correctly cleaned up if a share type has been deleted. See launchpad bug #1811680 (https://bugs.launchpad.net/manila/+bug/1811680) for details regarding the bug that prevented this cleanup prior. * Launchpad bug 1815038 (https://bugs.launchpad.net/manila/+bug/1815038) has been fixed and now we correctly parse the base URL from manila's endpoint url, accounting for proxy URLs. * APIs that were not returning a request ID ('x-compute-request-id') in the response headers have been fixed. * Shares backed by CephFS no longer have hard-coded mode 755. Use the "cephfs_volume_mode" configuration option to set another mode, such as 775 when using manila dynamic external storage provider with OpenShift. The default value remains 755 for backwards compatibility. * Drivers using ganesha can now handle 'manila access-allow <share- id> ip 0.0.0.0/0' as a way to allow access to the share from all IPs. * Fixed the driver filter to not check for hard equality between the share_backend_name and the name reported by the host as it defeats the purpose of the capabilities filter giving the ability to use "<in>" selection operator in the extra-spec. Refer to Launchpad bug 1815700 (https://bugs.launchpad.net/manila/+bug/1815700) for more details. Changes in manila 6.1.0..6.2.0 ------------------------------ 7c142838 Manila VMAX docs - differences between quotas 988c63ec Manila VMAX docs - improve pre-configurations on VMAX section 9ffe3901 Manila VMAX docs - clarify snapshot support e2298733 Manila VMAX docs - clarify driver_handles_share_servers 9f987871 VMAX manila doc - SSL Support d10334e1 VMAX manila doc - use of correct VMAX tags c75d48c0 Fix driver filter to not check share_backend_name c9f95411 Destroy type quotas when a share type is deleted 07c48099 Fix API version inferred w/ un-versioned URLs 587a1b2a Fix version selector when for proxy-style URLs 4bfff605 Extend remove_version_from_href support 534aed13 Return request-id to APIs that don't respond with a body 00bd9230 Port dummy driver manage/unmanage changes to stable e9e4a3a6 [LVM] Run filesystem check before assigning UUID 5bfe7f33 Fix service image boot issues 1fa04f15 add tripleo scenario004 to experimental queue cf98b959 Set mode for CephFS volumes and snapshots 4de31175 Bump timeout on dsvm jobs 40792c69 Fix ganesha for 0.0.0.0/0 access 13f121ad Only run the needed services for CephFS jobs Diffstat (except docs and test files) ------------------------------------- .zuul.yaml | 21 +- devstack/settings | 4 +- .../drivers/dell-emc-vmax-driver.rst | 301 ++++++++++++++++++--- etc/manila/rootwrap.d/share.filters | 4 +- manila/api/common.py | 15 +- manila/api/openstack/wsgi.py | 10 +- manila/db/api.py | 9 +- manila/db/sqlalchemy/api.py | 51 ++-- manila/quota.py | 4 +- manila/scheduler/filters/driver.py | 16 +- manila/share/drivers/cephfs/driver.py | 27 +- manila/share/drivers/ganesha/__init__.py | 4 + manila/share/drivers/ganesha/utils.py | 13 + manila/share/drivers/generic.py | 3 + manila/share/drivers/lvm.py | 20 +- .../run.yaml | 2 + .../run.yaml | 2 + ...on-lvm-and-generic-driver-55e349e02e7fa370.yaml | 8 + ...-when-deleting-share-type-a18f2e00a65fe922.yaml | 7 + ...version_from_href-support-ea479daaaf5c5700.yaml | 6 + ...ly-request-id-in-all-apis-74419bc1b1feea1e.yaml | 4 + ...case-of-proxy-urls-e33466af856708b4.yaml\t\t\t" | 7 + .../notes/cephfs-set-mode-b7fb3ec51300c220.yaml | 8 + ...-allow-access-for-all-ips-09773a79dc76ad44.yaml | 6 + .../fixing-driver-filter-14022294c8c04d2d.yaml | 8 + 43 files changed, 880 insertions(+), 217 deletions(-)

1 0

heat-dashboard 1.0.3 (queens)
by no-reply＠openstack.org 25 Mar '19

25 Mar '19

We are happy to announce the release of: heat-dashboard 1.0.3: Heat Management Dashboard This release is part of the queens stable release series. The source is available from: http://git.openstack.org/cgit/openstack/heat-dashboard Download the package from: https://tarballs.openstack.org/heat-dashboard/ Please report issues through launchpad: http://bugs.launchpad.net/heat-dashboard For more details, please see below. Changes in heat-dashboard 1.0.2..1.0.3 -------------------------------------- d8b3a94 import zuul job settings from project-config 66d3844 Imported Translations from Zanata 7847636 Update UPPER_CONSTRAINTS_FILE for stable/queens fe6e30c Update .gitreview for stable/queens Diffstat (except docs and test files) ------------------------------------- .gitreview | 2 +- .zuul.yaml | 7 +++ heat_dashboard/locale/en_AU/LC_MESSAGES/django.po | 8 +-- heat_dashboard/locale/en_GB/LC_MESSAGES/django.po | 6 +-- .../locale/en_GB/LC_MESSAGES/djangojs.po | 8 +-- heat_dashboard/locale/ko_KR/LC_MESSAGES/django.po | 6 +-- .../locale/ko_KR/LC_MESSAGES/djangojs.po | 8 +-- heat_dashboard/locale/pl_PL/LC_MESSAGES/django.po | 8 +-- heat_dashboard/locale/pt_BR/LC_MESSAGES/django.po | 6 +-- .../locale/pt_BR/LC_MESSAGES/djangojs.po | 6 +-- heat_dashboard/locale/tr_TR/LC_MESSAGES/django.po | 8 +-- heat_dashboard/locale/zh_CN/LC_MESSAGES/django.po | 6 +-- .../locale/zh_CN/LC_MESSAGES/djangojs.po | 6 +-- heat_dashboard/locale/zh_TW/LC_MESSAGES/django.po | 8 +-- .../locale/en_GB/LC_MESSAGES/releasenotes.po | 61 --------------------- .../source/locale/id/LC_MESSAGES/releasenotes.po | 61 --------------------- .../source/locale/ja/LC_MESSAGES/releasenotes.po | 60 --------------------- .../locale/ko_KR/LC_MESSAGES/releasenotes.po | 63 ---------------------- .../locale/pt_BR/LC_MESSAGES/releasenotes.po | 61 --------------------- tools/tox_install.sh | 4 ++ tox.ini | 2 +- 21 files changed, 55 insertions(+), 350 deletions(-)

1 0

heat-agents 1.5.4 (queens)
by no-reply＠openstack.org 25 Mar '19

25 Mar '19

We enthusiastically announce the release of: heat-agents 1.5.4: heat-agents This release is part of the queens stable release series. Download the package from: https://tarballs.openstack.org/heat-agents/ For more details, please see below. Changes in heat-agents 1.5.3..1.5.4 ----------------------------------- 961bb35 Add region_name for heat-config-notify 3aac319 Use upper-constraints in tox tests 77ddce8 import zuul job settings from project-config ecf43c7 Update .gitreview for stable/queens Diffstat (except docs and test files) ------------------------------------- .gitreview | 1 + .zuul.yaml | 7 +++++++ heat-config/bin/heat-config-notify | 6 ++++-- heat-config/os-apply-config/etc/os-collect-config.conf | 2 ++ tox.ini | 1 + 6 files changed, 20 insertions(+), 3 deletions(-)

1 0

python-heatclient 1.14.1 (queens)
by no-reply＠openstack.org 25 Mar '19

25 Mar '19

We are satisfied to announce the release of: python-heatclient 1.14.1: OpenStack Orchestration API Client Library This release is part of the queens stable release series. The source is available from: https://git.openstack.org/cgit/openstack/python-heatclient Download the package from: https://pypi.org/project/python-heatclient Please report issues through launchpad: https://bugs.launchpad.net/python-heatclient For more details, please see below. Changes in python-heatclient 1.14.0..1.14.1 ------------------------------------------- 034e6dd Set Content-Type header explictly for SessionClient 2557c39 import zuul job settings from project-config 4005e52 Update UPPER_CONSTRAINTS_FILE for stable/queens 965a8b5 Update .gitreview for stable/queens Diffstat (except docs and test files) ------------------------------------- .gitreview | 1 + .zuul.yaml | 13 +++++++++++-- heatclient/common/http.py | 3 +++ tox.ini | 2 +- 5 files changed, 22 insertions(+), 5 deletions(-)

1 0

python-heatclient 1.16.2 (rocky)
by no-reply＠openstack.org 25 Mar '19

25 Mar '19

We are glad to announce the release of: python-heatclient 1.16.2: OpenStack Orchestration API Client Library This release is part of the rocky stable release series. The source is available from: https://git.openstack.org/cgit/openstack/python-heatclient Download the package from: https://pypi.org/project/python-heatclient Please report issues through launchpad: https://bugs.launchpad.net/python-heatclient For more details, please see below. Changes in python-heatclient 1.16.1..1.16.2 ------------------------------------------- 951b50f Set Content-Type header explictly for SessionClient 47d27b2 import zuul job settings from project-config 310b034 Update UPPER_CONSTRAINTS_FILE for stable/rocky 99cdad0 Update .gitreview for stable/rocky Diffstat (except docs and test files) ------------------------------------- .gitreview | 1 + .zuul.yaml | 10 ++++++++++ heatclient/common/http.py | 3 +++ tox.ini | 6 +++--- 5 files changed, 23 insertions(+), 5 deletions(-)

1 0

heat-agents 1.4.1 (pike)
by no-reply＠openstack.org 25 Mar '19

25 Mar '19

We are ecstatic to announce the release of: heat-agents 1.4.1: heat-agents This release is part of the pike stable release series. Download the package from: https://tarballs.openstack.org/heat-agents/ For more details, please see below. Changes in heat-agents 1.4.0..1.4.1 ----------------------------------- 9751edd import zuul job settings from project-config 1a89d63 Fix heat docker agent tests ff31eb2 Update .gitreview for stable/pike Diffstat (except docs and test files) ------------------------------------- .gitreview | 1 + .zuul.yaml | 7 + 3 files changed, 306 insertions(+), 308 deletions(-)

1 0

heat-dashboard 1.4.1 (rocky)
by no-reply＠openstack.org 25 Mar '19

25 Mar '19

We are gleeful to announce the release of: heat-dashboard 1.4.1: Heat Management Dashboard This release is part of the rocky stable release series. The source is available from: https://git.openstack.org/cgit/openstack/heat-dashboard Download the package from: https://tarballs.openstack.org/heat-dashboard/ Please report issues through launchpad: https://bugs.launchpad.net/heat-dashboard For more details, please see below. Changes in heat-dashboard 1.4.0..1.4.1 -------------------------------------- bd6f0b6 Imported Translations from Zanata 99993e4 Sync lower-constraints with Horizon 6238718 Imported Translations from Zanata 55546ea Update UPPER_CONSTRAINTS_FILE for stable/rocky 1cb1042 Update .gitreview for stable/rocky Diffstat (except docs and test files) ------------------------------------- .gitreview | 2 +- heat_dashboard/locale/de/LC_MESSAGES/djangojs.po | 49 +- heat_dashboard/locale/eo/LC_MESSAGES/django.po | 625 +++++++++++++++++++++ heat_dashboard/locale/eo/LC_MESSAGES/djangojs.po | 111 ++++ heat_dashboard/locale/fr/LC_MESSAGES/django.po | 45 +- heat_dashboard/locale/fr/LC_MESSAGES/djangojs.po | 98 ---- heat_dashboard/locale/ja/LC_MESSAGES/djangojs.po | 12 +- heat_dashboard/locale/zh_CN/LC_MESSAGES/django.po | 15 +- .../locale/zh_CN/LC_MESSAGES/djangojs.po | 62 +- lower-constraints.txt | 10 +- .../source/locale/de/LC_MESSAGES/releasenotes.po | 99 ---- .../locale/en_GB/LC_MESSAGES/releasenotes.po | 94 ---- .../source/locale/id/LC_MESSAGES/releasenotes.po | 95 ---- .../source/locale/ja/LC_MESSAGES/releasenotes.po | 63 --- .../locale/ko_KR/LC_MESSAGES/releasenotes.po | 96 ---- .../locale/pt_BR/LC_MESSAGES/releasenotes.po | 95 ---- tox.ini | 6 +- 17 files changed, 827 insertions(+), 750 deletions(-)

1 0

nova 18.2.0 (rocky)
by no-reply＠openstack.org 25 Mar '19

25 Mar '19

We jubilantly announce the release of: nova 18.2.0: Cloud computing fabric controller This release is part of the rocky stable release series. Download the package from: https://tarballs.openstack.org/nova/ For more details, please see below. 18.2.0 ^^^^^^ Upgrade Notes ************* * Adds a "use_cache" parameter to the virt driver "get_info" method. Out of tree drivers should add support for this parameter. * Live migration of instances with NUMA topologies is now disabled by default when using the libvirt driver. This includes live migration of instances with CPU pinning or hugepages. CPU pinning and huge page information for such instances is not currently re- calculated, as noted in bug #1289064. This means that if instances were already present on the destination host, the migrated instance could be placed on the same dedicated cores as these instances or use hugepages allocated for another instance. Alternately, if the host platforms were not homogeneous, the instance could be assigned to non-existent cores or be inadvertently split across host NUMA nodes. The long term solution to these issues is to recalculate the XML on the destination node. When this work is completed, the restriction on live migration with NUMA topologies will be lifted. For operators that are aware of the issues and are able to manually work around them, the "[workarounds] enable_numa_live_migration" option can be used to allow the broken behavior. For more information, refer to bug #1289064. (https://bugs.launchpad.net/nova/+bug/1289064) (https://blueprints.launchpad.net/nova/+spec/numa-aware-live- migration) Bug Fixes ********* * "PUT /os-aggregates/{aggregate_id}" and "POST /os- aggregates/{aggregate_id}/action" (for set_metadata action) will now return HTTP 400 for availability zone renaming if the hosts of the aggregate have any instances. * Fixes a race condition that could allow a newly created Ironic instance to be powered off after deployment, without letting the user power it back on. * [bug 1818295 (https://bugs.launchpad.net/nova/+bug/1818295) Fixes the problem with endpoint lookup in Ironic driver where only public endpoint is possible, which breaks deployments where the controllers have no route to the public network per security requirement. Note that python-ironicclient fix I610836e5038774621690aca88b2aee25670f0262 must also be present to resolve the bug. Other Notes *********** * The "[workarounds]/ensure_libvirt_rbd_instance_dir_cleanup" configuration option has been introduced. This can be used by operators to ensure that instance directories are always removed during cleanup within the Libvirt driver while using "[libvirt]/images_type = rbd". This works around known issues such as bug 1414895 when cleaning up after an evacuation and bug 1761062 when reverting from an instance resize. Operators should be aware that this workaround only applies when using the libvirt compute driver and rbd images_type as enabled by the following configuration options: * "[DEFAULT]/compute_driver = libvirt" * "[libvirt]/images_type = rbd" Warning: Operators will need to ensure that the instance directory itself, specified by "[DEFAULT]/instances_path", is not shared between computes before enabling this workaround, otherwise files associated with running instances may be removed. (https://bugs.launchpad.net/nova/+bug/1414895) (https://bugs.launchpad.net/nova/+bug/1761062) Changes in nova 18.1.0..18.2.0 ------------------------------ 02d6146e4d Fix resetting non-persistent fields when saving obj 133763d358 Update instance.availability_zone during live migration d4cea970c2 pass endpoint interface to Ironic client 7d0dd625d3 Allow utime call to fail on qcow2 image base file cfad7a1faa Handle templated cell mappings in nova-status 50cc1e8bb6 Handle missing exception in instance creation code 31b74bfa40 Fix WeighedHost logging regression 1559db5704 Check hosts have no instances for AZ rename e2185168f8 Fix an error when generating a host ID b09f2e58e9 Fix resource tracker updates during instance evacuation 81b0e5a068 ironic: check fresh data when sync_power_state doesn't line up 4ede352811 ironic: stop hammering ironic API in power sync loop 40771bc155 Fix race in test_volume_swap_server_with_error ecdf3c67ee fix up numa-topology live migration hypervisor check 32a77abbfc Move legacy-grenade-dsvm-neutron-multinode-live-migration in-tree c4a2a32f07 Fix legacy-grenade-dsvm-neutron-multinode-live-migration 35a050a520 Avoid BadRequest error log on volume attachment 0794345ecd Don't emit warning when ironic properties are zero 3310c3cbf5 Lock detach_volume a4017aaa53 Fix a missing policy in test policy data 315d9fab7a Provide a useful error message when trying to update non-compute services 1a684f6fbe Ignore VolumeAttachmentNotFound exception in compute.manager 99f0c4c014 tox: Don't write byte code (maybe) 75e0f5a9b1 Avoid redundant initialize_connection on source post live migration cb65d3d69c Fix InstanceMapping to always default queued_for_delete=False 9f9f372f33 PCI: do not force remove allocated devices 218c0f5f97 Use X-Forwarded-Proto as origin protocol if present e7dc43bf84 Don't call begin_detaching when detaching volume from shelved vm d2662df485 Fix port dns_name reset 1ac56a4038 Skip checking of target_dev for vhostuser 780ccfcbde Fix overcommit for NUMA-based instances 444d65221c Fix typo a0f5618ffa Fix using template cell urls with nova-manage ba269da87a Convert port to str when validate console port 6061186d2d Fix incompatible version handling in BuildRequest 6e1120ae30 Send context.global_id on neutron calls 8c678ae572 libvirt: Add workaround to cleanup instance dir when using rbd 7a0203c9ad Restore nova-consoleauth to install docs e54b064c91 Add links to summit videos in user/cells.rst 99bf929024 Removing pip-missing-reqs from default tox jobs eea3de99c6 Imported Translations from Zanata f5d8ee1bfc Ensure rbd auth fallback uses matching credentials 56778f82d6 Fix destination_type attribute in the bdm_v2 documentation 87be408b12 Fix a broken link 3eb0ba988f Exclude build request marker from server listing 44d405083d Fix a broken-link in nova doc c4db57c3de Fix a broken-link in nova doc ec91a66da4 Fix an inaccurate link in nova doc 3b18ab4b32 Document using service user tokens for long running operations bc0a5d0355 Handle unbound vif plug errors on compute restart 3e38d1cf16 Update port device_owner when unshelving 52b8973442 Fail to live migration if instance has a NUMA topology db6fc29ad2 Make compute rpcapi version calculation check all cells a8b5d0c2bd Migrate nova v2.0 legacy job to zuulv3 Diffstat (except docs and test files) ------------------------------------- .zuul.yaml | 71 ++++++--- .../admin/migrate-instance-with-snapshot.rst | 4 + nova/api/openstack/compute/instance_actions.py | 9 +- nova/api/openstack/compute/migrate_server.py | 6 +- nova/api/openstack/compute/servers.py | 1 + nova/api/openstack/compute/services.py | 11 +- nova/cmd/manage.py | 4 +- nova/cmd/status.py | 61 +++++--- nova/compute/api.py | 38 ++++- nova/compute/manager.py | 157 +++++++++++++------ nova/compute/resource_tracker.py | 5 +- nova/compute/rpcapi.py | 11 +- nova/compute/task_states.py | 7 + nova/conductor/tasks/live_migrate.py | 34 ++++ nova/conf/compute.py | 4 + nova/conf/libvirt.py | 1 + nova/conf/workarounds.py | 58 +++++++ nova/console/websocketproxy.py | 7 + nova/locale/ko_KR/LC_MESSAGES/nova.po | 11 +- nova/network/neutronv2/api.py | 61 +++++++- nova/network/os_vif_util.py | 12 ++ nova/objects/build_request.py | 10 +- nova/objects/cell_mapping.py | 8 +- nova/objects/instance.py | 11 ++ nova/objects/instance_mapping.py | 5 + nova/objects/migrate_data.py | 2 + nova/objects/numa.py | 17 +- nova/objects/request_spec.py | 13 ++ nova/pci/manager.py | 35 ++++- nova/scheduler/filter_scheduler.py | 5 +- .../functional/regressions/test_bug_1815153.py | 173 +++++++++++++++++++++ .../openstack/compute/admin_only_action_common.py | 36 ++++- .../api/openstack/compute/test_flavor_manage.py | 5 +- .../api/openstack/compute/test_instance_actions.py | 63 +++++++- .../api/openstack/compute/test_migrate_server.py | 8 +- .../unit/api/openstack/compute/test_serversV21.py | 14 +- .../unit/api/openstack/compute/test_services.py | 14 +- .../unit/conductor/tasks/test_live_migrate.py | 55 ++++++- nova/virt/driver.py | 7 +- nova/virt/fake.py | 2 +- nova/virt/hardware.py | 23 ++- nova/virt/hyperv/driver.py | 2 +- nova/virt/ironic/client_wrapper.py | 6 + nova/virt/ironic/driver.py | 46 +++--- nova/virt/libvirt/driver.py | 52 ++----- nova/virt/libvirt/guest.py | 5 +- nova/virt/libvirt/imagebackend.py | 32 +++- nova/virt/libvirt/volume/net.py | 5 +- nova/virt/powervm/driver.py | 3 +- nova/virt/vmwareapi/driver.py | 2 +- nova/virt/xenapi/driver.py | 2 +- nova/virt/zvm/driver.py | 2 +- nova/volume/cinder.py | 15 +- .../legacy/nova-grenade-live-migration/post.yaml | 15 ++ .../legacy/nova-grenade-live-migration/run.yaml | 58 +++++++ ...1378904-disable-az-rename-b22a558a20b12706.yaml | 7 + .../notes/bug-1414895-8f7d8da6499f8e94.yaml | 24 +++ .../notes/bug-1815791-f84a913eef9e3b21.yaml | 11 ++ ...-live-migration-with-numa-bc710a1bcde25957.yaml | 25 +++ ...nterface-for-ironicclient-a0b6b8f8dedc7341.yaml | 9 ++ tox.ini | 5 +- 108 files changed, 2326 insertions(+), 452 deletions(-)

1 0

nova 17.0.10 (queens)
by no-reply＠openstack.org 25 Mar '19

25 Mar '19

We eagerly announce the release of: nova 17.0.10: Cloud computing fabric controller This release is part of the queens stable release series. Download the package from: https://tarballs.openstack.org/nova/ For more details, please see below. 17.0.10 ^^^^^^^ Bug Fixes ********* * The "os-simple-tenant-usage" pagination has been fixed. In some cases, nova usage-list would have returned incorrect results because of this. See bug https://launchpad.net/bugs/1796689 for details. Other Notes *********** * The "[workarounds]/ensure_libvirt_rbd_instance_dir_cleanup" configuration option has been introduced. This can be used by operators to ensure that instance directories are always removed during cleanup within the Libvirt driver while using "[libvirt]/images_type = rbd". This works around known issues such as bug 1414895 when cleaning up after an evacuation and bug 1761062 when reverting from an instance resize. Operators should be aware that this workaround only applies when using the libvirt compute driver and rbd images_type as enabled by the following configuration options: * "[DEFAULT]/compute_driver = libvirt" * "[libvirt]/images_type = rbd" Warning: Operators will need to ensure that the instance directory itself, specified by "[DEFAULT]/instances_path", is not shared between computes before enabling this workaround, otherwise files associated with running instances may be removed. (https://bugs.launchpad.net/nova/+bug/1414895) (https://bugs.launchpad.net/nova/+bug/1761062) Changes in nova 17.0.9..17.0.10 ------------------------------- 3bd7293dac Fix resource tracker updates during instance evacuation 2b1544390c Allow utime call to fail on qcow2 image base file b7bf1fbe49 libvirt: Add workaround to cleanup instance dir when using rbd fee13a41c7 Add description of custom resource classes bc2c3359b3 Fix WeighedHost logging regression 8f7b778f82 Avoid BadRequest error log on volume attachment b041160c8d Provide a useful error message when trying to update non-compute services e46019a6e5 Don't emit warning when ironic properties are zero 013f421bca Avoid redundant initialize_connection on source post live migration 6933c880b8 Make host_manager use scatter-gather and ignore down cells b7237a9e6c Make service all-cells min version helper use scatter-gather 17b3d5734a Lock detach_volume b176013b7b Fix a missing policy in test policy data 4c127db2f3 Handle unicode characters in migration params df24e3b9c8 tox: Don't write byte code (maybe) 8369a78af0 Handle IndexError in _populate_neutron_binding_profile 955ecf26c5 PCI: do not force remove allocated devices e5e929f019 Fix port dns_name reset 7c85ebad0b Fix incompatible version handling in BuildRequest b8704a1d1c Don't call begin_detaching when detaching volume from shelved vm 6d38ba1589 Skip checking of target_dev for vhostuser 2e3f30ac4d Migrate nova v2.0 legacy job to zuulv3 70b4cdce68 Fix os-simple-tenant-usage result order dcd7a30c95 Send context.global_id on neutron calls 187ad17728 Removing pip-missing-reqs from default tox jobs 16b2a56005 Do not dump all instances in the scheduler 8aadd4ebdf Exclude build request marker from server listing 051a6690ce Remove stale pip-missing-reqs tox test accef50f96 Ensure rbd auth fallback uses matching credentials 14e69e0591 Fix destination_type attribute in the bdm_v2 documentation 79a90d3702 Handle unbound vif plug errors on compute restart 245364ece1 Update port device_owner when unshelving 4827cedbc5 Handle binding_failed vif plug errors on compute restart a29a3c9cb1 Don't persist RequestSpec.requested_destination fa178ed4e5 Handle tags in _bury_in_cell0 5c7638bab4 Note the aggregate allocation ratio restriction in scheduler docs 6c7e53e210 Fix InstanceNotFound during _destroy_evacuated_instances c3fd5e5061 Add functional regression test for bug 1794996 7827890421 Explicitly fail if trying to attach SR-IOV port 437211bf37 Null out instance.availability_zone on shelve offload Diffstat (except docs and test files) ------------------------------------- .zuul.yaml | 17 +- .../v2.40/simple-tenant-usage-get-all.json | 68 ++++++++ .../instance-shelve_offload-end.json | 2 +- nova/api/openstack/compute/servers.py | 3 + nova/api/openstack/compute/services.py | 11 +- nova/api/openstack/compute/simple_tenant_usage.py | 3 +- nova/compute/api.py | 18 ++- nova/compute/manager.py | 86 +++++++--- nova/compute/resource_tracker.py | 5 +- nova/compute/task_states.py | 7 + nova/conductor/manager.py | 15 +- nova/conf/compute.py | 4 + nova/conf/libvirt.py | 1 + nova/conf/workarounds.py | 30 ++++ nova/exception.py | 6 + nova/network/neutronv2/api.py | 106 ++++++++++-- nova/network/os_vif_util.py | 26 +++ nova/objects/build_request.py | 10 +- nova/objects/migrate_data.py | 2 + nova/objects/request_spec.py | 8 +- nova/objects/service.py | 73 +++++++-- nova/pci/manager.py | 35 +++- nova/scheduler/filter_scheduler.py | 5 +- nova/scheduler/host_manager.py | 40 +++-- .../v2.40/simple-tenant-usage-get-all.json.tpl | 68 ++++++++ .../functional/regressions/test_bug_1794996.py | 179 +++++++++++++++++++++ .../functional/regressions/test_bug_1797580.py | 8 +- .../functional/regressions/test_bug_1806515.py | 69 ++++++++ .../api/openstack/compute/test_flavor_manage.py | 5 +- .../unit/api/openstack/compute/test_services.py | 14 +- .../api_samples_test_base/test_compare_result.py | 2 +- nova/virt/ironic/driver.py | 15 -- nova/virt/libvirt/driver.py | 49 ++---- nova/virt/libvirt/guest.py | 9 +- nova/virt/libvirt/imagebackend.py | 32 +++- nova/virt/libvirt/volume/net.py | 5 +- nova/volume/cinder.py | 15 +- .../notes/bug-1414895-8f7d8da6499f8e94.yaml | 24 +++ ...e-tenant-usage-pagination-393ed6e7d0e31594.yaml | 6 + tox.ini | 13 +- 68 files changed, 1526 insertions(+), 336 deletions(-)

1 0

puppet-pacemaker 0.7.2
by no-reply＠openstack.org 25 Mar '19

25 Mar '19

We jubilantly announce the release of: puppet-pacemaker 0.7.2: Puppet module for Pacemaker Download the package from: https://tarballs.openstack.org/puppet-pacemaker/ For more details, please see below. 0.7.2 ^^^^^ New Features * A new 'deep_compare' parameter has been added to the pacemaker::resource::* classes (defaulting to false). By default pacemaker does not update resources and will keep doing so. This happens for a number of mostly historical reasons (old non HA-NG OSP releases had way too many relationships between pacemaker resources and puppet-triggered restart would cause havoc on the overcloud, also lack of the code for doing this in puppet-pacemaker was a factor). When set to true additional code comparison logic will be triggered and we will actually update pacemaker resources. We do so by modifying an offline CIB with the manifests resources and then running crm_simulate on it in order to determine if pacemaker would trigger a restart of the resource if the CIB was to be pushed for real on to the cluster. We currently cannot use crm_diff due to a bug where it would trigger too many false positives. Using crm_simulate has one small side-effect. Namely, changes in resource operation timeouts normally do not trigger a resource restart and hence they won't update a resource. Also note that this is currently only supported for resources and bundles (not constraints not stonith resources). Changes in puppet-pacemaker 0.7.1..0.7.2 ---------------------------------------- 5f79695 Release 0.7.2 5deba12 Make the redfish stonith agent a manual agent and add two workaround bc7b472 Add fence-redfish support 306b0e0 Initial support for properties managed by pcs 0.10 c7b21ee Initial pcs 0.10 support 002b848 Modify puppet version 4 to 5 93482ad Add cluster_members_addr parameter to specify ip addresses used in cluster setup 7b55ac3 Fix up ordering of remote authkeys and a couple of pcs commands 6632d50 Match node properties more strictly 5800e93 Remove unneeded spec testing file c2aa846 Deprecate include_class b2744d3 Fix container_backend customizability 2fb9ce4 Fix stdlib version in metadata fafb72f Skip some tests for Ubuntu 18.04 and puppet 4.8. 90033be Improve deep_compare detection a31971d Update min tox version to 2.0 ece92d1 Fix reconnect_interval parameter 9a4bc2d Dissuade .gitignore references to personal tools 48bb89e Also consider podman containers when running facter 1320c38 Rely on path for CLI calls when possible cbcf2b3 Remove the duplicated "the" 1cc8417 Update overriden to overridden 7a73e8d Fix container_backend issues on update ecd3c1f switch documentation job to new PTI 123646b import zuul job settings from project-config a451c3d Add 'Development' in README e400b7b Abstract container backend 533dad0 Remove PE requirement from metadata.json 205191e Deep_compare fix with location constraints and better debugging cd20731 Initial support for adding cluster nodes to an existing cluster 8d09c3f Remove the pcmk_is_remote fact a82e355 Pin net-telnet to 0.1.1 8b2c014 Add the project source code repository in README 9fe625a Fix rspec test on ubuntu os. 475f65f Revert "Initial support for adding cluster nodes to an existing cluster" 966943a Do not call crm_node -n when running in a container 9c9c36b Fix OS versions in metadata 03391e0 Initial support for adding cluster nodes to an existing cluster d465e25 Use crm_diff for pcmk resource deep_compare 4b14fe1 Introduce a function to verify for fixed crm_diff 8695d6f Fix a small race window when setting up pcmk remotes 354d2db fix tox python3 overrides c0fb9ae fix error url 2bdb6f1 Move the tests around so pcmk_resource_has_changed? does not get triggered 99b7eb0 Fix missing pass-through of cluster_auth_enabled parameter 44ef58f Detect when a bundle or a resource needs updating 8df2e01 Add a deep_compare option in bundles and resources da4673f Introduce some new functions in pcmk_common 77ba104 Work around ruby 2.5 dropping Dir::Tmpname.make_tmpname ec5e694 Wrap the logic for creating resource and location_rule in its own function 52e85b0 Change resource/location exists return code and store their return codes in a class instance variable 6388e3f Move location_rule build to a common function 80667cc Add serverspec to Gemfile c3e09a6 Wrap pcs command generation into their own functions 24d465a Wrap the cib file deletion commands in a function faf5d4f Drop ubuntu 14.04 from spec tests faa731b Fix up error code path bde4061 Allow meta_params and op_params on resource::ip 2d24201 Follow the new PTI for document build 63016fa Add .tox/ to .gitignore 256d592 Add a pcsd_debug option Diffstat (except docs and test files) ------------------------------------- .gitignore | 14 +- .zuul.yaml | 1 + Gemfile | 3 +- README.md | 7 +- agent_generator/src_xml/fence_redfish.xml | 182 ++++++++++ agent_generator/variables.sh | 3 + bindep.txt | 4 + test-requirements.txt => doc/requirements.txt | 0 lib/facter/pacemaker_node_name.rb | 9 +- lib/facter/pcmk_is_remote.rb | 8 - .../parser/functions/pacemaker_cluster_nodes.rb | 8 +- .../functions/pacemaker_resource_parameters.rb | 1 + lib/puppet/parser/functions/pcmk_cluster_setup.rb | 62 ++++ lib/puppet/parser/functions/pcmk_nodes_added.rb | 54 +++ lib/puppet/provider/pcmk_bundle/default.rb | 167 ++++++--- lib/puppet/provider/pcmk_common.rb | 388 ++++++++++++++++++++- lib/puppet/provider/pcmk_property/default.rb | 50 ++- lib/puppet/provider/pcmk_resource/default.rb | 123 ++++--- lib/puppet/type/pcmk_bundle.rb | 31 ++ lib/puppet/type/pcmk_resource.rb | 27 ++ manifests/corosync.pp | 102 +++++- manifests/new.pp | 31 +- manifests/new/wrapper.pp | 2 +- manifests/params.pp | 7 + manifests/resource/bundle.pp | 18 + manifests/resource/filesystem.pp | 17 + manifests/resource/ip.pp | 28 ++ manifests/resource/lsb.pp | 16 + manifests/resource/ocf.pp | 15 + manifests/resource/remote.pp | 16 + manifests/resource/route.pp | 16 + manifests/resource/service.pp | 16 + manifests/resource/systemd.pp | 16 + manifests/stonith/fence_redfish.pp | 343 ++++++++++++++++++ metadata.json | 15 +- .../notes/update-resources-ae2ef4f9e75e8699.yaml | 16 + spec/classes/coverage_spec.rb | 3 - spec/classes/pacemaker_service_spec.rb | 49 +-- spec/classes/pacemaker_spec.rb | 26 +- spec/defines/pacemaker_contain_spec.rb | 2 - spec/functions/pacemaker_cluster_nodes_spec.rb | 1 - spec/functions/pcmk_cluster_setup_spec.rb | 41 +++ spec/functions/pcmk_nodes_added_spec.rb | 31 ++ spec/unit/puppet/provider/cib-orig.xml | 238 +++++++++++++ spec/unit/puppet/provider/pcmk_common_spec.rb | 76 ++++ tox.ini | 5 +- 46 files changed, 2050 insertions(+), 238 deletions(-)

1 0

sushy-tools 0.5.0
by no-reply＠openstack.org 22 Mar '19

22 Mar '19

We are pumped to announce the release of: sushy-tools 0.5.0: A set of tools to support the development and test of the Sushy library (https://docs.openstack.org/sushy/) The source is available from: http://git.openstack.org/cgit/openstack/sushy-tools Download the package from: https://tarballs.openstack.org/sushy-tools/ Please report issues through launchpad: https://storyboard.openstack.org/#!/project/openstack/sushy-tools For more details, please see below. Changes in sushy-tools 0.4.0..0.5.0 ----------------------------------- 0a74170 Fix broken Systems listing in dynamic emulator b13ea4e Add memoization to expensive emulator calls 2709e7b Move to zuulv3 7152f1d Limit instances exposure 9bfc0c2 Add configurable libvirt firmware beeda95 Update default templates for docs builds 232564a Update home-page ff4e7f4 Add configuration file to sushy-emulator 68fa8d9 Remove support for py34 b356171 Fix copyright statement 499536a Redirect to UUID URLs a7d8302 Fix libvirt driver to handle domains by UUID ef0d049 Change openstack-dev to openstack-discuss 2091c28 Add release notes generation 80916f4 Fix nova driver to report on unsupported call cc0bd13 Escape JSON rendered in templates a7d29fd Rename SUSHY_EMULATOR_LIBVIRT_URL environment variable 50d3c1d Rearrange emulator unit tests dc2e5dc Fix HTTP response code on errors c5bf616 Fix wrong `set_server_metadata` args c09ce2c Fix UEFI firmware path and connection attribute in libvirt driver 483fefe Make external dependencies optional 7aaa76d Rename `glance` for `image` service in openstacksdk d46e964 Update the URL in HACKING.rst 9770851 fix bug link in readme 4fc7477 Bump hacking version to 1.0 (capped by 1.2) 3f15ec9 Support EthernetInterface resource in the emulator 92235d3 add python 3.6 unit test job 16dede3 import zuul job settings from project-config Diffstat (except docs and test files) ------------------------------------- HACKING.rst | 2 +- README.rst | 2 +- lower-constraints.txt | 2 + .../post.yaml | 15 - .../run.yaml | 139 ------- releasenotes/notes/.placeholder | 0 releasenotes/source/_static/.placeholder | 0 releasenotes/source/_templates/.placeholder | 0 releasenotes/source/conf.py | 277 ++++++++++++++ releasenotes/source/index.rst | 8 + releasenotes/source/unreleased.rst | 5 + requirements.txt | 2 - setup.cfg | 5 +- sushy_tools/emulator/drivers/base.py | 43 ++- sushy_tools/emulator/drivers/libvirtdriver.py | 399 +++++++++++++-------- sushy_tools/emulator/drivers/memoize.py | 56 +++ sushy_tools/emulator/drivers/novadriver.py | 123 +++++-- sushy_tools/emulator/main.py | 259 +++++++++---- sushy_tools/emulator/templates/bios.json | 8 +- sushy_tools/emulator/templates/bios_settings.json | 2 +- sushy_tools/emulator/templates/error.json | 2 +- .../emulator/templates/ethernet_interface.json | 9 + .../templates/ethernet_interfaces_collection.json | 17 + sushy_tools/emulator/templates/system.json | 28 +- .../emulator/templates/system_collection.json | 2 +- sushy_tools/error.py | 4 + test-requirements.txt | 8 +- tox.ini | 5 + zuul.d/legacy-sushy-tools-jobs.yaml | 24 -- zuul.d/project.yaml | 16 +- zuul.d/sushy-tools-jobs.yaml | 15 + 40 files changed, 1871 insertions(+), 769 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 694a40f..adfca57 100644 --- a/requirements.txt +++ b/requirements.txt @@ -7,2 +6,0 @@ Flask>=1.0.2 # BSD -libvirt-python!=4.1.0,>=3.5.0 # LGPLv2+ -openstacksdk>=0.11.2 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index dedd86b..3fd4307 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -5 +5 @@ -hacking!=0.13.0,<0.14,>=0.12.0 # Apache-2.0 +hacking>=1.0.0,<1.2.0 # Apache-2.0 @@ -7,0 +8,2 @@ coverage!=4.4,>=4.0 # Apache-2.0 +# used by libvirt driver +libvirt-python!=4.1.0,>=3.5.0 # LGPLv2+ @@ -10,0 +13,2 @@ openstackdocstheme>=1.18.1 # Apache-2.0 +# used by nova driver +openstacksdk>=0.11.2 # Apache-2.0 @@ -14,0 +19,2 @@ testtools>=2.2.0 # MIT +munch>=2.1.0 # MIT +reno>=2.5.0 # Apache-2.0

1 0

virtualbmc 1.5.0
by no-reply＠openstack.org 22 Mar '19

22 Mar '19

We eagerly announce the release of: virtualbmc 1.5.0: Create virtual BMCs for controlling virtual instances via IPMI The source is available from: https://git.openstack.org/cgit/openstack/virtualbmc Download the package from: https://tarballs.openstack.org/virtualbmc/ Please report issues through launchpad: https://storyboard.openstack.org/#!/project/openstack/virtualbmc For more details, please see below. 1.5.0 ^^^^^ Bug Fixes * Ignores instance "start" command if instance appears to be running. This helps preserving backward-compatible behaviour, as previous implementation has required the user to explicitly "start" enabled instances. With current virtualbmc, only the master process needs to be started. Changes in virtualbmc 1.4.0..1.5.0 ---------------------------------- bff0e6c Ignore "start" command if instance appears to be running 89cc01b Bump lower libvirt-python to 3.7 200b274 Move to zuulv3 90ac530 Update README b8ee278 Update home-page d50610c Change openstack-dev to openstack-discuss 3952d59 Update min tox version to 2.0 ff84f71 Don't quote {posargs} in tox.ini 6d9c5ed Tolerate missing openstackdocstheme in docs dc62440 Remove duplicate lines in README cd63bf7 Change CI job to use python3 fa04f7b add python 3.6 unit test job 3344834 switch documentation job to new PTI 743cccd import zuul job settings from project-config 91a759d Change py35 to py3 so Python 3.6 can be picked up 3a2c03a Update name for virtualbmc CI job 8c407df Enable debug logging in tests ec5fbb5 Fix release note theme for virtualbmc Diffstat (except docs and test files) ------------------------------------- README.rst | 32 ++++-- lower-constraints.txt | 2 +- .../post.yaml | 15 --- .../run.yaml | 124 --------------------- .../ignore-start-if-running-c9a8f6c0514624a1.yaml | 7 ++ releasenotes/source/conf.py | 12 +- requirements.txt | 2 +- setup.cfg | 4 +- tox.ini | 6 +- virtualbmc/manager.py | 10 +- zuul.d/legacy-virtualbmc-jobs.yaml | 22 ---- zuul.d/project.yaml | 14 ++- zuul.d/virtualbmc-jobs.yaml | 27 +++++ 15 files changed, 112 insertions(+), 189 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index a63b982..6af0990 100644 --- a/requirements.txt +++ b/requirements.txt @@ -7 +7 @@ six>=1.10.0 # MIT -libvirt-python!=4.1.0,>=3.5.0 # LGPLv2+ +libvirt-python!=4.1.0,>=3.7.0 # LGPLv2+

1 0

sahara-tests 0.8.0 (stein)
by no-reply＠openstack.org 22 Mar '19

22 Mar '19

We are thrilled to announce the release of: sahara-tests 0.8.0: Sahara tests This release is part of the stein release series. The source is available from: https://git.openstack.org/cgit/openstack/sahara-tests Download the package from: https://tarballs.openstack.org/sahara-tests/ For more details, please see below. 0.8.0 ^^^^^ Prelude ******* Tempest tests now support APIv2. Scenario tests now support APIv2. New Features ************ * The Tempest plugin provides an APIv2 DataProcessing client and tempest tests can be executed against APIv2 too. The type of API used is driven by a tempest.conf configuration key (data_processing.use_api_v2 for API tests, data_processing.api_version_saharaclient for client and CLI tests) * sahara-scenario supports feature sets. When passing specific feature tags to sahara-scenario, additional job templates and EDP jobs marked with those tags will be loaded. * The fully generated YAML file is printed when the verbose mode is enabled. * Scenario tests can be executed against APIv2. The usage of APIv2 is enabled through a new command line argument for sahara-scenario (--v2, -2). Bug Fixes ********* * Fix the test template for storm 1.2. * When passing the plugin/version parameters to sahara-scenario, users can now specify additional YAML templates which will be merged to the default YAMLs, instead of being ignored. Changes in sahara-tests 0.7.0..0.8.0 ------------------------------------ 7e39b7b APIv2 jobs also on the gate queue, add the py37 job 9985429 APIv2 support for scenario tests e79f870 New job for sahara-scenario based on Python 3 139df1c sahara-scenario: improve the python3 compatibility 1518565 Feature sets for sahara-scenario c9a6516 APIv2 support for all Tempest-based tests 23af154 Scenario runner can print the the generated configuration e4e5e31 Job updates: use RadosGW for Py3, fix irrelevant files 481f5eb Set API version in RestClient d31d731 Fix String comparison for Python3 1dd0bf2 Fix the test template for storm 1.2 d5ecdd2 Update devel info: mailing list 6fa353f Update the min version of tox to 2.0 cb04a44 Use upper-constraints.txt for sahara-tests testing 30ff92e Add scenario test job against stable/rocky 2688ad1 Update cover jobs Diffstat (except docs and test files) ------------------------------------- .zuul.yaml | 110 +++++++++- etc/scenario/simple-testcase.yaml | 14 ++ ...x-storm-scenario-template-2d28644c9fd2ec06.yaml | 4 + .../scenario-feature-sets-ac3e0e9e40b236bb.yaml | 11 + ...rio-runner-templatesdebug-5ee5e2447cff770a.yaml | 4 + roles/run-sahara-scenario/defaults/main.yaml | 1 + roles/run-sahara-scenario/tasks/main.yaml | 5 +- roles/setup-sahara-scenario-env/tasks/main.yaml | 31 +-- sahara_tempest_plugin/common/plugin_utils.py | 16 +- sahara_tempest_plugin/config.py | 3 + sahara_tempest_plugin/plugin.py | 10 +- .../services/data_processing/base_client.py | 50 +++++ .../data_processing/v1_1/data_processing_client.py | 34 +-- .../services/data_processing/v2/__init__.py | 18 ++ .../data_processing/v2/data_processing_client.py | 241 +++++++++++++++++++++ .../scenario/defaults/rocky/storm-1.2.0.yaml.mako | 2 +- .../scenario/defaults/storm-1.2.0.yaml.mako | 2 +- setup.cfg | 2 +- tox.ini | 15 +- 44 files changed, 1265 insertions(+), 147 deletions(-)

1 0

octavia-tempest-plugin 1.0.0 (stein)
by no-reply＠openstack.org 22 Mar '19

22 Mar '19

We exuberantly announce the release of: octavia-tempest-plugin 1.0.0: Tempest plugin for Octavia This release is part of the stein release series. The source is available from: https://git.openstack.org/cgit/openstack/octavia-tempest-plugin Download the package from: https://tarballs.openstack.org/octavia-tempest-plugin/ Please report issues through launchpad: https://storyboard.openstack.org/#!/project/openstack/octavia- tempest-plugin For more details, please see below. 1.0.0 ^^^^^ New Features * Added the listener stats service client and API test. Changes in octavia-tempest-plugin 0.2.0..1.0.0 ---------------------------------------------- a1c25b3 Fix barbican service_available check 8bf958e Add octavia-lib to required projects 45e6e66 Update json module to jsonutils 3e79500 Check Monitor in Member Scenario Tests a2f5503 Update the live jobs to set higher retries 436dd9f Skip amphora scenario test if provider is not set c4ccd81 Use cls.skipException and raise it 9169029 Modify Member tests for Provider Drivers fc223fe Adds provider API tests a2d0307 Adds flavor API tests aff2e86 Adds flavor profile API tests 08a0ef5 Add the provider service client. cfb0254 Add the flavor service client. fd90e15 Add the flavor profile service client. 69cb566 Add listener stats service client and API test e05ba7e Add wait for resource cleanup if there is no parent 6626f25 Add configuration to enable/disable L7,L4 protocols 04dc5cb Retry subnet/network deletes on 409 Conflict 0a0f9b3 Add a TLS scenario using Barbican 5a16ad3 Add traffic tests using an IPv6 VIP 37fb30e Change openstack-dev to openstack-discuss 2a6cf67 Fix a spelling mistake c451ff9 Fix dependency on requests library version 75c086b Adds get_amphora_stats to the service client 9f99afd Add v2 two-node scenario test 9153af1 Transition to python 3.x primary gates d92d76a Make the CentOS 7 scenario gate non-voting bf916df Adds a mixed IPv4/IPv6 members traffic test dc5a39d Enable Octavia API audit logging for API jobs Diffstat (except docs and test files) ------------------------------------- octavia_tempest_plugin/clients.py | 12 + .../common/barbican_client_mgr.py | 88 +++++ octavia_tempest_plugin/common/cert_utils.py | 130 ++++++ octavia_tempest_plugin/common/constants.py | 14 + octavia_tempest_plugin/config.py | 29 ++ .../services/load_balancer/v2/amphora_client.py | 54 +++ .../services/load_balancer/v2/base_client.py | 34 +- .../services/load_balancer/v2/flavor_client.py | 263 +++++++++++++ .../load_balancer/v2/flavor_profile_client.py | 263 +++++++++++++ .../services/load_balancer/v2/listener_client.py | 52 +++ .../load_balancer/v2/loadbalancer_client.py | 10 +- .../services/load_balancer/v2/member_client.py | 5 +- .../services/load_balancer/v2/provider_client.py | 61 +++ .../barbican_scenario/v2/test_tls_barbican.py | 274 +++++++++++++ ...d-listener-stats-api-test-88947cf5e6ae9cae.yaml | 4 + requirements.txt | 5 + setup.cfg | 2 +- tox.ini | 2 +- zuul.d/jobs.yaml | 266 ++++++++++++- zuul.d/projects.yaml | 34 +- 44 files changed, 3118 insertions(+), 187 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 5b1b3ee..c9f839c 100644 --- a/requirements.txt +++ b/requirements.txt @@ -4,0 +5 @@ +cryptography>=2.1 # BSD/Apache-2.0 @@ -7,0 +9 @@ pbr!=2.1.0,>=2.0.0 # Apache-2.0 +octavia-lib>=1.0.0 # Apache-2.0 @@ -9,0 +12 @@ oslo.log>=3.36.0 # Apache-2.0 +oslo.serialization!=2.19.1,>=2.18.0 # Apache-2.0 @@ -11,0 +15,2 @@ oslotest>=3.2.0 # Apache-2.0 +python-barbicanclient>=4.5.2 # Apache-2.0 +pyOpenSSL>=17.1.0 # Apache-2.0

1 0

ironic 12.1.0 (stein)
by no-reply＠openstack.org 21 Mar '19

21 Mar '19

We joyfully announce the release of: ironic 12.1.0: OpenStack Bare Metal Provisioning This release is part of the stein stable release series. The source is available from: https://git.openstack.org/cgit/openstack/ironic Download the package from: https://tarballs.openstack.org/ironic/ Please report issues through launchpad: https://storyboard.openstack.org/#!/project/943 For more details, please see below. 12.1.0 ^^^^^^ Prelude ******* The Bare Metal as a Service team joyfully announces our OpenStack Stein release of ironic 12.1.0. While no steins nor speakers were harmed during the development of this release, we might have suffered some hearing damage after we learned that we could increase the volume well past eleven! Notable items include: * Increased parallelism of power synchronization to improve overall conductor efficiency. * API fields to support node "description" and "owner" values. * HPE iLO "ilo5" and Huawei "ibmc" hardware types. * Allocations API interface to enable operators to find and select bare metal nodes for deployment. * JSON-RPC can now be used for "ironic-api" to "ironic-conductor" communication as opposed to using an AMQP messaging provider. * Support for customizable PXE templates and streamlined deployment sequences. * Initial support for the definition of "deployment templates" to enable operators to define and match customized deployment sequences. * Initial work for supporting SmartNIC configuration is included, however the Networking Service changes required are not anticipated until sometime during the Train development cycle. * And numerous bug fixes, including ones for IPv6 and IPMI. This release includes the changes in ironic's "12.0.0" release which was also released during the Stein development cycle and includes a number of improvements for Bare Metal infrastructure operators. More about our earlier stein release can be found in our release notes (ht tps://docs.openstack.org/releasenotes/ironic/stein.html#relnotes-12-0 -0). New Features ************ * Adds option "[ansible]default_python_interpreter" to choose the python interpreter that ansible uses on managed machines. By default, ansible uses "/usr/bin/python" as interpreter, making the assumption that that path is always present on remote managed systems. This might not be always the case, for example in custom build images or Python 3 native distributions. With this option the operator has the ability to set the absolute path of the python interpreter on the remote machines, for example "/usr/bin/python3". The same interpreter will be used in all operations that use the ansible deploy interface. It is also possible to override the value set in the configuration for a node by passing "ansible_python_interpreter" in its "driver_info". * Adds currently used boot mode into node "properties/capabilities" upon "redfish" inspect interface run. The idea behind this change is to align with the in-band "inspector" behavior. * Adds a "description" field to the node object to enable operators to store any information related to the node. The field is up to 4096 UTF-8 characters. * Adds capability to control the persistency of boot order changes during instance deployment via (i)PXE on a per-node level. The option 'force_persistent_boot_device' in the node's driver info for the (i)PXE drivers is extended to allow the values 'Default' (make all changes but the last one upon deployment non-persistent), 'Always' (make all changes persistent), and 'Never' (make all boot order changes non-persistent). * Adds API version 1.50 which allows for the storage of an "owner" field on node objects. This is intended for either storage of human parsable information or the storage of a tenant UUID which could be leveraged in a future version of the Bare Metal as a Service API. * Parallelizes periodic power sync calls by running up to ironic configuration "[conductor]/sync_power_state_workers" simultaneously. The default is to run up to "8" workers. This change should let larger-scale setups running power syncs more frequently and make the whole power sync procedure more resilient to slow or dead BMCs. * Adds an "is_smartnic" field to the port object in REST API version 1.53. "is_smartnic" field indicates if this port is a Smart NIC port, False by default. This field may be set by operator to use baremetal nodes with Smart NICs as ironic nodes. The REST API endpoints related to ports provide support for the "is_smartnic" field. The ironic admin documentation (https://docs.openstack.org/ironic/latest/admin/multitenancy.html) provides information on how to configure and use Smart NIC ports. * Add a new field pxe_template that can be set at driver-info level. This will specify a path for a custom pxe boot template. If present, this template will be read and will have priority in front of the per-arch and general pxe templates. * Adds support to enable deployment workflow changes necessary to support the use of Smart NICs in the "ansible", "direct", "iscsi" and "ramdisk" deployment interfaces. Networking service integration for this functionality is not anticipated until the Train release of the Networking service. * Introduces allocation API. This API allows finding and reserving a node by its resource class, traits and optional list of candidate nodes. Introduces new API endpoints: * "GET/POST /v1/allocations" * "GET/DELETE /v1/allocations/<ID or name>" * "GET/DELETE /v1/nodes/<ID or name>/allocation" * Adds support for building config drives. Starting with API version 1.56, the "configdrive" parameter of "/v1/nodes/<node>/states/provision" can be a JSON object with optional keys "meta_data" (JSON object), "network_data" (JSON object) and "user_data" (JSON object, array or string). See story 2005083 (https://storyboard.openstack.org/#!/story/2005083) for more details. * Allows the user to supply EFI system partition image to ironic, for building UEFI-bootable ISO images, in form of a local file or UUID or URI reference. The new "[conductor]esp_image" option can be used to configure ironic to use local file. * Adds the deploy templates API. Deploy templates can be used to customise the node deployment process, each specifying a list of deploy steps to execute with configurable priority and arguments. Introduces the following new API endpoints, available from Bare Metal API version 1.55: * "GET /v1/deploy_templates" * "GET /v1/deploy_templates/<deploy template identifier>" * "POST /v1/deploy_templates" * "PATCH /v1/deploy_templates/<deploy template identifier>" * "DELETE /v1/deploy_templates/<deploy template identifier>" * Adds a new feature called *fast-track* which allows an operator to optionally configure the Bare Metal API Service and the Bare Metal conductor service to permit lookup and heartbeat for nodes that are in the process of being enrolled and created. These nodes can be left online, from a process such as discovery. If ironic-python-agent has communicated with the Bare Metal Service API endpoint with-in the last *300* seconds, then setup steps that are normally involved with preparing to launch a ramdisk on the node, are skipped along with power operations to enable a baremetal node to undergo discovery through to deployment with a single power cycle. Fast track functionality may be enabled through the "[deploy]fast_track" option. * Adds a new hardware type "ibmc" for HUAWEI 2288H V5, CH121 V5 series servers. This hardware type supports PXE based boot using HUAWEI iBMC RESTful APIs. The following driver interfaces are supported: * management: "ibmc" * power: "ibmc" * vendor: "ibmc" * Adds new hardware type "ilo5". Including all other hardware interfaces "ilo" hardware type supports, this has one new RAID interface "ilo5". * Adds functionality to perform out-of-band RAID operation for iLO5 based HPE Proliant servers. * New property "ipmi_hex_kg_key" for the ipmi based interfaces. The property enables user to set the Kg key for IPMIv2 authentication in hexadecimal format. This value is provided to "ipmitool" as the -y argument. * Adds the ability to use JSON RPC for communication between API and conductor services. To use it set the new "rpc_transport" configuration options to "json-rpc" and configure the credentials and the "host_ip" in the "json_rpc" section. Hostnames of all conductors must be resolvable for this implementation to work. * Adds a "[DEFAULT]/versioned_notifications_topics" configuration option. This enables operators to configure the topics used for versioned notifications. * Notification events for metrics data now contains a "node_name" field to assist operators with relating metrics data being transmitted by the conductor service. * Set boot_mode in node properties during OOB Introspection for "idrac" hardware type. Known Issues ************ * As good security practice[0], in Ubuntu Bionic the "nf_conntrack_helper" is disabled. This causes an issue when using the "pxe" boot interface with the PXE environment that breaks some of the Ironic CI tests, since Ironic needs conntrack for TFTP traffic. It's still possible to use Ironic with PXE on Ubuntu Xenial, and it's also possible to use Ironic with PXE on Ubuntu Bionic using a workaround based on custom firewall rules as shown in [0]. [0] https://home.regit.org/netfilter-en/secure-use-of-helpers/ Upgrade Notes ************* * Adds an "is_smartnic" field to the port object in REST API version 1.53. Upgrading to this release will set "is_smartnic" to False for all ports. * Adds a check to the "ironic-status upgrade check" command, to check for compatibility of the object versions with the release of ironic. * The "create_raid_configuration", "delete_raid_configuration" and "read_raid_configuration" interfaces of 'proliantutils' library has been enhanced to support out-of-band RAID operation for "ilo5" hardware type. To leverage this feature, the 'proliantutils' library needs to be upgraded to version '2.7.0'. * Removes deprecated "driver_info["drac_host"]" property for "idrac" hardware type that was marked for removal in Pike. Please use "driver_info["drac_address"]" instead. Deprecation Notes ***************** * The values 'True'/'False' for the option 'force_persistent_boot_device' in the node's driver info for the (i)PXE drivers are deprecated and support for them may be removed in a future release. The former default value 'False' is replaced by the new value 'Default', the value 'True' is replaced by 'Always'. * The Cisco "cisco-ucs-managed" and "cisco-ucs-standalone" drivers have been deprecated due to a lack of reporting third-party CI and vendor maintenance of the driver code. In the present state of these drivers, they would have been removed as part of the eventual removal of support for Python2. These drivers should be anticipated to be removed prior to the final Train release of the Bare Metal service. More information can be found here (http://lists.openstack.org/pipermail/openstack- discuss/2019-February/002460.html). * The "hash_distribution_replicas" configuration option is now deprecated. If specified in the config file, a warning is logged. Bug Fixes ********* * A bug has been fixed in the node update code that could cause the nodes to become not updatable if their driver is no longer available. * Fixes an issue where setting the "conductor_group" for a node was not entirely case-sensitive, in that this could fail if case- sensitivity did not match between the conductor configuration and the API request. * Makes ironic building UEFI-only bootable ISO image (when being asked to build a UEFI-bootable image) rather than building a hybrid BIOS /UEFI-bootable ISO. * Fixes an issue that node list with conductor fails if any of the nodes has an invalid hardware type, which may happen when some conductor is out of service. * Fixes an issue in the "idrac" RAID interface seen when creating RAID configurations using "python-dracclient" version "2.0.0" or higher. * Fixes an issue where the master TFTP image cache could not be disabled. The configuration option "[pxe]/tftp_master_path" may now be set to the empty string to disable the cache. For more information, see story 2004608 (https://storyboard.openstack.org/#!/story/2004608) * Fixes an issue where "xclarity" management interface fails to get boot order. Now the driver correctly gets boot device and this has been verified in the 3rd party CI. See story 2004576 (https://storyboard.openstack.org/#!/story/2004576) for details. * Advances required "python-dracclient" version to 1.5.0 and later. That version is required by the fix to the "idrac" hardware type's bug 2004340 (https://storyboard.openstack.org/#!/story/2004340) * Makes all "ilo" driver BIOS interface clean steps as asynchronous. This is required to ensure the settings on the baremetal node are consistent with the settings stored in the database irrespective of the node clean step status. Refer bug 2004066 (https://storyboard.openstack.org/#!/story/2004066) for details. * Fixes the IPMI console implementation to respect all supported IPMI "driver_info" and configuration options, particularly "ipmi_port". * Fixes an issue has been corrected where hosts executing "iPXE" to boot would error indicating that no configuration was found for networks where IPv6 is in use. This has been remedied through a minor addition to the Networking service in the Stein development cycle. For more information please see story 2004502 (https://storyboard.openstack.org/#!/story/2004502) * Notification event types now include the hardware type name string as opposed to a static string of "ipmi". This allows event processors and operators to understand what the actual notification event data source is as opposed to having to rely upon fingerprints of the data to make such determinations. * Fixes a bug where cinder block storage service volumes volume fail to attach expecting a mountpoint to be a valid string. See story 2004864 (https://storyboard.openstack.org/#!/story/2004864) for additional information. * Fixes an issue where the socat process would exit on client disconnect, which would (a) leave a zombie socat process in the process table and (b) disable any subsequent serial console connections. This issue was addressed by updating ironic to call socat with the "fork,max-children=1" options, which makes socat persist and accept multiple connections (but only one at a time). Please see story 2005024 (https://storyboard.openstack.org/#!/story/2005024) for additional information. * Fixes an issue with the "ipmi" hardware type where "node['driver_info']['ipmi_force_boot_device']" could be interpreted as "True" when set to values such as "False". * Returns the correct error message on providing an invalid reference to "image_source". Previously an internal error was raised. * The "instance_info[root_gb]" property is no longer required for whole-disk images. It has always been ignored for them, but the validation code still expected it to be present. Other Notes *********** * The Bare Metal service now builds UEFI-only bootable ISO image (when being asked to build a UEFI-bootable image) rather than building a hybrid BIOS/UEFI-bootable ISO. Changes in ironic 12.0.0..12.1.0 -------------------------------- 62d40c17e Add systemd unit for vbmcd in devstack da966c987 Workaround for postgres job with ubuntu bionic e3c606d4e Add release note on conntrack issue on bionic b805491c9 Update release-mappings and api version data for Stein release 320a61b68 Pass kwargs to exception to get better formatted error message ed04e8e4a Advance python-dracclient version requirement c76254776 Add prelude and update release notes for 12.1.0 da0de5c30 Optimize: HUAWEI iBMC driver utils a79b150ea Set boot_mode in node properties during OOB Introspection c11f45bdd Fix idrac driver unit test backwards compat issue 56acabfab Deploy Templates: factor out ironic.conductor.steps b5d44d3aa Make metrics usable 82704e6d8 Kg key for IPMIv2 authentication 3f734c872 fast tracked deployment support 3c5307df2 Update doc for UEFI first 2eceb3c8a Fix lower-constraints job 82cd13177 Fix idrac Job.state renamed to Job.status 9c266df8b Deprecates `hash_distribution_replicas` config option f1f4f892f Add Huawei iBMC driver support 618b94c71 Fix misuse of assertTrue cfc4a6f75 Allow methods to be both deploy and clean steps 80e762e18 Adding ansible python interpreter as driver_info 7480e581d Return 405 for old versions in allocation and deploy template APIs 70d7bb369 honor ipmi_port in serial console drivers 7e9ff1d6b Follow up to available node protection e4cce6759 Deploy templates: conductor and API nits 89c58cbb6 Deploy Templates: documentation fac7384b4 Fixing a bash test in devstack ironic lib 9672cb73d Deploy Templates: API reference bdcba4fb8 Fix formatting issue in doc ab3377260 Update dist filter for devstack ubuntu 2bf3d0a3a Add a non-voting metalsmith job for local boot coverage 05d6735c6 Document building configdrive on the server side fefb3201e Check microversions before validations for allocations and deploy templates cf2c0a002 Add python3 unit test with drivers installed c9b3ef468 Fix missing print format error 13bdf8b0c Fix typo and docstring in pxe/ipxe 40b55416a Stop requiring root_gb for whole-disk images 442376a7c driver-requirements: mark UcsSdk as Python 2 only a80873593 Set boot_mode in node properties during Redfish introspection c8ece0c62 Add option to set python interpreter for ansible 77ee49f21 Document using a URL for image_checksum 8f8be9dec [docs] IPv6 support for iLO 790530f33 Temporary marking ironic-standalone non-voting 3e1e0c9d5 Allow building configdrive from JSON in the API 885bfbda9 Allocation API: optimize check on candidate nodes 245af384f Fix TypeError: __str__ returned non-string (type ImageRefValidationFailed) ec2f7f992 Deploy templates: API & notifications 17a944fe9 Deploy templates: conductor 296480961 Drop installing python-libvirt system package c12170957 Test API max version is in RELEASE_MAPPINGS 51b67c441 Update the log message for ilo drivers e989a21f0 Deploy templates: fix updating steps in Python 3 db94e3574 Fix pysendfile requirement marker 885ddb436 Add option to protect available nodes from accidental deletion a105ee094 Deploy Templates: add 'extra' field to DB & object 9e8464346 Trivial: Fix error message when waiting for power state 08270ceba Allocation API: fix minor issues in the API reference acc4c402d Allocation API: reference documentation e0639875f Adding bios_interface reference to api docs a9d7d8fd9 Set available_nodes in tempest conf b9f7cf59f Update the proliantutils version in documentation 578805b34 [trivial] Removing python 3.5 template jobs a094aa7e9 Deploy Templates: Fix DB & object nits 33383c9c7 Add check for object versions 671b0cf3d [Trivial] Fix incorrect logging in destroy_allocation 6885c674c Allocation API: taking over allocations of offline conductors b1cfcb7c9 Allocation API: resume allocations on conductor restart e240dd501 Devstack - run vbmc as sudo 1d882df18 Documentation update for iLO Drivers f4c43f8b2 Follow up - API - Implement /events endpoint 7a6a6bf69 Follow up to node description f369fdd33 ensure that socat serial proxy keeps running f9e53e2c6 Deprecate Cisco drivers e95515a07 Follow up to ISO image build patch 50205ca07 API - Implement /events endpoint dabb9a48e Add a requisite for metadata with BFV b0d7c2d82 [Follow Up] Add support for Smart NICs 7efbbcc2d Support using JSON-RPC instead of oslo.messaging b137af30b Deploy templates: data model, DB API & objects bcf5b37c7 [Follow Up] Expose is_smartnic in port API 0d798372e Prioritize sloppy nodes for power sync d4233e52a Expose conductors: api-ref 3e1a7b464 Remove duplicated jobs and refactor jobs 9741aed7b Allocation API: fix a small inconsistency 6325b6c13 Expose is_smartnic in port API e64510e75 [Trivial] Allocation API: correct syntax in API version history docs 390a1c9a7 Allocation API: REST API implementation 2dfb0650d Make power sync unit test operational c803488af Allow case-insensitivity when setting conductor_group via API 206134cf5 Optionally preserve original system boot order upon instance deployment a41c7a959 Add support for Smart NICs 15fafe686 Add a voting CI job running unit tests with driver-requirements 699bd410c [Refactor] Make caching BIOS settings explicit 903f796c9 [docs] OOB RAID implementation for ilo5 based HPE Proliant servers 335f6b4fd Make iLO BIOS interface clean steps asynchronous 57037378b Provides mount point as cinder requires it to attach volume 96bc6729c Add description field to node: api-ref d30d81495 Add description field to node 2aaa6744c Fix test for 'force_persistent_boot_device' (i)PXE driver_info option cede60388 Fix iPXE boot interface with ipxe_enabled=False 96b9d9de0 Allocation API: conductor API (without HA and take over) 972747671 Removing deprecated drac_host property 86e31bff4 Add is_smartnic to Port data model 80caf5833 Remove uses of logger name "oslo_messaging" 69d713d39 [Trivial] Fix typo in noop interface comment c3648e8b4 Remove duplicated fault code 9555ad281 Fix listing nodes with conductor could raise 821d5fef7 Parallelize periodic power sync calls follow up 738d4eafd Build ISO out of EFI system partition image 0e81ec00c Make versioned notifications topics configurable 4008c9bfa Build UEFI-only ISO for UEFI boot 7448603ab Parallelize periodic power sync calls cc73bb21f Limit the timeout value of heartbeat_timeout d6c9d6cae Replace use of Q_USE_PROVIDERNET_FOR_PUBLIC 03375f003 Make ipmi_force_boot_device more user friendly 0d943c635 Follow-up logging change 3ad700aca Remove dsvm from zuulv3 jobs 1b019ddf8 Allocation API: allow picking random conductor for RPC topic cea8d7491 Fix updating nodes with removed or broken drivers 66dc4c674 Fix ironic port creation after Redfish inspection fb93d4bc3 Allocation API: minor fixes to DB and RPC 8e5337c39 Allocation API: allow skipping retries in TaskManager a4717d995 Allocation API: database and RPC b8e720e51 Allow missing ``local_gb`` property 6bc306d9e Fix typo in release note cbf1e9d03 Fix IPv6 iPXE support 58a395bf8 OOB RAID implementation for ilo5 based HPE Proliant servers. 831b6ff16 Fix SushyError namespacing in Redfish inspection 4c987aa51 Allow disabling TFTP image cache 0bda09acf Add pxe template per node b1c9e5d82 Fix the misspelling of "configuration" 1effd562e Switch to cirros 0.4.0 62ca0816a Update tox version to 2.0 71f0256b1 Disable metadata_csum when creating ext4 filesystems 053965c6d Switch the default NIC driver to e1000 c153b345b Change openstack-dev to openstack-discuss bb2942295 Fix XClarity driver management defect 78d6d9503 Ignore newly introduced tables in pre-upgrade versions check c5a4ad800 Switch CI back to xenial 052d90506 Add "owner" information field 0678a08c9 Follow-up patch for I71feefa3d0593fd185a286bec4ce38607203641d 913e4cebb Log a warning for Gen8 Inspection Diffstat (except docs and test files) ------------------------------------- api-ref/regenerate-samples.sh | 51 +- api-ref/source/baremetal-api-v1-allocation.inc | 210 ++++ api-ref/source/baremetal-api-v1-conductors.inc | 97 ++ .../source/baremetal-api-v1-deploy-templates.inc | 222 ++++ api-ref/source/baremetal-api-v1-drivers.inc | 4 + .../source/baremetal-api-v1-node-allocation.inc | 81 ++ .../source/baremetal-api-v1-node-management.inc | 4 + api-ref/source/baremetal-api-v1-nodes-ports.inc | 7 + api-ref/source/baremetal-api-v1-nodes.inc | 70 ++ .../source/baremetal-api-v1-portgroups-ports.inc | 7 + api-ref/source/baremetal-api-v1-ports.inc | 20 + api-ref/source/index.rst | 9 +- api-ref/source/parameters.yaml | 238 +++- .../samples/allocation-create-request-2.json | 6 + .../source/samples/allocation-create-request.json | 4 + .../source/samples/allocation-create-response.json | 23 + .../source/samples/allocation-show-response.json | 23 + .../source/samples/allocations-list-response.json | 52 + .../samples/conductor-list-details-response.json | 44 + .../source/samples/conductor-list-response.json | 34 + .../source/samples/conductor-show-response.json | 20 + .../samples/deploy-template-create-request.json | 19 + .../samples/deploy-template-create-response.json | 32 + .../samples/deploy-template-detail-response.json | 36 + .../samples/deploy-template-list-response.json | 18 + .../samples/deploy-template-show-response.json | 32 + .../samples/deploy-template-update-request.json | 7 + .../samples/deploy-template-update-response.json | 32 + api-ref/source/samples/driver-get-response.json | 4 + .../samples/drivers-list-detail-response.json | 8 + .../samples/node-create-request-classic.json | 3 +- .../samples/node-create-request-dynamic.json | 3 +- api-ref/source/samples/node-create-response.json | 5 +- .../source/samples/node-port-detail-response.json | 1 + api-ref/source/samples/node-show-response.json | 6 +- .../samples/node-update-driver-info-response.json | 3 + .../samples/nodes-list-details-response.json | 9 +- api-ref/source/samples/port-create-request.json | 1 + api-ref/source/samples/port-create-response.json | 1 + .../source/samples/port-list-detail-response.json | 1 + api-ref/source/samples/port-update-response.json | 1 + .../samples/portgroup-port-detail-response.json | 1 + bindep.txt | 3 +- devstack/common_settings | 2 +- devstack/files/debs/ironic | 9 +- devstack/lib/ironic | 80 +- devstack/plugin.sh | 5 + devstack/tools/ironic/scripts/create-node.sh | 4 +- devstack/upgrade/upgrade.sh | 5 + .../contributor/ironic-multitenant-networking.rst | 3 - .../images/ironic_standalone_with_ibmc_driver.svg | 1309 ++++++++++++++++++++ .../install/include/configure-ironic-api.inc | 41 + .../install/include/configure-ironic-conductor.inc | 50 + driver-requirements.txt | 9 +- ironic/api/controllers/base.py | 30 +- ironic/api/controllers/v1/__init__.py | 42 + ironic/api/controllers/v1/allocation.py | 471 +++++++ ironic/api/controllers/v1/chassis.py | 8 +- ironic/api/controllers/v1/deploy_template.py | 445 +++++++ ironic/api/controllers/v1/event.py | 54 + ironic/api/controllers/v1/node.py | 180 ++- ironic/api/controllers/v1/notification_utils.py | 6 + ironic/api/controllers/v1/port.py | 48 +- ironic/api/controllers/v1/portgroup.py | 19 +- ironic/api/controllers/v1/ramdisk.py | 12 +- ironic/api/controllers/v1/types.py | 148 ++- ironic/api/controllers/v1/utils.py | 234 +++- ironic/api/controllers/v1/versions.py | 17 +- ironic/api/controllers/v1/volume_connector.py | 19 +- ironic/api/controllers/v1/volume_target.py | 19 +- ironic/cmd/dbsync.py | 68 +- ironic/cmd/status.py | 33 +- ironic/common/cinder.py | 8 +- ironic/common/exception.py | 50 +- ironic/common/images.py | 113 +- ironic/common/json_rpc/__init__.py | 20 + ironic/common/json_rpc/client.py | 185 +++ ironic/common/json_rpc/server.py | 283 +++++ ironic/common/neutron.py | 138 +++ ironic/common/policy.py | 62 +- ironic/common/pxe_utils.py | 45 +- ironic/common/raid.py | 48 + ironic/common/release_mappings.py | 40 +- ironic/common/rpc.py | 12 +- ironic/common/rpc_service.py | 13 +- ironic/common/states.py | 24 +- ironic/conductor/allocations.py | 233 ++++ ironic/conductor/base_manager.py | 16 + ironic/conductor/manager.py | 197 ++- ironic/conductor/rpcapi.py | 50 +- ironic/conductor/steps.py | 601 +++++++++ ironic/conductor/task_manager.py | 28 +- ironic/conductor/utils.py | 406 +++--- ironic/conf/__init__.py | 4 + ironic/conf/agent.py | 15 + ironic/conf/ansible.py | 6 + ironic/conf/conductor.py | 22 +- ironic/conf/default.py | 49 +- ironic/conf/deploy.py | 21 + ironic/conf/ibmc.py | 35 + ironic/conf/json_rpc.py | 44 + ironic/conf/opts.py | 4 +- ironic/conf/pxe.py | 2 +- ironic/db/api.py | 220 +++- ...7122cc9_add_extra_column_to_deploy_templates.py | 31 + .../versions/28c44432c9c3_add_node_description.py | 31 + .../versions/2aac7e0872f6_add_deploy_templates.py | 67 + .../versions/9cbeefa3763f_add_port_is_smartnic.py | 32 + .../versions/dd67b91a1981_add_allocations_table.py | 56 + .../versions/f190f9d00a11_add_node_owner.py | 32 + ironic/db/sqlalchemy/api.py | 597 ++++++++- ironic/db/sqlalchemy/models.py | 68 + ironic/drivers/base.py | 48 +- ironic/drivers/cisco_ucs.py | 8 + ironic/drivers/ibmc.py | 40 + ironic/drivers/ilo.py | 13 + ironic/drivers/modules/agent.py | 99 +- ironic/drivers/modules/agent_base_vendor.py | 54 +- ironic/drivers/modules/ansible/deploy.py | 30 +- ironic/drivers/modules/cimc/management.py | 4 + ironic/drivers/modules/cimc/power.py | 4 + ironic/drivers/modules/console_utils.py | 6 +- ironic/drivers/modules/deploy_utils.py | 107 +- ironic/drivers/modules/drac/common.py | 21 +- ironic/drivers/modules/drac/inspect.py | 9 + ironic/drivers/modules/drac/raid.py | 4 +- ironic/drivers/modules/ibmc/__init__.py | 0 ironic/drivers/modules/ibmc/management.py | 237 ++++ ironic/drivers/modules/ibmc/mappings.py | 70 ++ ironic/drivers/modules/ibmc/power.py | 145 +++ ironic/drivers/modules/ibmc/utils.py | 172 +++ ironic/drivers/modules/ibmc/vendor.py | 87 ++ ironic/drivers/modules/ilo/bios.py | 142 ++- ironic/drivers/modules/ilo/boot.py | 6 +- ironic/drivers/modules/ilo/inspect.py | 19 + ironic/drivers/modules/ilo/raid.py | 235 ++++ ironic/drivers/modules/inspect_utils.py | 35 +- ironic/drivers/modules/ipmitool.py | 91 +- ironic/drivers/modules/ipxe.py | 29 +- ironic/drivers/modules/irmc/bios.py | 2 + ironic/drivers/modules/irmc/boot.py | 6 +- ironic/drivers/modules/iscsi_deploy.py | 49 +- ironic/drivers/modules/network/common.py | 15 + ironic/drivers/modules/network/neutron.py | 18 + ironic/drivers/modules/noop.py | 2 +- ironic/drivers/modules/pxe.py | 30 +- ironic/drivers/modules/pxe_base.py | 14 +- ironic/drivers/modules/redfish/bios.py | 2 + ironic/drivers/modules/redfish/inspect.py | 67 +- ironic/drivers/modules/ucs/management.py | 4 + ironic/drivers/modules/ucs/power.py | 3 + ironic/drivers/modules/xclarity/common.py | 2 +- ironic/drivers/modules/xclarity/management.py | 72 +- ironic/drivers/modules/xclarity/power.py | 2 +- ironic/drivers/utils.py | 5 +- ironic/objects/__init__.py | 2 + ironic/objects/allocation.py | 300 +++++ ironic/objects/deploy_template.py | 281 +++++ ironic/objects/fields.py | 4 + ironic/objects/node.py | 56 +- ironic/objects/port.py | 47 +- ...ction-for-available-nodes-25f163d69782ef63.yaml | 12 + .../unit/api/controllers/v1/test_allocation.py | 743 +++++++++++ .../api/controllers/v1/test_deploy_template.py | 956 ++++++++++++++ .../unit/drivers/modules/ansible/test_deploy.py | 230 +++- .../unit/drivers/modules/drac/test_inspect.py | 11 +- .../drivers/modules/drac/test_periodic_task.py | 18 +- .../unit/drivers/modules/ibmc/test_management.py | 276 +++++ .../unit/drivers/modules/irmc/test_inspect.py | 2 +- .../unit/drivers/modules/network/test_common.py | 20 + .../unit/drivers/modules/network/test_neutron.py | 42 +- .../unit/drivers/modules/redfish/test_inspect.py | 70 +- .../unit/drivers/modules/test_agent_base_vendor.py | 193 ++- .../unit/drivers/modules/test_console_utils.py | 6 +- .../unit/drivers/modules/test_deploy_utils.py | 61 +- .../unit/drivers/modules/test_inspect_utils.py | 22 + .../unit/drivers/modules/test_iscsi_deploy.py | 219 ++++ .../drivers/modules/xclarity/test_management.py | 37 + .../unit/drivers/modules/xclarity/test_power.py | 5 +- .../unit/drivers/third_party_driver_mock_specs.py | 10 + lower-constraints.txt | 6 +- .../run.yaml | 10 +- ...nsible-python-interpreter-2035e0f23d407aaf.yaml | 15 + ...boot-mode-redfish-inspect-48e2b27ef022932a.yaml | 6 + .../add-node-description-790097704f45af91.yaml | 6 + ...on-persistent-boot-device-139cf280fb66f4f7.yaml | 17 + .../add-owner-information-52e153faf570747e.yaml | 7 + .../add-parallel-power-syncs-b099d66e80aab616.yaml | 8 + .../add-port-is-smartnic-4ce6974c8fe2732d.yaml | 21 + .../notes/add-pxe-per-node-526fd79df17efda8.yaml | 8 + ...add-support-for-smart-nic-0fc5b10ba6772f7f.yaml | 8 + .../notes/allocation-api-6ac2d262689f5f59.yaml | 10 + .../broken-driver-update-fc5303340080ef04.yaml | 5 + .../notes/bug-2004947-e5f27e11b8f9c96d.yaml | 6 + .../notes/build-configdrive-5b3b9095824faf4e.yaml | 9 + .../notes/build-iso-from-esp-d156036aa8ef85fb.yaml | 12 + .../build-uefi-only-iso-ce6bcb0da578d1d6.yaml | 7 + .../notes/check_obj_versions-e86d897df673e833.yaml | 5 + .../notes/deploy-templates-5df3368df862631c.yaml | 15 + .../deprecate-cisco-drivers-3ae79a24b76ff963.yaml | 11 + ...ash-distribution-replicas-ef0626ccc592b70e.yaml | 5 + .../fast-track-deployment-f09a8b921b3aae36.yaml | 16 + .../fix-conductor-list-raise-131ac76719b74032.yaml | 6 + .../notes/fix-drac-job-state-8c5422bbeaf15226.yaml | 5 + ...x-tftp-master-path-config-77face94f5db9af7.yaml | 7 + ...clarity-management-defect-ec5af0cc6d1045d9.yaml | 8 + .../notes/ibmc-driver-45fcf9f50ebf0193.yaml | 10 + ...python-dracclient-version-01c6ef671670ffb3.yaml | 6 + ...lo-async-bios-clean-steps-15e49545ba818997.yaml | 8 + .../notes/ilo5-oob-raid-a0eac60f7d77a4fc.yaml | 12 + .../notes/ipmi-console-port-ec6348df4eee6746.yaml | 5 + .../notes/ipmi_hex_kg_key-8f6caabe5b7d7a9b.yaml | 7 + .../notes/ipxe-with-dhcpv6-2bc7bd7f53a70f51.yaml | 8 + .../issue-conntrack-bionic-7483671771cf2e82.yaml | 13 + releasenotes/notes/json-rpc-0edc429696aca6f9.yaml | 8 + ...tions-topics-configurable-18d70d573c27809e.yaml | 6 + ...rics-notifier-information-17858c8e27c795d7.yaml | 13 + .../prelude-to-the-stein-f25b6073b6d1c598.yaml | 32 + .../notes/provide_mountpoint-58cfd25b6dd4cfde.yaml | 7 + ...move-deprecated-drac_host-865be09c6e8fcb90.yaml | 5 + .../notes/set-boot-mode-4c42b3fd0b5f5b37.yaml | 5 + .../notes/socat-respawn-de9e8805c820a7ac.yaml | 10 + .../notes/story-2004444-f540d9bbc3532ad0.yaml | 6 + .../notes/type-error-str-6826c53d7e5e1243.yaml | 5 + .../notes/whole-disk-root-gb-9132e5a354e6cb9d.yaml | 6 + requirements.txt | 5 +- setup.cfg | 6 + test-requirements.txt | 2 +- tox.ini | 7 +- zuul.d/ironic-jobs.yaml | 147 ++- zuul.d/project.yaml | 57 +- 313 files changed, 22097 insertions(+), 1990 deletions(-) Requirements updates -------------------- diff --git a/driver-requirements.txt b/driver-requirements.txt index 5ee2943f0..6b4765745 100644 --- a/driver-requirements.txt +++ b/driver-requirements.txt @@ -7 +7 @@ -proliantutils>=2.6.0 +proliantutils>=2.7.0 @@ -11,2 +11,2 @@ python-scciclient>=0.8.0 -UcsSdk==0.8.2.2 -python-dracclient>=1.3.0 +UcsSdk==0.8.2.2;python_version<'3' +python-dracclient>=1.5.0 @@ -22,0 +23,3 @@ ansible>=2.4 + +# HUAWEI iBMC hardware type uses the python-ibmcclient library +python-ibmcclient>=0.1.0 diff --git a/requirements.txt b/requirements.txt index 0bcdf484a..ba1845d8d 100644 --- a/requirements.txt +++ b/requirements.txt @@ -18 +18 @@ stevedore>=1.20.0 # Apache-2.0 -pysendfile>=2.0.0 # MIT +pysendfile>=2.0.0;sys_platform!='win32' # MIT @@ -40 +40 @@ jsonpatch!=1.20,>=1.16 # BSD -WSME>=0.8.0 # MIT +WSME>=0.9.3 # MIT @@ -49,0 +50 @@ tooz>=1.58.0 # Apache-2.0 +openstacksdk>=0.25.0 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index 80ff78035..373d2a4da 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -14 +14 @@ stestr>=1.0.0 # Apache-2.0 -psycopg2>=2.6.2 # LGPL/ZPL +psycopg2>=2.7.3 # LGPL/ZPL

1 0

ironic-tempest-plugin 1.3.0 (stein)
by no-reply＠openstack.org 21 Mar '19

21 Mar '19

We enthusiastically announce the release of: ironic-tempest-plugin 1.3.0: Tempest plugin for ironic and ironic- inspector This release is part of the stein release series. The source is available from: https://git.openstack.org/cgit/openstack/ironic-tempest-plugin Download the package from: https://tarballs.openstack.org/ironic-tempest-plugin/ Please report issues through launchpad: https://storyboard.openstack.org/#!/project/951 For more details, please see below. Changes in ironic-tempest-plugin 1.2.1..1.3.0 --------------------------------------------- 0812cc7 discovery: optional support for testing changing driver df2244e Run all defined jobs defined in check and gate fb8c51e Deploy Templates: Allow old ironic API to return 405 0f0908a Fix deploy template tests on Rocky and earlier 72b14d5 Marking ironic-standalone job voting again 7c2143d Allocation API: use generate_uuid for random resource classes 6f5f021 Temporary marking ironic-standalone non-voting 44bc3dd Deploy templates: API test nits 0bf905f Test BM with VM on the same network 6f2e72c Deploy templates: add API tests 318ac4d inspector py3 gate fix 1824c0f Ensure list_with_limit tests pass 54894ab Update json module to jsonutils bbba297 Fix a race in the allocation API tests c34f9b7 tests for node description 47ff489 Allocation API: functional tests 36960a9 Fix for the Api discovery tests. 51266a5 Enable tempest run -l without credential setting ee7491f Rename zuulv3 jobs 6fe29d2 [gate] update the list of the voting jobs 4f21307 Tests for exposing conductors 31c97f9 Change openstack-dev to openstack-discuss 09593ac Replace Ocata jobs with Rocky 0325dbd Add API tests for protected nodes Diffstat (except docs and test files) ------------------------------------- ironic_tempest_plugin/common/waiters.py | 34 +++ ironic_tempest_plugin/config.py | 3 + .../services/baremetal/v1/json/baremetal_client.py | 121 +++++++- .../services/introspection_client.py | 5 +- setup.cfg | 2 +- zuul.d/project.yaml | 72 +++-- zuul.d/stable-jobs.yaml | 137 +++++++-- 19 files changed, 1266 insertions(+), 105 deletions(-)

1 0

puppet-vswitch 10.4.0 (stein)
by no-reply＠openstack.org 21 Mar '19

21 Mar '19

We are thrilled to announce the release of: puppet-vswitch 10.4.0: Puppet module for OpenStack Vswitch This release is part of the stein release series. Download the package from: https://tarballs.openstack.org/puppet-vswitch/ For more details, please see below. Changes in puppet-vswitch 10.3.0..10.4.0 ---------------------------------------- 1613f68 Prepare Stein RC1 Diffstat (except docs and test files) ------------------------------------- metadata.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)

1 0