March 2022 - Release-announce - lists.openstack.org

kuryr-kubernetes 6.0.0 (yoga)
by no-reply＠openstack.org 30 Mar '22

30 Mar '22

We are thrilled to announce the release of: kuryr-kubernetes 6.0.0: Kubernetes integration with OpenStack networking This release is part of the yoga release series. The source is available from: https://opendev.org/openstack/kuryr-kubernetes Download the package from: https://tarballs.openstack.org/kuryr-kubernetes/ Please report issues through: https://bugs.launchpad.net/kuryr-kubernetes/+bugs For more details, please see below. Changes in kuryr-kubernetes 5.0.0..6.0.0 ---------------------------------------- 8655bb4 [devstack] Support config image repository for kubeadm 63864d1 [devstack] Replace healthz with readyz to check kubernetes 6199ad5 Fix prepoulation of ports pool definition 1021da4 Updating python testing classifier as per Yoga testing runtime b9f68b4 Update KLB .spec.provider when required c624887 Update Centos version for container images. 274c08b Fix error message on VLAN ID conflict f36f869 Ignore Pod event if Pod is Pending with no Node set 2ac0190 Raise kubernetes tests version to 1.22.5 and fix legacy tests. 00a0701 Bump docutils version on lower constraints. 6bfe058 Added missing raise statement for not ready resource. fe6f2c8 DevStack: Allow kuryr-cni SA to create Events cbda9b9 Switch Amphora jobs to use clouds with nested-virt 376716d Re-add events for reconciliation. 7369dc2 Add events for Network Policy related activities. 3f98851 Fix f-string for event message. fce11a1 Add source to Events f25ab8f Remove surplus function for getting lb client. 6da97aa KuryrLoadBalancer Listener Reconciliation 769d213 Remove another log without sense 85a9696 Follow up to Pods events patch 7e2d002 Limit the number of concurrent create_ports requests e2bfcac Add lock to pools poulation f8c0b73 Add events for Pod object. 9a2b6af Set KURYR_CONFIGMAP_MODIFIABLE: false in pools job ca719a4 Add events for Services 858bac9 Remove log that has no sense 6836825 Enable reconciliation only if OVN Octavia is enabled 1933ab1 CNI: Improve logging of timeout errors 410b204 Add config option to enable Kubernetes Event creation. 58e74b8 Add TRACE logging a12bd0b Remove event added in KuryrNetwork's on_finalize 0c87500 Avoid controller restart when Port is not connected to Trunk 5dac721 Fix VLAN ID management 9647340 Make gates to use CRI-O on devstack by default. b97b120 Bump kubernetes version. fb994ec Use CRI-O with kubeadm. 87981d0 Do not start kuryr-daemon when worker_num <= 1 0105d22 Remove Amphora job from gate queue a207fdf Decrease log level of leftover ports message 731d9b8 Improve retrieval of Trunks info 80ab92c Increase tempest timeout 182364e Ensure DOWN subports are cleaned up 32cdda4 Restrict handling of Namespace events 21871b5 Ensure KLB is updated ad3f5ff Added events for namespace live cycle object. 455bafb Add permission to create events 2e8c316 Clean up extra spaces 85a4cd1 Make completed Pods Ports reusable b4bd731 For containerized cni_ds set mountPropagation=HostToContainer to let containers aware of the host's netns changes 817b8e0 Support for ports and primarySubnet fields in machine. bb41c38 Move jobs to use Ubuntu Focal 27cf09f Don't change aliveness for certain exceptions. 8336a8f Added metrics for failures caused by OpenStack services. c4278f9 Expose critical lbs metrics 291821c Disable Flask logs of metrics calls fcc71ce Decrease CPU usage of Prometheus exporter 410793a Revert "Bug 1890630: Ensure Ports in use per Subnet calculation is correct" 842862a Increase kuryr controller prometheus bucket for pods creation d9460a5 Log the exception-info when an error raises in hanlder 2cb2f6a Fix l-c and requirements job 935d917 Export Prometheus metrics c70a81a Drop constrain of versions <0.8 for PrettyTable. 9c33e71 Add kuryr-k8s-sanity command 2085524 Switch gates to OVN by default. ce7f56e Remove port from trunk on _cleanup_leftover_ports fe7d4de Added method for creating k8s events object. b0e1ded Add Python3 yoga unit tests 195c8e3 Update master for stable/xena Diffstat (except docs and test files) ------------------------------------- .gitignore | 2 +- .zuul.d/base.yaml | 277 ++++++++++------ .zuul.d/k8s-np-e2e.yaml | 143 ++++++++ .zuul.d/nodesets.yaml | 10 + .zuul.d/octavia.yaml | 151 --------- .zuul.d/project.yaml | 31 +- .zuul.d/sdn.yaml | 186 ----------- .zuul.d/tempest-jobs.yaml | 250 ++++++++++++++ ...{multinode.yaml => tempest-multinode-jobs.yaml} | 137 ++++---- cni.Dockerfile | 23 +- controller.Dockerfile | 14 +- devstack/lib/kubernetes | 43 ++- devstack/lib/kuryr_kubernetes | 146 ++++++--- devstack/local.conf.ovs.sample | 17 +- devstack/local.conf.sample | 15 +- devstack/plugin.sh | 4 +- devstack/settings | 7 +- kuryr_kubernetes/clients.py | 8 +- kuryr_kubernetes/cmd/sanity/__init__.py | 0 kuryr_kubernetes/cmd/sanity/checks.py | 85 +++++ kuryr_kubernetes/cmd/sanity_checks.py | 105 ++++++ kuryr_kubernetes/cni/daemon/service.py | 117 ++++--- kuryr_kubernetes/cni/plugins/k8s_cni_registry.py | 36 +- kuryr_kubernetes/cni/prometheus_exporter.py | 70 ++++ kuryr_kubernetes/cni/utils.py | 20 ++ kuryr_kubernetes/config.py | 18 + kuryr_kubernetes/controller/drivers/base.py | 4 +- kuryr_kubernetes/controller/drivers/lbaasv2.py | 17 +- .../controller/drivers/namespace_subnet.py | 32 +- .../controller/drivers/nested_vlan_vif.py | 31 +- .../controller/drivers/network_policy.py | 28 +- kuryr_kubernetes/controller/drivers/neutron_vif.py | 18 +- .../controller/drivers/node_subnets.py | 54 +-- kuryr_kubernetes/controller/drivers/utils.py | 101 +++++- kuryr_kubernetes/controller/drivers/vif_pool.py | 169 ++++++---- .../controller/handlers/kuryrnetwork.py | 58 +++- .../controller/handlers/kuryrnetworkpolicy.py | 28 +- kuryr_kubernetes/controller/handlers/kuryrport.py | 55 +++- kuryr_kubernetes/controller/handlers/lbaas.py | 197 ++++++----- .../controller/handlers/loadbalancer.py | 362 +++++++++++++-------- kuryr_kubernetes/controller/handlers/namespace.py | 23 ++ kuryr_kubernetes/controller/handlers/pipeline.py | 12 +- kuryr_kubernetes/controller/handlers/pod_label.py | 7 +- kuryr_kubernetes/controller/handlers/vif.py | 120 ++++--- .../controller/managers/prometheus_exporter.py | 192 +++++++++++ kuryr_kubernetes/controller/service.py | 6 +- kuryr_kubernetes/exceptions.py | 37 ++- kuryr_kubernetes/handlers/asynchronous.py | 6 +- kuryr_kubernetes/handlers/dispatch.py | 2 +- kuryr_kubernetes/handlers/logging.py | 5 +- kuryr_kubernetes/handlers/retry.py | 21 +- kuryr_kubernetes/k8s_client.py | 68 ++++ .../unit/cni/plugins/test_k8s_cni_registry.py | 2 +- .../controller/drivers/test_nested_vlan_vif.py | 19 +- .../unit/controller/drivers/test_neutron_vif.py | 13 +- .../unit/controller/drivers/test_node_subnets.py | 155 +++++++++ .../unit/controller/handlers/test_kuryrnetwork.py | 40 ++- .../unit/controller/handlers/test_loadbalancer.py | 188 ++++------- .../unit/controller/handlers/test_namespace.py | 33 ++ .../unit/controller/handlers/test_pipeline.py | 3 +- .../managers/test_prometheus_exporter.py | 169 ++++++++++ kuryr_kubernetes/utils.py | 81 +++++ lower-constraints.txt | 11 +- playbooks/copy-crio-logs.yaml | 14 + playbooks/get_amphora_tarball.yaml | 4 +- releasenotes/source/index.rst | 1 + releasenotes/source/xena.rst | 6 + requirements.txt | 7 +- setup.cfg | 2 + test-requirements.txt | 2 +- tools/gate/copy_crio_logs.sh | 29 ++ tools/gate/copy_k8s_logs.sh | 37 ++- 86 files changed, 3408 insertions(+), 1517 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index cb84f72..47f9607 100644 --- a/requirements.txt +++ b/requirements.txt @@ -5 +5 @@ -cotyledon>=1.5.0 # Apache-2.0 +cotyledon>=1.7.3 # Apache-2.0 @@ -21 +21 @@ os-vif>=1.12.0 # Apache-2.0 -PrettyTable<0.8,>=0.7.2 # BSD +PrettyTable>=0.7.2 # BSD @@ -25 +25 @@ stevedore>=1.20.0 # Apache-2.0 -grpcio>=1.12.0 # Apache-2.0 +grpcio>=1.25.0 # Apache-2.0 @@ -26,0 +27 @@ protobuf>=3.6.0 # 3-Clause BSD +prometheus_client>=0.6.0 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index 2e42c1a..9a6d4b2 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -9 +9 @@ ddt>=1.0.1 # MIT -docutils>=0.11 # OSI-Approved Open Source, Public Domain +docutils>=0.12 # OSI-Approved Open Source, Public Domain

1 0

ec2-api 14.0.0 (yoga)
by no-reply＠openstack.org 30 Mar '22

30 Mar '22

We are happy to announce the release of: ec2-api 14.0.0: OpenStack Ec2api Service This release is part of the yoga release series. The source is available from: https://opendev.org/openstack/ec2-api Download the package from: https://pypi.org/project/ec2-api Please report issues through: https://bugs.launchpad.net/ec2-api/+bugs For more details, please see below. Changes in ec2-api 13.0.0.0rc1..14.0.0 -------------------------------------- c1eaa49 Re-add python 3.6/3.7 in classifier dee854f Updating python testing as per Yoga testing runtime 65aa616 Include oslo.cache options to the generated configuration file 994d02b Changed minversion in tox to 3.18.0 aa02567 Use py3 as the default runtime for tox 3846493 Use TOX_CONSTRAINTS_FILE f9e7528 fix UT for cinderclient ab73c93 Add Python3 yoga unit tests 722b7b0 Run TripleO jobs on CentOS8 instead of CentOS7 a83177a Dep's should be restricted by upper-constraints Diffstat (except docs and test files) ------------------------------------- .gitignore | 2 +- .zuul.yaml | 6 ++---- README.rst | 3 ++- devstack/plugin.sh | 3 ++- ec2api/api/cloud.py | 14 ++++++++++---- ec2api/api/image.py | 4 ++-- ec2api/api/network_interface.py | 18 +++++++++++++++++- ec2api/api/subnet.py | 9 +++++---- ec2api/api/volume.py | 17 ++++++++++++++++- ec2api/metadata/api.py | 6 ++++++ etc/ec2api/ec2api-config-generator.conf | 1 + setup.cfg | 1 + tox.ini | 14 +++++++------- 16 files changed, 78 insertions(+), 31 deletions(-)

1 0

heat-dashboard 7.0.0 (yoga)
by no-reply＠openstack.org 30 Mar '22

30 Mar '22

We are gleeful to announce the release of: heat-dashboard 7.0.0: Heat Management Dashboard This release is part of the yoga release series. The source is available from: https://opendev.org/openstack/heat-dashboard Download the package from: https://tarballs.openstack.org/heat-dashboard/ Please report issues through: https://storyboard.openstack.org/#!/project/openstack/heat- dashboard For more details, please see below. Changes in heat-dashboard 6.0.0..7.0.0 -------------------------------------- 7729b75 Fix UT failure due to horizon system-scope support 458e9b0 Imported Translations from Zanata 157a343 Fix lower-constraints job e085f13 Fixed getting the location header 76cefac Update master for stable/xena Diffstat (except docs and test files) ------------------------------------- heat_dashboard/locale/es/LC_MESSAGES/django.po | 14 +- heat_dashboard/locale/ru/LC_MESSAGES/django.po | 14 +- .../locale/zh_Hant/LC_MESSAGES/django.po | 464 --------------------- heat_dashboard/test/helpers.py | 31 +- lower-constraints.txt | 11 +- releasenotes/source/index.rst | 1 + .../source/locale/ru/LC_MESSAGES/releasenotes.po | 36 +- releasenotes/source/xena.rst | 6 + test-requirements.txt | 1 - 9 files changed, 83 insertions(+), 495 deletions(-) Requirements updates -------------------- diff --git a/test-requirements.txt b/test-requirements.txt index 075d90f..cc9df55 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -13 +12,0 @@ coverage!=4.4,>=4.0 # Apache-2.0 -doc8>=0.6.0 # Apache-2.0

1 0

heat-agents 4.0.0 (yoga)
by no-reply＠openstack.org 30 Mar '22

30 Mar '22

We eagerly announce the release of: heat-agents 4.0.0: heat-agents This release is part of the yoga release series. The source is available from: https://opendev.org/openstack/heat-agents Download the package from: https://tarballs.openstack.org/heat-agents/ Please report issues through: https://bugs.launchpad.net/heat-agents/+bugs For more details, please see below. Changes in heat-agents 3.0.0..4.0.0 ----------------------------------- cb6bc9c Fix lower-constraints 8c489b8 Add Python3 yoga unit tests 15b82a1 Update master for stable/xena Diffstat (except docs and test files) ------------------------------------- .zuul.yaml | 2 +- lower-constraints.txt | 6 +++--- releasenotes/source/index.rst | 1 + releasenotes/source/xena.rst | 6 ++++++ 4 files changed, 11 insertions(+), 4 deletions(-)

1 0

murano-dashboard 13.0.0 (yoga)
by no-reply＠openstack.org 30 Mar '22

30 Mar '22

We are delighted to announce the release of: murano-dashboard 13.0.0: The Murano Dashboard This release is part of the yoga release series. The source is available from: https://opendev.org/openstack/murano-dashboard Download the package from: https://tarballs.openstack.org/murano-dashboard/ Please report issues through: https://bugs.launchpad.net/murano/+bugs For more details, please see below. Changes in murano-dashboard 12.0.0..13.0.0 ------------------------------------------ ad3ddf6c Fix the install murano-dashboard 0dbf31f1 Add tools to irrelevant-files 882a9c14 Add py39 classifier 81195976 Django 3.2 support 67c584cd Add Python3 yoga unit tests c6df893d Update master for stable/xena Diffstat (except docs and test files) ------------------------------------- .zuul.yaml | 3 ++- muranodashboard/catalog/views.py | 2 +- muranodashboard/environments/topology.py | 2 +- releasenotes/source/index.rst | 1 + releasenotes/source/xena.rst | 6 ++++++ setup.cfg | 1 + 10 files changed, 19 insertions(+), 9 deletions(-)

1 0

monasca-persister 6.0.0 (yoga)
by no-reply＠openstack.org 30 Mar '22

30 Mar '22

We are thrilled to announce the release of: monasca-persister 6.0.0: Moves metrics and alarm state transitions from the Message Queue to the Metrics and Alarms database. This release is part of the yoga release series. The source is available from: https://opendev.org/openstack/monasca-persister Download the package from: https://tarballs.openstack.org/monasca-persister/ Please report issues through: https://bugs.launchpad.net/monasca/+bugs For more details, please see below. Changes in monasca-persister 5.0.0..6.0.0 ----------------------------------------- 49e654a Add Python3 yoga unit tests 397c093 Update master for stable/xena Diffstat (except docs and test files) ------------------------------------- .zuul.yaml | 2 +- releasenotes/source/index.rst | 1 + releasenotes/source/xena.rst | 6 ++++++ 3 files changed, 8 insertions(+), 1 deletion(-)

1 0

masakari-monitors 13.0.0 (yoga)
by no-reply＠openstack.org 30 Mar '22

30 Mar '22

We are glad to announce the release of: masakari-monitors 13.0.0: Monitors for Masakari This release is part of the yoga release series. The source is available from: https://opendev.org/openstack/masakari-monitors Download the package from: https://tarballs.openstack.org/masakari-monitors/ Please report issues through: https://bugs.launchpad.net/masakari-monitors/+bugs For more details, please see below. Changes in masakari-monitors 12.0.0..13.0.0 ------------------------------------------- 741cffd Use LOG.warning instead of deprecated LOG.warn 4ecfb34 connection too much when large scale failure 45adf21 Updating python testing classifier as per Yoga testing runtime 7c476d0 host monitor by consul 857df76 Updating python testing classifier as per Yoga testing runtime 50677c2 Fix a typo 5198a3c Fix some typos 8af96ce Fix home_page in setup.cfg 7bece96 Add note for package maintainers in requirements.txt af0f140 Add Python3 yoga unit tests 71cc4b1 Update master for stable/xena Diffstat (except docs and test files) ------------------------------------- .zuul.yaml | 2 +- HACKING.rst | 2 + etc/masakarimonitors/matrix.yaml.sample | 19 ++ masakarimonitors/conf/__init__.py | 2 + masakarimonitors/conf/consul.py | 37 ++++ masakarimonitors/conf/host.py | 2 +- masakarimonitors/ha/masakari.py | 15 +- masakarimonitors/hacking/checks.py | 15 ++ .../hostmonitor/consul_check/__init__.py | 0 .../hostmonitor/consul_check/consul_helper.py | 122 +++++++++++++ .../hostmonitor/consul_check/manager.py | 193 +++++++++++++++++++++ .../hostmonitor/consul_check/matrix_helper.py | 77 ++++++++ .../introspectiveinstancemonitor/instance.py | 6 +- .../introspectiveinstancemonitor/qemu_utils.py | 8 +- .../unit/hostmonitor/consul_check/__init__.py | 0 .../hostmonitor/consul_check/test_consul_helper.py | 128 ++++++++++++++ .../unit/hostmonitor/consul_check/test_manager.py | 157 +++++++++++++++++ .../hostmonitor/consul_check/test_matrix_helper.py | 55 ++++++ ...or-driver-based-on-consul-03f7e619d91e7e06.yaml | 6 + releasenotes/source/index.rst | 1 + releasenotes/source/xena.rst | 6 + requirements.txt | 4 + setup.cfg | 4 +- tox.ini | 3 +- 27 files changed, 1059 insertions(+), 20 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 96f6a4b..1a5d635 100644 --- a/requirements.txt +++ b/requirements.txt @@ -18,0 +19 @@ pbr!=2.1.0,>=2.0.0 # Apache-2.0 +python-consul >=1.1.0 # MIT @@ -25,0 +27,3 @@ pbr!=2.1.0,>=2.0.0 # Apache-2.0 +# +# Note for package maintainers: just use the libvirt-python package version +# as seen in the Nova dependencies.

1 0

glance 24.0.0 (yoga)
by no-reply＠openstack.org 30 Mar '22

30 Mar '22

We eagerly announce the release of: glance 24.0.0: OpenStack Image Service This release is part of the yoga release series. The source is available from: https://opendev.org/openstack/glance Download the package from: https://tarballs.openstack.org/glance/ Please report issues through: https://bugs.launchpad.net/glance/+bugs For more details, please see below. Changes in glance 23.0.0.0rc1..24.0.0 ------------------------------------- daa602ba Change default value for [wsgi]/python_interpreter 69a4de82 Sync example configs for Yoga b434adba Yoga RC-1 release notes a34764ec Added a new API to expose store info 2a9a4c8e Fix overwriting of existing tags while creating new tags 87eae327 Cache management API endpoints 0457ab20 Make FIPS job non-voting ba5f556d Update migration constant bf226615 Add Python 3 only classifier 0f13754f Add fips check jobs f865b8ca [APIImpact] Quota usage API 753c74c3 Fix set_property_atomic() boolean type casting d95fd8ac tests: Remove check for os.set_inheritable eb1fdd8a doc: Remove info on running under Python 3 33874f09 Remove '__unicode__' magic methods 87b4b33e Remove glance.common.client._encode_headers 33741138 Remove final six usage f68e04f2 Remove six.assertRaisesRegex usage 931809c0 Remove remaining six.moves usage 87ba5616 Remove six.moves.urllib usage 9679ffc4 Remove six.moves.http_client usage 39e667a1 Remove six.moves.range usage 67b531b1 Replace six.BytesIO, six.StringIO usage 6bd7c188 Remove six.text_type, six.binary_type usage 800ba964 Fix tests on Python3.10 71c1e4b1 Bump SQLalchemy to version that supports PY3.9 0a5b5117 Use LOG.warning instead of deprecated LOG.warn 502fa0ff Remove six.iteritems usage 0562e333 Remove six.add_metaclass usage ed118391 Updating python testing as per Yoga testing runtime de8c8502 Replace FakeObject with mock.MagicMock 89769785 Imported Translations from Zanata 6fd949a9 Refactor glance cinder tests bfc7a178 Add "bochs" as a possible video model fd36d645 Update Interop doc 474c600b Add missing packages to test dependencies 458e2b7b Remove broken tempest-full-py3-opensuse15 job 947e541f Update qcow test to use qcow2 instead 0ca2f921 Fix typos 5e288201 Imported Translations from Zanata 88d586f0 Use singular they instead of "he/she" where possible 8436401b Remove dead psutil-related code 6bfe0a97 Add libpcre3-dev/pcre-devel to bindep.txt 37696e8c Use single quotes in image policies 416791f3 Bump oslo.policy to version 3.8.1 48929884 Bump oslo.log to version 4.5.0 b8c55efa Add Python3 yoga unit tests d7b66743 Update master for stable/xena fb3d3fa8 trivial: Double quote check_str for consistency f9258314 Make glance cinder multistore job voting Diffstat (except docs and test files) ------------------------------------- .zuul.yaml | 121 ++++--- HACKING.rst | 6 +- api-ref/source/v2/cache-manage.inc | 84 +++++ api-ref/source/v2/discovery-parameters.yaml | 25 ++ api-ref/source/v2/discovery.inc | 59 ++++ api-ref/source/v2/images-parameters.yaml | 8 + api-ref/source/v2/index.rst | 1 + api-ref/source/v2/metadefs-namespaces-tags.inc | 1 + api-ref/source/v2/metadefs-parameters.yaml | 7 + .../v2/samples/stores-list-detail-response.json | 19 ++ api-ref/source/v2/samples/usage-response.json | 20 ++ bindep.txt | 5 + etc/glance-api.conf | 121 +++++-- etc/glance-cache.conf | 11 +- etc/glance-manage.conf | 8 +- etc/glance-scrubber.conf | 19 +- etc/metadefs/compute-libvirt-image.json | 3 +- glance/api/common.py | 16 +- glance/api/middleware/cache.py | 6 +- glance/api/middleware/context.py | 4 +- glance/api/middleware/version_negotiation.py | 4 + glance/api/policy.py | 2 +- glance/api/v2/cached_images.py | 134 +++++++- glance/api/v2/discovery.py | 85 ++++- glance/api/v2/image_actions.py | 4 +- glance/api/v2/image_data.py | 5 +- glance/api/v2/image_members.py | 13 +- glance/api/v2/image_tags.py | 3 +- glance/api/v2/images.py | 41 +-- glance/api/v2/metadef_namespaces.py | 8 +- glance/api/v2/metadef_objects.py | 8 +- glance/api/v2/metadef_properties.py | 8 +- glance/api/v2/metadef_resource_types.py | 10 +- glance/api/v2/metadef_tags.py | 16 +- glance/api/v2/policy.py | 24 +- glance/api/v2/router.py | 42 +++ glance/api/v2/tasks.py | 23 +- glance/api/versions.py | 21 +- glance/async_/flows/api_image_import.py | 9 +- glance/async_/flows/base_import.py | 7 +- glance/async_/flows/convert.py | 2 +- glance/async_/flows/ovf_process.py | 17 +- glance/async_/flows/plugins/image_conversion.py | 3 +- glance/async_/taskflow_executor.py | 3 +- glance/async_/utils.py | 2 +- glance/cmd/cache_cleaner.py | 2 +- glance/cmd/cache_manage.py | 2 - glance/cmd/control.py | 2 - glance/cmd/manage.py | 3 +- glance/cmd/replicator.py | 46 ++- glance/common/auth.py | 8 +- glance/common/client.py | 74 ++--- glance/common/config.py | 17 +- glance/common/crypt.py | 14 +- glance/common/exception.py | 9 +- glance/common/format_inspector.py | 2 +- glance/common/location_strategy/__init__.py | 2 +- glance/common/location_strategy/store_type.py | 6 +- glance/common/property_utils.py | 9 +- glance/common/scripts/api_image_import/main.py | 9 +- glance/common/scripts/image_import/main.py | 10 +- glance/common/scripts/utils.py | 4 +- glance/common/store_utils.py | 6 +- glance/common/swift_store_utils.py | 6 +- glance/common/utils.py | 24 +- glance/common/wsgi.py | 37 +-- glance/db/__init__.py | 4 +- glance/db/migration.py | 2 +- glance/db/simple/api.py | 46 +-- .../db/sqlalchemy/alembic_migrations/__init__.py | 2 +- glance/db/sqlalchemy/api.py | 35 +- glance/db/sqlalchemy/metadata.py | 11 +- glance/db/sqlalchemy/metadef_api/namespace.py | 2 +- glance/db/sqlalchemy/metadef_api/object.py | 2 +- glance/db/sqlalchemy/metadef_api/property.py | 2 +- glance/db/sqlalchemy/metadef_api/tag.py | 12 +- glance/domain/__init__.py | 9 +- glance/domain/proxy.py | 4 +- glance/hacking/checks.py | 44 +-- glance/image_cache/__init__.py | 20 +- glance/image_cache/drivers/sqlite.py | 15 +- glance/image_cache/drivers/xattr.py | 9 +- glance/image_cache/prefetcher.py | 7 +- glance/locale/de/LC_MESSAGES/glance.po | 32 +- glance/locale/en_GB/LC_MESSAGES/glance.po | 276 +--------------- glance/locale/es/LC_MESSAGES/glance.po | 32 +- glance/locale/fr/LC_MESSAGES/glance.po | 32 +- glance/locale/it/LC_MESSAGES/glance.po | 32 +- glance/locale/ja/LC_MESSAGES/glance.po | 32 +- glance/locale/ko_KR/LC_MESSAGES/glance.po | 93 ++++-- glance/locale/pt_BR/LC_MESSAGES/glance.po | 32 +- glance/locale/ru/LC_MESSAGES/glance.po | 33 +- glance/locale/tr_TR/LC_MESSAGES/glance.po | 32 +- glance/locale/zh_CN/LC_MESSAGES/glance.po | 31 +- glance/locale/zh_TW/LC_MESSAGES/glance.po | 31 +- glance/location.py | 8 +- glance/notifier.py | 17 +- glance/policies/__init__.py | 4 + glance/policies/base.py | 9 +- glance/policies/cache.py | 75 +++++ glance/policies/discovery.py | 33 ++ glance/policies/image.py | 2 +- glance/quota/keystone.py | 26 ++ glance/schema.py | 3 +- glance/scrubber.py | 6 +- .../db/migrations/test_ocata_migrate01.py | 2 +- .../functional/test_healthcheck_middleware.py | 6 +- .../v2/test_legacy_update_cinder_store.py | 30 +- .../functional/v2/test_metadef_resourcetypes.py | 3 +- .../v2/test_property_quota_violations.py | 19 +- .../async_/flows/plugins/test_image_conversion.py | 20 ++ .../unit/common/scripts/image_import/test_main.py | 3 +- .../unit/common/scripts/test_scripts_utils.py | 3 +- playbooks/enable-fips.yaml | 3 + .../added-quota-usage-api-f1914054132f2021.yaml | 9 + .../added-store-detail-api-215810aa85dfbb99.yaml | 6 + releasenotes/notes/cache-api-b806ccfb8c5d9bb6.yaml | 9 + ...ix-md-tag-create-multiple-c04756cf5155983d.yaml | 13 + .../yoga-rc1-release-notes-153932161f52a038.yaml | 24 ++ releasenotes/source/index.rst | 1 + .../locale/en_GB/LC_MESSAGES/releasenotes.po | 8 +- .../source/locale/fr/LC_MESSAGES/releasenotes.po | 63 ---- releasenotes/source/xena.rst | 6 + requirements.txt | 10 +- setup.cfg | 2 + tools/test-setup.sh | 28 ++ tox.ini | 18 +- 199 files changed, 3115 insertions(+), 1873 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index bcdaa8c5..d14c8256 100644 --- a/requirements.txt +++ b/requirements.txt @@ -9 +9 @@ defusedxml>=0.6.0 # PSF -SQLAlchemy!=1.1.5,!=1.1.6,!=1.1.7,!=1.1.8,>=1.0.10 # MIT +SQLAlchemy>=1.3.14 # MIT @@ -36,2 +35,0 @@ pyOpenSSL>=17.1.0 # Apache-2.0 -# Required by openstack.common libraries -six>=1.11.0 # MIT @@ -41,2 +39,2 @@ oslo.i18n>=5.0.0 # Apache-2.0 -oslo.limit>=1.0.0 # Apache-2.0 -oslo.log>=4.3.0 # Apache-2.0 +oslo.limit>=1.4.0 # Apache-2.0 +oslo.log>=4.5.0 # Apache-2.0 @@ -46 +44 @@ oslo.reports>=1.18.0 # Apache-2.0 -oslo.policy>=3.7.0 # Apache-2.0 +oslo.policy>=3.8.1 # Apache-2.0

1 0

openstack-heat 18.0.0 (yoga)
by no-reply＠openstack.org 30 Mar '22

30 Mar '22

We are satisfied to announce the release of: openstack-heat 18.0.0: OpenStack Orchestration This release is part of the yoga release series. The source is available from: https://opendev.org/openstack/openstack-heat Download the package from: https://tarballs.openstack.org/heat/ For more details, please see below. Changes in openstack-heat 17.0.0.0rc1..18.0.0 --------------------------------------------- 968969b99 Fix compatibility with oslo.context >= 4.0.0 b1fe9752b Fix for tenacity 8.0.1 0fa19e7a9 Add Python 3 only classifier 9ed612906 Fix unit tests for croniter>=1.2.0 9af3af156 Bump lower constraints for OSC d5ef98b88 Updating python testing classifier as per Yoga testing runtime 80453f913 Adjust self.assertRaisesRegex messages for py310 a2fd56a93 Don't test zaqar in CI 575827c9a Skip aodhclient plugin test f5da6d210 Fix broken devstack plugin c63a2cbba Fix Pool resource update for session_persistence 2c5f6e7a8 Add intersphinx_mapping for sqlalchemy bf9186a37 Fallback to upstream for Fedora image 403fa55fe Fix None comparision when sorting by `updated_at` 29637ce94 Imported Translations from Zanata b6a2c2231 Catch all create stack project exceptions 83774a1c8 Use yaml.safe_load() in lbaas tests e70ff2e15 Allow for creating server_group with max_nova_api_microversion 5d27ba3c8 Remove python-ceilometerclient from requirements 9aedaa6d8 Fix ServerGroup create 315fbc4fd docs: Fix typo in developer guide 96d6084b8 Imported Translations from Zanata 9131940eb Drop six library ef731bca0 Fix timeout calc of nested resource groups 863d645d7 Reproduce bug story/2009237 2d0a951b6 Run TripleO jobs on CentOS8 instead of CentOS7 960601eb7 Add Python3 yoga unit tests c20bbba58 Update master for stable/xena 0f0508821 Use correct argument name for setting Nova KeyPair key type 3290d2ea2 Imported Translations from Zanata 4154029eb Add missing [oslo_reports] options 271156446 Drop support for Block Storage API v2 77bde0120 Add volumev3 to shared_services_types by default Diffstat (except docs and test files) ------------------------------------- .zuul.yaml | 9 +- config-generator.conf | 1 + devstack/lib/heat | 42 ++-- heat/common/auth_password.py | 8 +- heat/common/config.py | 2 +- heat/common/context.py | 4 +- heat/db/sqlalchemy/types.py | 2 + heat/engine/clients/os/__init__.py | 5 +- heat/engine/clients/os/cinder.py | 11 +- .../clients/os/keystone/heat_keystoneclient.py | 5 + heat/engine/resource.py | 4 +- .../resources/openstack/heat/resource_group.py | 18 +- .../resources/openstack/neutron/extrarouteset.py | 3 +- heat/engine/resources/openstack/nova/keypair.py | 2 +- .../resources/openstack/nova/server_group.py | 43 ++-- heat/engine/resources/openstack/octavia/pool.py | 10 +- heat/engine/service.py | 4 + heat/engine/stack.py | 5 +- heat/locale/de/LC_MESSAGES/heat.po | 13 +- heat/locale/es/LC_MESSAGES/heat.po | 12 +- heat/locale/fr/LC_MESSAGES/heat.po | 10 +- heat/locale/it/LC_MESSAGES/heat.po | 12 +- heat/locale/ja/LC_MESSAGES/heat.po | 9 +- heat/locale/ko_KR/LC_MESSAGES/heat.po | 8 +- heat/locale/pt_BR/LC_MESSAGES/heat.po | 9 +- heat/locale/ru/LC_MESSAGES/heat.po | 11 +- heat/locale/zh_CN/LC_MESSAGES/heat.po | 8 +- heat/locale/zh_TW/LC_MESSAGES/heat.po | 8 +- .../functional/test_resource_group.py | 54 +++++ lower-constraints.txt | 4 +- ...d_services_types-volumev3-a2c24233b5812e40.yaml | 5 + .../notes/volumev2-removal-13eeb4d7192578ee.yaml | 4 + releasenotes/source/index.rst | 1 + .../locale/en_GB/LC_MESSAGES/releasenotes.po | 230 ++++++++++++++------- .../source/locale/fr/LC_MESSAGES/releasenotes.po | 16 +- .../locale/ko_KR/LC_MESSAGES/releasenotes.po | 47 +---- releasenotes/source/xena.rst | 6 + requirements.txt | 3 +- setup.cfg | 2 + tox.ini | 3 +- 64 files changed, 450 insertions(+), 381 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 2f54c37aa..f263179a1 100644 --- a/requirements.txt +++ b/requirements.txt @@ -17 +17 @@ neutron-lib>=1.14.0 # Apache-2.0 -openstacksdk>=0.11.2 # Apache-2.0 +openstacksdk>=0.28.0 # Apache-2.0 @@ -39 +38,0 @@ python-blazarclient>=1.0.1 # Apache-2.0 -python-ceilometerclient>=2.5.0

1 0

cinder 20.0.0 (yoga)
by no-reply＠openstack.org 30 Mar '22

30 Mar '22

We are pumped to announce the release of: cinder 20.0.0: OpenStack Block Storage This release is part of the yoga release series. The source is available from: https://opendev.org/openstack/cinder Download the package from: https://tarballs.openstack.org/cinder/ Please report issues through: https://bugs.launchpad.net/cinder/+bugs For more details, please see below. 20.0.0 ^^^^^^ Prelude ******* Welcome to the Yoga release of the OpenStack Block Storage service (cinder). With this release, the Block Storage API version 3 has reached microversion **3.68**. The cinder team would like to bring the following points to your attention. Details may be found throughout this document. * Microversion 3.67 is introduced as a marker to indicate that any instance of the Block Storage API 3.67 or greater treats a project_id in the URL as optional. This change is backward compatible: the API can handle legacy URLs containing a project_id as well as URLs without a project_id. This is the case regardless of what microversion specified in a request. See the "New Features" section for details. * Microversion 3.68 introduces a new volume action, "os-reimage", that allows a user to replace the current content of a specified volume with the data of a specified image supplied by the Image service (glance). See the "New Features" section for details. * Some new backend storage drivers have been added, and many current drivers have added features and fixed bugs. Known Issues ************ * Just before release, Bug #1965847 (https://bugs.launchpad.net/cinder/+bug/1965847) was reported. When importing a backup record for a backup_id that currently exists, the import fails as expected. However, this operation has the unfortunate side effect that the existing backup record is deleted. Initial analysis of the bug indicates a small, isolated solution that should be backportable to stable branches. * When the Ceph backup driver is used for the backup service, restoring a backup to a volume created on a non-RBD backend fails. The cinder team has developed a fix but decided to do more thorough testing before including it in a release. When ready, the solution is expected to be backported to a future release in the Yoga series. The issue is being tracked as Bug #1895035 (https://bugs.launchpad.net/cinder/+bug/1895035). * Creating a volume of an encrypted volume type from an image in the Image service (Glance) using the generic NFS driver results in an unusable volume. The cinder team is working on a solution which is expected to be backported to a future release in the Yoga series. The issue is being tracked as Bug #1888680 (https://bugs.launchpad.net/cinder/+bug/1888680). * **Cinder use of cgroups v1** This note applies to deployments that are using the cinder configuration option "volume_copy_bps_limit" in its non-default value (the default is 0). The cinder-volume service depends on Linux Kernel Control Groups (cgroups) version 1 (https://www.kernel.org/doc/html/latest/admin- guide/cgroup-v1/cgroups.html) to control i/o throttling during some volume-copy and image-convert operations. Some Linux distributions, however, have changed to using cgroup v2 (https://www.kernel.org/doc/html/latest/admin-guide/cgroup-v2.html) by default and may have discontinued cgroups v1 support completely. Consult your Linux distribution's documentation for details. The cinder team is working on a throttling solution using cgroup v2, but it was not ready at the time of this release. The solution is expected to be backported to a future release in the Yoga series. This issue continues to be tracked as Bug #1942203 (https://bugs.launchpad.net/cinder/+bug/1942203). * **NVMe-oF issues** Cinder and Nova use the os-brick library to facilitate connections to volumes. The "nvmeof" os-brick connector has been refactored over the past few development cycles. In between the time of the Yoga os-brick release (os-brick 5.2.0) and this cinder release, several bugs were discovered in this connector. You can find these in the bug tracker with this query: https://bugs.launchpad.net/os-brick/+bugs?field.tag=nvme Bug Fixes ********* * Bug #1944577 (https://bugs.launchpad.net/cinder/+bug/1944577): Managing a volume to an encrypted type was never a good idea because there was no way to specify an encryption key ID so that the volume could be used. Requests to manage a volume to an encrypted volume type now result in an invalid request response. Changes in cinder 19.0.0.0rc1..20.0.0 ------------------------------------- bcec93ea1 Update policy matrix for Yoga a97fd2369 Add nvme known issues to yoga release notes 38c58c7e0 Add general known issues to yoga release notes 9c1aa92b9 Prohibit volume manage to an encrypted volume type a002f635b Update TOX_CONSTRAINTS_FILE for stable/yoga 50323f954 Update .gitreview for stable/yoga b69353b6c Add yoga release note prelude c04e2084f lightos - bugfix compression stats should be True 9e261bf1a db: Increase timeout for migration tests 634c81e69 Doc: IBM FlashSystem family update in IBM Spectrum Virtualize user guide 167826053 Hitachi: Add Target Port Assignment for VSP Driver a74513db9 Specify yoga os-brick in requirements 5c48b6fc3 Hitachi: Support AIX as host OS type 11d26b9f5 Hitachi: bugfix and refactoring for add maintenance parameters bb15d83b5 fix 'huawei dorado v6' FC initiator can be added to host d94f1381c Tests: Fix missing novaclient context arg in test_host_filters 88fd602ed [SVf] Manage host attachment using portsets 61f1179c0 Reset state robustification for volume os-reset_status fedd9b145 Followup: Address review comments on re-image patch d69e89ea3 Support volume re-image 171894c7f Add missing microversion entry for 3.67 18b8033b6 Fix request id mess on Cinder-API 369af76f8 db: Preserve API signatures 001b0e43d db: Move utility methods to top of file 52370e58f docs: Remove unnecessary 'blockstorage-' prefix 31f8ad4eb db: Enable auto-generation of database migrations 0d7f3ba86 docs: Rework and move upgrades guide 31303ed65 docs: Add whereto for testing redirect rules 8b5705156 db: Add tests to ensure we keep migrations in sync c3e8f0a8a db: Resolve additional migration-model mismatches 1990ce420 db: Add missing foreign keys, indexes to models be24c0c6e Fix typo in release note. 52d97807c PureStorage FlashArray: Add active/active replication 955d6a6e2 Update 'cinder-specs-core' description 88d3005df [SVf] update rccg name property to metadata e0f9e0ce5 [Lightos] standardize connector usage a03e10ceb Use LOG.warning instead of deprecated LOG.warn 31b34e91e Remove the need for project_id from API endpoints ea07317f0 [SVf] RevertToSnapshot for rep-volumes in group c569b7f22 [SVf] Fixed Detach for multi-attach volumes f1062f4be docs: Update "Getting your patch merged" ae5fd170f Imported Translations from Zanata e6859ded3 docs: Add docs for 'RateLimitingMiddleware' d5a8c7203 Remove attach and detach volume driver methods 2c3635b61 [SVf] Add cleanrate in volume-type extra specs efd476c74 mypy: RBD driver 1075d1d30 RBD driver: clean up _trash_purge exception handling beb287979 Lightbits LightOS driver 3143f7cf1 Doc: IBM flashsystem driver update 0c0a11026 db: Remove unnecessary timezone configuration 36bd8f5c9 Remove various unused code c4f5564d9 Add cinder volume drivers for NEC V series Storage 5f1e539f5 Remove unused variable 2e4b8dea9 PowerMax docs - Include a note in cinder backup section e38fb71aa Rework backup process to make it async 54ac21f73 mypy: Allow mypy to pass with requests-packaged urllib3 4082ed3be Hitachi: Make the parameters name variable for supporting OEM storages 2925aa974 Hitachi: Add maintenance parameters 43ca0d6e3 Remove block-box files 7ba9935a6 Volume transfers: Remove duplicate policy check fb8d5de5f Fix Typos from Review 819790 b06fe2197 Fix spacing in CapacityFilter debug log message 2bdc08678 Support Cinder FC driver for TOYOU NetStor 73d0818a9 Doc: Typos in Spectrum Virtulize family user guide d3cd45453 Imported Translations from Zanata ce34288e4 mypy: backup dc574fa7b db: Correct 'nullable' mismatches on models b59de266e db: Fix formatting of database models c064de299 Updating python testing as per Yoga testing runtime 18687a383 Fix log message error in capacity filter 80dc6c915 mypy: annotate volume/api.py d49b001f1 [SVF]:Fix multiple lsiogrp,lsvdisk calls in Retype. d67dcf42d Move nimble driver code to hpe folder 77da18785 fix 'huawei dorado v6' create new volume from snapshot error e5ef39604 Improve no_snapshot_gb_quota description 4bc498fe3 Run database migration tests 50bcacee8 Fix a typo error in explanatory notes 97cd6052a PowerMax Driver - Re-use existing initiator group/host. 97aeffa9f replace deprecated pyparsing method fce3e1a6e Update release cycle tasks 50e173101 [SVF] Fix Retype issue of mirror volume 104e3e049 Add default types info in admin docs ba28f2925 api-ref: Add info regarding default types d259197c2 Add info about __DEFAULT__ in install docs d5cfbf41f [Pure Storage] Add volume metadata 6904db860 DOC: Add cinder modules on initial configuration 32e856424 Fix misspelled get_time_comparsion_operators method name 25a5145a9 RBD: Check for OSError before using errno 713569987 pylint: Update to 2.11.1 8bb216dc1 [Pure Storage] Remove all REST version checks fb430df6f Clarify conditional_update return types 5df7daabe mypy: filter scheduler e644e3584 RBD: Open RBD images read-only where possible 25f2e27b2 [Pure Storage] Add check for NVMe-FC capable array 96384e139 Remove broken tempest-full-py3-opensuse15 job dcc191646 Fixed copy-on-write mode in GPFS NFS driver 8e0398ff9 Correct type annotations for utils.retry() 2ec222284 Fix: Race between attachment and volume deletion fd5ec459c Increase min version of oslo.vmware to 3.10.0 6f8d7e11e [ubuntu] Add tgt package for cinder storage ef0dcbeb2 Imported Translations from Zanata c1222fc00 Signature of base method in class 'AccelBase' f1431ff6d PowerMax Docs - Xena release notes 651c936f2 Fix typo in message policy deprecations dd0b1076d NetApp ONTAP: Fix sub-clone zapi call d98d8dd2f Pure Storage FlashArray - Version increment for Cinder drivers 888159918 Raise min version of ddt b7e294599 Update rbd warning message 35c078837 [Pure Storage] Add missing DB values when performing create CG from CG snap 91d0a6512 Use os-brick 5.0.1 309c20eab Fix a typo 853f08288 NetApp Solidfire: Fix retype and name exception on migration 89ec25b3d Cinder matrix - Removal of Snapshot Attachment c69e564c6 Fix: nfs format info limitation cefba8640 [SVF] Fix rccg and relationship creation issues 7689e46ca Add reviewing section to release notes doc 01d1b3e3a Tests: Improve RBD trash unit tests 4653773bc Seagate driver: fix get_volume_size() 9489f57d4 Raise min of oslo.db to 11.0.0 7187dbfb3 Fix cinder-manage db version ed4d5585e fixtures: Don't persist state in the Database fixture 4efd313d4 Erroneous log message args location causes a misconception c9f44d124 Imported Translations from Zanata bff1d26f6 Dell PowerVault: Fix "cinder manageable-list" 8f68fd47d Dell PowerVault driver: Fix documentation typos 85fbb317f Specify xena os-brick series in requirements 72c471408 Update SQLAlchemy related requirements 00ffdc0d4 Raise min of oslo.policy to 3.8.1 dc16eb075 Add deprecation notices to deprecated policy rules dfcf4817c Raise minimum oslo.log to 4.5.0 ca0587207 Add Python3 yoga unit tests a499372ca Update master for stable/xena ac2f8a4d8 RBD: Call trash operation when plain deletion fails 028b9a648 Turn off inline comments for mypy zuul job e8e0f8756 PowerMax Driver - Get manageable volumes fix 28e7a46af PowerMax Driver - Update unsupported retype combinations 794e31bba PowerMax Driver - Fix for GVG snapshot delete e07bf3787 Expose volume_attachments in Volume OVO 3aa00b087 Delete attachment on remove_export failure 68d494457 Fix detach notification 3cb65ed58 Remove unused config imports/objects 6ddbdc5e8 PowerMax Driver - Port load balancing fix 60b96656d Remove unused nested_contexts method 7fd59da14 Tests: Fix missing RBD delete_volume test case 32b7fcfc7 PowerMax Driver - refactoring feedback 38c8423b6 Tests: Remove brick_lvm mocks from all unit tests 1df0b544c Modify erroneous annotation 1634c5b29 mypy: update retry decorator in utils.py 1daded795 HPE 3PAR: Reuse existing session 61335da5b mypy: coordination.py d4ee73e58 KumoScale Driver replicated volume missing portals attaches without raid ee1b5e2b7 PowerMax Driver - Fix for legacy PowerMax OS around generations 2bd22f240 Fix extra_capabilities fdcad2010 PowerMax Driver - Fix for group snapshot deletion 075a5254c Mark QNAP driver as unsupported de8b3b0b0 Reject bad img formats for uploaded encrypted vols cbc3516b3 PowerMax Driver - Allow for volume uuid in manage volume 6ab6f7116 PowerMax Driver - Retype fix for replication f269346a4 Address new hacking enforcement 1084de1f1 PowerMax Driver - QoS should not be set on parent storage group cb094f5ab zuul: configure irrelevant-files for the rally job eb1b23dc6 LVM: Added NVMe TCP support for the nvmet target 3d8d14d76 Fix best_match() deprecation warning b9bc30779 Add iSCSI IPv6 support to Dell EMC XtremIO driver 2d5f02df2 PowerFlex documentation contains invalid paths 4c6be7e47 Use 'visibility' instead of 'is_public' when only use Glance API v2 Diffstat (except docs and test files) ------------------------------------- .gitignore | 6 +- .gitreview | 1 + .zuul.yaml | 10 +- HACKING.rst | 1 + api-ref/source/v3/index.rst | 19 + api-ref/source/v3/parameters.yaml | 30 + .../v3/samples/versions/version-show-response.json | 4 +- .../v3/samples/versions/versions-response.json | 4 +- .../v3/samples/volume-os-reimage-request.json | 6 + api-ref/source/v3/volume-manage.inc | 6 +- api-ref/source/v3/volumes-v3-types.inc | 52 +- api-ref/source/v3/volumes-v3-volumes-actions.inc | 45 +- api-ref/source/v3/volumes-v3-volumes.inc | 8 + cinder/api/common.py | 20 +- cinder/api/contrib/admin_actions.py | 51 +- cinder/api/contrib/volume_actions.py | 28 + cinder/api/contrib/volume_manage.py | 3 + cinder/api/microversions.py | 4 + cinder/api/middleware/auth.py | 123 +- cinder/api/middleware/request_id.py | 71 + cinder/api/openstack/__init__.py | 45 +- cinder/api/openstack/api_version_request.py | 6 +- cinder/api/openstack/rest_api_version_history.rst | 13 + cinder/api/openstack/wsgi.py | 16 +- cinder/api/schemas/volume_actions.py | 17 + cinder/api/v3/router.py | 58 +- cinder/api/v3/volumes.py | 2 +- cinder/backup/api.py | 87 +- cinder/backup/manager.py | 135 +- cinder/backup/rpcapi.py | 15 +- cinder/common/config.py | 11 +- cinder/compute/nova.py | 18 + cinder/coordination.py | 19 +- cinder/db/alembic.ini | 4 +- cinder/db/api.py | 279 +- cinder/db/migration.py | 6 +- cinder/db/migrations/env.py | 19 +- .../db/migrations/versions/921e1a36b076_initial.py | 8 +- cinder/db/sqlalchemy/api.py | 560 +- cinder/db/sqlalchemy/models.py | 651 ++- cinder/image/accelerator.py | 4 +- cinder/image/glance.py | 6 +- cinder/interface/volume_driver.py | 19 - cinder/locale/de/LC_MESSAGES/cinder.po | 29 +- cinder/locale/es/LC_MESSAGES/cinder.po | 28 +- cinder/locale/fr/LC_MESSAGES/cinder.po | 5798 -------------------- cinder/locale/it/LC_MESSAGES/cinder.po | 5707 ------------------- cinder/locale/ja/LC_MESSAGES/cinder.po | 32 +- cinder/locale/ko_KR/LC_MESSAGES/cinder.po | 82 +- cinder/locale/pt_BR/LC_MESSAGES/cinder.po | 5630 ------------------- cinder/locale/ru/LC_MESSAGES/cinder.po | 5585 ------------------- cinder/locale/zh_CN/LC_MESSAGES/cinder.po | 30 +- cinder/locale/zh_TW/LC_MESSAGES/cinder.po | 5214 ------------------ cinder/objects/backup.py | 35 +- cinder/objects/base.py | 6 +- cinder/objects/volume.py | 23 +- cinder/opts.py | 20 +- cinder/policies/base.py | 10 +- cinder/policies/messages.py | 4 +- cinder/policies/volume_actions.py | 22 + cinder/scheduler/base_filter.py | 8 +- cinder/scheduler/base_handler.py | 4 +- cinder/scheduler/base_weight.py | 27 +- cinder/scheduler/evaluator/evaluator.py | 7 +- cinder/scheduler/filter_scheduler.py | 80 +- cinder/scheduler/filters/capacity_filter.py | 9 +- cinder/scheduler/flows/create_volume.py | 47 +- cinder/scheduler/host_manager.py | 167 +- cinder/scheduler/scheduler_options.py | 2 +- cinder/scheduler/weights/capacity.py | 8 +- cinder/scheduler/weights/stochastic.py | 2 +- cinder/scheduler/weights/volume_number.py | 2 +- .../unit/api/contrib/test_volume_image_metadata.py | 6 - .../unit/attachments/test_attachments_manager.py | 66 +- .../volume/drivers/dell_emc/powerflex/mocks.py | 3 - .../drivers/dell_emc/powermax/powermax_data.py | 38 +- .../dell_emc/powermax/powermax_fake_objects.py | 2 +- .../dell_emc/powermax/test_powermax_common.py | 256 +- .../drivers/dell_emc/powermax/test_powermax_fc.py | 3 +- .../dell_emc/powermax/test_powermax_masking.py | 84 +- .../dell_emc/powermax/test_powermax_provision.py | 18 + .../dell_emc/powermax/test_powermax_rest.py | 32 +- .../dell_emc/powermax/test_powermax_utils.py | 5 + .../powerstore/test_volume_attach_detach.py | 4 +- .../unit/volume/drivers/dell_emc/test_xtremio.py | 19 + .../drivers/hitachi/test_hitachi_hbsd_rest_fc.py | 168 +- .../hitachi/test_hitachi_hbsd_rest_iscsi.py | 123 +- .../unit/volume/drivers/{ => hpe}/test_nimble.py | 14 +- .../volume/drivers/huawei/test_huawei_drivers.py | 83 +- .../unit/volume/drivers/ibm/test_ds8k_proxy.py | 4 +- .../unit/volume/drivers/ibm/test_storwize_svc.py | 576 +- .../drivers/inspur/as13000/test_as13000_driver.py | 3 - .../volume/drivers/lightos/test_lightos_storage.py | 773 +++ .../unit/volume/drivers/nec/v/test_nec_rest_fc.py | 383 ++ .../volume/drivers/nec/v/test_nec_rest_iscsi.py | 403 ++ .../netapp/dataontap/client/test_client_cmode.py | 36 + .../volume/drivers/solidfire/test_solidfire.py | 92 +- .../unit/volume/drivers/toyou/test_acs5000.py | 782 ++- .../drivers/veritas_access/test_veritas_iscsi.py | 2 - .../unit/volume/flows/test_create_volume_flow.py | 9 +- cinder/utils.py | 16 +- cinder/volume/api.py | 684 ++- cinder/volume/driver.py | 47 +- cinder/volume/drivers/dell_emc/powerflex/driver.py | 7 +- cinder/volume/drivers/dell_emc/powermax/common.py | 406 +- cinder/volume/drivers/dell_emc/powermax/fc.py | 2 +- cinder/volume/drivers/dell_emc/powermax/masking.py | 73 +- .../volume/drivers/dell_emc/powermax/provision.py | 3 +- cinder/volume/drivers/dell_emc/powermax/rest.py | 11 +- cinder/volume/drivers/dell_emc/powermax/utils.py | 39 +- cinder/volume/drivers/dell_emc/xtremio.py | 11 +- cinder/volume/drivers/hitachi/hbsd_common.py | 199 +- cinder/volume/drivers/hitachi/hbsd_fc.py | 64 +- cinder/volume/drivers/hitachi/hbsd_iscsi.py | 47 +- cinder/volume/drivers/hitachi/hbsd_rest.py | 254 +- cinder/volume/drivers/hitachi/hbsd_rest_api.py | 126 +- cinder/volume/drivers/hitachi/hbsd_rest_fc.py | 52 +- cinder/volume/drivers/hitachi/hbsd_rest_iscsi.py | 27 +- cinder/volume/drivers/hitachi/hbsd_utils.py | 78 +- cinder/volume/drivers/hpe/hpe_3par_base.py | 206 +- cinder/volume/drivers/hpe/hpe_3par_common.py | 27 - cinder/volume/drivers/{ => hpe}/nimble.py | 6 +- cinder/volume/drivers/huawei/common.py | 131 +- cinder/volume/drivers/huawei/constants.py | 7 + cinder/volume/drivers/huawei/huawei_conf.py | 39 +- cinder/volume/drivers/huawei/huawei_driver.py | 56 +- cinder/volume/drivers/huawei/huawei_utils.py | 7 + cinder/volume/drivers/huawei/rest_client.py | 43 +- cinder/volume/drivers/ibm/flashsystem_fc.py | 3 - cinder/volume/drivers/ibm/gpfs.py | 30 +- .../volume/drivers/ibm/storwize_svc/replication.py | 4 +- .../ibm/storwize_svc/storwize_svc_common.py | 215 +- .../drivers/ibm/storwize_svc/storwize_svc_fc.py | 35 +- .../drivers/ibm/storwize_svc/storwize_svc_iscsi.py | 78 +- .../drivers/inspur/instorage/instorage_fc.py | 3 - cinder/volume/drivers/kioxia/kumoscale.py | 3 +- cinder/volume/drivers/lightos.py | 1492 +++++ cinder/volume/drivers/lvm.py | 2 +- cinder/volume/drivers/nec/v/__init__.py | 0 cinder/volume/drivers/nec/v/nec_v_fc.py | 72 + cinder/volume/drivers/nec/v/nec_v_iscsi.py | 71 + cinder/volume/drivers/nec/v/nec_v_rest.py | 279 + cinder/volume/drivers/nec/v/nec_v_utils.py | 50 + .../volume/drivers/netapp/dataontap/block_cmode.py | 10 +- .../netapp/dataontap/client/client_cmode.py | 7 +- .../volume/drivers/netapp/dataontap/nfs_cmode.py | 8 +- cinder/volume/drivers/pure.py | 308 +- cinder/volume/drivers/qnap.py | 3 + cinder/volume/drivers/rbd.py | 466 +- cinder/volume/drivers/remotefs.py | 13 +- cinder/volume/drivers/solidfire.py | 76 +- cinder/volume/drivers/stx/client.py | 61 +- cinder/volume/drivers/stx/common.py | 92 + cinder/volume/drivers/stx/fc.py | 22 + cinder/volume/drivers/stx/iscsi.py | 22 + .../volume/drivers/toyou/acs5000/acs5000_common.py | 366 +- cinder/volume/drivers/toyou/acs5000/acs5000_fc.py | 165 + .../volume/drivers/toyou/acs5000/acs5000_iscsi.py | 80 +- cinder/volume/drivers/veritas_cnfs.py | 2 +- cinder/volume/flows/manager/create_volume.py | 11 +- cinder/volume/manager.py | 116 +- cinder/volume/rpcapi.py | 18 +- cinder/volume/targets/nvmeof.py | 1 + cinder/volume/targets/nvmet.py | 6 +- cinder/volume/volume_utils.py | 50 - contrib/block-box/.gitignore | 1 - contrib/block-box/LICENSE | 201 - contrib/block-box/Makefile | 21 - contrib/block-box/README.CVOL-LVM.md | 49 - contrib/block-box/README.md | 176 - contrib/block-box/cinder.rc | 5 - contrib/block-box/contrib/cinderflex | 208 - .../block-box/docker-compose-add-vol-service.yml | 28 - contrib/block-box/docker-compose.yml | 87 - .../docker-entrypoint-initdb.d/script.sql | 5 - contrib/block-box/etc/api-paste.ini | 55 - contrib/block-box/etc/cinder.conf | 26 - contrib/block-box/etc/cinder.conf.keystone | 35 - contrib/block-box/etc/cinder.conf.sf | 24 - contrib/block-box/etc/cinder.conf.solidfire | 23 - contrib/block-box/etc/logging.conf | 76 - contrib/block-box/etc/policy.json | 141 - contrib/block-box/etc/rootwrap.conf | 27 - contrib/block-box/scripts/cinder-api.sh | 7 - contrib/block-box/scripts/lvm-service.sh | 26 - ...ession.rst => accelerate-image-compression.rst} | 0 ...orage-api-throughput.rst => api-throughput.rst} | 0 ...ty-zone-type.rst => availability-zone-type.rst} | 0 ...ckstorage-backup-disks.rst => backup-disks.rst} | 0 ...e-basic-volume-qos.rst => basic-volume-qos.rst} | 0 ...e-boot-from-volume.rst => boot-from-volume.rst} | 0 ...pacity-based-qos.rst => capacity-based-qos.rst} | 0 ...nsistency-groups.rst => consistency-groups.rst} | 0 ...ter-weighing.rst => driver-filter-weighing.rst} | 0 ...ralized_filters.rst => generalized-filters.rst} | 0 ...e-get-capabilities.rst => get-capabilities.rst} | 0 .../admin/{blockstorage-groups.rst => groups.rst} | 0 ...age-volume-cache.rst => image-volume-cache.rst} | 0 ...lio-iscsi-support.rst => lio-iscsi-support.rst} | 0 ...orage-manage-volumes.rst => manage-volumes.rst} | 38 +- ...storage-multi-backend.rst => multi-backend.rst} | 0 ...lockstorage-nfs-backend.rst => nfs-backend.rst} | 0 ...over-subscription.rst => over-subscription.rst} | 0 ...dth.rst => ratelimit-volume-copy-bandwidth.rst} | 0 .../{blockstorage-security.rst => security.rst} | 0 ...ckstorage-troubleshoot.rst => troubleshoot.rst} | 0 ...xtra-specs.rst => user-visible-extra-specs.rst} | 0 ...me-backed-image.rst => volume-backed-image.rst} | 0 ...import.rst => volume-backups-export-import.rst} | 0 ...orage-volume-backups.rst => volume-backups.rst} | 0 ...e-volume-migration.rst => volume-migration.rst} | 0 ...lume-multiattach.rst => volume-multiattach.rst} | 0 ...umber-weigher.rst => volume-number-weigher.rst} | 0 .../drivers/dell-emc-powerflex-driver.rst | 14 +- .../drivers/dell-emc-powermax-driver.rst | 99 +- .../drivers/dell-emc-powervault-me.rst | 6 +- .../drivers/dell-emc-unity-driver.rst | 2 +- .../block-storage/drivers/dell-emc-vnx-driver.rst | 2 +- .../drivers/ibm-flashsystem-volume-driver.rst | 11 +- .../drivers/ibm-storwize-svc-driver.rst | 97 +- .../block-storage/drivers/kaminario-driver.rst | 2 +- .../drivers/lightbits-lightos-driver.rst | 143 + .../drivers/nec-storage-v-series-driver.rst | 139 + .../block-storage/drivers/nimble-volume-driver.rst | 6 +- .../block-storage/drivers/toyou-acs5000-driver.rst | 72 - .../block-storage/drivers/toyou-netstor-driver.rst | 106 + .../block-storage/policy-personas.rst | 1084 +--- .../block-storage/samples/api-paste.ini.inc | 4 + .../block-storage/volume-encryption.rst | 2 +- .../configuration/tables/cinder-storwize.inc | 2 + .../install/cinder-storage-install-ubuntu.rst | 2 +- etc/cinder/api-paste.ini | 29 +- mypy-files.txt | 19 + .../add-volume-re-image-api-6f02dcefd4975a66.yaml | 40 + ...-clustered-nvmetcp-driver-d1ef8f83263921f2.yaml | 8 + ...918889-xtremio-iscsi-ipv6-05c59b897da5c01b.yaml | 5 + .../bug-1922255-dell-powervault-manage-volumes.rst | 6 + .../notes/bug-1934168-a61c71869742867d.yaml | 9 + .../notes/bug-193688-bb045badcd5aecad.yaml | 12 + ...with-multiple-partnership-c437ebbb511879b9.yaml | 8 + ...ti_attach_type_volume_fix-b9a882a7faa8eed6.yaml | 7 + ...when-plain-deletion-fails-50cef4a8a8010ba9.yaml | 24 + ...a-for-clone-group-volumes-baa6bebcf8caacb8.yaml | 7 + ...-manage-to-encrypted-type-b5b5d7f8360f037f.yaml | 8 + ...1947518-rbd-open-readonly-ba523c4b0ddbba76.yaml | 9 + ...pe_issue_of_mirror_volume-5f37c265bee89d97.yaml | 7 + ...iple-ssh-calls-for-retype-d3b56379b7d8b049.yaml | 7 + ...x-capacity-filter-message-456dea41fa8a4a1b.yaml | 5 + ..._for_rep_volumes_in_group-e3ff6c87edd4de39.yaml | 7 + releasenotes/notes/bug-gpfs-fix-nfs-cow.yaml | 10 + .../notes/bug_1945824-7f8f238e274ddebd.yaml | 5 + .../detach-notification-31ae15dafdef36c1.yaml | 9 + .../notes/detach-race-delete-012820ad9c8dbe16.yaml | 6 + .../notes/fix-request_id-6f6972b2c12d1a18.yaml | 15 + .../notes/fix-size-reporting-seagate-driver.rst | 5 + .../fix-sub-clone-operation-f42a84ab17930f24.yaml | 7 + ...ix-transfer-accept-policy-7594806372b14284.yaml | 7 + .../hitachi-vsp-aix-os-type-23bf7cc3b98dff3a.yaml | 7 + ...hitachi-vsp-tgt-port-asgn-7536da008990824a.yaml | 9 + .../hpe-3par-reuse-session-4439cb07b9118867.yaml | 6 + ...svf-add-cleanrate-support-e246a8f218d2f22e.yaml | 6 + ...attachment-using-portsets-0003c54b185f0eb2.yaml | 5 + .../notes/lvm-nvmet-tcp-72a41be1a1fe0fbd.yaml | 6 + .../mark-unsupported-gnap-739f90232c60ab3e.yaml | 11 + ...c_v_storage_volume_driver-e3cb7e3c496ab066.yaml | 4 + .../nimble-change-location-277b7fc0c39fd91d.yaml | 12 + .../powermax-bug-1930290-4f598329a6ced006.yaml | 7 + .../powermax-existing-host-092f7daf29053d82.yaml | 6 + ...max_legacy_generation_fix-09e437f955cd9d70.yaml | 8 + ...oject-id-optional-in-urls-db97e2c447167853.yaml | 25 + .../pure-check-nvmefc-ports-cf2aec3952d8192f.yaml | 5 + ...age-change-purity-support-b94057d3842a80a8.yaml | 16 + .../pure_aa_replication-e3f5f6666f0b0c43.yaml | 6 + ...orage_add_volume_metadata-89f1e23573efcf83.yaml | 8 + ...failure_leaves_attachment-24e0c648269b0177.yaml | 6 + ...me-exception-on-migration-2af26f095b7cb345.yaml | 10 + ...idfire-no-attach-metadata-b17729ebd34703db.yaml | 6 + ...storage-acs5000-fc-driver-f0d7428924bfeda1.yaml | 4 + .../notes/yoga-known-issues-7a0dd15cbe080d7e.yaml | 47 + .../yoga-known-issues-nvme-a342a1f0232d2bc2.yaml | 13 + .../yoga-release-prelude-9fc369cf00df1a48.yaml | 23 + releasenotes/source/index.rst | 1 + .../locale/en_GB/LC_MESSAGES/releasenotes.po | 89 +- releasenotes/source/xena.rst | 6 + requirements.txt | 34 +- setup.cfg | 1 + test-requirements.txt | 8 +- tox.ini | 19 +- 364 files changed, 14630 insertions(+), 34985 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 48af461c4..9c5cbc1fd 100644 --- a/requirements.txt +++ b/requirements.txt @@ -5 +5 @@ -pbr>=5.5.1 # Apache-2.0 +pbr>=5.8.0 # Apache-2.0 @@ -7 +7 @@ decorator>=4.4.2 # BSD -eventlet>=0.30.1 # MIT +eventlet>=0.30.1,!=0.32.0 # MIT @@ -18,4 +18,4 @@ oslo.config>=8.3.2 # Apache-2.0 -oslo.concurrency>=4.4.0 # Apache-2.0 -oslo.context>=3.1.1 # Apache-2.0 -oslo.db>=8.4.0 # Apache-2.0 -oslo.log>=4.4.0 # Apache-2.0 +oslo.concurrency>=4.5.0 # Apache-2.0 +oslo.context>=3.4.0 # Apache-2.0 +oslo.db>=11.0.0 # Apache-2.0 +oslo.log>=4.6.1 # Apache-2.0 @@ -24,2 +24,2 @@ oslo.middleware>=4.1.1 # Apache-2.0 -oslo.policy>=3.6.2 # Apache-2.0 -oslo.privsep>=2.4.0 # Apache-2.0 +oslo.policy>=3.8.1 # Apache-2.0 +oslo.privsep>=2.6.2 # Apache-2.0 @@ -28,2 +28,2 @@ oslo.rootwrap>=6.2.0 # Apache-2.0 -oslo.serialization>=4.1.0 # Apache-2.0 -oslo.service>=2.5.0 # Apache-2.0 +oslo.serialization>=4.2.0 # Apache-2.0 +oslo.service>=2.8.0 # Apache-2.0 @@ -31 +31 @@ oslo.upgradecheck>=1.1.1 # Apache-2.0 -oslo.utils>=4.8.0 # Apache-2.0 +oslo.utils>=4.12.1 # Apache-2.0 @@ -51 +51 @@ six>=1.15.0 # MIT -SQLAlchemy>=1.3.19 # MIT +SQLAlchemy>=1.4.23 # MIT @@ -57,4 +57,4 @@ WebOb>=1.8.6 # MIT -oslo.i18n>=5.0.1 # Apache-2.0 -oslo.vmware>=3.8.0 # Apache-2.0 -os-brick>=4.3.1 # Apache-2.0 -os-win>=5.4.0 # Apache-2.0 +oslo.i18n>=5.1.0 # Apache-2.0 +oslo.vmware>=3.10.0 # Apache-2.0 +os-brick>=5.2.0 # Apache-2.0 +os-win>=5.5.0 # Apache-2.0 @@ -63 +63 @@ google-api-python-client>=1.11.0 # Apache-2.0 -castellan>=3.6.0 # Apache-2.0 +castellan>=3.7.0 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index 731e4e59c..51a74cf7d 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -10 +10 @@ flake8-logging-format>=0.6.0 # Apache-2.0 -stestr>=3.1.0 # Apache-2.0 +stestr>=3.2.1 # Apache-2.0 @@ -12 +12 @@ coverage>=5.5 # Apache-2.0 -ddt>=1.4.1 # MIT +ddt>=1.4.4 # MIT @@ -14 +14 @@ fixtures>=3.0.0 # Apache-2.0/BSD -oslotest>=4.4.1 # Apache-2.0 +oslotest>=4.5.0 # Apache-2.0 @@ -17 +17 @@ psycopg2>=2.8.5 # LGPL/ZPL -SQLAlchemy-Utils>=0.36.8 # BSD License +SQLAlchemy-Utils>=0.37.8 # BSD License

1 0