February 2022 - Release-announce - lists.openstack.org

oslo.versionedobjects 2.6.0 (yoga)
by no-reply＠openstack.org 16 Feb '22

16 Feb '22

We are happy to announce the release of: oslo.versionedobjects 2.6.0: Oslo Versioned Objects library This release is part of the yoga release series. The source is available from: https://opendev.org/openstack/oslo.versionedobjects Download the package from: https://pypi.org/project/oslo.versionedobjects Please report issues through: https://bugs.launchpad.net/oslo.versionedobjects/+bugs For more details, please see below. Changes in oslo.versionedobjects 2.5.0..2.6.0 --------------------------------------------- 25d34d6 Update python testing classifier e7b6d52 Add Python3 yoga unit tests c2e6c12 Update master for stable/xena Diffstat (except docs and test files) ------------------------------------- .zuul.yaml | 2 +- releasenotes/source/index.rst | 1 + releasenotes/source/xena.rst | 6 ++++++ setup.cfg | 1 + 4 files changed, 9 insertions(+), 1 deletion(-)

1 0

glance_store 3.0.0 (yoga)
by no-reply＠openstack.org 16 Feb '22

16 Feb '22

We are amped to announce the release of: glance_store 3.0.0: OpenStack Image Service Store Library This release is part of the yoga release series. The source is available from: https://opendev.org/openstack/glance_store Download the package from: https://pypi.org/project/glance_store For more details, please see below. 3.0.0 ^^^^^ Bug Fixes * Bug #1959913 (https://bugs.launchpad.net/glance- store/+bug/1959913): Added wait between the volume being extended and the new size being detected while opening the volume device. Changes in glance_store 2.7.0..3.0.0 ------------------------------------ f3433ed Cinder store: Wait for device resize e1ced9e Correct attachment_complete call 8b4d97a Pass valid IP address to os-brick 3d221ec [RBD] Clone v2: Image is unusable if deletion fails 8bc3f81 Updating python testing classifier as per Yoga testing runtime 6295d2e Imported Translations from Zanata 5677ae3 nit: Correct debug log fe51a87 Cleanup devstack jobs e4930e5 Fix documentation build with Sphinx>=4.2.0 e6b1e2d Fix typos 68200a8 Add Python3 yoga unit tests bf8418c Update master for stable/xena 5d1598f setup.cfg: Replace dashes with underscores 72b46d1 Fix option load for swift/vmware Diffstat (except docs and test files) ------------------------------------- .zuul.yaml | 5 +- glance_store/_drivers/cinder.py | 53 +++++++++- glance_store/_drivers/filesystem.py | 2 +- glance_store/_drivers/rbd.py | 20 +++- glance_store/_drivers/swift/store.py | 6 +- glance_store/_drivers/vmware_datastore.py | 2 +- glance_store/common/attachment_state_manager.py | 2 +- .../notes/bug-1954883-3666d63a3c0233f1.yaml | 13 +++ .../fix-ip-in-connector-info-36b95d9959f10f63.yaml | 6 ++ .../fix-wait-device-resize-c282940b71a3748e.yaml | 7 ++ releasenotes/source/index.rst | 1 + .../locale/en_GB/LC_MESSAGES/releasenotes.po | 114 ++++++++++++++++++++- releasenotes/source/xena.rst | 6 ++ setup.cfg | 9 +- tox.ini | 2 +- 20 files changed, 392 insertions(+), 41 deletions(-)

1 0

oslo.messaging 12.13.0 (yoga)
by no-reply＠openstack.org 16 Feb '22

16 Feb '22

We are delighted to announce the release of: oslo.messaging 12.13.0: Oslo Messaging API This release is part of the yoga release series. The source is available from: https://opendev.org/openstack/oslo.messaging Download the package from: https://pypi.org/project/oslo.messaging Please report issues through: https://bugs.launchpad.net/oslo.messaging/+bugs For more details, please see below. 12.13.0 ^^^^^^^ New Features * Adding support for quorum queues. Quorum queues are enabled if the "rabbit_quorum_queue" parameter is sets ("x-queue-type: quorum"). Setting x-queue-type to quorum means that replicated FIFO queue based on the Raft consensus algorithm will be used. It is available as of RabbitMQ 3.8.0. The quorum queues are durable by default ("amqp_durable_queues") will be ignored. when enabled the HA queues ("rabbit_ha_queues") aka mirrored queues should be disabled since the queue can't be both types at the same time Changes in oslo.messaging 12.12.0..12.13.0 ------------------------------------------ 7e8acbf8 Adding support for rabbitmq quorum queues Diffstat (except docs and test files) ------------------------------------- oslo_messaging/_drivers/amqp.py | 4 +- oslo_messaging/_drivers/impl_rabbit.py | 59 +++++++++++++++++++--- ...support_for_quorum_queues-3101d055b492289e.yaml | 11 ++++ 4 files changed, 66 insertions(+), 9 deletions(-)

1 0

openstack-governance 0.12.0
by no-reply＠openstack.org 16 Feb '22

16 Feb '22

We are pumped to announce the release of: openstack-governance 0.12.0: OpenStack Governance Documents The source is available from: https://opendev.org/openstack/openstack-governance Download the package from: https://tarballs.openstack.org/governance/ For more details, please see below. Changes in openstack-governance 0.11.0..0.12.0 ---------------------------------------------- 72a3018a Clean generated files before run in docs target fcbfe33d Add timelines to few of the Chair duties. 0fee3b97 Continue to maintain the neutron-fwaas project 63a41a49 Remove security-specs from security sig d95ab28b Rename skyline project repo 9484073d Cleanup expired extra-atcs b3e4cc67 Fix hardcoded extlinks link error in sphinx 4.4.0 4348fb36 Add proposed community goal for FIPS compatibility and compliance 4450e822 Add the cinder-nimblestorage charm to Openstack charms 2666de8c [masakari] Transfer PTL role to suzhengwei 751d815f Starting the 'Z' release naming process 1170b571 Add the cinder-solidfire charm to Openstack charms 7718c031 Add Skyline as an official project 312e1c70 Clarify that selected are Active goal as per new model 076ffed0 Address followup comments to secure RBAC community goal 75d6efad Updating the Yoga testing runtime f88b94be Add NVidia vGPU plugin charm to OpenStack charms ac29ea21 Move completed goals into the completed directory acdf04a9 Select secure and consistent RBAC as a community-wide goal 4a2df751 Rework the yoga secure RBAC community goal 80c7f7e4 Add ansible-collection-kolla repo to Kolla project 4a31ed47 Add 'goal-proposal' topic vote in review check status tool c9b37b20 Retire training-labs repo 847803f5 Remove office hours in favour of weekly meetings 2f4e9b25 Retire puppet-senlin 8894cb8c Add ProxySQL repository for OpenStack-Ansible e65769df Update Yoga testing runtime 4d2720d3 Remove oslo independent deliverables from stable policy 3d8d0e0b Decouple the community-wide goals from cycle release 753fbb7f Setting Spryos as the Magnum PTL 1a935567 Unselect RBAC goal to rework the implementation 158e2be5 Merge 'Technical Writing' SIG into TC 90d80c57 Add openstack/ci-log-processing project into TaCT c8217883 kolla-cli: enter retirement 96f47a8d Update venus repos c420c9ac Add TC Video meeting transcripts c688a93a Propose changes to the stable core team 59702817 Add the cinder-netapp charm to Openstack charms 6ffa72cb Retire puppet-freezer Diffstat (except docs and test files) ------------------------------------- CHAIR.rst | 17 +- goals/completed/index.rst | 10 + goals/{selected => completed}/ocata/index.rst | 0 .../ocata/remove-incubated-oslo-code.rst | 0 .../pike/deploy-api-in-wsgi.rst | 4 +- goals/{selected => completed}/pike/index.rst | 0 goals/{selected => completed}/pike/python35.rst | 52 +- goals/{selected => completed}/queens/index.rst | 0 .../queens/policy-in-code.rst | 0 .../queens/split-tempest-plugins.rst | 22 +- .../rocky/enable-mutable-configuration.rst | 0 goals/{selected => completed}/rocky/index.rst | 0 .../{selected => completed}/rocky/mox_removal.rst | 0 goals/{selected => completed}/stein/index.rst | 0 .../stein/python3-first.rst | 0 .../stein/upgrade-checkers.rst | 6 +- goals/{selected => completed}/train/index.rst | 0 .../train/ipv6-support-and-testing.rst | 11 +- .../train/pdf-doc-generation.rst | 0 .../train/python3-updates.rst | 0 goals/{selected => completed}/ussuri/drop-py27.rst | 0 goals/{selected => completed}/ussuri/index.rst | 0 .../ussuri/project-ptl-and-contrib-docs.rst | 4 +- goals/{selected => completed}/victoria/index.rst | 0 .../migrate-ci-cd-jobs-to-ubuntu-focal.rst | 0 .../victoria/native-zuulv3-jobs.rst | 5 +- goals/{selected => completed}/wallaby/index.rst | 0 .../migrate-policy-format-from-json-to-yaml.rst | 0 goals/index.rst | 94 +- goals/proposed/fips.rst | 200 ++ goals/proposed/index.rst | 2 + goals/selected/consistent-and-secure-rbac.rst | 688 +++++ goals/selected/index.rst | 10 +- .../selected/{wallaby => }/migrate-to-privsep.rst | 4 +- goals/selected/yoga/consistent-and-secure-rbac.rst | 110 - goals/selected/yoga/index.rst | 9 - goals/template.rst | 26 +- reference/legacy.yaml | 21 + reference/project-testing-interface.rst | 3 +- reference/projects.yaml | 114 +- reference/release-naming.rst | 1 + reference/runtimes/yoga.rst | 14 +- reference/sigs-repos.yaml | 46 +- reference/tc-guide.rst | 23 +- ...mittee Video meeting Transcript(2021-09-02).txt | 1576 +++++++++++ ...mittee Video meeting Transcript(2021-10-07).txt | 2741 ++++++++++++++++++++ reference/technical-committee-repos.yaml | 3 + ...160414-grant-cross-project-spec-team-voting.rst | 3 +- .../20180307-trademark-program-test-location.rst | 7 +- .../20190711-mandatory-repository-retirement.rst | 18 +- .../20200803-distributed-project-leadership.rst | 17 +- resolutions/20210923-stable-core-team.rst | 52 + .../superseded/20160504-defcore-test-location.rst | 5 +- tools/check_review_status.py | 2 + tox.ini | 8 +- 56 files changed, 5552 insertions(+), 385 deletions(-)

1 0

oslo.config 8.8.0 (yoga)
by no-reply＠openstack.org 15 Feb '22

15 Feb '22

We are tickled pink to announce the release of: oslo.config 8.8.0: Oslo Configuration API This release is part of the yoga release series. The source is available from: https://opendev.org/openstack/oslo.config Download the package from: https://pypi.org/project/oslo.config Please report issues through: https://bugs.launchpad.net/oslo.config/+bugs For more details, please see below. Changes in oslo.config 8.7.1..8.8.0 ----------------------------------- 64c82a0 Update python testing classifier 92216ff Add Python3 yoga unit tests 9e82ae1 Update master for stable/xena 0c0b745 setup.cfg: Replace dashes with underscores 88c831c Fix tests for Python3. 807d9c5 Replace deprecated UPPER_CONSTRAINTS_FILE variable Diffstat (except docs and test files) ------------------------------------- .zuul.yaml | 2 +- releasenotes/source/index.rst | 1 + releasenotes/source/xena.rst | 6 ++++++ setup.cfg | 3 ++- tox.ini | 2 +- 6 files changed, 19 insertions(+), 5 deletions(-)

1 0

oslo.db 11.2.0 (yoga)
by no-reply＠openstack.org 15 Feb '22

15 Feb '22

We are pleased to announce the release of: oslo.db 11.2.0: Oslo Database library This release is part of the yoga release series. The source is available from: https://opendev.org/openstack/oslo.db Download the package from: https://pypi.org/project/oslo.db Please report issues through: https://bugs.launchpad.net/oslo.db/+bugs For more details, please see below. 11.2.0 ^^^^^^ Upgrade Notes * The following helpers have been removed from the "oslo_db.sqlalchemy.utils" module: * "NonCommittingConnectable" * "NonCommittingEngine" * "NonCommittingConnection" * "NonCommittingTransaction" These were unused outside of oslo.db and were not compatible with SQLAlchemy 2.0. In addition, the "RollsBackTransaction" fixture has been removed from "oslo_db.sqlalchemy.test_fixtures". This was similarly unused and presented similar compatibility issues. Changes in oslo.db 11.1.0..11.2.0 --------------------------------- 22c602f utils: Remove troublesome utility methods ff96dc6 Update python testing classifier a0db55d tests: Restore - don't reset - warning filters cd5f697 Remove use of Session.begin.subtransactions flag b3a56b3 Don't rely on implicit autocommit Diffstat (except docs and test files) ------------------------------------- oslo_db/sqlalchemy/models.py | 14 +- oslo_db/sqlalchemy/provision.py | 24 +- oslo_db/sqlalchemy/test_fixtures.py | 16 -- oslo_db/sqlalchemy/utils.py | 249 ++++++--------------- ...emove-NotCommitting-utils-fed6df0e2f85edfa.yaml | 15 ++ setup.cfg | 1 + 11 files changed, 172 insertions(+), 339 deletions(-)

1 0

automaton 2.5.0 (yoga)
by no-reply＠openstack.org 15 Feb '22

15 Feb '22

We are pleased to announce the release of: automaton 2.5.0: Friendly state machines for python. This release is part of the yoga release series. The source is available from: https://opendev.org/openstack/automaton Download the package from: https://pypi.org/project/automaton Please report issues through: https://bugs.launchpad.net/automaton/+bugs For more details, please see below. Changes in automaton 2.4.0..2.5.0 --------------------------------- 45e5452 doc: Avoid duplicate entry warning a065638 Add Python3 yoga unit tests 1b1e186 Update master for stable/xena Diffstat (except docs and test files) ------------------------------------- .zuul.yaml | 2 +- releasenotes/source/index.rst | 1 + releasenotes/source/xena.rst | 6 ++++++ 4 files changed, 9 insertions(+), 1 deletion(-)

1 0

ironic-inspector 10.10.0 (yoga)
by no-reply＠openstack.org 14 Feb '22

14 Feb '22

We are amped to announce the release of: ironic-inspector 10.10.0: Hardware introspection for OpenStack Bare Metal This release is part of the yoga release series. The source is available from: https://opendev.org/openstack/ironic-inspector Download the package from: https://tarballs.openstack.org/ironic-inspector/ Please report issues through: https://storyboard.openstack.org/#!/project/944 For more details, please see below. 10.10.0 ^^^^^^^ Known Issues ************ * The response headers for empty body HTTP 204 replies, at present, violate RFC7230. This was not intentional, but underlying libraries also make inappropriate changes to the headers, which can cause clients to experience odd failures. This is anticipated to be corrected once an underlying issue in eventlet (https://github.com/eventlet/eventlet/issues/746) is resolved. Upgrade Notes ************* * The rootwrap rule to allow restarting the systemd service openstack- ironic-inspector-dnsmasq.service has been removed. No known tooling requires this rule since before Train. Any configuration tool which is setting [dnsmasq_pxe_filter]dnsmasq_start_command also needs to be writing an appropriate rootwrap.d file, as the inspector devstack plugin does. Bug Fixes ********* * Fixes HTTP responses so the Eventlet library, which is used to support the operation of the WSGI application, does not incorrectly inject a "Transfer-Encoding" header into the HTTP response, even on HTTP 204 replies, which is a violation of RFC7230. This header ultimately can cause varying client reactions which are not expected and can raise exceptions. For now, this has been remedied via an explicit return of a "Content-Length" header, which is also an RFC7230 violation, but it appears to be the lesser of known evils at this time. Changes in ironic-inspector 10.9.0..10.10.0 ------------------------------------------- a72289f Remove rootwrap rule for dnsmasq systemctl 55e47c6 Return a content-length on HTTP204 to prevent client failures fe32ebd Re-add python 3.6/3.7 in classifier Diffstat (except docs and test files) ------------------------------------- ironic_inspector/main.py | 14 ++++++++++++++ ironic_inspector/test/unit/test_main.py | 6 ++++++ ..._eventlet_wsgi_evil_override-3905c6eef0ad7fa3.yaml | 19 +++++++++++++++++++ .../notes/rootwrap-removal-68af457a0104a2ba.yaml | 9 +++++++++ rootwrap.d/ironic-inspector.filters | 4 ---- setup.cfg | 2 ++ 6 files changed, 50 insertions(+), 4 deletions(-)

1 0

ironic-python-agent 8.4.0 (yoga)
by no-reply＠openstack.org 14 Feb '22

14 Feb '22

We are thrilled to announce the release of: ironic-python-agent 8.4.0: Ironic Python Agent Ramdisk This release is part of the yoga release series. The source is available from: https://opendev.org/openstack/ironic-python-agent Download the package from: https://tarballs.openstack.org/ironic-python-agent/ Please report issues through: https://storyboard.openstack.org/#!/project/openstack/ironic- python-agent For more details, please see below. 8.4.0 ^^^^^ New Features ************ * For network burn-in, nodes can now be paired dynamically via a distributed coordination backend (as an alternative to a static configuration). This allows burn-in to proceed on a "first come first served" basis with the nodes available, rather than a node being blocked since the static partner is currently delayed. In order to configure this dynamic pairing, the nodes will need at least "agent_burnin_fio_network_pairing_backend_url" in their "driver_info" (the URL for the coordination backend). In order to separate different hardware types, which may be using different networks and shall be burnt-in separately, the nodes can in addition define "agent_burnin_fio_network_pairing_group_name" to have pairing only happening between nodes in the same group. An additional parameter "agent_burnin_fio_network_pairing_timeout" allows to limit the time given to the nodes to wait for a partner. Bug Fixes ********* * Uses "efibootmgr" instead of "grub2-install" for software RAID. This fixes an issue with images which include newer versions of "grub2-install", such as CentOS Stream 8, as they refuse bootloader installations in UEFI boot mode due to the lack of secure boot support. Changes in ironic-python-agent 8.3.0..8.4.0 ------------------------------------------- b8b1991 Clean up release notes b921b76 Make the standalone job voting again 6ebf041 Use canonical device name for RAID device for ESP 62c5674 SoftwareRAID: Use efibootmgr (and drop grub2-install) 7f15455 Burn-in: Dynamic network pairing 0b69890 [trivial] Fix typo in __init__.py bdf735c Re-add python 3.6/3.7 in classifier Diffstat (except docs and test files) ------------------------------------- ironic_python_agent/__init__.py | 2 +- ironic_python_agent/burnin.py | 149 ++++++++++++++++++--- ironic_python_agent/efi_utils.py | 73 ++++++++-- ironic_python_agent/extensions/image.py | 16 +-- ironic_python_agent/hardware.py | 6 +- ironic_python_agent/raid_utils.py | 14 ++ lower-constraints.txt | 2 + ...n_dynamic_network_pairing-33e398255050eb98.yaml | 18 +++ ...move_swraid_to_efibootmgr-d87c1bfde1661fb5.yaml | 7 + requirements.txt | 1 + setup.cfg | 6 + zuul.d/project.yaml | 9 +- 17 files changed, 543 insertions(+), 87 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index cadb5c3..3badcd0 100644 --- a/requirements.txt +++ b/requirements.txt @@ -22,0 +23 @@ cryptography>=2.3 # BSD/Apache-2.0 +tooz>=2.7.2 # Apache-2.0

1 0

swift 2.29.0 (yoga)
by no-reply＠openstack.org 14 Feb '22

14 Feb '22

We are delighted to announce the release of: swift 2.29.0: OpenStack Object Storage This release is part of the yoga release series. The source is available from: https://opendev.org/openstack/swift Download the package from: https://tarballs.openstack.org/swift/ Please report issues through: https://bugs.launchpad.net/swift/+bugs For more details, please see below. 2.29.0 ^^^^^^ New Features ************ * S3 API improvements * CORS preflights are now allowed for pre-signed URLs. * The "storage_domain" option now accepts a comma-separated list of storage domains. This allows multiple storage domains to configured for use with virtual-host style addressing. * Reduced the overhead of retrieving bucket and object ACLs. * Replication, reconstruction, and diskfile improvements * The reconstructor now uses the replication network to fetch fragments for reconstruction. * Added the ability to limit how many objects per handoff partition will be reverted in a reconstructor cycle using the new "max_objects_per_revert" option. This may be useful to reduce ssync timeouts and lock contention, ensuring that progress is made during rebalances. * Object updater improvements * Added the ability to ratelimit updates (approximately) per- container using the new "max_objects_per_container_per_second" option. This may be used to limit requests to already-overloaded containers while still making progress on updates to other containers. * Added timing stats by response code. * Updates are now sent over the replication network. * Memcache improvements * Added the ability to configure a chance to skip checking memcache when querying shard ranges. This allows some fraction of traffic to go to disk and refresh memcache before the key ages out. Recommended values for the new "container_updating_shard_ranges_skip_cache_pct" and "container_listing_shard_ranges_skip_cache_pct" options are in the range of 0.0 to 0.1. * Added stats for shard range cache hits, misses, and skips. * Added object-reconstructor stats to recon. * Added a new "swift.common.registry" module. This includes helper functions "register_sensitive_header" and "register_sensitive_param" which third party middleware authors may use to flag headers and query parameters for redaction when logging. For more information, see the documentation. * Added the ability to configure project-scope read-only roles for keystoneauth using the new "project_reader_roles" option. * The "cname_lookup" middleware now works with dnspython 2.0 and later. * The internal clients used by the container-reconciler, container- sharder, container-sync, and object-expirer daemons now use a more- descriptive "<daemon>-ic" log name, rather than "swift". If you previously configured the "log_name" option in "internal- client.conf", you must now use the "set log_name = <value>" syntax to configure it, even if no value is set in the "[DEFAULT]" section. This may be done prior to upgrading. * Removed translations from most logging. Deprecation Notes ***************** * The "StatsdClient.set_prefix" method is now deprecated and may be removed in a future release; by extension, so is the "LogAdapter.set_statsd_prefix" method. Middleware developers should use the "statsd_tail_prefix" argument to "get_logger" instead. Bug Fixes ********* * S3 API fixes * Fixed the types of configured values in "/info" response. * Fixed a server error when trying to copy objects with non-ASCII names. * Fixed a server error when uploading objects with very long names. A "KeyTooLongError" is now returned. * Fixed an error when multi-deleting MPUs when SLO async-deletes are enabled. * Fixed an error that allowed list-uploads and list-parts requests to return incomplete or out-of-order results. * Fixed several bugs when dealing with non-ASCII object names and multipart uploads. * Replication, reconstruction, and diskfile fixes * Ensure that non-durable data and .meta files are purged from handoffs after syncing. * Fixed tracebacks when there's a race to mark a file durable or delete it. * Improved cooperative multitasking during ssync. * Upon detecting a ring change, the reconstructor now only aborts the jobs for that ring and continues processing jobs for other rings. * Fixed a traceback when logging about a lock timeout in the replicator. * Fixed a security issue where tempurl and s3api signatures were logged in full. This allowed an attacker with access to log data to perform replay attacks, potentially accessing or overwriting cluster data. Now, such signatures are redacted in a manner similar to auth tokens; see the "reveal_sensitive_prefix" option in "proxy- server.conf". See CVE-2017-8761 for more information. * Fixed a race condition where swift would attempt to quarantine recently-deleted object updates. * Improved handling of timeouts and other errors when obtaining a connection to memcached. * The "swift-recon" tool now queries each object-server IP only once when reporting disk usage. Previously, each port in the ring would be queried; when using servers-per-port, this could dramatically overstate the disk capacity in the cluster. * Fixed a bug that allowed some statsd metrics to be annotated with the wrong backend layer. * Fixed a traceback in the account-server when there's no account database on disk to receive a container update. The account-server now correctly 404s. * The container-updater will quarantine container databases if all replicas for the account respond 404. * Fixed a proxy-server error when the read-only middleware tried to handle non-Swift paths (such as may be used by third-party middleware). * Some client behaviors that the proxy previously logged at warning have been lowered to info. * Various other minor bug fixes and improvements. Changes in swift 2.28.0..2.29.0 ------------------------------- 975d3dbcf AUTHORS/CHANGELOG for 2.29.0 c4762acaa Quiet more BadStatusLine tracebacks a9565893f Add docs for registry module 00bb0f8ba read-only: Only act on Swift paths 086aa5c4f CI: fix lower-constraints job f2c279bae Trim sensitive information in the logs (CVE-2017-8761) eda7d5fe3 Deprecate LogAdapter.set_statsd_prefix 7f2adb4e8 CI: Use xena on CentOS 8 Stream 589ac355f Move *_swift_info functions into a new registry module 363aa3319 Fix multipart upload listings 5f25e1cc7 s3api: Fix non-ascii MPUs ab52b2f77 tests: Clean up some dangling timeouts 9bc1c008a Get rid of pipeline_property 114440487 proxy-server: add stats for backend shard_listing requests a50726f27 Make NodeIter require a logger argument 6942b25cc Fix statsd prefix mutation in proxy controllers 0a1955d88 s3api: tighten register_info unit test 4edf0cde4 s3api: Fix types in /info 8c6ccb5fd proxy: Add a chance to skip memcache when looking for shard ranges 876a7de6a De-clutter container sync sample internal client conf 03be71c44 Add FIPS CI jobs 11d102216 s3api: Allow multiple storage domains 7be5cb0ab Error limit the correct node on ECFragGetter resume b8d7c3dcb Do not fetch content of container/object to retrieve S3 ACLs 035d91dce Modify log_name in internal clients' pipeline configs 1907594bd reconstructor: Abort just the changed policies 874a5865b tests: Improve FakeMemcache call tracking de8886298 Finer grained ratelimit for update f7101f379 tests: Unify FakeMemcaches 5079d8429 internal-client: pass global_conf to loadapp b1f03149f Attempt fix test timeouts 40e0f577a Add stats for shard range cache hits/misses 54fc8a7de Fix cname_lookup test ac92b3d8d CI: Add rolling upgrade job coming from stable/xena d6206e6fe CI: Move py37 and py38 jobs to experimental pipeline 546c9629e Move CI from CentOS 8 to CentOS 8 Stream 219a79a24 updater: Add timing stats eec595b12 updaters: use replication network 1b3879e0d reconstructor: include partially reverted handoffs in handoffs_remaining 8ee631cce reconstructor: restrict max objects per revert job 9acc44b15 Add some extra logging when EC decode fails 5979b6e15 account: Remove logging translations 7cfacbb25 container: Remove a bunch of logging translations 80d025233 object: Remove a bunch of logging translations 1942262db recon: only query each host once for disk usage 1eaf7474f Fix some imports for py310 346f518d6 Make arm jobs voting (but not the pipeline) ada9f0eeb reconstructor: purge meta files in pure handoffs 092d409c4 reconstructor: silence traceback when purging 88eb360f5 ssync sender: add context to missing_check error log e3069e6f7 reconstructor: remove non-durable files on handoffs 591adc845 Fix SSYNC update phase blocking bb487bb20 Fix SSYNC/missing_check blocking (sender) 3ee262d8b Make cmp_policy_info agree with the API behaviour 3d190dba5 Clean up devstack job definitions 439fbbdc7 Ensure close socket for memcached if got timeout 898a1d790 memcache: Prevent possible pool exhaustion 8ebd0354a Test for PartitionLockTimeout c4dca39a7 Make SAIO reconciler multiprocess 336599842 Fix log message interpolation f1c411c52 proxy: Remove a bunch of logging translations 7f5e34a40 sharidng: update doc to only mention auto_shard experimental d49dc9db5 Update master for stable/xena 4f84e77a6 Bump up timeout on swift-probetests-centos-8-arm64 job a5fbe6ca4 ec: Use replication network to get frags for reconstruction 1cde3938a cname_lookup: Work with dnspython 2.0+ 5b9a90b65 sharder: Make stats interval configurable 85d021127 Get rid of port to node assumptions and their modulo kludges c15818f1e s3api: fix the copy of non-ASCII objects 47749cd0e Bug: fix s3api multipart parts listings b4e532a46 func test improvements 9facfdc95 Clean up extra spaces dfd1bdc9e Add documentation for DELETE method for Swift Object Store API. 930ac1114 Fix docker image builds 7a105b5ef Add and pipe reconstructor stats through recon 927691098 Plumb allow_modify_pipeline through run_wsgi/run_server 2992f1417 container GET: return 503 if policy index mismatches 56510ab3c container-server: return objects of a given policy bcff1282b Band-aid and test the crash of the account server 619828483 Add a project scope read-only role to keystoneauth 61dd2ee44 s3api: Fix (async) multi-delete of MPUs 2a806296f func tests: plumb tolerate_missing through to listing_empty c9b0795b9 diskfile: Stop raising ENOENT when we race to mark durable 460dcf756 s3api: Allow CORS preflights for pre-signed URLs 66ab1da99 updater: Stop trying to quarantine missing asyncs ca0c34445 s3api: Return KeyTooLongError when upload name exceeds constraints a61d154fa proxy: Downgrade some client problems to info 0d44328c7 Quiet more deprecation warnings on py2 9f9360833 use a context manager to apply --no-auto-shard option Diffstat (except docs and test files) ------------------------------------- .zuul.yaml | 119 ++-- AUTHORS | 7 + CHANGELOG | 143 ++++- Dockerfile | 2 +- Dockerfile-py3 | 2 +- api-ref/source/storage-account-services.inc | 64 +++ .../1.conf} | 2 + etc/container-server.conf-sample | 3 + etc/internal-client.conf-sample | 4 +- etc/object-server.conf-sample | 24 + etc/proxy-server.conf-sample | 42 +- lower-constraints.txt | 2 +- py2-constraints.txt | 1 + .../notes/2_29_0_release-af71f7efd73109b0.yaml | 167 ++++++ releasenotes/source/index.rst | 2 + releasenotes/source/xena.rst | 6 + requirements.txt | 2 +- swift/__init__.py | 4 + swift/account/auditor.py | 5 +- swift/account/server.py | 10 +- swift/cli/container_deleter.py | 7 +- swift/cli/recon.py | 126 +++-- swift/common/internal_client.py | 25 +- swift/common/memcached.py | 32 +- swift/common/middleware/account_quotas.py | 2 +- swift/common/middleware/bulk.py | 4 +- swift/common/middleware/cname_lookup.py | 5 +- swift/common/middleware/container_quotas.py | 2 +- swift/common/middleware/container_sync.py | 3 +- swift/common/middleware/crossdomain.py | 2 +- swift/common/middleware/crypto/__init__.py | 3 +- swift/common/middleware/domain_remap.py | 4 +- swift/common/middleware/etag_quoter.py | 3 +- swift/common/middleware/formpost.py | 7 +- swift/common/middleware/keystoneauth.py | 22 +- swift/common/middleware/name_check.py | 3 +- swift/common/middleware/proxy_logging.py | 34 +- swift/common/middleware/ratelimit.py | 3 +- swift/common/middleware/read_only.py | 10 +- swift/common/middleware/recon.py | 9 + swift/common/middleware/s3api/acl_handlers.py | 3 + .../common/middleware/s3api/controllers/bucket.py | 4 +- .../middleware/s3api/controllers/multi_delete.py | 11 +- .../middleware/s3api/controllers/multi_upload.py | 98 ++-- swift/common/middleware/s3api/controllers/obj.py | 8 +- .../common/middleware/s3api/controllers/s3_acl.py | 2 +- .../middleware/s3api/controllers/versioning.py | 3 +- swift/common/middleware/s3api/s3api.py | 66 ++- swift/common/middleware/s3api/s3request.py | 24 +- swift/common/middleware/s3api/s3response.py | 7 +- swift/common/middleware/s3api/utils.py | 2 +- swift/common/middleware/slo.py | 7 +- swift/common/middleware/staticweb.py | 3 +- swift/common/middleware/symlink.py | 3 +- swift/common/middleware/tempauth.py | 12 +- swift/common/middleware/tempurl.py | 8 +- .../common/middleware/versioned_writes/__init__.py | 4 +- swift/common/registry.py | 154 ++++++ swift/common/swob.py | 6 +- swift/common/utils.py | 216 ++++---- swift/common/wsgi.py | 88 ++- swift/container/reconciler.py | 16 +- swift/container/server.py | 25 +- swift/container/sharder.py | 63 ++- swift/container/sync.py | 88 ++- swift/container/updater.py | 55 +- swift/obj/auditor.py | 31 +- swift/obj/diskfile.py | 119 ++-- swift/obj/expirer.py | 42 +- swift/obj/reconstructor.py | 151 +++-- swift/obj/replicator.py | 70 +-- swift/obj/server.py | 17 +- swift/obj/ssync_receiver.py | 4 + swift/obj/ssync_sender.py | 41 +- swift/obj/updater.py | 239 ++++++-- swift/proxy/controllers/account.py | 7 +- swift/proxy/controllers/base.py | 135 +++-- swift/proxy/controllers/container.py | 117 +++- swift/proxy/controllers/info.py | 4 +- swift/proxy/controllers/obj.py | 221 ++++---- swift/proxy/server.py | 56 +- test/__init__.py | 4 + test/cors/test-s3-obj.js | 25 + test/functional/s3api/__init__.py | 7 +- test/functional/s3api/s3_test_client.py | 23 +- test/functional/s3api/test_bucket.py | 12 +- test/functional/s3api/test_multi_delete.py | 4 +- test/functional/s3api/test_multi_upload.py | 27 +- test/functional/s3api/test_object.py | 15 +- test/functional/swift_test_client.py | 8 +- test/probe/common.py | 27 +- test/probe/test_container_failures.py | 30 +- test/probe/test_container_sync.py | 2 +- test/probe/test_object_failures.py | 2 +- test/probe/test_object_handoff.py | 33 +- test/probe/test_orphan_container.py | 150 +++++ test/probe/test_reconstructor_revert.py | 4 +- test/probe/test_sharder.py | 70 ++- test/unit/__init__.py | 58 +- test/unit/cli/test_container_deleter.py | 10 + test/unit/cli/test_recon.py | 83 ++- test/unit/common/middleware/crypto/test_crypto.py | 32 +- test/unit/common/middleware/helpers.py | 2 + test/unit/common/middleware/s3api/__init__.py | 2 +- test/unit/common/middleware/s3api/test_acl.py | 12 +- .../common/middleware/s3api/test_multi_delete.py | 23 +- .../common/middleware/s3api/test_multi_upload.py | 175 ++++-- test/unit/common/middleware/s3api/test_obj.py | 37 +- test/unit/common/middleware/s3api/test_s3api.py | 47 +- .../unit/common/middleware/s3api/test_s3request.py | 55 +- test/unit/common/middleware/s3api/test_utils.py | 4 +- test/unit/common/middleware/test_bulk.py | 8 +- test/unit/common/middleware/test_cname_lookup.py | 17 +- test/unit/common/middleware/test_container_sync.py | 3 +- test/unit/common/middleware/test_domain_remap.py | 10 +- test/unit/common/middleware/test_keystoneauth.py | 40 +- test/unit/common/middleware/test_name_check.py | 10 +- test/unit/common/middleware/test_proxy_logging.py | 297 +++++++--- test/unit/common/middleware/test_ratelimit.py | 52 +- test/unit/common/middleware/test_read_only.py | 54 +- test/unit/common/middleware/test_recon.py | 26 + test/unit/common/middleware/test_slo.py | 10 +- test/unit/common/middleware/test_symlink.py | 3 +- test/unit/common/middleware/test_tempauth.py | 68 +-- test/unit/common/middleware/test_tempurl.py | 38 +- .../common/middleware/test_versioned_writes.py | 10 +- test/unit/common/test_exceptions.py | 5 +- test/unit/common/test_internal_client.py | 140 ++++- test/unit/common/test_memcached.py | 35 ++ test/unit/common/test_registry.py | 296 ++++++++++ test/unit/common/test_utils.py | 401 +++++++------- test/unit/common/test_wsgi.py | 105 ++-- test/unit/container/test_reconciler.py | 126 ++++- test/unit/container/test_server.py | 124 +++++ test/unit/container/test_sharder.py | 39 +- test/unit/container/test_sync.py | 28 +- test/unit/container/test_updater.py | 54 +- test/unit/obj/test_diskfile.py | 130 ++++- test/unit/obj/test_expirer.py | 127 +++-- test/unit/obj/test_reconstructor.py | 451 ++++++++++++++- test/unit/obj/test_replicator.py | 15 + test/unit/obj/test_server.py | 4 + test/unit/obj/test_ssync.py | 2 +- test/unit/obj/test_ssync_sender.py | 181 +++++- test/unit/obj/test_updater.py | 437 +++++++++++++-- test/unit/proxy/controllers/test_base.py | 33 +- test/unit/proxy/controllers/test_container.py | 608 ++++++++++++++++++--- test/unit/proxy/controllers/test_info.py | 61 ++- test/unit/proxy/controllers/test_obj.py | 146 ++++- test/unit/proxy/test_server.py | 493 +++++++++++++---- tools/playbooks/multinode_setup/common_config.yaml | 2 +- tools/test-setup.sh | 2 +- 164 files changed, 7088 insertions(+), 2080 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 223fc617b..3b74c3a87 100644 --- a/requirements.txt +++ b/requirements.txt @@ -8 +8 @@ netifaces>=0.8,!=0.10.0,!=0.10.1 -PasteDeploy>=1.3.3 +PasteDeploy>=2.0.0

1 0