We are pleased to announce the release of: taskflow 5.5.0: Taskflow structured state management library. This release is part of the caracal release series. The source is available from: https://opendev.org/openstack/taskflow Download the package from: https://pypi.org/project/taskflow Please report issues through: https://bugs.launchpad.net/taskflow/+bugs For more details, please see below. 5.5.0 ^^^^^ New Features ************ * The redis jobboard driver now supports the username option, which is required in authentication request to Redis with ACL enabled. * The redis driver now supports "sentinel_fallbacks" option. This allows using additional sentinel servers as fallbacks. * Redis jobboard driver now enables SSL for connections to Redis Sentinel when SSL is enabled for connections to Redis. * Now the redis driver uses the credential for redis servers in connections to Redis Sentinel servers. Upgrade Notes ************* * Now the redis driver uses the same credentials as redis by default. If a different credentials need to be used, override these via "sentinel_kwargs". Bug Fixes ********* * Fixed potential endless loop of exceptions when the storage is down and Taskflow loads a logbook. * Fixed an issue with the handling of exceptions when running a flow, some jobs may have been incorrectly consumed (and not rescheduled) during outages. Changes in taskflow 5.4.0..5.5.0 -------------------------------- b389cb5e Prevent potential ReDoS attack fe74dae2 redis: Support fallback servers 3fbd0507 Use consistent credential for Redis and Redis Sentinel 14444aca redis: Enable SSL for sentinel 78f3ef26 redis: Add username 0000c792 Bump hacking 60c01f2c Replace deprecated perl-style regex 0d5c948a Cleanup setup.py and requirements 1c4af176 Update python classifier in setup.cfg 76d7ce09 coveragerc: Remove non-existent path 78d8f7f7 Fix python shebang 981052a6 Avoid endless backtraces on StorageFailure 07a1a3f4 Fix incorrect handling of storage exceptions db27bef4 bindep: Use new mysql-* package names b329ec7e Update master for stable/2023.2 a45f8249 Delete the job from backend if it cannot be consumed Diffstat (except docs and test files) ------------------------------------- .coveragerc | 2 +- .pre-commit-config.yaml | 2 +- .zuul.yaml | 4 +- bindep.txt | 13 +++-- ...-loop-on-storage-failures-b98b30f0c34d25e1.yaml | 5 ++ ...-storage-failure-handling-5c115d92daa0eb82.yaml | 6 ++ .../notes/redis-username-df0eb33869db09a2.yaml | 5 ++ .../notes/sentinel-fallbacks-6fe2ab0d68959cdf.yaml | 5 ++ .../notes/sentinel-ssl-399c56ed7067d282.yaml | 5 ++ .../sentinel-use-redis-creds-63f58b12ad46a2b5.yaml | 11 ++++ releasenotes/source/2023.2.rst | 6 ++ releasenotes/source/index.rst | 1 + requirements.txt | 4 -- setup.cfg | 3 +- setup.py | 9 --- taskflow/conductors/backends/impl_executor.py | 13 ++++- taskflow/jobs/backends/impl_redis.py | 33 ++++++++--- taskflow/jobs/backends/impl_zookeeper.py | 2 +- taskflow/jobs/base.py | 10 ++++ taskflow/storage.py | 6 +- test-requirements.txt | 4 +- tools/schema_generator.py | 2 +- tools/state_graph.py | 2 +- tools/subunit_trace.py | 2 +- 29 files changed, 186 insertions(+), 51 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 32ded5c7..a8cb2f14 100644 --- a/requirements.txt +++ b/requirements.txt @@ -1,4 +0,0 @@ -# The order of packages is significant, because pip processes them in the order -# of appearance. Changing the order has an impact on the overall integration -# process, which may cause wedges in the gate later. - diff --git a/test-requirements.txt b/test-requirements.txt index 5a440519..c9c3dd0f 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -10 +10 @@ zake>=0.1.6 # Apache-2.0 -redis>=2.10.0 # MIT +redis>=4.0.0 # MIT @@ -27 +27 @@ pydotplus>=2.0.2 # MIT License -hacking<2.1,>=2.0 +hacking<6.2.0,>=6.1.0