We are pumped to announce the release of: storlets 5.0.0: Middleware and Compute Engine for an OpenStack Swift compute framework that runs compute within a Swift cluster This release is part of the ussuri release series. The source is available from: https://opendev.org/openstack/storlets Download the package from: https://tarballs.openstack.org/storlets/ Please report issues through: https://bugs.launchpad.net/storlets/+bugs For more details, please see below. Changes in storlets 4.0.0.0rc1..5.0.0 ------------------------------------- 7a5542d Add release note for 5.0.0 8a01566 Revert "[ussuri][goal] Drop python 2.7 support and testing" b9b5619 Use python-swiftclient 3.8.1 to run func tests in Python2.7 a090737 Use stable/train keystone to run Python 2.7 job 5250bc8 Fix cap for hacking in python 2.7 271dae8 Revert "Cleanup py27 support" 826be15 Use SBusClient for execute command 60c1454 Cleanup py27 support ceda1ba Update hacking for Python3 82c1595 Install test-requirements.txt during installation d30f5fc Remove compatibility codes for swift < 2.8.0 2f5d030 [ussuri][goal] Drop python 2.7 support and testing 8215700 Raise timeout value for zuul job execution. 62cf0e5 Use https://repo.maven.apache.org/maven2/ to retrieve jar files 55d9c28 Use Python 3 by default to run storlet applications fe165a2 Py3: Encode log messages in StorletLogger f5815f0 Use the same python version to run storlet agents 7ab7b10 Do not bind python2 specific directory into container 148c626 Change storlets-functional-py3 as voting gate 1c22762 PY3: Fix ipython extension as py3 compatible b4af2b1 Avoid broken http header including white space 26bb093 Remove unused PUT path in test_half_storlet ccef5d4 Update test_deploy_storlet expectations to be bytes 2e5823f Clean up tmp file in more cases e4363f4 Use maven for simple_json jar 01e3dfa py3: Fix up some func tests 9f2e9b2 Make jupyter test notebook py2/3 compatible ba5aa7c Ensure task_id is a native string on py3 236aaf2 PY3: Fix datagram message to be bytes 28677c0 Port gathering logs routine from .functests to post ansible yaml 839d175 Decrease fuctional test timeout 8ec7ae5 PY3: skip jupyter notebook test b0aa01f Fix CI to collect the all logs dfbdd27 Use smaller file for functional tests 8e31cdc Migrate detailed implementation from __init__.py c72226b PY3: decode subprocess output if it's bytes 89fd96b PY3: ensure bytes format in sbus conversation 3369c8b Be explicit about which python3 to use for py36 and py37 tox envs 84421c9 PY3: Fix file open to read/write the data as bytes 12bc89b Enable unit tests related to internal_client 9eb84a2 PY3: Fix urllib path to be compatible with py3 926b4bc Switch to Ussuri jobs a05c782 Sync Sphinx requirement a543cd3 Add release note for 4.0.0 04ed79a Update master for stable/train 9097e05 Update the constraints url Diffstat (except docs and test files) ------------------------------------- .zuul.yaml | 7 +- .../storlet/identity/IdentityStorlet.java | 2 +- .../multi_input/multi_input_mime.py | 6 +- StorletSamples/python/storlet_samples/test/test.py | 3 +- bin/init_container.sh | 4 +- devstack/localrc.py2.sample | 18 ++ devstack/plugin.sh | 117 ++++++------ devstack/swift_config.py | 5 +- .../building_and_deploying_docker_images.rst | 2 + install_libs.sh | 5 +- playbooks/storlets-functional/post-py3.yaml | 35 +++- playbooks/storlets-functional/post.yaml | 34 +++- playbooks/storlets-functional/pre.yaml | 2 + playbooks/storlets-functional/run.yaml | 2 + releasenotes/notes/4_0_0-a37d0a751c96b27d.yaml | 23 +++ releasenotes/notes/5_0_0-7e2680cab4c2548b.yaml | 18 ++ releasenotes/source/index.rst | 2 + releasenotes/source/train.rst | 6 + s2aio.sh | 7 +- scripts/restart_docker_container.c | 7 +- setup.cfg | 15 +- setup.py | 3 +- src/java/SBus/build.xml | 15 +- .../storlet/sbus/ServerSBusInDatagram.java | 6 +- .../openstack/storlet/daemon/SAbstractTask.java | 5 +- .../org/openstack/storlet/daemon/SCancelTask.java | 2 +- .../storlet/daemon/SExecutionManager.java | 5 +- .../openstack/storlet/daemon/SExecutionTask.java | 25 +-- .../org/openstack/storlet/daemon/SHaltTask.java | 2 +- .../org/openstack/storlet/daemon/SPingTask.java | 2 +- .../org/openstack/storlet/daemon/STaskFactory.java | 8 +- src/java/build.xml | 8 +- storlets/agent/common/server.py | 27 ++- storlets/agent/common/utils.py | 3 +- storlets/agent/daemon/files.py | 10 +- storlets/agent/daemon/server.py | 123 +++++++------ storlets/agent/daemon_factory/server.py | 41 +++-- storlets/gateway/common/stob.py | 2 + storlets/gateway/gateways/docker/gateway.py | 8 +- storlets/gateway/gateways/docker/runtime.py | 59 +++--- storlets/sbus/__init__.py | 148 +--------------- storlets/sbus/client/__init__.py | 117 +----------- storlets/sbus/client/cli.py | 21 +-- storlets/sbus/client/client.py | 135 ++++++++++++++ storlets/sbus/datagram.py | 81 +++++---- storlets/sbus/file_description.py | 1 - storlets/sbus/sbus.py | 165 +++++++++++++++++ storlets/swift_middleware/handlers/proxy.py | 20 +-- storlets/tools/extensions/ipython.py | 5 +- storlets/tools/utils.py | 2 +- test-requirements.txt | 6 +- .../java/test_partitions_identity_storlet.py | 16 +- .../python/test_execqueryheader_storlet.py | 7 +- tox.ini | 14 +- 90 files changed, 1210 insertions(+), 957 deletions(-) Requirements updates -------------------- diff --git a/test-requirements.txt b/test-requirements.txt index b663b22..7364273 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -5 +5,2 @@ -hacking>=0.11.0,<0.12 +hacking>=0.11.0,<0.12;python_version=='2.7' # Apache-2.0 +hacking>=3.0,<3.1.0;python_version>='3.4' # Apache-2.0 @@ -11 +12,2 @@ python-subunit>=0.0.18 -sphinx>=1.6.2 # BSD +sphinx!=1.6.6,!=1.6.7,>=1.6.2,<2.0.0;python_version=='2.7' # BSD +sphinx!=1.6.6,!=1.6.7,!=2.1.0,>=1.6.2;python_version>='3.4' # BSD