We are excited to announce the release of: storlets 8.0.0: Middleware and Compute Engine for an OpenStack Swift compute framework that runs compute within a Swift cluster This release is part of the xena release series. The source is available from: https://opendev.org/openstack/storlets Download the package from: https://tarballs.openstack.org/storlets/ Please report issues through: https://bugs.launchpad.net/storlets/+bugs For more details, please see below. 8.0.0 ^^^^^ Prelude ******* Now Storlets supports some new features to optimize resource usage by storlet containers. Also, management of docker containers was refactored and re-implemented by the docker python sdk, to allow more flexible and secure container management. New Features ************ * The new timeout feature has been added to the agent processes running in storlet containers. This feature makes storlet containers and storlet daemon processes inside these containers to terminate automatically if the process receives no requests for 300 seconds. * Now storlet containers are started with auto remove flag enabled. Because of this change the containers are automatically deleted after these are stoped (manually or because of timeout). * The agent processes inside storlet containers now accept SIGHUP signal and shutdown gracefully. * The new "max_containers_per_node" option has been added to the docker gateway configuration file. This option limits the number of storlet containers in a single node, and would be useful to distribute containers among multiple nodes. This parameter should be carefully determined based on actual workload. If the limit is too low, clients might experience frequent 503 errors because the required storlet container cannot be launched in the cluster. Upgrade Notes ************* * The "restart_docker_container" script has been removed, and now the storlet_handler middleware directly communicates with the docker daemon to manage docker containers. Because of this change, now the user to run swift processes (which is usually the "swift" user) should belong to the "docker" group. * Now "managed_by=storlets" is added as a tag to all storlet containers, to look up containers launched by Storlets. All existing containers without this tag should be stoped and removed during upgrade to use the new "max_containers_per_node" option. Changes in storlets 7.0.0..8.0.0 -------------------------------- a513114 Add release note for 8.0.0 a3583b5 Allow limiting number of containers on a node 33c403e Accept SIGHUP for graceful shutdown b5678a4 Stop Inactive storlet processes automatically d0f5560 Run agent processes by the swift user d60176c Get rid of SUID binary to restart docker containers e2060cd devstack: Make OpenJDK version configurable ef91a60 Update IRC network to OFTC be9f7fc setup.cfg: Replace dashes with underscores 7d980c2 Add Python3 xena unit tests 77b2112 Update master for stable/wallaby Diffstat (except docs and test files) ------------------------------------- .gitignore | 3 - .zuul.yaml | 2 +- AUTHORS | 2 +- CONTRIBUTING.rst | 2 +- devstack/plugin.sh | 106 ++++------ etc/storlet-docker-gateway.conf-sample | 1 + install_libs.sh | 6 - releasenotes/notes/8_0_0-535e0fed9755d83c.yaml | 45 ++++ releasenotes/source/index.rst | 2 + releasenotes/source/wallaby.rst | 6 + requirements.txt | 1 + s2aio.sh | 2 +- scripts/Makefile | 16 -- scripts/restart_docker_container.c | 87 -------- setup.cfg | 6 +- src/c/sbus/sbus.c | 42 +++- src/c/sbus/sbus.h | 4 +- src/java/SBus/SBusJNI.c | 5 +- .../src/main/org/openstack/storlet/sbus/SBus.java | 4 +- .../org/openstack/storlet/sbus/SBusBackend.java | 7 +- .../main/org/openstack/storlet/sbus/SBusJNI.java | 2 +- .../main/org/openstack/storlet/daemon/SDaemon.java | 3 +- storlets/agent/common/server.py | 53 ++++- storlets/agent/daemon/server.py | 11 +- storlets/agent/daemon_factory/server.py | 12 +- storlets/gateway/gateways/docker/runtime.py | 86 +++++--- storlets/sbus/sbus.py | 8 +- 32 files changed, 455 insertions(+), 344 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 68d910a..eee4e12 100644 --- a/requirements.txt +++ b/requirements.txt @@ -9,0 +10 @@ stevedore>=1.16.0 # Apache-2.0 +docker