We enthusiastically announce the release of: trove 15.0.0: OpenStack DBaaS This release is part of the wallaby release series. The source is available from: https://opendev.org/openstack/trove Download the package from: https://tarballs.openstack.org/trove/ Please report issues through: https://bugs.launchpad.net/trove/+bugs For more details, please see below. Changes in trove 14.0.0.0rc1..15.0.0 ------------------------------------ 579b6142 Fix test_create_inactive_datastore_by_admin 87d681aa Update TOX_CONSTRAINTS_FILE for stable/wallaby 333364ce Update .gitreview for stable/wallaby 7dc95b61 doc: Restore backup from other regions 6fdf11ea Support to restore backup from remote location 5640a61a Change the default agent_heartbeat_expiry to 90s 9f7fa551 Remove the incorrect log for creating replication cluster 9c2e0bf3 Do not override RESTART_REQUIRED service status 6edd3332 Doc: custom container image registry 52f7b67d Support custom container registry for database images 1e04b269 Stop using pip-and-virtualenv diskimage element 537a2859 update ci job description 7cb6e06b add python37 setup.cfg 5d641033 remove unicode from code bcb8992f [goal] Deprecate the JSON formatted policy file bdb00f65 remove py37 9edeb8d9 update cliff to 3.5.0 support python3.8 517a814e Disable some tempest tests that always failed in CI ca04c94e Support instance operating_status 9a6d4163 Do not rely on description for checking port type 9ea87ccf Disable openstack-lower-constraints-jobs b425a4fd Update doc8 version 5d19f8e4 Add Neutron extension check before calling some APIs c1a722d7 use HTTPStatus instead of http.client 7a5e94f6 Add support for python 3.8 25abf125 Fixup zuul nodetype for nested cc57e32c Use nested virt node for trove functional test 7f62f199 Fix the guest service name in troubleshooting guide 9dd8e315 Remove the experimental claim of dev_mode false a97ff84c Improve trove guest image build script da2da696 Support --image-tags for trove-manager datastore_version_update command c615f7ea Remove use of removed tail_log command 3a3b8245 [docs]Fix wrong links in README c9e27cab [Doc] Support datastore version number 589e4ec4 Support datastore version number for configuration df82af30 Get slave_pos to choose latest replica 8987244c Use current slave_pos of slave to continue replicate 19552632 [API Doc] Support datastore version number 5e117876 convert to type str to compare d51b163e Support datastore version number for creating configuration bf1ee5e8 Support datastore version number for creating instance 051cdbe0 Update datastore version name 652b1e14 No validate when perform eject replica source 33c0b640 Add 'version' to datastore version 293a0764 Fix the race condition for creating and deleting instance a05b6ee1 Do not check server status when waiting for instance removed 5be23d1b Support ram quota c02d2f74 Fix deleting volume for instance e8287dfd Pass availability zone through to volume creation. 59a972b3 Fix upgrading instance datastore version b68bcb6f Fix edit instance action return code 2d299711 Fix the functional test related to flavor check d39f8a15 Make guest agent api changes backwards compatible 3aa0c328 Revert "Remove flavor API" de12499a Use datastore manager as opposed to name to restrict actions 71d99e2c Add doc for running functional test 3753c702 Update TOX_CONSTRAINTS_FILE bd2b256a Fix restore encrypted backup 69c84678 Return instances by created order 33f5c2d6 Release note for mysql 8 support d1af33f1 Support mysql 8.0 d734037c Fix getting user port for instance d77229e7 Update quota API description bfa2392d Support to get instances of a specified project e0840af5 Remove the unused coding style modules 6a12e596 [TrivialFix] Fix '--replica-of' argument format in docs e9541846 Remove six usage and basestring check e21f90a0 [Doc] datastore guide 03a3be83 Fix error handling on instance create 9e2515aa fix typo in docs e3429a5b Add resource quota description for production guide 5efbc159 Create floating IP in the user's project 1d659d03 Fix the image CI job 91ba6d1d Remove six.moves d729fe9c bump py37 to py38 in tox.ini c1be8a41 Support database version image tags for creating instance 1d24b650 Image tags support in datastore version 680c7b83 Set default-authentication-plugin default for mysql 2a87b1c5 Warning user running command trove-manage db_recreate 20c45515 Update OS Ubuntu and fix create configuration d36f82a9 abbreviation error correction 608c740e Remove mysql query cache settings adc29948 Add user/project/trove-id metadata to trove server instances c46bd061 Only confirm resize when nova instance status is VERIFY_RESIZE f9a99bc4 Handle case where no networks are selected at create 2f336f3e [Postgresql] Adding config parameters 7380380f Remove six.moves.urllib 957e0c1a Add Python3 wallaby unit tests 80c3a285 Update master for stable/victoria Diffstat (except docs and test files) ------------------------------------- .gitreview | 1 + .zuul.yaml | 33 +- HACKING.rst | 2 - README.rst | 4 +- api-ref/source/backups.inc | 14 + api-ref/source/conf.py | 10 +- api-ref/source/datastore-versions.inc | 23 +- api-ref/source/instances.inc | 29 +- api-ref/source/parameters.yaml | 93 +- api-ref/source/quotas.inc | 7 +- .../samples/config-group-create-request.json | 3 +- .../samples/config-group-create-response.json | 3 +- .../source/samples/config-group-show-response.json | 5 +- .../samples/config-groups-list-response.json | 7 +- .../samples/datastore-version-create-request.json | 5 +- .../samples/datastore-version-list-response.json | 3 +- .../datastore-version-mgmt-list-response.json | 6 +- .../datastore-version-mgmt-patch-request.json | 1 + .../datastore-version-mgmt-show-response.json | 3 +- .../samples/datastore-version-show-response.json | 3 +- .../source/samples/instance-create-response.json | 33 +- .../samples/instance-list-detail-response.json | 4 +- api-ref/source/samples/instance-list-response.json | 1 + .../samples/instance-mgmt-list-response.json | 4 +- .../samples/instance-mgmt-show-response.json | 3 +- api-ref/source/samples/instance-show-response.json | 3 +- api-ref/source/samples/quota-update.json | 3 +- backup/Dockerfile | 5 +- backup/drivers/base.py | 26 +- backup/drivers/xtrabackup.py | 133 ++ backup/install.sh | 12 +- backup/main.py | 11 +- devstack/plugin.sh | 11 +- devstack/settings | 2 +- etc/trove/README-policy.generated.md | 2 +- integration/README.md | 3 +- .../files/elements/guest-agent/element-deps | 2 - .../31-guest-agent-install | 2 +- .../elements/guest-agent/package-installs.yaml | 39 +- .../guest-agent/post-install.d/99-clean-apt | 2 +- .../elements/ubuntu-docker/install.d/21-docker | 1 + .../files/requirements/ubuntu-requirements.txt | 1 - integration/scripts/functions_qemu | 45 +- integration/scripts/trovestack | 14 +- lower-constraints.txt | 25 +- .../add-cinder-az-option-d4ff1968e6064ff2.yaml | 5 + .../wallaby-add-ram-quota-d8e64d0385b1429f.yaml | 7 + .../wallaby-datastore-version-image-tags.yaml | 5 + ...son-formatted-policy-file-21c88ff2ad490a2e.yaml | 20 + releasenotes/notes/wallaby-docker-registry.yaml | 4 + .../notes/wallaby-fix-deleting-volume.yaml | 5 + .../wallaby-fix-race-condition-create-delete.yaml | 4 + releasenotes/notes/wallaby-mysql-8.yaml | 4 + releasenotes/notes/wallaby-operating-status.yaml | 9 + releasenotes/notes/wallaby-restore-backup.yaml | 5 + releasenotes/source/conf.py | 16 +- releasenotes/source/index.rst | 1 + releasenotes/source/victoria.rst | 6 + requirements.txt | 12 +- test-requirements.txt | 2 +- tools/trove-pylint.py | 8 +- tox.ini | 5 +- trove/backup/models.py | 130 +- trove/backup/service.py | 23 +- trove/backup/state.py | 3 +- trove/cluster/models.py | 4 +- trove/cluster/views.py | 5 +- trove/cmd/manage.py | 157 +- trove/cmd/status.py | 3 + trove/common/api.py | 13 + trove/common/apischema.py | 49 +- trove/common/cfg.py | 80 +- trove/common/constants.py | 16 + trove/common/crypto_utils.py | 5 +- trove/common/db/models.py | 3 +- trove/common/db/postgresql/models.py | 4 +- trove/common/exception.py | 33 +- trove/common/extensions.py | 4 +- trove/common/glance.py | 38 + trove/common/limits.py | 2 +- trove/common/neutron.py | 50 +- trove/common/pagination.py | 2 +- trove/common/policy.py | 7 + trove/common/server_group.py | 4 +- .../strategies/cluster/experimental/mongodb/api.py | 4 +- trove/common/strategies/strategy.py | 4 +- trove/common/stream_codecs.py | 18 +- trove/common/swift.py | 42 + trove/common/utils.py | 5 +- trove/conductor/manager.py | 13 +- trove/configuration/models.py | 15 +- trove/configuration/service.py | 7 +- trove/configuration/views.py | 8 +- trove/datastore/models.py | 291 ++- trove/datastore/service.py | 4 +- trove/datastore/views.py | 6 + ...e_datastore_configuration_parameters_deleted.py | 42 +- .../versions/047_image_tag_in_datastore_version.py | 29 + .../048_add_version_to_datastore_version.py | 71 + trove/extensions/common/models.py | 5 +- trove/extensions/common/service.py | 4 +- trove/extensions/mgmt/datastores/service.py | 77 +- trove/extensions/mgmt/datastores/views.py | 3 + trove/extensions/mgmt/instances/models.py | 17 +- trove/extensions/mgmt/instances/service.py | 8 +- trove/extensions/mysql/common.py | 2 +- trove/flavor/service.py | 51 + trove/guestagent/api.py | 59 +- trove/guestagent/common/configuration.py | 4 +- trove/guestagent/common/guestagent_utils.py | 4 +- trove/guestagent/common/sql_query.py | 48 +- trove/guestagent/datastore/manager.py | 18 +- trove/guestagent/datastore/mariadb/manager.py | 10 +- trove/guestagent/datastore/mariadb/service.py | 8 +- trove/guestagent/datastore/mysql/manager.py | 25 + trove/guestagent/datastore/mysql/service.py | 37 +- trove/guestagent/datastore/mysql_common/manager.py | 22 +- trove/guestagent/datastore/mysql_common/service.py | 47 +- trove/guestagent/datastore/postgres/manager.py | 5 +- trove/guestagent/datastore/postgres/service.py | 8 + trove/guestagent/datastore/service.py | 13 +- trove/guestagent/guest_log.py | 27 +- trove/guestagent/module/drivers/module_driver.py | 4 +- trove/guestagent/pkg.py | 3 +- trove/guestagent/strategies/replication/base.py | 4 +- .../strategies/replication/mariadb_gtid.py | 10 +- trove/guestagent/utils/docker.py | 8 + trove/guestagent/volume.py | 4 +- trove/hacking/checks.py | 12 - trove/instance/models.py | 255 +-- trove/instance/service.py | 22 +- trove/instance/service_status.py | 1 + trove/instance/views.py | 13 +- trove/module/models.py | 3 +- trove/network/base.py | 5 +- trove/quota/models.py | 1 + trove/quota/quota.py | 4 +- trove/taskmanager/manager.py | 1 - trove/taskmanager/models.py | 79 +- trove/templates/mysql/config.template | 5 +- trove/templates/mysql/validation-rules.json | 1250 ++++++------- trove/templates/postgresql/validation-rules.json | 1896 ++++++++++---------- .../scenario/runners/configuration_runners.py | 23 +- .../datastore/test_datastore_version_metadata.py | 73 +- .../extensions/mgmt/datastores/__init__.py | 0 .../extensions/mgmt/datastores/test_service.py | 385 ++++ .../extensions/mgmt/instances/__init__.py | 0 .../mgmt/instances}/test_models.py | 0 .../extensions/mgmt/instances/test_service.py | 88 + 205 files changed, 5389 insertions(+), 3625 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 6579d13f..33bd3e83 100644 --- a/requirements.txt +++ b/requirements.txt @@ -30,2 +30,2 @@ pexpect!=3.3,>=3.1 # ISC License -oslo.config>=5.2.0 # Apache-2.0 -oslo.context>=2.19.2 # Apache-2.0 +oslo.config>=6.8.0 # Apache-2.0 +oslo.context>=2.22.0 # Apache-2.0 @@ -36,2 +36,2 @@ oslo.service!=1.28.1,>=1.24.0 # Apache-2.0 -oslo.upgradecheck>=0.1.0 # Apache-2.0 -oslo.utils>=3.33.0 # Apache-2.0 +oslo.upgradecheck>=1.3.0 # Apache-2.0 +oslo.utils>=3.40.0 # Apache-2.0 @@ -40 +39,0 @@ PyMySQL>=0.7.6 # MIT License -six>=1.10.0 # MIT @@ -48 +47 @@ cryptography>=2.1.4 # BSD/Apache-2.0 -oslo.policy>=1.30.0 # Apache-2.0 +oslo.policy>=3.6.0 # Apache-2.0 @@ -51,0 +51 @@ psycopg2-binary>=2.6.2 # LGPL/ZPL +semantic-version>=2.7.0 # BSD diff --git a/test-requirements.txt b/test-requirements.txt index 3b90a3fa..ba437f33 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -21 +21 @@ stestr>=1.1.0 # Apache-2.0 -doc8>=0.6.0 # Apache-2.0 +doc8>=0.8.1 # Apache-2.0