We are jubilant to announce the release of: rally 0.4.0: Benchmark System for OpenStack With source available at: http://git.openstack.org/cgit/openstack/rally With package available at: https://pypi.python.org/pypi/rally Please report issues through launchpad: http://bugs.launchpad.net/rally For more details, please see below. Changes in rally 0.3.3..0.4.0 ----------------------------- b6a203d fix up the formatting of the readme for the announce script d8fde48 Release notes for 0.4.0 a26bc6b [Verify] Fixing 'xfail' mechanism and whole test case failure issue 78ab9d2 [Verify] Fixing issue with discovering images a1f198e [CI] Move cinder scenarios to cinder job from neutron_unstable b04fbe6 Updated from global requirements 8c2b6c1 Friendlier error message with empty task file c12534b Isolate scenario args between iterations 34e465e Use "visibility" param in create_image() for V1 4dc8b21 Fix filters in glance v1 wrapper 9a9bc20 Refactor neutron utils 3c977a5 Fix various bugs in tests/code that creates b612185 Fixed typo in context plugin doc 42fde0e Fix typo in install_rally.sh script 1749905 [Docstrings] Improvements for docstings 92f63ca Suppress warning insecure URL messages bc819cb Fix rally task verification log b8e858d Print proper status in task results 0a1ac85 [Tests] Fix unexpected tox output of SomeError exception 6d5f0e6 [Verify] Fixing Tempest resources context to create network resources a088bfd Updated from global requirements 8b863d3 Add functional tests to task detailed with errors 27f3367 Test: Compare resources even if SLA fails 21657b6 Add more bindings for bounce server scenario dc12401 Convert task execution time to float value 901b1f2 Updated from global requirements ebe9787 [Reports] Fix parallel iteration calc in LoadChart 68ddc58 [Reports] Improve results calculation in charts.Table 5edfa67 [Tests] Remove costilius from test_charts 6ec7cb9 [CLI] Add status messages of db migration process b197efd [CLI] Display task errors in human-friendly form ab68447 Fix Zaqar client issue 7849a4a Test: Distinguish expected added resources e6cd176 Test: don't stringify cloud resources until printing de64f72 Test: switch osresources to Credential class 213b6e9 [Bug1535948] Add Heat template validator a2cf8fe Glance wrapper: De-obfuscate image fetching 0a18644 [Core] Fix jsonschema huge impact on task performance fda70af Updated from global requirements 7209374 Make glance web uploads streamable 6e1dcb6 Make sure we don't have a stale package cache ede6367 Fix import in migration test 5175bdf [ci] Workaround for siege workload template 6bdbcf3 Remove hardcode from heat service c022c23 Fix rally-neutron-unstable-job 7aa37d2 Move unstable scenario to neutron unstable job e7b3a39 Remove usage of costilius in Charts 2772296 Use existing_users in TestTaskSamples 14e3678 [Reports] Hotfix for rendering tables in HTML report c7244cd Restrict deletion of "default" security group 989fbc0 Cleanup: Fix getting name from neutron resources b6045a9 Add exact error message into runcommand_heat scenario 2c45b50 [Reports] Fix calc of running iterations in parallel 9752bf0 Show Missing Argument Error raised by Argparse 0913ddd Allow max_avg_sla per atomic actions 9ec0bf7 Calculate duration of load more accurate c53d00e Reduce default speed of users creation in users context 8515b0d Remove deprecated scenario output mechanism via returing value 885953e Actually delete result_batch arrays 8323128 [CI] add --debug flag to deployment check a9a9e66 [Reports] Various fixes for load profile chart 1faf688 [Reports] Move angular directive to separate file c50087e [Reports] Refactor processing.plot.plot 3bb1bbf Fix typos in Rally files bfa828f Support OS_PROJECT_NAME as well as OS_TENANT_NAME in the CLI 77994a4 [spec] Rally Verification refactoring 433cf08 Change deployment model schema e6234c3 Add task exporter to the file system fe8eede [Tests] Some fixes in SaharaInputDataSourcesTestCase 91b9e23 Add heat scenarios: output-show, output-list c2b5a06 Fix typos in comments and docstrings fc00fd0 [CI] Download sahara image from local mirror 4137839 [Verify] Set time precision to 3 digits (instead of 5) after dot 3f47065 devstack: support to be enabled with different plugin name 3d197f7 devstack: removed uncalled code d7ecd75 [Verify] Don't use "--parallel" flag when concurrency == 1 b6ddbb4 Automatically configure mock context clients 7dac478 Fix validate_args function in cliutils Diffstat (except docs and test files) ------------------------------------- README.rst | 29 +- devstack/lib/rally | 3 +- devstack/plugin.sh | 8 +- etc/rally.bash_completion | 3 +- etc/rally/rally.conf.sample | 16 +- install_rally.sh | 2 +- rally-jobs/cinder.yaml | 32 +- .../resource_group_with_outputs.yaml.template | 37 + rally-jobs/extra/workload/wp-instances.yaml | 3 +- rally-jobs/heat.yaml | 54 ++ rally-jobs/nova.yaml | 8 + rally-jobs/rally-mos.yaml | 14 + rally-jobs/rally-neutron.yaml | 56 +- rally-jobs/rally.yaml | 17 + rally-jobs/sahara-clusters.yaml | 2 +- rally-jobs/unstable-neutron.yaml | 97 +-- rally/cli/cliutils.py | 25 +- rally/cli/commands/task.py | 122 ++- rally/cli/envutils.py | 15 +- rally/cli/manage.py | 25 +- rally/common/db/api.py | 6 +- rally/common/db/sqlalchemy/api.py | 18 + rally/common/db/sqlalchemy/migrations/README.rst | 12 +- rally/common/db/sqlalchemy/migrations/env.py | 1 + ...ea270_merge_credentials_from_users_and_admin.py | 100 +++ rally/common/db/sqlalchemy/models.py | 24 +- rally/common/io/subunit_v2.py | 30 +- rally/common/objects/task.py | 13 +- rally/common/plugin/discover.py | 2 +- rally/common/plugin/meta.py | 2 +- rally/common/plugin/plugin.py | 2 +- rally/common/sshutils.py | 2 +- rally/common/utils.py | 2 +- rally/exceptions.py | 7 +- rally/osclients.py | 2 +- rally/plugins/common/exporter/__init__.py | 0 rally/plugins/common/exporter/file_system.py | 98 +++ rally/plugins/common/runners/constant.py | 2 +- rally/plugins/common/scenarios/dummy/dummy.py | 11 + .../common/sla/max_average_duration_per_atomic.py | 70 ++ rally/plugins/openstack/cleanup/resources.py | 29 +- rally/plugins/openstack/context/glance/images.py | 2 +- rally/plugins/openstack/context/keystone/users.py | 2 +- .../plugins/openstack/context/network/networks.py | 6 + .../plugins/openstack/scenarios/cinder/volumes.py | 19 +- .../plugins/openstack/scenarios/designate/utils.py | 2 +- .../openstack/scenarios/fuel/environments.py | 2 +- rally/plugins/openstack/scenarios/fuel/utils.py | 2 +- rally/plugins/openstack/scenarios/heat/stacks.py | 95 ++ rally/plugins/openstack/scenarios/heat/utils.py | 54 ++ rally/plugins/openstack/scenarios/neutron/utils.py | 45 +- rally/plugins/openstack/scenarios/nova/servers.py | 73 +- rally/plugins/openstack/scenarios/tempest/utils.py | 3 +- rally/plugins/openstack/scenarios/vm/vmtasks.py | 3 +- rally/plugins/openstack/services/heat/main.py | 8 +- rally/plugins/openstack/wrappers/glance.py | 44 +- rally/task/engine.py | 29 +- rally/task/exporter.py | 18 +- rally/task/processing/charts.py | 125 ++- rally/task/processing/plot.py | 41 +- rally/task/runner.py | 155 ++-- rally/task/scenario.py | 15 +- rally/task/validation.py | 34 + rally/ui/templates/task/directive_widget.js | 216 +++++ rally/ui/templates/task/report.html | 236 +---- rally/verification/tempest/config.py | 42 +- rally/verification/tempest/tempest.py | 25 +- requirements.txt | 16 +- .../dummy/dummy_timed_atomic_actions.json | 26 + .../dummy/dummy_timed_atomic_actions.yaml | 17 + .../scenarios/heat/create-and-delete-stack.json | 2 +- .../scenarios/heat/create-and-delete-stack.yaml | 2 +- .../create-and-delete-stack_resource_group.json | 4 +- .../create-and-delete-stack_resource_group.yaml | 4 +- .../heat/create-and-delete-stack_with_delay.json | 2 +- .../heat/create-and-delete-stack_with_delay.yaml | 2 +- .../heat/create-and-delete-stack_with_neutron.json | 2 +- .../heat/create-and-delete-stack_with_neutron.yaml | 2 +- .../heat/create-and-delete-stack_with_volume.json | 2 +- .../heat/create-and-delete-stack_with_volume.yaml | 2 +- .../scenarios/heat/create-and-list-stack.json | 2 +- .../scenarios/heat/create-and-list-stack.yaml | 2 +- .../scenarios/heat/create-check-delete-stack.json | 2 +- .../scenarios/heat/create-check-delete-stack.yaml | 2 +- .../heat/create-snapshot-restore-delete-stack.json | 2 +- .../heat/create-snapshot-restore-delete-stack.yaml | 2 +- ...reate-stack-and-list-output_resource_group.json | 39 + ...reate-stack-and-list-output_resource_group.yaml | 26 + .../scenarios/heat/create-stack-and-scale.json | 2 +- .../scenarios/heat/create-stack-and-scale.yaml | 2 +- ...reate-stack-and-show-output_resource_group.json | 41 + ...reate-stack-and-show-output_resource_group.yaml | 28 + .../heat/create-suspend-resume-delete-stack.json | 2 +- .../heat/create-suspend-resume-delete-stack.yaml | 2 +- .../heat/create-update-delete-stack-add-res.json | 4 +- .../heat/create-update-delete-stack-add-res.yaml | 4 +- .../heat/create-update-delete-stack-del-res.json | 4 +- .../heat/create-update-delete-stack-del-res.yaml | 4 +- .../heat/create-update-delete-stack-increase.json | 4 +- .../heat/create-update-delete-stack-increase.yaml | 4 +- .../heat/create-update-delete-stack-inplace.json | 4 +- .../heat/create-update-delete-stack-inplace.yaml | 4 +- .../heat/create-update-delete-stack-reduce.json | 4 +- .../heat/create-update-delete-stack-reduce.yaml | 4 +- .../heat/create-update-delete-stack-replace.json | 4 +- .../heat/create-update-delete-stack-replace.yaml | 4 +- .../resource_group_with_outputs.yaml.template | 37 + .../plugins/common/exporter/test_file_system.py | 96 +++ .../plugins/common/scenarios/dummy/test_dummy.py | 15 + .../sla/test_max_average_duration_per_atomic.py | 90 ++ .../unit/plugins/openstack/cleanup/test_manager.py | 6 +- .../plugins/openstack/cleanup/test_resources.py | 92 +- .../openstack/context/glance/test_images.py | 11 +- .../sahara/test_sahara_input_data_sources.py | 68 +- .../openstack/scenarios/heat/test_stacks.py | 71 ++ .../plugins/openstack/scenarios/heat/test_utils.py | 34 + .../openstack/scenarios/neutron/test_utils.py | 515 +++++------ .../openstack/scenarios/nova/test_servers.py | 118 ++- .../openstack/scenarios/tempest/test_tempest.py | 3 +- .../openstack/scenarios/tempest/test_utils.py | 15 + .../plugins/openstack/services/heat/test_main.py | 4 +- .../unit/plugins/openstack/wrappers/test_cinder.py | 29 +- .../unit/plugins/openstack/wrappers/test_glance.py | 94 +- 160 files changed, 4960 insertions(+), 1529 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 3aa93ff..fe3599e 100644 --- a/requirements.txt +++ b/requirements.txt @@ -4,2 +4,2 @@ -alembic>=0.8.0 # MIT -Babel>=1.3 # BSD +alembic>=0.8.4 # MIT +Babel!=2.3.0,!=2.3.1,!=2.3.2,!=2.3.3,>=1.3 # BSD @@ -8 +8 @@ decorator>=3.4.0 # BSD -fixtures>=1.3.1 # Apache-2.0/BSD +fixtures<2.0,>=1.3.1 # Apache-2.0/BSD @@ -13 +13 @@ netaddr!=0.7.16,>=0.7.12 # BSD -oslo.config>=3.7.0 # Apache-2.0 +oslo.config>=3.9.0 # Apache-2.0 @@ -27,2 +27,2 @@ python-novaclient!=2.33.0,>=2.29.0 # Apache-2.0 -python-neutronclient!=4.1.0,>=2.6.0 # Apache-2.0 -python-cinderclient>=1.3.1 # Apache-2.0 +python-neutronclient>=4.2.0 # Apache-2.0 +python-cinderclient>=1.6.0 # Apache-2.0 @@ -34,2 +34,2 @@ python-saharaclient>=0.13.0 # Apache-2.0 -python-troveclient!=2.1.0,>=1.2.0 # Apache-2.0 -python-zaqarclient>=0.3.0 # Apache-2.0 +python-troveclient>=2.2.0 # Apache-2.0 +python-zaqarclient>=1.0.0 # Apache-2.0