We are tickled pink to announce the release of: sahara-tests 0.4.0: Sahara tests The source is available from: https://git.openstack.org/cgit/openstack/sahara-tests Download the package from: https://tarballs.openstack.org/sahara-tests/ For more details, please see below. 0.4.0 ^^^^^ Fixes and addition for the API and CLI tests. Support for CDH 5.9 in scenario tests. Less parameters required for scenario tests. Ocata test templates are now available, while Liberty test templates have been removed. New Features ************ * The Tempest-based tests have received an increase of the coverage for both API and CLI tests (job, plugins, templates; negative testing). * CDH 5.9 can be tested thanks to the addition of the specific templates. * Few parameters are not required anymore by the templates in scenario tests; a default value is provided (name of templates, etc). * The flavors used in templates are now parameters too. * If a flavor name is provided in addition to its specification and a flavor with that name exists, it is used and not created again. * The dependencies on non-public Tempest interfaces have been removed. * A folder with test templates with Ocata has been created and initialized starting from the templates in the main directory, following the status of the jobs tested on the Sahara CI. * Capture and report the timestamp in scenario tests when an event starts and when an exception is triggered. Upgrade Notes ************* * the name of the variables/parameters used for the name of the images in the scenario tests have been changes to follow a more consistent pattern. Deprecation Notes ***************** * The Liberty-specific job templates have been removed. This means that starting from this release Liberty is not supported (it has been EOL for a while). * The MapR 5.0.0 test template have been removed from the master branch as well. Critical Issues *************** * The Tempest plugin was fixed after the removal of the data_processing plugin from the tempest repository. Most of the work was in place, only a small change was missing. Bug Fixes ********* * The artifacts created during the execution of CLI tests are properly cleaned at the end of the tests. Other Notes *********** * The documentation was improved (scenario tests) and extended (Tempest plugin). Changes in sahara-tests 0.3.0..0.4.0 ------------------------------------ 02e2208 Cleanup relase notes: remove a spurious entry 52ea7a6 Test templates: add the ocata/ dir, remove liberty/ etc dabfeb5 Add the release notes for most changes after 0.3.0 0939e81 Replace yaml.load() with yaml.safe_load() fc4cbf8 [doc] Added link to Tempest plugin doc and fixed typos 31dead5 Add new negative cli tests for node group templates 910d7f5 Add cluster template update test 1cb3194 Adding missing data sources API tests b3a8dc4 Add CDH 5.9.0 scenario test f1a997c [doc] Added doc for Sahara Tempest plugin 35a0b40 Add test to node group template editing 0443bb5 Clean env before and after tempest test 1d344f8 [doc] Update Authentication section in Scenario Readme 52bbed2 Fix typos in cover.sh 9831bb4 Added cli tests for job binary 1ddaea3 Add new negative cli tests for image and job binary ab1a2a2 Added cli-test for "plugin update" af2b3b8 More timetracking: start of tasks, exceptions 9d49e71 [doc] Updated doc for Sahara scenario tests 9cdcb87 Exclude ct and cluster names from scenarios 7a01645 Renaming of all images names for one pattern 23b8e53 Show team and repo badges on README 1af4ebf Remove more usages of Tempest core code 0110617 scenario job improvements 478840b [Trivial]Replace the combination symbol in file name a16d3f6 Less deps on private Tempest APIs (utils, exceptions) e37b0bc Fix CLI configs get test for plugins with more versions a3dfd27 Get plugin data: dynamically discover the output file 1783831 Added test for job update using cli 88e8033 Revert "Temp workaround: drop volumes from tests" f650b57 Add default values for the flavors in MapR templates 5cc72bc If the name of custom flavor exists, use it 253192a Temp workaround: drop volumes from tests 3373621 Fix sahara gate: failure in tempest config options access c3928e8 Move flavor_id to page args f354bd9 Enable release notes translation 74945b4 Added cli-tests with "job" command Diffstat (except docs and test files) ------------------------------------- README.rst | 9 + etc/scenario/gate/fake.yaml.mako | 2 +- .../notes/post-030-preocata-40c5fbf4d3522074.yaml | 35 +++ .../test-templates-ocata-dcc438604c94b72f.yaml | 15 ++ .../track-steps-timestamps-56c40d06c49dc88e.yaml | 4 + releasenotes/source/conf.py | 3 + sahara_tempest_plugin/config.py | 4 + sahara_tempest_plugin/plugin.py | 3 + .../data_processing/v1_1/data_processing_client.py | 18 ++ .../scenario/defaults/ambari-2.3.yaml.mako | 4 +- .../scenario/defaults/ambari-2.4.yaml.mako | 4 +- .../scenario/defaults/liberty/ambari-2.3.yaml.mako | 65 ------ .../scenario/defaults/liberty/cdh-5.4.0.yaml.mako | 83 ------- .../scenario/defaults/liberty/fake.yaml.mako | 34 --- .../scenario/defaults/liberty/hdp-2.0.6.yaml.mako | 54 ----- .../defaults/liberty/mapr-5.0.0.mrv2.yaml.mako | 54 ----- .../defaults/liberty/spark-1.3.1.yaml.mako | 37 --- .../scenario/defaults/liberty/transient.yaml.mako | 54 ----- .../defaults/liberty/vanilla-2.7.1.yaml.mako | 79 ------- .../scenario/defaults/mapr-5.0.0.mrv2.yaml.mako | 54 ----- .../scenario/defaults/mapr-5.1.0.mrv2.yaml.mako | 4 +- .../scenario/defaults/mapr-5.2.0.mrv2.yaml.mako | 4 +- .../scenario/defaults/mitaka/ambari-2.3.yaml.mako | 4 +- .../scenario/defaults/mitaka/cdh-5.5.0.yaml.mako | 4 +- .../scenario/defaults/mitaka/fake.yaml.mako | 2 +- .../defaults/mitaka/mapr-5.0.0.mrv2.yaml.mako | 4 +- .../defaults/mitaka/mapr-5.1.0.mrv2.yaml.mako | 4 +- .../scenario/defaults/mitaka/spark-1.3.1.yaml.mako | 4 +- .../scenario/defaults/mitaka/spark-1.6.0.yaml.mako | 4 +- .../scenario/defaults/mitaka/transient.yaml.mako | 4 +- .../defaults/mitaka/vanilla-2.7.1.yaml.mako | 4 +- .../scenario/defaults/newton/ambari-2.4.yaml.mako | 4 +- .../scenario/defaults/newton/cdh-5.7.0.yaml.mako | 4 +- .../defaults/newton/mapr-5.1.0.mrv2.yaml.mako | 4 +- .../defaults/newton/mapr-5.2.0.mrv2.yaml.mako | 4 +- .../scenario/defaults/newton/spark-1.6.0.yaml.mako | 4 +- .../scenario/defaults/newton/storm-1.0.1.yaml.mako | 4 +- .../defaults/newton/vanilla-2.7.1.yaml.mako | 4 +- .../scenario/defaults/ocata/ambari-2.4.yaml.mako | 67 ++++++ .../scenario/defaults/ocata/cdh-5.7.0.yaml.mako | 90 ++++++++ .../scenario/defaults/ocata/cdh-5.9.0.yaml.mako | 90 ++++++++ .../defaults/ocata/mapr-5.2.0.mrv2.yaml.mako | 56 +++++ .../scenario/defaults/ocata/spark-1.6.0.yaml.mako | 37 +++ .../scenario/defaults/ocata/storm-1.0.1.yaml.mako | 37 +++ .../defaults/ocata/vanilla-2.7.1.yaml.mako | 81 +++++++ .../scenario/defaults/spark-1.3.1.yaml.mako | 4 +- .../scenario/defaults/spark-1.6.0.yaml.mako | 4 +- .../scenario/defaults/storm-1.0.1.yaml.mako | 4 +- .../scenario/defaults/vanilla-2.7.1.yaml.mako | 5 +- .../unit/scenario/templatevars_complete.ini | 8 +- .../unit/scenario/templatevars_nodefault.ini | 2 +- tools/cover.sh | 6 +- tools/gate/scenario/commons | 2 - tools/gate/scenario/dsvm-scenario-rc | 19 ++ 90 files changed, 1549 insertions(+), 915 deletions(-)