[openstack-dev] [new][sahara] sahara-tests 0.3.0 release

no-reply at openstack.org no-reply at openstack.org
Tue Oct 4 17:32:35 UTC 2016


We are amped to announce the release of:

sahara-tests 0.3.0: Sahara tests

With source available at:

    https://git.openstack.org/cgit/openstack/sahara-tests

For more details, please see below.

0.3.0
^^^^^

Added ability to use clouds.yaml with scenario tests

Client tests have been imported from the Sahara repository.

Migrate sahara cli tests from saharaclient to sahara-tests

Yaml-files for deprecated plugins was removed

Tests no longer depend on fake plugin to run

Sahara Tests plugin now uses tempest stable interface


New Features
************

* User can now use clouds.yaml in the format defined by os-client-
  config to specify the auth values wanted on a scenario test.

* The tests for the official Python clients have been moved here
  from the Sahara repository. They are based on the Tempest libraries
  even they do not follow the Tempest guidelines (as they need to test
  the Python clients, they do not use the native Tempest clients).


Upgrade Notes
*************

* Migration from novaclient.v2.images to glanceclient


Bug Fixes
*********

* Removed yaml-files for Kilo release

* Removed unused yaml-files for master branch


Other Notes
***********

* Adapt Sahara Tests code to stop relying only on the fake plugin
  and use the default plugin available. However, it's worth noting
  that - if available - the fake plugin will be used.

* Sahara Tests plugin is adapted to use in-tree client, which was
  migrated from Tempest code. Also, there's a new stable interface for
  Service Clients in Tempest, so this change adapts the code to use
  it.

Changes in sahara-tests 0.2.0..0.3.0
------------------------------------

4ebba66 Added folder with defaults for newton
44a4503 Temporarily skip test_cluster_cli to avoid timeouts
026e612 Fix creation of ng with proxy node
883a09f Fix the network settings of the templates
1670a25 Fixed unit tests in sahara scenario
d70d4cc Use default plugin instead of fake
f844235 define output datasource for spark wordcount
a0314ad Trivial: delete openstack/common in flake8 exclude list
e91f1f2 Moving hdfs_username to cluster configuration
881409e add impl of SparkWordCount example
b25514b Added cli-tests for job template
2378cae Add image clean up to test_cluster_cli
9a93de6 Added verification of cluster to scenario-framework
5ed393d Added cli tests for data sources
eee440c Fix using additional parameters in 'credentials'
ed3a540 Added cli tests for job binary
4accb7d Remove hardcoded config values in CLI tests
60d35c6 Test fix for CLI tests
6459b15 Update home-page
4f320f6 Added tests for job types
59ae23b Adding link on documentation in README
c614216 TrivialFix: Remove logging import unused
0d41475 Add MapR 520 test
6a2b026 Adapt plugin to use new tempest stable interface
501c3ed Use session to create Sahara Client in tests
288d963 Update tests for plugin, cluster and image
0169a4f Trivial: Replace 'assertTrue(a in b)' with 'assertIn(a, b)'
560c3c5 Add Spark WordCount job for Vanilla Plugin
0d4db58 fix bug: skipException() instead of SkipException()
f32eb1e Fix tempest.conf generation
8fd39dc Remove the deprecated access to Exception message
a38f750 Removed 'scenario' section from ambari scenarios
66dc1c0 Migrate the imported client tests to the Tempest plugin
77fa63e New Pig example with a User Defined Function
d5e565d Correct place for the imported Tempest client
bc969cd Added the possibility to set auto_security_group par to False
4d5cb98 Service client modules in various services  __init__
dd7d457 Make data_processing/baremetal use rest_client
8d91e32 Fix H404/405 violations for service clients
49c6c59 Full response for DataProcessingClient methods
e354df9 Switch all uses of json to oslo_serialization
b473dce Remove CONF values from data_processing client
8eb3310 Rename data_processing client
e7bef91 Change data_processing client to return one value and update tests
e5b5321 Remove all CONF values from RestClient
c651538 Move _get_region() to NegativeRestClient
d853750 Remove _get_endpoint_type() from RestClient
3a64b4e Separate build_interval/timeout from RestClient
0e283b5 Sahara: preparations for job tests
2cc7cfd Add client response checking for data processing service
894ded5 Sahara: preparations for job binary tests
8485358 Sahara: add API tests for job binary internals
fbe51d0 Sahara: preparations for job binary internal tests
f2c685a Sahara: editing licenses
407a266 Sahara: preparations for data source tests
07825b7 Sahara: preparations for new tests
9c3f914 Savanna: add API client and tests for plugins
9c940b0 Multiversion authentication part1
4f32f83 Convert all service clients to global CONF object
395d077 Add Savanna client for node group templates
d01f168 Check if resources are really deleted in api tests
dfbe9f9 Fix CDH 5.7.0 template
62d8842 Strengthen the permission for the generated ssh key
57a6616 embedded jars: replace spark-example.jar
35173b3 Added ability to use clouds.yaml with scenario tests
12872a5 Move CLI tests under sahara_tempest_plugin
cd2d236 Improve documentation
1409bc4 Ubuntu 16.04 cloud image for the fake plugin testing
f2e3c31 fix storm template
33bc238 Add unit-tests for runner.py
78ef51c Removing not existing dir from coveragerc
171c0c4 Fix coverage test by setting the analyzed directory
c575ee4 Update README
d3d64f4 Move auto_security_group to page args
1e82a40 Update README
b3356ba Migrate tests with tempest-lib to tempest
3b9cb59 Remove unused yaml files
b2a3190 Adding ability to run transient cluster in gate
2daa3f1 Added ability to use auth env variables or flags
105eb5d Added tests for "cluster template" and "cluster" commands for Sahara CLI
57d2c10 Added page args for transient mode for fake plugin
0620b5a Fix for uploading image in sahara_cli tests
30bf03c Moved floating ip on Cloudera Manager
77412d2 Created yaml-file for storm plugin
a9061b8 Added README for Sahara CLI tests
87bae85 Remove unecessary decorators from private interface
f4db822 update options mentioned in tempest readme
f82c7db Use the integrated tempest.lib module
85ce728 Replacing all hard coded cluster status using cluster_utils
0abdc18 Add missed checks for testing update method
80bfb9a Adding tests for checking updating of templates
2e68007 Fix tempest tests
4f116d0 Fix of client tests in tempest
512b207 Adapt python client tests to use Tempest plugin interface
a356fc3 Python client tests: access to credentials/net clients
5fc4c51 Set up network client for tempest client tests
b5ae7bd Fix order of arguments in assertEqual - Part1
9d62e63 Fix log import error in tempest tests for Sahara
0db1e94 Change imports after moving tempest common code
ce39d65 Skip job_execution tempest client test
e31343f Fix tempest tests for Sahara
375e070 Fix tempest client tests in Sahara
dd2d383 Using oslo_* instead of oslo.*
08f6043 Fix getting not registered images
d758afd Saharaclient tests for tempest
5606480 Added tests with "node group" commands for Sahara CLI
51ebc59 Tests for Sahara CLI client.
3da2e19 fix test and adding empty pre_test_hook
5c6a853 Removed unused dir
9ad7973 Add CDH 5.7.0 scenario test
e8d032e Migrate "post_test_hook" from sahara-client to sahara-tests
83bc8b3 Migrate functional tests to openstack-client
e38ae68 Replace tempest_lib with tempest.lib
9001b96 Deprecation of the Sahara CLI
a6ddbc2 Fix functional tests in gate
b270548 Fix functional tests in saharaclient
2fdd6ff Add post_test_hook for functional tests
1755d70 Copy functional tests from tempest CLI
4e6dcee novaclient.v2.images to glanceclient migration
28c9bb0 Temporary disable check kafka tests
354fafd Update name for ambari_2.4 template
77559ef [HDP 2.4] Added yaml file


Diffstat (except docs and test files)
-------------------------------------

.coveragerc                                        |   1 -
README.rst                                         |   4 +-
etc/scenario/gate/credentials.yaml.mako            |   6 -
etc/scenario/gate/edp.yaml.mako                    |   6 +-
etc/scenario/gate/fake.yaml.mako                   |   7 +-
etc/scenario/simple-testcase.yaml                  |   6 -
...bility-to-use-clouds-yaml-5f66a2c3959f894b.yaml |   7 +
...nt_images_to_glanceclient-9f8351330147f770.yaml |   3 +
.../remove-old-yaml-files-97ecb4a11582f033.yaml    |   6 +
.../support-non-fake-plugin-a4ba718b787246e8.yaml  |   8 +
...-tempest-stable-interface-aefdfd8f81361dc8.yaml |   8 +
requirements.txt                                   |   4 +-
sahara_tempest_plugin/clients.py                   |  30 +
sahara_tempest_plugin/common/__init__.py           |   0
sahara_tempest_plugin/common/plugin_utils.py       | 318 ++++++++++
sahara_tempest_plugin/config.py                    |  31 +
sahara_tempest_plugin/plugin.py                    |  42 +-
sahara_tempest_plugin/services/__init__.py         |   0
.../services/data_processing/__init__.py           |   0
.../services/data_processing/v1_1/__init__.py      |  18 +
.../data_processing/v1_1/data_processing_client.py | 280 +++++++++
.../scenario/defaults/ambari-2.3.yaml.mako         |  15 +-
.../scenario/defaults/ambari-2.4.yaml.mako         |  67 +++
.../scenario/defaults/credentials.yaml.mako        |   6 -
.../edp-examples/edp-pig/cleanup-string/README.rst |  35 ++
.../edp-pig/cleanup-string/data/expected_output    |   3 +
.../edp-examples/edp-pig/cleanup-string/data/input |   3 +
.../cleanup-string/edp-pig-udf-stringcleaner.jar   | Bin 0 -> 1539 bytes
.../edp-pig/cleanup-string/example.pig             |   3 +
.../edp-pig/cleanup-string/src/StringCleaner.java  |  25 +
.../edp-examples/edp-pig/trim-spaces/README.rst    |  11 -
.../edp-examples/edp-pig/trim-spaces/example.pig   |   3 -
.../edp-examples/edp-pig/trim-spaces/udf.jar       | Bin 1526 -> 0 bytes
.../edp-examples/edp-spark/spark-example.jar       | Bin 4268 -> 0 bytes
.../defaults/edp-examples/edp-spark/spark-pi.py    |  39 ++
.../edp-examples/edp-spark/spark-wordcount.jar     | Bin 28997 -> 6900 bytes
.../edp-examples/edp-spark/wordcountapp/pom.xml    |  61 ++
.../scala/sahara/edp/spark/SparkWordCount.scala    |  38 ++
.../edp-examples/json-api-examples/v1.1/README.rst |  12 +-
.../v1.1/data-sources/create.swift-pig-input.json  |   2 +-
.../v1.1/data-sources/create.swift-pig-output.json |   2 +-
.../v1.1/job-binaries/create.pig-job.json          |   2 +-
.../v1.1/job-binaries/create.pig-udf.json          |   4 +-
.../scenario/defaults/kilo/cdh-5.3.0.yaml.mako     |  75 ---
.../scenario/defaults/kilo/hdp-1.3.2.yaml.mako     |  43 --
.../scenario/defaults/kilo/hdp-2.0.6.yaml.mako     |  54 --
.../scenario/defaults/kilo/spark-1.0.0.yaml.mako   |  33 --
.../scenario/defaults/kilo/vanilla-1.2.1.yaml.mako |  76 ---
.../scenario/defaults/kilo/vanilla-2.6.0.yaml.mako |  90 ---
.../scenario/defaults/liberty/ambari-2.3.yaml.mako |  10 +-
.../scenario/defaults/liberty/cdh-5.4.0.yaml.mako  |  16 +-
.../scenario/defaults/liberty/fake.yaml.mako       |   6 +-
.../scenario/defaults/liberty/hdp-2.0.6.yaml.mako  |  54 ++
.../defaults/liberty/mapr-5.0.0.mrv2.yaml.mako     |   8 +-
.../defaults/liberty/spark-1.3.1.yaml.mako         |   6 +-
.../scenario/defaults/liberty/transient.yaml.mako  |   6 +-
.../defaults/liberty/vanilla-2.7.1.yaml.mako       |  14 +-
.../scenario/defaults/mapr-4.0.2.mrv2.yaml.mako    |  50 --
.../scenario/defaults/mapr-5.0.0.mrv2.yaml.mako    |   8 +-
.../scenario/defaults/mapr-5.1.0.mrv2.yaml.mako    |   8 +-
.../scenario/defaults/mapr-5.2.0.mrv2.yaml.mako    |  54 ++
.../scenario/defaults/mitaka/ambari-2.3.yaml.mako  |  10 +-
.../scenario/defaults/mitaka/cdh-5.5.0.yaml.mako   |  16 +-
.../scenario/defaults/mitaka/fake.yaml.mako        |   6 +-
.../defaults/mitaka/mapr-5.0.0.mrv2.yaml.mako      |   8 +-
.../defaults/mitaka/mapr-5.1.0.mrv2.yaml.mako      |   8 +-
.../scenario/defaults/mitaka/spark-1.3.1.yaml.mako |   6 +-
.../scenario/defaults/mitaka/spark-1.6.0.yaml.mako |   6 +-
.../scenario/defaults/mitaka/transient.yaml.mako   |   6 +-
.../defaults/mitaka/vanilla-2.7.1.yaml.mako        |  14 +-
.../scenario/defaults/newton/ambari-2.4.yaml.mako  |  67 +++
.../scenario/defaults/newton/cdh-5.7.0.yaml.mako   |  90 +++
.../defaults/newton/mapr-5.1.0.mrv2.yaml.mako      |  54 ++
.../defaults/newton/mapr-5.2.0.mrv2.yaml.mako      |  54 ++
.../scenario/defaults/newton/spark-1.6.0.yaml.mako |  37 ++
.../scenario/defaults/newton/storm-1.0.1.yaml.mako |  37 ++
.../defaults/newton/vanilla-2.7.1.yaml.mako        |  81 +++
.../scenario/defaults/spark-1.0.0.yaml.mako        |  33 --
.../scenario/defaults/spark-1.3.1.yaml.mako        |   6 +-
.../scenario/defaults/spark-1.6.0.yaml.mako        |   6 +-
.../scenario/defaults/storm-1.0.1.yaml.mako        |  37 ++
.../scenario/defaults/vanilla-1.2.1.yaml.mako      |  76 ---
.../scenario/defaults/vanilla-2.6.0.yaml.mako      |  90 ---
.../scenario/defaults/vanilla-2.7.1.yaml.mako      |  20 +-
.../unit/scenario/templatevars_complete.ini        |   6 +-
.../unit/scenario/templatevars_incomplete.ini      |   4 -
.../unit/scenario/templatevars_nodefault.ini       |   4 -
setup.cfg                                          |   2 +-
tools/cover.sh                                     |  14 +-
tools/gate/scenario/commons                        |   4 +
tools/gate/scenario/post_test_hook.sh              |  12 +-
tools/gate/scenario/pre_test_hook.sh               |   6 +-
tools/gate/scenario/settings                       |   8 +-
tox.ini                                            |   8 +-
158 files changed, 5236 insertions(+), 1933 deletions(-)


Requirements updates
--------------------

diff --git a/requirements.txt b/requirements.txt
index 0bda827..52d0060 100644
--- a/requirements.txt
+++ b/requirements.txt
@@ -14,0 +15 @@ oslotest>=1.10.0 # Apache-2.0
+os-client-config>=1.13.1  # Apache-2.0
@@ -16,0 +18 @@ paramiko>=1.16.0 # LGPL
+python-glanceclient>=2.0.0  # Apache-2.0
@@ -23 +25 @@ six>=1.9.0 # MIT
-tempest-lib>=0.14.0 # Apache-2.0
+tempest>=12.2.0  # Apache-2.0





More information about the OpenStack-dev mailing list