We are overjoyed to announce the release of: sahara 4.0.1: Sahara project This release is part of the mitaka stable release series. With source available at: http://git.openstack.org/cgit/openstack/sahara For more details, please see below. 4.0.1 ^^^^^ Deprecation Notes ***************** * Remove Impala 1.4.1, HBase 0.98.9, Hive 1.0, Hue 3.7 support in MapR 5.1.0 plugin Bug Fixes ********* * Fixed incorrect down scaling of ambari cluster * Fixed launching Hive jobs in Ambari plugin. * Correctly configure Spark with Hive and HBase on different nodes. * Fix creating Hive database schema automatically. * Fix Hue intergation with Spark and Hive on different nodes * Fix unavailable MCS link. * Fix visualization of MapR versions when running on python 3 * Remove hive.server2.authentication property from hive-site.xml for Hue 3.9.0 in MapR plugin. * Make Oozie use correct maprfs jar in MapR plugin Changes in sahara 4.0.0..4.0.1 ------------------------------ 0084842 Updated from global requirements c972db0 HDP hive HDFS support b672921 Fix cluster creation with another tenant 671dc29 Fix down scaling of ambari cluster fc14aa9 Change 'Hbase' to 'HBase' string in spark service dc27769 Updated from global requirements 703492a Fix typo in Spark service ef01e89 Updated from global requirements 89c5936 Do not build config example for readthedocs.org 1c57d03 Fix incorrect visualization of MapR versions 063a88c Correctly configure Spark with Hive, HBase ffdf30d Fix Hue integration with Spark and Hive 0469439 Remove unsupported services from 5.1.0 bc378fb Change property for auto creating schema 2066c61 Fix unavailable MCS link cbdae1d Add hive property for Hue < 0.9.0 4a57af3 Workaround for temporary Oozie bug Diffstat (except docs and test files) ------------------------------------- .../notes/ambari-downscaling-b9ba759ce9c7325e.yaml | 3 + .../notes/ambari-hive-92b911e0a759ee88.yaml | 3 + ...onfigure-spark-hive-hbase-60dd82c05449bc03.yaml | 4 + ...ix-hive-schema-autocreate-00ba0952ed46e8bf.yaml | 3 + ...ue-spark-hive-integration-7879af4da79699bd.yaml | 3 + .../fix-unavailable-MCS-link-c8e06d411fae0beb.yaml | 4 + ...x-visualization-mapr-py37-710b5635696bd646.yaml | 4 + .../notes/remove-hive-prop-38a48eda938badad.yaml | 4 + ...move-unsupported-services-eceed9fc82de136b.yaml | 4 + ...karound-for-tmp-oozie-bug-eb36ac00b98c96ea.yaml | 3 + requirements.txt | 6 +- sahara/conductor/manager.py | 1 + sahara/plugins/ambari/client.py | 13 +++ sahara/plugins/ambari/deploy.py | 39 +++++++ sahara/plugins/ambari/plugin.py | 2 + sahara/plugins/mapr/domain/service.py | 4 +- .../services/hbase/resources/hbase-default.json | 5 + sahara/plugins/mapr/services/hive/hive.py | 7 ++ .../mapr/services/hive/resources/hive-default.xml | 2 +- sahara/plugins/mapr/services/hue/hue.py | 13 ++- .../plugins/mapr/services/management/management.py | 7 ++ .../plugins/mapr/services/mapreduce/mapreduce.py | 2 +- sahara/plugins/mapr/services/oozie/oozie.py | 24 +++++ .../services/spark/resources/spark-env.template | 2 +- sahara/plugins/mapr/services/spark/spark.py | 115 +++++++++++++++------ sahara/plugins/mapr/util/maprfs_helper.py | 33 ++++-- .../mapr/versions/v5_0_0_mrv2/version_handler.py | 1 + .../mapr/versions/v5_1_0_mrv2/version_handler.py | 5 - .../mapr/versions/version_handler_factory.py | 2 +- test-requirements.txt | 2 +- 31 files changed, 267 insertions(+), 57 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 506f672..d4df32a 100644 --- a/requirements.txt +++ b/requirements.txt @@ -8 +8 @@ alembic>=0.8.0 # MIT -Babel>=1.3 # BSD +Babel!=2.3.0,!=2.3.1,!=2.3.2,!=2.3.3,>=1.3 # BSD @@ -11 +11 @@ eventlet!=0.18.3,>=0.18.2 # MIT -Flask<1.0,>=0.10 # BSD +Flask!=0.11,<1.0,>=0.10 # BSD @@ -32 +32 @@ python-cinderclient>=1.3.1 # Apache-2.0 -python-keystoneclient!=1.8.0,!=2.1.0,>=1.6.0 # Apache-2.0 +python-keystoneclient!=1.8.0,!=2.1.0,<3.0.0,>=1.6.0 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index b7d345e..eeb7a5e 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -13 +13 @@ doc8 # Apache-2.0 -fixtures>=1.3.1 # Apache-2.0/BSD +fixtures<2.0,>=1.3.1 # Apache-2.0/BSD