[release-announce] sahara 10.0.0 (stein)
no-reply at openstack.org
no-reply at openstack.org
Wed Apr 10 12:34:59 UTC 2019
We are pumped to announce the release of:
sahara 10.0.0: Sahara project
This release is part of the stein release series.
The source is available from:
https://git.openstack.org/cgit/openstack/sahara
Download the package from:
https://tarballs.openstack.org/sahara/
Please report issues through:
https://bugs.launchpad.net/sahara/+bugs
For more details, please see below.
Changes in sahara 9.0.0.0rc1..10.0.0
------------------------------------
bb5f75db doc: refer to the split plugin documentation
dc17f190 Making Sahara Python 3 compatible
8010e24a grenade: re-enable, really test rocky->master
f0a1cc99 Fix the lower-requirements job: libpq-dev, psycopg 2.7
cd68ad36 Add missing ws seperator between words
b95503f3 Use authorize instead of enforce for policies
f422b31b Fixing policies inconsistencies
423a9bf5 Add API v2 jobs (scenario, tempest); buildimages fixes
47ca63ae add python 3.7 unit test job
b21e6969 Adapt to the additional rules from pycodestyle 2.5.0
8f62975a Fixing NTP issues for CDH plugin
f6afe5b7 Adding spark build image job
21791d1f Changing hdfs fs to hdfs dfs
55bd5da5 Dynamically loading plugins
7f8c565d Add missing ws separator between words
e51dd010 Make sure that default_ntp_server option is exported
1c16c48b Fix version discovery for Python 3
92686f5a Prepare Sahara core for plugin split
a83c97f4 Declare APIv2 stable and CURRENT
33489a1f Give the illusion of microversion support
69d74c1a Some polish for APIv2
4bfd800f API v2: fix "local variable 'c' referenced before assignment"
7105a891 APIv2 - Fix 500 on malformed query string on
359b89de Enhance boot from volume
0b8002a9 APIv2 - api-ref documentation for APIv2
81d05942 Deploying Sahara with unversioned endpoints
596c2599 Fix validation of job binary with Python3
904d70f1 Migrate away from oslo_i18n.enable_lazy()
9bf50ce5 APIv2 Changing return payload to project_id
0b8ab036 Fixing cluster scale
5bb7f379 doc: Fix the snippet in "The Script Validator" section
7e24f288 String-related fixes for Python 3
3c165262 fixed word error
c4554ccd Add DEBIAN_FRONTEND=noninteractive in front of apt-get install commands
61b0b2e0 Bump the version of hacking to 1.1.0, with few fixes
425c8256 Update devel info: mailing list, meeting time
98ac996d Update http link to https
7a815ac0 Add python 3.6 unit test job
cc41e862 Add framework for sahara-status upgrade check
4a44010f doc: restructure the image building documentation
01d465dd Fixing image validation for Ambari 2.3
3f22c4a9 Cleanup tox.ini constraint handling
8bded6c9 Increase the startup time of ambari-server to 180s
3f292dbc Increment versioning with pbr instruction
059457e8 Fix a typo on Storm plugin cluster info (Strom -> Storm)
12b270b0 sahara-image-pack: use curl for tarballs.openstack.org
3a2b3f63 sahara-image-pack: remove bashisms from shell scripts
4e39a45f adds unit test for ssh_remote.replace_remote_line
e0fd845d Force the format of ssh key to PEM, at least for now
e7a4b58c Add template param for ambari pkg install timeout
98777adc Use templates lower-constraints, update cover job
45714289 grenade: relevant fixes for master (sahara-api/apache)
10e48a37 doc: update distro information and cloud-init users
aa514b51 Fixed link for more information about Ambari images
c59780a9 Correct repo_id_map for hdp 2.5
b4535e5d Make sahara-grenade job voting on the "gate" queue too
5a3ae85c Import the legacy grenade sahara job
b248ef27 Correct Hbase ports in Ambari plugin
4ac73ea6 Fixing anti-affinity for Sahara
f8566f6d add python 3.6 unit test job
10b64c23 switch documentation job to new PTI
25369d92 import zuul job settings from project-config
1b659db8 Imported Translations from Zanata
1cf0c5c6 Update reno for stable/rocky
77a106a8 Adapt to Keystone changes: use member instead of Member
Diffstat (except docs and test files)
-------------------------------------
.gitignore | 1 +
.zuul.yaml | 75 +-
api-ref/source/index.rst | 1 +
api-ref/source/v1.1/index.rst | 6 +-
api-ref/source/v2/cluster-templates.inc | 241 +
api-ref/source/v2/clusters.inc | 293 +
api-ref/source/v2/data-sources.inc | 202 +
api-ref/source/v2/event-log.inc | 42 +
api-ref/source/v2/image-registry.inc | 244 +
api-ref/source/v2/index.rst | 20 +
api-ref/source/v2/job-binaries.inc | 256 +
api-ref/source/v2/job-templates.inc | 257 +
api-ref/source/v2/job-types.inc | 61 +
api-ref/source/v2/jobs.inc | 262 +
api-ref/source/v2/node-group-templates.inc | 289 +
api-ref/source/v2/parameters.yaml | 1183 ++++
api-ref/source/v2/plugins.inc | 179 +
.../cluster-template-create-request.json | 17 +
.../cluster-template-create-response.json | 82 +
.../cluster-template-show-response.json | 82 +
.../cluster-template-update-request.json | 11 +
.../cluster-template-update-response.json | 67 +
.../cluster-templates-list-response.json | 140 +
.../samples/clusters/cluster-create-request.json | 9 +
.../samples/clusters/cluster-create-response.json | 128 +
.../v2/samples/clusters/cluster-scale-request.json | 15 +
.../samples/clusters/cluster-scale-response.json | 370 ++
.../v2/samples/clusters/cluster-show-response.json | 128 +
.../samples/clusters/cluster-update-request.json | 4 +
.../samples/clusters/cluster-update-response.json | 128 +
.../samples/clusters/clusters-list-response.json | 327 ++
.../clusters/multiple-clusters-create-request.json | 11 +
.../multiple-clusters-create-response.json | 6 +
.../data-source-register-hdfs-request.json | 6 +
.../data-source-register-hdfs-response.json | 14 +
.../data-source-register-swift-request.json | 10 +
.../data-source-register-swift-response.json | 14 +
.../data-sources/data-source-show-response.json | 14 +
.../data-sources/data-source-update-request.json | 4 +
.../data-sources/data-source-update-response.json | 14 +
.../data-sources/data-sources-list-response.json | 28 +
.../event-log/cluster-progress-response.json | 72 +
.../image-registry/image-register-request.json | 4 +
.../image-registry/image-register-response.json | 25 +
.../image-registry/image-show-response.json | 24 +
.../image-registry/image-tags-add-request.json | 7 +
.../image-registry/image-tags-add-response.json | 27 +
.../image-registry/image-tags-delete-request.json | 5 +
.../image-registry/image-tags-delete-response.json | 25 +
.../image-registry/images-list-response.json | 48 +
.../v2/samples/job-binaries/create-request.json | 9 +
.../v2/samples/job-binaries/create-response.json | 13 +
.../v2/samples/job-binaries/list-response.json | 37 +
.../v2/samples/job-binaries/show-data-response | 3 +
.../v2/samples/job-binaries/show-response.json | 13 +
.../v2/samples/job-binaries/update-request.json | 5 +
.../v2/samples/job-binaries/update-response.json | 13 +
.../job-templates/job-template-create-request.json | 11 +
.../job-template-create-response.json | 35 +
.../job-templates/job-template-show-response.json | 26 +
.../job-templates/job-template-update-request.json | 4 +
.../job-template-update-response.json | 26 +
.../job-templates/job-templates-list-response.json | 66 +
.../samples/job-types/job-types-list-response.json | 209 +
.../source/v2/samples/jobs/cancel-response.json | 120 +
api-ref/source/v2/samples/jobs/job-request.json | 20 +
api-ref/source/v2/samples/jobs/job-response.json | 30 +
.../source/v2/samples/jobs/job-update-request.json | 3 +
.../v2/samples/jobs/job-update-response.json | 120 +
api-ref/source/v2/samples/jobs/list-response.json | 122 +
.../node-group-template-create-request.json | 13 +
.../node-group-template-create-response.json | 33 +
.../node-group-template-show-response.json | 37 +
.../node-group-template-update-request.json | 10 +
.../node-group-template-update-response.json | 30 +
.../node-group-templates-list-response.json | 76 +
.../v2/samples/plugins/plugin-show-response.json | 12 +
.../v2/samples/plugins/plugin-update-request.json | 7 +
.../v2/samples/plugins/plugin-update-response.json | 32 +
.../plugins/plugin-version-show-response.json | 92 +
.../v2/samples/plugins/plugins-list-response.json | 41 +
bindep.txt | 1 +
devstack/plugin.sh | 75 +-
devstack/settings | 21 +
devstack/upgrade/from-rocky/upgrade-sahara | 18 +
devstack/upgrade/resources.sh | 2 +-
devstack/upgrade/settings | 13 +-
devstack/upgrade/shutdown.sh | 3 +-
devstack/upgrade/upgrade.sh | 3 +-
.../user/building-guest-images/baremetal.rst | 14 +
.../building-guest-images/sahara-image-create.rst | 80 +
.../building-guest-images/sahara-image-pack.rst | 90 +
lower-constraints.txt | 12 +-
playbooks/buildimages/run.yaml | 2 +-
playbooks/sahara-grenade/post.yaml | 15 +
playbooks/sahara-grenade/run.yaml | 72 +
...d-upgrade-check-framework-9cd18dbc47b0efbd.yaml | 13 +
...pkg-install-timeout-param-d50e5c15e06fa51e.yaml | 4 +
.../api-v2-return-payload-a84a609db410228a.yaml | 4 +
.../notes/apiv2-microversion-4c1a58ee8090e5a9.yaml | 5 +
.../apiv2-stable-release-25ba9920c8e4632a.yaml | 3 +
.../notes/enhance-bfv-12bac06c4438675f.yaml | 6 +
...ng-policy-inconsistencies-984020000cc3882a.yaml | 12 +
releasenotes/notes/hdfs-dfs-94a9c4f64cf8994f.yaml | 5 +
.../notes/ntp-config-51ed9d612132e2fa.yaml | 6 +
...ns-split-from-sahara-core-9ffc5e5d06c9239c.yaml | 5 +
.../proxy-user-lowercase-f116f7b7e89274cb.yaml | 6 +
.../notes/some-polish-api-v2-2d2e390a74b088f9.yaml | 12 +
...t-validation-query-string-a6cadbf2f9c57d06.yaml | 5 +
releasenotes/source/index.rst | 1 +
.../locale/en_GB/LC_MESSAGES/releasenotes.po | 8 +-
.../source/locale/fr/LC_MESSAGES/releasenotes.po | 63 +
releasenotes/source/rocky.rst | 6 +
requirements.txt | 2 +
roles/build-sahara-images-cli/tasks/main.yaml | 5 +
sahara/api/acl.py | 4 +-
sahara/api/microversion.py | 30 +
sahara/api/middleware/version_discovery.py | 11 +-
sahara/api/v2/cluster_templates.py | 31 +-
sahara/api/v2/clusters.py | 43 +-
sahara/api/v2/data_sources.py | 29 +-
sahara/api/v2/images.py | 21 +-
sahara/api/v2/job_binaries.py | 33 +-
sahara/api/v2/job_templates.py | 58 +-
sahara/api/v2/job_types.py | 11 +-
sahara/api/v2/jobs.py | 28 +-
sahara/api/v2/node_group_templates.py | 31 +-
sahara/api/v2/plugins.py | 12 +-
sahara/cli/image_pack/api.py | 4 +
sahara/cli/image_pack/cli.py | 4 +-
sahara/cli/sahara_all.py | 7 -
sahara/cli/sahara_api.py | 8 -
sahara/cli/sahara_engine.py | 9 -
sahara/cli/sahara_status.py | 53 +
sahara/cli/sahara_subprocess.py | 17 +-
sahara/common/policies/__init__.py | 24 +-
sahara/common/policies/base.py | 13 +-
sahara/common/policies/cluster.py | 60 +
sahara/common/policies/cluster_template.py | 57 +
sahara/common/policies/cluster_templates.py | 12 +-
sahara/common/policies/clusters.py | 12 -
sahara/common/policies/data_source.py | 57 +
sahara/common/policies/data_sources.py | 12 +-
sahara/common/policies/image.py | 65 +
sahara/common/policies/images.py | 27 +-
sahara/common/policies/job.py | 49 +
sahara/common/policies/job_binaries.py | 14 +-
sahara/common/policies/job_binary.py | 62 +
.../policies/{job_templates.py => job_template.py} | 12 +-
.../edp_engine.py => common/policies/job_type.py} | 22 +-
sahara/common/policies/job_types.py | 2 -
sahara/common/policies/jobs.py | 11 +-
sahara/common/policies/node_group_template.py | 57 +
sahara/common/policies/node_group_templates.py | 12 +-
sahara/common/policies/plugin.py | 49 +
sahara/common/policies/plugins.py | 8 -
sahara/conductor/__init__.py | 1 +
sahara/conductor/manager.py | 3 +
sahara/conductor/objects.py | 9 +
sahara/config.py | 2 +
sahara/db/migration/alembic_migrations/env.py | 1 +
.../versions/035_boot_from_volume_enhancements.py | 70 +
sahara/db/sqlalchemy/model_base.py | 1 +
sahara/db/sqlalchemy/models.py | 9 +
sahara/db/templates/api.py | 1 +
sahara/plugins/ambari/__init__.py | 0
sahara/plugins/ambari/client.py | 363 --
sahara/plugins/ambari/common.py | 155 -
sahara/plugins/ambari/configs.py | 327 --
sahara/plugins/ambari/deploy.py | 709 ---
sahara/plugins/ambari/edp_engine.py | 130 -
sahara/plugins/ambari/ha_helper.py | 252 -
sahara/plugins/ambari/health.py | 149 -
sahara/plugins/ambari/plugin.py | 294 -
sahara/plugins/ambari/requests_helper.py | 145 -
sahara/plugins/ambari/resources/configs-2.3.json | 1276 -----
sahara/plugins/ambari/resources/configs-2.4.json | 1331 -----
sahara/plugins/ambari/resources/configs-2.5.json | 2008 -------
sahara/plugins/ambari/resources/configs-2.6.json | 2008 -------
sahara/plugins/ambari/resources/generate_config.py | 80 -
.../ambari/resources/images/centos/disable_ambari | 8 -
.../images/centos/disable_certificate_check | 12 -
.../resources/images/centos/disable_firewall | 20 -
.../ambari/resources/images/centos/disable_selinux | 12 -
.../ambari/resources/images/centos/setup_java_home | 31 -
.../images/centos/unlimited_security_artifacts | 11 -
.../ambari/resources/images/centos/wget_repo | 9 -
.../plugins/ambari/resources/images/common/add_jar | 31 -
.../resources/images/common/fix_tls_ambari_agent | 17 -
.../images/common/mysql_connector_java_link | 14 -
.../ambari/resources/images/common/oracle_java | 41 -
sahara/plugins/ambari/resources/images/image.yaml | 111 -
.../ambari/resources/images/ubuntu/wget_repo | 10 -
sahara/plugins/ambari/validation.py | 226 -
sahara/plugins/base.py | 12 +-
.../v5_7_0/plugin_utils.py => castellan_utils.py} | 18 +-
sahara/plugins/cdh/__init__.py | 0
sahara/plugins/cdh/abstractversionhandler.py | 234 -
sahara/plugins/cdh/client/__init__.py | 0
sahara/plugins/cdh/client/api_client.py | 145 -
sahara/plugins/cdh/client/clusters.py | 240 -
sahara/plugins/cdh/client/cms.py | 84 -
sahara/plugins/cdh/client/hosts.py | 90 -
sahara/plugins/cdh/client/http_client.py | 143 -
sahara/plugins/cdh/client/resource.py | 166 -
sahara/plugins/cdh/client/role_config_groups.py | 108 -
sahara/plugins/cdh/client/roles.py | 187 -
sahara/plugins/cdh/client/services.py | 528 --
sahara/plugins/cdh/client/types.py | 684 ---
sahara/plugins/cdh/client/users.py | 62 -
sahara/plugins/cdh/cloudera_utils.py | 837 ---
sahara/plugins/cdh/commands.py | 116 -
sahara/plugins/cdh/config_helper.py | 307 -
sahara/plugins/cdh/confighints_helper.py | 46 -
sahara/plugins/cdh/db_helper.py | 120 -
sahara/plugins/cdh/db_resources/create_hive_db.sql | 4 -
.../plugins/cdh/db_resources/create_sentry_db.sql | 4 -
sahara/plugins/cdh/deploy.py | 124 -
sahara/plugins/cdh/edp_engine.py | 103 -
sahara/plugins/cdh/exceptions.py | 78 -
sahara/plugins/cdh/health.py | 145 -
sahara/plugins/cdh/plugin.py | 125 -
sahara/plugins/cdh/plugin_utils.py | 471 --
sahara/plugins/cdh/v5_11_0/__init__.py | 0
sahara/plugins/cdh/v5_11_0/cloudera_utils.py | 28 -
sahara/plugins/cdh/v5_11_0/config_helper.py | 101 -
sahara/plugins/cdh/v5_11_0/deploy.py | 168 -
sahara/plugins/cdh/v5_11_0/edp_engine.py | 47 -
sahara/plugins/cdh/v5_11_0/images.py | 43 -
sahara/plugins/cdh/v5_11_0/plugin_utils.py | 23 -
sahara/plugins/cdh/v5_11_0/resources/cdh_config.py | 63 -
sahara/plugins/cdh/v5_11_0/resources/cdh_config.sh | 14 -
.../plugins/cdh/v5_11_0/resources/flume-agent.json | 440 --
.../cdh/v5_11_0/resources/flume-service.json | 164 -
.../cdh/v5_11_0/resources/hbase-gateway.json | 122 -
.../v5_11_0/resources/hbase-hbaserestserver.json | 452 --
.../v5_11_0/resources/hbase-hbasethriftserver.json | 458 --
.../cdh/v5_11_0/resources/hbase-master.json | 518 --
.../cdh/v5_11_0/resources/hbase-regionserver.json | 878 ---
.../cdh/v5_11_0/resources/hbase-service.json | 668 ---
.../cdh/v5_11_0/resources/hdfs-balancer.json | 128 -
.../cdh/v5_11_0/resources/hdfs-datanode.json | 656 ---
.../v5_11_0/resources/hdfs-failovercontroller.json | 344 --
.../cdh/v5_11_0/resources/hdfs-gateway.json | 116 -
.../plugins/cdh/v5_11_0/resources/hdfs-httpfs.json | 452 --
.../cdh/v5_11_0/resources/hdfs-journalnode.json | 458 --
.../cdh/v5_11_0/resources/hdfs-namenode.json | 872 ---
.../cdh/v5_11_0/resources/hdfs-nfsgateway.json | 410 --
.../v5_11_0/resources/hdfs-secondarynamenode.json | 458 --
.../cdh/v5_11_0/resources/hdfs-service.json | 1340 -----
.../cdh/v5_11_0/resources/hive-gateway.json | 98 -
.../cdh/v5_11_0/resources/hive-hivemetastore.json | 434 --
.../cdh/v5_11_0/resources/hive-hiveserver2.json | 848 ---
.../resources/hive-metastore-sentry-safety.xml | 15 -
.../resources/hive-server2-sentry-safety.xml | 12 -
.../cdh/v5_11_0/resources/hive-service.json | 656 ---
sahara/plugins/cdh/v5_11_0/resources/hive-site.xml | 61 -
.../cdh/v5_11_0/resources/hive-webhcat.json | 344 --
.../v5_11_0/resources/hue-hue_load_balancer.json | 248 -
.../cdh/v5_11_0/resources/hue-hue_server.json | 392 --
.../cdh/v5_11_0/resources/hue-kt_renewer.json | 212 -
.../plugins/cdh/v5_11_0/resources/hue-service.json | 692 ---
.../resources/images/centos/disable_firewall | 20 -
.../resources/images/centos/selinux_permissive | 13 -
.../resources/images/centos/turn_off_services | 33 -
.../cdh/v5_11_0/resources/images/centos/wget_repo | 33 -
.../cdh/v5_11_0/resources/images/common/add_jar | 22 -
.../resources/images/common/install_cloudera | 17 -
.../v5_11_0/resources/images/common/install_extjs | 30 -
.../images/common/unlimited_security_artifacts | 11 -
.../cdh/v5_11_0/resources/images/image.yaml | 131 -
.../resources/images/ubuntu/turn_off_services | 33 -
.../cdh/v5_11_0/resources/images/ubuntu/wget_repo | 34 -
.../v5_11_0/resources/impala-catalogserver.json | 542 --
.../cdh/v5_11_0/resources/impala-impalad.json | 746 ---
.../cdh/v5_11_0/resources/impala-llama.json | 518 --
.../cdh/v5_11_0/resources/impala-service.json | 572 --
.../cdh/v5_11_0/resources/impala-statestore.json | 404 --
.../cdh/v5_11_0/resources/kafka-gateway.json | 62 -
.../cdh/v5_11_0/resources/kafka-kafka_broker.json | 566 --
.../resources/kafka-kafka_mirror_maker.json | 626 --
.../cdh/v5_11_0/resources/kafka-service.json | 404 --
sahara/plugins/cdh/v5_11_0/resources/kms-kms.json | 638 ---
.../plugins/cdh/v5_11_0/resources/kms-service.json | 86 -
.../resources/ks_indexer-hbase_indexer.json | 374 --
.../cdh/v5_11_0/resources/ks_indexer-service.json | 188 -
.../plugins/cdh/v5_11_0/resources/mapred-site.xml | 157 -
.../cdh/v5_11_0/resources/oozie-oozie_server.json | 674 ---
.../cdh/v5_11_0/resources/oozie-service.json | 260 -
.../cdh/v5_11_0/resources/priority-one-confs.json | 45 -
.../cdh/v5_11_0/resources/sentry-gateway.json | 62 -
.../resources/sentry-impala-client-safety.xml | 16 -
.../v5_11_0/resources/sentry-sentry_server.json | 320 --
.../cdh/v5_11_0/resources/sentry-service.json | 230 -
.../cdh/v5_11_0/resources/solr-gateway.json | 50 -
.../cdh/v5_11_0/resources/solr-service.json | 350 --
.../cdh/v5_11_0/resources/solr-solr_server.json | 464 --
.../cdh/v5_11_0/resources/spark-gateway.json | 242 -
.../cdh/v5_11_0/resources/spark-service.json | 158 -
.../resources/spark-spark_yarn_history_server.json | 404 --
.../cdh/v5_11_0/resources/sqoop-service.json | 110 -
.../cdh/v5_11_0/resources/sqoop-sqoop_server.json | 410 --
.../cdh/v5_11_0/resources/yarn-gateway.json | 506 --
.../cdh/v5_11_0/resources/yarn-jobhistory.json | 494 --
.../cdh/v5_11_0/resources/yarn-nodemanager.json | 794 ---
.../v5_11_0/resources/yarn-resourcemanager.json | 686 ---
.../cdh/v5_11_0/resources/yarn-service.json | 554 --
.../cdh/v5_11_0/resources/zookeeper-server.json | 608 --
.../cdh/v5_11_0/resources/zookeeper-service.json | 236 -
sahara/plugins/cdh/v5_11_0/versionhandler.py | 37 -
sahara/plugins/cdh/v5_13_0/__init__.py | 0
sahara/plugins/cdh/v5_13_0/cloudera_utils.py | 34 -
sahara/plugins/cdh/v5_13_0/config_helper.py | 89 -
sahara/plugins/cdh/v5_13_0/deploy.py | 168 -
sahara/plugins/cdh/v5_13_0/edp_engine.py | 47 -
sahara/plugins/cdh/v5_13_0/images.py | 43 -
sahara/plugins/cdh/v5_13_0/resources/cdh_config.py | 68 -
.../plugins/cdh/v5_13_0/resources/flume-agent.json | 440 --
.../cdh/v5_13_0/resources/flume-service.json | 164 -
.../cdh/v5_13_0/resources/hbase-gateway.json | 122 -
.../v5_13_0/resources/hbase-hbaserestserver.json | 452 --
.../v5_13_0/resources/hbase-hbasethriftserver.json | 458 --
.../cdh/v5_13_0/resources/hbase-master.json | 530 --
.../cdh/v5_13_0/resources/hbase-regionserver.json | 884 ---
.../cdh/v5_13_0/resources/hbase-service.json | 692 ---
.../cdh/v5_13_0/resources/hdfs-balancer.json | 128 -
.../cdh/v5_13_0/resources/hdfs-datanode.json | 656 ---
.../v5_13_0/resources/hdfs-failovercontroller.json | 344 --
.../cdh/v5_13_0/resources/hdfs-gateway.json | 116 -
.../plugins/cdh/v5_13_0/resources/hdfs-httpfs.json | 464 --
.../cdh/v5_13_0/resources/hdfs-journalnode.json | 458 --
.../cdh/v5_13_0/resources/hdfs-namenode.json | 884 ---
.../cdh/v5_13_0/resources/hdfs-nfsgateway.json | 410 --
.../v5_13_0/resources/hdfs-secondarynamenode.json | 458 --
.../cdh/v5_13_0/resources/hdfs-service.json | 1352 -----
.../cdh/v5_13_0/resources/hive-gateway.json | 98 -
.../cdh/v5_13_0/resources/hive-hivemetastore.json | 434 --
.../cdh/v5_13_0/resources/hive-hiveserver2.json | 866 ---
.../resources/hive-metastore-sentry-safety.xml | 15 -
.../resources/hive-server2-sentry-safety.xml | 12 -
.../cdh/v5_13_0/resources/hive-service.json | 656 ---
sahara/plugins/cdh/v5_13_0/resources/hive-site.xml | 61 -
.../cdh/v5_13_0/resources/hive-webhcat.json | 356 --
.../v5_13_0/resources/hue-hue_load_balancer.json | 260 -
.../cdh/v5_13_0/resources/hue-hue_server.json | 404 --
.../cdh/v5_13_0/resources/hue-kt_renewer.json | 212 -
.../plugins/cdh/v5_13_0/resources/hue-service.json | 692 ---
.../resources/images/centos/disable_firewall | 20 -
.../resources/images/centos/selinux_permissive | 13 -
.../resources/images/centos/turn_off_services | 33 -
.../cdh/v5_13_0/resources/images/centos/wget_repo | 27 -
.../cdh/v5_13_0/resources/images/common/add_jar | 22 -
.../resources/images/common/install_cloudera | 17 -
.../v5_13_0/resources/images/common/install_extjs | 30 -
.../images/common/unlimited_security_artifacts | 11 -
.../cdh/v5_13_0/resources/images/image.yaml | 128 -
.../resources/images/ubuntu/turn_off_services | 33 -
.../cdh/v5_13_0/resources/images/ubuntu/wget_repo | 31 -
.../v5_13_0/resources/impala-catalogserver.json | 542 --
.../cdh/v5_13_0/resources/impala-impalad.json | 746 ---
.../cdh/v5_13_0/resources/impala-llama.json | 518 --
.../cdh/v5_13_0/resources/impala-service.json | 572 --
.../cdh/v5_13_0/resources/impala-statestore.json | 404 --
.../cdh/v5_13_0/resources/kafka-gateway.json | 62 -
.../cdh/v5_13_0/resources/kafka-kafka_broker.json | 584 --
.../resources/kafka-kafka_mirror_maker.json | 644 ---
.../cdh/v5_13_0/resources/kafka-service.json | 404 --
sahara/plugins/cdh/v5_13_0/resources/kms-kms.json | 656 ---
.../plugins/cdh/v5_13_0/resources/kms-service.json | 86 -
.../resources/ks_indexer-hbase_indexer.json | 374 --
.../cdh/v5_13_0/resources/ks_indexer-service.json | 188 -
.../plugins/cdh/v5_13_0/resources/mapred-site.xml | 157 -
.../cdh/v5_13_0/resources/oozie-oozie_server.json | 674 ---
.../cdh/v5_13_0/resources/oozie-service.json | 260 -
.../cdh/v5_13_0/resources/priority-one-confs.json | 45 -
.../cdh/v5_13_0/resources/sentry-gateway.json | 62 -
.../resources/sentry-impala-client-safety.xml | 16 -
.../v5_13_0/resources/sentry-sentry_server.json | 320 --
.../cdh/v5_13_0/resources/sentry-service.json | 230 -
.../cdh/v5_13_0/resources/solr-gateway.json | 50 -
.../cdh/v5_13_0/resources/solr-service.json | 350 --
.../cdh/v5_13_0/resources/solr-solr_server.json | 470 --
.../cdh/v5_13_0/resources/spark-gateway.json | 242 -
.../cdh/v5_13_0/resources/spark-service.json | 170 -
.../resources/spark-spark_yarn_history_server.json | 422 --
.../cdh/v5_13_0/resources/sqoop-service.json | 116 -
.../cdh/v5_13_0/resources/sqoop-sqoop_server.json | 410 --
.../v5_13_0/resources/sqoop_client-gateway.json | 92 -
.../v5_13_0/resources/sqoop_client-service.json | 80 -
.../cdh/v5_13_0/resources/yarn-gateway.json | 530 --
.../cdh/v5_13_0/resources/yarn-jobhistory.json | 500 --
.../cdh/v5_13_0/resources/yarn-nodemanager.json | 794 ---
.../v5_13_0/resources/yarn-resourcemanager.json | 686 ---
.../cdh/v5_13_0/resources/yarn-service.json | 554 --
.../cdh/v5_13_0/resources/zookeeper-server.json | 608 --
.../cdh/v5_13_0/resources/zookeeper-service.json | 236 -
sahara/plugins/cdh/v5_13_0/versionhandler.py | 37 -
sahara/plugins/cdh/v5_7_0/__init__.py | 0
sahara/plugins/cdh/v5_7_0/cloudera_utils.py | 28 -
sahara/plugins/cdh/v5_7_0/config_helper.py | 101 -
sahara/plugins/cdh/v5_7_0/deploy.py | 168 -
sahara/plugins/cdh/v5_7_0/edp_engine.py | 47 -
sahara/plugins/cdh/v5_7_0/images.py | 43 -
sahara/plugins/cdh/v5_7_0/resources/cdh_config.py | 139 -
sahara/plugins/cdh/v5_7_0/resources/cdh_config.sh | 3 -
.../plugins/cdh/v5_7_0/resources/flume-agent.json | 428 --
.../cdh/v5_7_0/resources/flume-service.json | 164 -
.../cdh/v5_7_0/resources/hbase-gateway.json | 110 -
.../v5_7_0/resources/hbase-hbaserestserver.json | 440 --
.../v5_7_0/resources/hbase-hbasethriftserver.json | 446 --
.../plugins/cdh/v5_7_0/resources/hbase-master.json | 506 --
.../cdh/v5_7_0/resources/hbase-regionserver.json | 836 ---
.../cdh/v5_7_0/resources/hbase-service.json | 740 ---
.../cdh/v5_7_0/resources/hdfs-balancer.json | 68 -
.../cdh/v5_7_0/resources/hdfs-datanode.json | 644 ---
.../v5_7_0/resources/hdfs-failovercontroller.json | 332 --
.../plugins/cdh/v5_7_0/resources/hdfs-gateway.json | 116 -
.../plugins/cdh/v5_7_0/resources/hdfs-httpfs.json | 440 --
.../cdh/v5_7_0/resources/hdfs-journalnode.json | 446 --
.../cdh/v5_7_0/resources/hdfs-namenode.json | 812 ---
.../cdh/v5_7_0/resources/hdfs-nfsgateway.json | 386 --
.../v5_7_0/resources/hdfs-secondarynamenode.json | 446 --
.../plugins/cdh/v5_7_0/resources/hdfs-service.json | 1400 -----
.../plugins/cdh/v5_7_0/resources/hive-gateway.json | 98 -
.../cdh/v5_7_0/resources/hive-hivemetastore.json | 392 --
.../cdh/v5_7_0/resources/hive-hiveserver2.json | 704 ---
.../resources/hive-metastore-sentry-safety.xml | 15 -
.../resources/hive-server2-sentry-safety.xml | 12 -
.../plugins/cdh/v5_7_0/resources/hive-service.json | 722 ---
sahara/plugins/cdh/v5_7_0/resources/hive-site.xml | 61 -
.../plugins/cdh/v5_7_0/resources/hive-webhcat.json | 332 --
.../v5_7_0/resources/hue-hue_load_balancer.json | 236 -
.../cdh/v5_7_0/resources/hue-hue_server.json | 356 --
.../cdh/v5_7_0/resources/hue-kt_renewer.json | 200 -
.../plugins/cdh/v5_7_0/resources/hue-service.json | 674 ---
.../resources/images/centos/disable_firewall | 20 -
.../resources/images/centos/selinux_permissive | 13 -
.../resources/images/centos/turn_off_services | 33 -
.../cdh/v5_7_0/resources/images/centos/wget_repo | 33 -
.../cdh/v5_7_0/resources/images/common/add_jar | 22 -
.../resources/images/common/install_cloudera | 17 -
.../v5_7_0/resources/images/common/install_extjs | 30 -
.../images/common/unlimited_security_artifacts | 11 -
.../plugins/cdh/v5_7_0/resources/images/image.yaml | 132 -
.../resources/images/ubuntu/turn_off_services | 33 -
.../cdh/v5_7_0/resources/images/ubuntu/wget_repo | 36 -
.../cdh/v5_7_0/resources/impala-catalogserver.json | 506 --
.../cdh/v5_7_0/resources/impala-impalad.json | 710 ---
.../plugins/cdh/v5_7_0/resources/impala-llama.json | 506 --
.../cdh/v5_7_0/resources/impala-service.json | 632 ---
.../cdh/v5_7_0/resources/impala-statestore.json | 374 --
.../cdh/v5_7_0/resources/kafka-kafka_broker.json | 476 --
.../v5_7_0/resources/kafka-kafka_mirror_maker.json | 482 --
.../cdh/v5_7_0/resources/kafka-service.json | 374 --
sahara/plugins/cdh/v5_7_0/resources/kms-kms.json | 530 --
.../plugins/cdh/v5_7_0/resources/kms-service.json | 86 -
.../v5_7_0/resources/ks_indexer-hbase_indexer.json | 356 --
.../cdh/v5_7_0/resources/ks_indexer-service.json | 188 -
.../plugins/cdh/v5_7_0/resources/mapred-site.xml | 157 -
.../cdh/v5_7_0/resources/oozie-oozie_server.json | 662 ---
.../cdh/v5_7_0/resources/oozie-service.json | 236 -
.../cdh/v5_7_0/resources/priority-one-confs.json | 45 -
.../resources/sentry-impala-client-safety.xml | 16 -
.../cdh/v5_7_0/resources/sentry-sentry_server.json | 308 -
.../cdh/v5_7_0/resources/sentry-service.json | 278 -
.../plugins/cdh/v5_7_0/resources/solr-gateway.json | 32 -
.../plugins/cdh/v5_7_0/resources/solr-service.json | 404 --
.../cdh/v5_7_0/resources/solr-solr_server.json | 440 --
.../cdh/v5_7_0/resources/spark-gateway.json | 170 -
.../cdh/v5_7_0/resources/spark-service.json | 152 -
.../resources/spark-spark_yarn_history_server.json | 314 --
.../cdh/v5_7_0/resources/sqoop-service.json | 110 -
.../cdh/v5_7_0/resources/sqoop-sqoop_server.json | 398 --
.../plugins/cdh/v5_7_0/resources/yarn-gateway.json | 476 --
.../cdh/v5_7_0/resources/yarn-jobhistory.json | 476 --
.../cdh/v5_7_0/resources/yarn-nodemanager.json | 764 ---
.../cdh/v5_7_0/resources/yarn-resourcemanager.json | 674 ---
.../plugins/cdh/v5_7_0/resources/yarn-service.json | 542 --
.../cdh/v5_7_0/resources/zookeeper-server.json | 596 --
.../cdh/v5_7_0/resources/zookeeper-service.json | 224 -
sahara/plugins/cdh/v5_7_0/versionhandler.py | 37 -
sahara/plugins/cdh/v5_9_0/__init__.py | 0
sahara/plugins/cdh/v5_9_0/cloudera_utils.py | 28 -
sahara/plugins/cdh/v5_9_0/config_helper.py | 101 -
sahara/plugins/cdh/v5_9_0/deploy.py | 168 -
sahara/plugins/cdh/v5_9_0/edp_engine.py | 47 -
sahara/plugins/cdh/v5_9_0/images.py | 43 -
sahara/plugins/cdh/v5_9_0/plugin_utils.py | 23 -
sahara/plugins/cdh/v5_9_0/resources/cdh_config.py | 139 -
sahara/plugins/cdh/v5_9_0/resources/cdh_config.sh | 3 -
.../plugins/cdh/v5_9_0/resources/flume-agent.json | 428 --
.../cdh/v5_9_0/resources/flume-service.json | 164 -
.../cdh/v5_9_0/resources/hbase-gateway.json | 110 -
.../v5_9_0/resources/hbase-hbaserestserver.json | 440 --
.../v5_9_0/resources/hbase-hbasethriftserver.json | 446 --
.../plugins/cdh/v5_9_0/resources/hbase-master.json | 506 --
.../cdh/v5_9_0/resources/hbase-regionserver.json | 842 ---
.../cdh/v5_9_0/resources/hbase-service.json | 746 ---
.../cdh/v5_9_0/resources/hdfs-balancer.json | 68 -
.../cdh/v5_9_0/resources/hdfs-datanode.json | 644 ---
.../v5_9_0/resources/hdfs-failovercontroller.json | 332 --
.../plugins/cdh/v5_9_0/resources/hdfs-gateway.json | 116 -
.../plugins/cdh/v5_9_0/resources/hdfs-httpfs.json | 440 --
.../cdh/v5_9_0/resources/hdfs-journalnode.json | 446 --
.../cdh/v5_9_0/resources/hdfs-namenode.json | 854 ---
.../cdh/v5_9_0/resources/hdfs-nfsgateway.json | 386 --
.../v5_9_0/resources/hdfs-secondarynamenode.json | 446 --
.../plugins/cdh/v5_9_0/resources/hdfs-service.json | 1418 -----
.../plugins/cdh/v5_9_0/resources/hive-gateway.json | 98 -
.../cdh/v5_9_0/resources/hive-hivemetastore.json | 416 --
.../cdh/v5_9_0/resources/hive-hiveserver2.json | 806 ---
.../resources/hive-metastore-sentry-safety.xml | 15 -
.../resources/hive-server2-sentry-safety.xml | 12 -
.../plugins/cdh/v5_9_0/resources/hive-service.json | 758 ---
sahara/plugins/cdh/v5_9_0/resources/hive-site.xml | 61 -
.../plugins/cdh/v5_9_0/resources/hive-webhcat.json | 332 --
.../v5_9_0/resources/hue-hue_load_balancer.json | 236 -
.../cdh/v5_9_0/resources/hue-hue_server.json | 368 --
.../cdh/v5_9_0/resources/hue-kt_renewer.json | 200 -
.../plugins/cdh/v5_9_0/resources/hue-service.json | 674 ---
.../resources/images/centos/disable_firewall | 20 -
.../resources/images/centos/selinux_permissive | 13 -
.../resources/images/centos/turn_off_services | 33 -
.../cdh/v5_9_0/resources/images/centos/wget_repo | 33 -
.../cdh/v5_9_0/resources/images/common/add_jar | 22 -
.../resources/images/common/install_cloudera | 17 -
.../v5_9_0/resources/images/common/install_extjs | 30 -
.../images/common/unlimited_security_artifacts | 11 -
.../plugins/cdh/v5_9_0/resources/images/image.yaml | 132 -
.../resources/images/ubuntu/turn_off_services | 33 -
.../cdh/v5_9_0/resources/images/ubuntu/wget_repo | 36 -
.../cdh/v5_9_0/resources/impala-catalogserver.json | 530 --
.../cdh/v5_9_0/resources/impala-impalad.json | 734 ---
.../plugins/cdh/v5_9_0/resources/impala-llama.json | 506 --
.../cdh/v5_9_0/resources/impala-service.json | 644 ---
.../cdh/v5_9_0/resources/impala-statestore.json | 392 --
.../cdh/v5_9_0/resources/kafka-kafka_broker.json | 476 --
.../v5_9_0/resources/kafka-kafka_mirror_maker.json | 482 --
.../cdh/v5_9_0/resources/kafka-service.json | 374 --
sahara/plugins/cdh/v5_9_0/resources/kms-kms.json | 530 --
.../plugins/cdh/v5_9_0/resources/kms-service.json | 86 -
.../v5_9_0/resources/ks_indexer-hbase_indexer.json | 362 --
.../cdh/v5_9_0/resources/ks_indexer-service.json | 188 -
.../plugins/cdh/v5_9_0/resources/mapred-site.xml | 157 -
.../cdh/v5_9_0/resources/oozie-oozie_server.json | 662 ---
.../cdh/v5_9_0/resources/oozie-service.json | 260 -
.../cdh/v5_9_0/resources/priority-one-confs.json | 45 -
.../cdh/v5_9_0/resources/sentry-gateway.json | 62 -
.../resources/sentry-impala-client-safety.xml | 16 -
.../cdh/v5_9_0/resources/sentry-sentry_server.json | 308 -
.../cdh/v5_9_0/resources/sentry-service.json | 290 -
.../plugins/cdh/v5_9_0/resources/solr-gateway.json | 50 -
.../plugins/cdh/v5_9_0/resources/solr-service.json | 416 --
.../cdh/v5_9_0/resources/solr-solr_server.json | 452 --
.../cdh/v5_9_0/resources/spark-gateway.json | 176 -
.../cdh/v5_9_0/resources/spark-service.json | 152 -
.../resources/spark-spark_yarn_history_server.json | 314 --
.../cdh/v5_9_0/resources/sqoop-service.json | 110 -
.../cdh/v5_9_0/resources/sqoop-sqoop_server.json | 398 --
.../plugins/cdh/v5_9_0/resources/yarn-gateway.json | 506 --
.../cdh/v5_9_0/resources/yarn-jobhistory.json | 476 --
.../cdh/v5_9_0/resources/yarn-nodemanager.json | 770 ---
.../cdh/v5_9_0/resources/yarn-resourcemanager.json | 674 ---
.../plugins/cdh/v5_9_0/resources/yarn-service.json | 632 ---
.../cdh/v5_9_0/resources/zookeeper-server.json | 596 --
.../cdh/v5_9_0/resources/zookeeper-service.json | 224 -
sahara/plugins/cdh/v5_9_0/versionhandler.py | 37 -
sahara/plugins/cdh/validation.py | 438 --
sahara/plugins/cdh/versionfactory.py | 57 -
sahara/plugins/conductor.py | 38 +
sahara/plugins/context.py | 74 +
sahara/plugins/db.py | 29 +
sahara/plugins/edp.py | 96 +
sahara/plugins/exceptions.py | 26 +
sahara/plugins/fake/edp_engine.py | 15 +-
sahara/plugins/fake/plugin.py | 3 +-
.../health => plugins}/health_check_base.py | 0
sahara/plugins/images.py | 49 +-
.../plugins/{cdh/v5_13_0/validation.py => main.py} | 13 +-
sahara/plugins/mapr/__init__.py | 0
sahara/plugins/mapr/abstract/__init__.py | 0
sahara/plugins/mapr/abstract/cluster_context.py | 157 -
sahara/plugins/mapr/abstract/cluster_validator.py | 29 -
sahara/plugins/mapr/abstract/configurer.py | 29 -
sahara/plugins/mapr/abstract/health_checker.py | 24 -
sahara/plugins/mapr/abstract/node_manager.py | 37 -
sahara/plugins/mapr/abstract/version_handler.py | 81 -
sahara/plugins/mapr/base/__init__.py | 0
.../plugins/mapr/base/base_cluster_configurer.py | 405 --
sahara/plugins/mapr/base/base_cluster_context.py | 444 --
sahara/plugins/mapr/base/base_cluster_validator.py | 35 -
sahara/plugins/mapr/base/base_edp_engine.py | 94 -
sahara/plugins/mapr/base/base_health_checker.py | 121 -
sahara/plugins/mapr/base/base_node_manager.py | 200 -
sahara/plugins/mapr/base/base_version_handler.py | 198 -
sahara/plugins/mapr/domain/__init__.py | 0
sahara/plugins/mapr/domain/configuration_file.py | 194 -
sahara/plugins/mapr/domain/distro.py | 96 -
sahara/plugins/mapr/domain/node_process.py | 177 -
sahara/plugins/mapr/domain/service.py | 246 -
sahara/plugins/mapr/images.py | 43 -
sahara/plugins/mapr/plugin.py | 110 -
sahara/plugins/mapr/resources/add_mapr_repo.sh | 37 -
.../plugins/mapr/resources/add_security_repos.sh | 6 -
.../mapr/resources/create_disk_list_file.sh | 13 -
.../mapr/resources/images/centos/disable_firewall | 20 -
.../mapr/resources/images/centos/epel_dependencies | 6 -
.../images/centos/install_mapr_core_repository | 27 -
.../images/centos/install_mapr_eco_repository | 27 -
.../mapr/resources/images/centos/install_openjdk | 14 -
.../mapr/resources/images/centos/install_scala | 34 -
.../mapr/resources/images/centos/requiretty | 6 -
.../resources/images/centos/selinux_permissive | 12 -
.../mapr/resources/images/centos/update_repository | 5 -
.../mapr/resources/images/common/configure_extjs | 31 -
.../mapr/resources/images/common/oracle_java | 42 -
.../images/common/resources/package_utils.sh | 226 -
.../images/common/resources/packages.json | 140 -
.../images/common/resources/spec_5.1.0.json | 46 -
.../images/common/resources/spec_5.2.0.json | 50 -
.../images/common/resources/spec_5.2.0_ubuntu.json | 47 -
.../resources/images/common/resources/versions.py | 83 -
sahara/plugins/mapr/resources/images/image.yaml | 205 -
.../images/ubuntu/install_mapr_core_repository | 27 -
.../images/ubuntu/install_mapr_dependencies | 22 -
.../images/ubuntu/install_mapr_eco_repository | 32 -
.../mapr/resources/images/ubuntu/install_openjdk | 16 -
.../mapr/resources/images/ubuntu/install_scala | 37 -
.../mapr/resources/images/ubuntu/update_repository | 5 -
sahara/plugins/mapr/resources/install_java.sh | 69 -
sahara/plugins/mapr/resources/install_mysql.sh | 31 -
.../plugins/mapr/resources/install_mysql_client.sh | 12 -
sahara/plugins/mapr/resources/install_scala.sh | 28 -
sahara/plugins/mapr/resources/topology.sh | 20 -
sahara/plugins/mapr/services/__init__.py | 0
sahara/plugins/mapr/services/drill/__init__.py | 0
sahara/plugins/mapr/services/drill/drill.py | 112 -
sahara/plugins/mapr/services/flume/__init__.py | 0
sahara/plugins/mapr/services/flume/flume.py | 47 -
sahara/plugins/mapr/services/hbase/__init__.py | 0
sahara/plugins/mapr/services/hbase/hbase.py | 120 -
.../services/hbase/resources/hbase-default.json | 31 -
sahara/plugins/mapr/services/hive/__init__.py | 0
sahara/plugins/mapr/services/hive/hive.py | 184 -
.../mapr/services/hive/resources/hive-default.xml | 59 -
.../mapr/services/hive/resources/sentry-db.xml | 27 -
.../services/hive/resources/sentry-default.xml | 45 -
sahara/plugins/mapr/services/httpfs/__init__.py | 0
sahara/plugins/mapr/services/httpfs/httpfs.py | 40 -
.../services/httpfs/resources/httpfs-default.json | 12 -
sahara/plugins/mapr/services/hue/__init__.py | 0
sahara/plugins/mapr/services/hue/hue.py | 365 --
.../services/hue/resources/hue_3.10.0.template | 1403 -----
.../mapr/services/hue/resources/hue_3.6.0.template | 947 ----
.../mapr/services/hue/resources/hue_3.7.0.template | 1001 ----
.../mapr/services/hue/resources/hue_3.8.1.template | 1143 ----
.../mapr/services/hue/resources/hue_3.9.0.template | 1184 ----
.../services/hue/resources/hue_sh_3.10.0.template | 130 -
.../services/hue/resources/hue_sh_3.7.0.template | 116 -
.../services/hue/resources/hue_sh_3.8.1.template | 130 -
.../services/hue/resources/hue_sh_3.9.0.template | 130 -
.../hue/resources/livy_conf_3.10.0.template | 80 -
.../services/hue/resources/livy_sh_3.10.0.template | 35 -
sahara/plugins/mapr/services/impala/__init__.py | 0
sahara/plugins/mapr/services/impala/impala.py | 192 -
.../services/impala/resources/impala-env.sh.j2 | 64 -
sahara/plugins/mapr/services/kafka/__init__.py | 0
sahara/plugins/mapr/services/kafka/kafka.py | 73 -
sahara/plugins/mapr/services/mahout/__init__.py | 0
sahara/plugins/mapr/services/mahout/mahout.py | 58 -
.../plugins/mapr/services/management/__init__.py | 0
.../plugins/mapr/services/management/management.py | 63 -
sahara/plugins/mapr/services/mapreduce/__init__.py | 0
.../plugins/mapr/services/mapreduce/mapreduce.py | 127 -
.../mapreduce/resources/mapreduce-cluster.json | 91 -
sahara/plugins/mapr/services/maprfs/__init__.py | 0
sahara/plugins/mapr/services/maprfs/maprfs.py | 157 -
.../mapr/services/maprfs/resources/cldb.conf | 63 -
sahara/plugins/mapr/services/mysql/__init__.py | 0
sahara/plugins/mapr/services/mysql/mysql.py | 207 -
.../services/mysql/resources/create_database.sql | 7 -
.../mapr/services/mysql/resources/grant_access.sql | 6 -
.../mapr/services/mysql/resources/hive_schema.sql | 2 -
sahara/plugins/mapr/services/oozie/__init__.py | 0
sahara/plugins/mapr/services/oozie/oozie.py | 168 -
.../services/oozie/resources/oozie-default.json | 28 -
sahara/plugins/mapr/services/pig/__init__.py | 0
sahara/plugins/mapr/services/pig/pig.py | 57 -
sahara/plugins/mapr/services/sentry/__init__.py | 0
.../services/sentry/resources/global-policy.ini | 6 -
.../services/sentry/resources/sentry-default.xml | 4 -
sahara/plugins/mapr/services/sentry/sentry.py | 171 -
sahara/plugins/mapr/services/spark/__init__.py | 0
.../services/spark/resources/spark-env.template | 134 -
sahara/plugins/mapr/services/spark/spark.py | 316 --
sahara/plugins/mapr/services/sqoop/__init__.py | 0
sahara/plugins/mapr/services/sqoop/sqoop2.py | 46 -
sahara/plugins/mapr/services/swift/__init__.py | 0
.../swift/resources/hadoop-swift-latest.jar | Bin 117363 -> 0 bytes
.../services/swift/resources/swift-default.json | 61 -
sahara/plugins/mapr/services/swift/swift.py | 58 -
sahara/plugins/mapr/services/yarn/__init__.py | 0
.../mapr/services/yarn/resources/yarn-cluster.json | 16 -
.../mapr/services/yarn/resources/yarn-node.json | 23 -
sahara/plugins/mapr/services/yarn/yarn.py | 144 -
sahara/plugins/mapr/util/__init__.py | 0
sahara/plugins/mapr/util/commands.py | 25 -
sahara/plugins/mapr/util/event_log.py | 63 -
sahara/plugins/mapr/util/general.py | 204 -
sahara/plugins/mapr/util/maprfs_helper.py | 108 -
sahara/plugins/mapr/util/password_utils.py | 69 -
sahara/plugins/mapr/util/service_utils.py | 51 -
sahara/plugins/mapr/util/validation_utils.py | 262 -
sahara/plugins/mapr/versions/__init__.py | 0
.../plugins/mapr/versions/v5_2_0_mrv2/__init__.py | 0
.../plugins/mapr/versions/v5_2_0_mrv2/context.py | 61 -
.../mapr/versions/v5_2_0_mrv2/version_handler.py | 75 -
.../mapr/versions/version_handler_factory.py | 57 -
.../{cdh/v5_9_0/validation.py => objects.py} | 9 +-
sahara/plugins/provisioning.py | 1 +
.../test_plugin_utils.py => plugins/resource.py} | 23 +-
.../{cdh/v5_7_0/validation.py => service_api.py} | 9 +-
sahara/plugins/spark/__init__.py | 0
sahara/plugins/spark/config_helper.py | 517 --
sahara/plugins/spark/edp_engine.py | 62 -
sahara/plugins/spark/plugin.py | 575 --
sahara/plugins/spark/resources/README.rst | 21 -
sahara/plugins/spark/resources/core-default.xml | 632 ---
sahara/plugins/spark/resources/hdfs-default.xml | 709 ---
sahara/plugins/spark/resources/spark-cleanup.cron | 2 -
.../plugins/spark/resources/spark-env.sh.template | 21 -
.../spark/resources/tmp-cleanup.sh.template | 48 -
sahara/plugins/spark/resources/topology.sh | 21 -
sahara/plugins/spark/run_scripts.py | 92 -
sahara/plugins/spark/scaling.py | 111 -
sahara/plugins/spark/shell_engine.py | 28 -
sahara/plugins/storm/__init__.py | 0
sahara/plugins/storm/config_helper.py | 159 -
sahara/plugins/storm/edp_engine.py | 52 -
sahara/plugins/storm/plugin.py | 410 --
sahara/plugins/storm/run_scripts.py | 54 -
.../v5_13_0/plugin_utils.py => swift_helper.py} | 17 +-
.../{cdh/v5_11_0/validation.py => swift_utils.py} | 9 +-
sahara/plugins/testutils.py | 34 +
.../topology_helper.py} | 22 +-
sahara/plugins/utils.py | 149 +-
sahara/plugins/vanilla/__init__.py | 0
sahara/plugins/vanilla/abstractversionhandler.py | 71 -
sahara/plugins/vanilla/confighints_helper.py | 45 -
sahara/plugins/vanilla/edp_engine.py | 40 -
sahara/plugins/vanilla/hadoop2/__init__.py | 0
sahara/plugins/vanilla/hadoop2/config.py | 479 --
sahara/plugins/vanilla/hadoop2/config_helper.py | 329 --
sahara/plugins/vanilla/hadoop2/keypairs.py | 94 -
sahara/plugins/vanilla/hadoop2/oozie_helper.py | 51 -
.../vanilla/hadoop2/recommendations_utils.py | 48 -
.../vanilla/hadoop2/resources/create_oozie_db.sql | 5 -
.../vanilla/hadoop2/resources/post_conf.template | 33 -
.../vanilla/hadoop2/resources/spark-cleanup.cron | 2 -
.../hadoop2/resources/tmp-cleanup.sh.template | 48 -
.../plugins/vanilla/hadoop2/resources/topology.sh | 21 -
.../vanilla/hadoop2/resources/zoo_sample.cfg | 29 -
sahara/plugins/vanilla/hadoop2/run_scripts.py | 293 -
sahara/plugins/vanilla/hadoop2/scaling.py | 147 -
sahara/plugins/vanilla/hadoop2/starting_scripts.py | 85 -
sahara/plugins/vanilla/hadoop2/utils.py | 89 -
sahara/plugins/vanilla/hadoop2/validation.py | 158 -
sahara/plugins/vanilla/plugin.py | 108 -
sahara/plugins/vanilla/utils.py | 69 -
sahara/plugins/vanilla/v2_7_1/__init__.py | 0
sahara/plugins/vanilla/v2_7_1/config_helper.py | 151 -
sahara/plugins/vanilla/v2_7_1/edp_engine.py | 81 -
sahara/plugins/vanilla/v2_7_1/resources/README.rst | 28 -
.../vanilla/v2_7_1/resources/core-default.xml | 1902 -------
.../vanilla/v2_7_1/resources/create_hive_db.sql | 9 -
.../vanilla/v2_7_1/resources/hdfs-default.xml | 2323 --------
.../vanilla/v2_7_1/resources/hive-default.xml | 1873 ------
.../vanilla/v2_7_1/resources/mapred-default.xml | 2128 -------
.../vanilla/v2_7_1/resources/oozie-default.xml | 2546 ---------
.../vanilla/v2_7_1/resources/yarn-default.xml | 1623 ------
sahara/plugins/vanilla/v2_7_1/versionhandler.py | 170 -
sahara/plugins/vanilla/v2_7_5/__init__.py | 0
sahara/plugins/vanilla/v2_7_5/config_helper.py | 151 -
sahara/plugins/vanilla/v2_7_5/edp_engine.py | 81 -
sahara/plugins/vanilla/v2_7_5/resources/README.rst | 27 -
.../vanilla/v2_7_5/resources/core-default.xml | 1997 -------
.../vanilla/v2_7_5/resources/create_hive_db.sql | 9 -
.../vanilla/v2_7_5/resources/hdfs-default.xml | 2677 ---------
.../vanilla/v2_7_5/resources/hive-default.xml | 5959 --------------------
.../vanilla/v2_7_5/resources/mapred-default.xml | 2221 --------
.../vanilla/v2_7_5/resources/oozie-default.xml | 2843 ----------
.../vanilla/v2_7_5/resources/yarn-default.xml | 1713 ------
sahara/plugins/vanilla/v2_7_5/versionhandler.py | 170 -
sahara/plugins/vanilla/v2_8_2/__init__.py | 0
sahara/plugins/vanilla/v2_8_2/config_helper.py | 151 -
sahara/plugins/vanilla/v2_8_2/edp_engine.py | 81 -
sahara/plugins/vanilla/v2_8_2/resources/README.rst | 27 -
.../vanilla/v2_8_2/resources/core-default.xml | 2414 --------
.../vanilla/v2_8_2/resources/create_hive_db.sql | 9 -
.../vanilla/v2_8_2/resources/hdfs-default.xml | 3138 -----------
.../vanilla/v2_8_2/resources/hive-default.xml | 5959 --------------------
.../vanilla/v2_8_2/resources/mapred-default.xml | 1892 -------
.../vanilla/v2_8_2/resources/oozie-default.xml | 2843 ----------
.../vanilla/v2_8_2/resources/yarn-default.xml | 2635 ---------
sahara/plugins/vanilla/v2_8_2/versionhandler.py | 170 -
sahara/plugins/vanilla/versionfactory.py | 57 -
sahara/service/coordinator.py | 3 +-
sahara/service/edp/hdfs_helper.py | 2 +-
sahara/service/edp/job_manager.py | 2 +-
sahara/service/edp/resources/launch_command.py | 1 +
sahara/service/health/common.py | 2 +-
sahara/service/health/verification_base.py | 2 +-
sahara/service/heat/templates.py | 34 +-
sahara/service/ntp_service.py | 4 +-
sahara/service/ops.py | 45 +-
sahara/service/quotas.py | 2 +-
sahara/service/validation.py | 19 +
sahara/service/validations/cluster_templates.py | 2 +-
sahara/service/validations/clusters_schema.py | 8 +-
.../service/validations/edp/job_binary_internal.py | 3 +-
sahara/service/validations/edp/job_execution.py | 8 +-
.../validations/node_group_template_schema.py | 9 +
sahara/service/validations/shares.py | 2 +-
sahara/swift/swift_helper.py | 2 +-
.../unit/plugins/ambari/test_requests_helper.py | 96 -
.../unit/plugins/cdh/base_config_helper_test.py | 187 -
.../unit/plugins/cdh/base_plugin_utils_test.py | 323 --
.../unit/plugins/cdh/test_confighints_helper.py | 59 -
.../unit/plugins/cdh/v5_11_0/test_config_helper.py | 25 -
.../plugins/cdh/v5_11_0/test_config_helper_5110.py | 168 -
.../unit/plugins/cdh/v5_11_0/test_edp_engine.py | 168 -
.../unit/plugins/cdh/v5_11_0/test_spark_engine.py | 69 -
.../unit/plugins/cdh/v5_11_0/test_validation.py | 24 -
.../plugins/cdh/v5_11_0/test_versionhandler.py | 140 -
.../unit/plugins/cdh/v5_7_0/test_config_helper.py | 25 -
.../plugins/cdh/v5_7_0/test_config_helper_570.py | 168 -
.../unit/plugins/cdh/v5_7_0/test_edp_engine.py | 200 -
.../unit/plugins/cdh/v5_7_0/test_plugin_utils.py | 25 -
.../plugins/cdh/v5_7_0/test_plugin_utils_570.py | 25 -
.../unit/plugins/cdh/v5_7_0/test_spark_engine.py | 69 -
.../unit/plugins/cdh/v5_7_0/test_validation.py | 24 -
.../unit/plugins/cdh/v5_7_0/test_versionhandler.py | 140 -
.../unit/plugins/cdh/v5_9_0/test_config_helper.py | 25 -
.../plugins/cdh/v5_9_0/test_config_helper_590.py | 168 -
.../unit/plugins/cdh/v5_9_0/test_edp_engine.py | 200 -
.../unit/plugins/cdh/v5_9_0/test_plugin_utils.py | 25 -
.../plugins/cdh/v5_9_0/test_plugin_utils_590.py | 25 -
.../unit/plugins/cdh/v5_9_0/test_spark_engine.py | 69 -
.../unit/plugins/cdh/v5_9_0/test_validation.py | 24 -
.../unit/plugins/cdh/v5_9_0/test_versionhandler.py | 140 -
.../unit/plugins/mapr/test_cluster_context.py | 284 -
.../unit/plugins/test_base_plugins_support.py | 7 +-
.../vanilla/hadoop2/resources/dfs-report.txt | 62 -
.../vanilla/hadoop2/resources/yarn-report.txt | 6 -
.../plugins/vanilla/hadoop2/test_config_helper.py | 196 -
.../unit/plugins/vanilla/hadoop2/test_configs.py | 41 -
.../plugins/vanilla/hadoop2/test_edp_engine.py | 89 -
.../plugins/vanilla/hadoop2/test_oozie_helper.py | 66 -
.../unit/plugins/vanilla/hadoop2/test_plugin.py | 47 -
.../vanilla/hadoop2/test_recommendation_utils.py | 60 -
.../plugins/vanilla/hadoop2/test_run_scripts.py | 313 -
.../unit/plugins/vanilla/hadoop2/test_scaling.py | 259 -
.../vanilla/hadoop2/test_starting_scripts.py | 152 -
.../unit/plugins/vanilla/hadoop2/test_utils.py | 141 -
.../plugins/vanilla/hadoop2/test_validation.py | 111 -
.../plugins/vanilla/test_confighints_helper.py | 59 -
.../plugins/vanilla/v2_7_1/test_config_helper.py | 73 -
.../unit/plugins/vanilla/v2_7_1/test_edp_engine.py | 96 -
.../plugins/vanilla/v2_7_1/test_versionhandler.py | 253 -
.../plugins/vanilla/v2_7_5/test_config_helper.py | 73 -
.../unit/plugins/vanilla/v2_7_5/test_edp_engine.py | 96 -
.../plugins/vanilla/v2_7_5/test_versionhandler.py | 253 -
.../plugins/vanilla/v2_8_2/test_config_helper.py | 73 -
.../unit/plugins/vanilla/v2_8_2/test_edp_engine.py | 96 -
.../plugins/vanilla/v2_8_2/test_versionhandler.py | 253 -
.../internal_db/test_internal_db_type.py | 144 +-
.../edp/job_binaries/job_binary_manager_support.py | 62 +-
.../edp/job_binaries/manila/test_manila_type.py | 286 +-
.../unit/service/edp/job_binaries/test_base.py | 18 +-
.../unit/service/health/test_verification_base.py | 4 +-
.../validation/edp/test_job_binary_internal.py | 2 +-
.../service/validation/edp/test_job_executor.py | 36 +-
.../service/validation/edp/test_job_interface.py | 1 +
.../test_cluster_template_create_validation.py | 2 +-
.../service/validation/test_share_validations.py | 4 +-
sahara/utils/api.py | 89 +-
sahara/utils/crypto.py | 4 +
sahara/utils/files.py | 8 +-
sahara/utils/hacking/checks.py | 7 +-
sahara/utils/hacking/import_checks.py | 9 +-
sahara/utils/openstack/keystone.py | 1 +
sahara/utils/procutils.py | 8 +-
sahara/utils/proxy.py | 2 +-
sahara/utils/ssh_remote.py | 74 +-
sahara/utils/xmlutils.py | 11 +-
setup.cfg | 9 +-
test-requirements.txt | 4 +-
tools/gate/build-images | 5 +-
tox.ini | 14 +-
985 files changed, 9723 insertions(+), 205579 deletions(-)
Requirements updates
--------------------
diff --git a/requirements.txt b/requirements.txt
index 6cea8b0d..28d95414 100644
--- a/requirements.txt
+++ b/requirements.txt
@@ -17,0 +18 @@ keystonemiddleware>=4.17.0 # Apache-2.0
+microversion-parse>=0.2.1 # Apache-2.0
@@ -29,0 +31 @@ oslo.service!=1.28.1,>=1.24.0 # Apache-2.0
+oslo.upgradecheck>=0.1.0 # Apache-2.0
diff --git a/test-requirements.txt b/test-requirements.txt
index 52c06260..12dde8e4 100644
--- a/test-requirements.txt
+++ b/test-requirements.txt
@@ -5 +5 @@
-hacking!=0.13.0,<0.14,>=0.12.0 # Apache-2.0
+hacking>=1.1.0 # Apache-2.0
@@ -16 +16 @@ stestr>=1.0.0 # Apache-2.0
-psycopg2>=2.6.2 # LGPL/ZPL
+psycopg2>=2.7.3 # LGPL/ZPL
More information about the Release-announce
mailing list