[openstack-announce] [new][sahara] sahara 5.0.0 release (newton)

no-reply at openstack.org no-reply at openstack.org
Thu Oct 6 13:24:47 UTC 2016


We are excited to announce the release of:

sahara 5.0.0: Sahara project

This release is part of the newton release series.

With source available at:

    http://git.openstack.org/cgit/openstack/sahara

For more details, please see below.

5.0.0
^^^^^

Documentation about distributed periodics are extended with steps
about installation additional libs required for correct work of
coordination backend. Please refer Advanced Configuration Guide for
details.


New Features
************

* Add impala 2.2 to MapR plugin

* MaR 5.2.0 is supported in MapR plugin.

* Add Sentry to MapR plugin

* Kafka was added in CDH 5.5 and CDH 5.7

* Add ability to automaticaly generate better configurations for
  Ambari cluster by using 'ALWAYS_APPLY' strategy

* Versions 5.5.0 and 5.7.0 of Cloudera plugin are declared as
  stable.

* CDH 5.7 is supported in CDH plugin.

* Added integration of Designate for hostname resolution through dns
  servers

* Added event log for HDP plugin

* Kerberos support implemented for Cloudera and Ambari plugins. New
  oozie client implemented to support authentication for oozie in
  kerberized cluster.

* Custom health check is added to MapR plugin

* MapR 5.1.0.mrv2 is now Enabled.

* Remove support for Spark standalone in MapR plugin

* The following service versions were added to MapR 5.2.0 plugin -
  HBase 1.1 - Drill 1.6 - Mahout 0.11 0.12 - Spark 1.6.1 - Impala 2.5

* Added rack awareness feature for CDH 5.5 and CDH 5.7

* Added rack awareness feature for HDP plugin

* Refactoring the logic on how floating ips are used by Sahara. This
  change will allow the coexistence of cluster using floating ips with
  cluster that do not.

* Separate transport url can be used for notifications purposes now,
  to enable this feature 'transport_url' should be provided in
  'oslo_messaging_notifications' section.


Upgrade Notes
*************

* migration from keystoneclient to keystoneauth is done for using
  auth features of keystone.

* Migration from novaclient.v2.images to glanceclient


Deprecation Notes
*****************

* Versions 5, 5.3.0, 5.4.0 of Cloudera plugin are deprecated. It is
  no longer maintainted and supposed to be removed in P release.

* Convert to cluster template feature is no longer supported by all
  plugins.

* Option 'infrastructure engine' is removed from sahara configs.

* MapR 5.0.0.mrv2 is now Deprecated. It is not recommended for
  usage. It is better to use MapR 5.1.0.mrv2 instead. This version of
  plugin will be removed in Ocata release.

* Support of HDP 2.0.6 plugin was removed. Use Ambari plugin
  instead.


Bug Fixes
*********

* Fixed incorrect down scaling of ambari cluster

* Fixed launching Hive jobs in Ambari plugin.

* Starting Ambari clusters on Centos 7 is fixed.

* CA certificate handling in keystone, nova, neutron and cinder
  clients are fixed (#330635)

* After decommissioning hosts all assoicated configs groups will be
  removed in ambari plugin.

* Fix uncompleted event logs for Oozie and Drill in MapR plugin.

* This patch adds ability to work with swift by using Keystone API
  v3

* Fixed issue with handling endpoint_type during creation neutron
  client, closed bug 1564805

* Fixed issues with hardcoded password during creation MySQL
  database for Oozie, bug 1541122.

* Fixed issues with hardcoded password during starting hive process,
  bug 1498035.

Changes in sahara 4.0.0.0rc1..5.0.0
-----------------------------------

bb96d84 Fix API compatibility issue
8622ca6 Fix incorrect event log for ambari
6e12a9f Documentation updates for stable/newton
5c9c023 Add workaround for Hue on CentOS 7
b178798 Fix ZooKeeper check for CentOS 7
5c775d2 Fill tempest.conf with Sahara-specific values
47579ee Update .gitreview for stable/newton
55f6eae Update link reference
c5baed4 [DOC] update doc about vanilla image builder
356417f [DOC] update doc about vanilla plugin
777b425 do not use artifacts at sahara files
602a771 fix docs env
c4d3474 [doc] change location of swiftfs jars
f18096a [DOC] update doc about cluster statuses
a01c3a1 [DOC] update doc about registering image
d693946 write docs about enabling kerberos
d0e47db [DOC] update doc about CDH image builder
1a738fd [DOC] update user doc about CDH plugin
d8e69c5 [Doc] Small fixes according to Spark on Vanilla supporting
fcc7bfe [Ambari] fix Ubuntu deploy
83a6a28 Remove entry point of sahara tempest plugin
a2a07ae Updated from global requirements
b3447fb Remove Tempest-like tests for clients (see sahara-tests)
f825ab3 standardize release note page ordering
5120dd7 reimplement oozie client as abstract
0d8af80 allow configuration of strategy for UI
f41bb7d [DOC] Add docs about pagination abilities
5b0960b Add MapR core 5.2
3a40553 [api-ref] Stop supporting os-api-ref 1.0.0
eb408c5 Add new version pack for services
2de626a Add event log for HDP plugin
e4207c8 Update api-ref docs for Designate feature
38784a4 Add Sentry service v1.6 to MapR plugin
cf7ed7f Add custom health check for MapR plugin
a2cf981 Rename all ClusterContext variables to 'cluster_context'
53f7854 Replace mfs.exchange with g.copy_file where it is possible
3b70e65 [DOC] Update user doc about Designate
89708bb [DOC] Fix misprints in api-ref
ff3e431 Spark on Vanilla Clusters
d44716f Added rack awareness in CDH plugin
3a4a3a0 [Doc] add description of "plugin update" to api ref
836e6fe Updated from global requirements
36640a8 Remove support for Spark standalone
af1a6bd Remove ssl config for Hue
94bb5a2 Refactor service home dir owner setting
8635ef6 [Ambari] More flexible auto configuration
1400bbe Fix invalid security repo
9f8c219 Added rack awareness in HDP plugin
5ccdc8e Updated from global requirements
9a322af use _LE() to wrap the error message
78beeb1 Added option to disable sahara db for storing job binaries.
fe46ce8 Config logABug feature for Sahara api-ref
53c5089 Remove unused config.CONF
4278b95 improve logging for job execution failure
abaf513 Updating DOC on floating IPs change
05b0dd0 Updated from global requirements
64cd756 Fix wait conditions with SSL deployments
2c7066a Enabling MapR on CentOS7
4eda721 Updated from global requirements
49d0e30 Fix wrong instance count in provision events
6427bc6 [doc] Fix some problems in docs
75053af delete unused LOG in some files
36c7b3d TrivialFix: Remove logging import usused
8efd656 Fix mapr cluster deployment
cdf8d23 Remove MAPR_USER variable
2cb0a6d Delete useless 'pass'
9694735 Updated from global requirements
2d54607 replace assertListEqual() to assertEqual()
7af18b9 Updated from global requirements
153ea9a Error handling during hosts file generation
047ab5a Replace 'lsb_release -is' with the method 'get_os_distrib'
2e78134 Add auto configs to HDP plugin
1a24d87 Correct reraising of exception
da70bca Fix wrong epel version for CentOS 7
c8dad2e Clean imports in code
3f6817a Adding release note to floating ips change
585c3af Updated from global requirements
d7f1793 Remove hardcoded password from db schema
2e74ca0 Get ready for os-api-ref sphinx theme change
e3c25ef Replace old CLI calls in grenade
4013eaa Updated from global requirements
7350d7b Add Kafka to CDH 5.5 and CDH 5.7
68e70f9 Updated from global requirements
ce5b034 plugins:patch is now admin only operation
91f99b7 Fix small bugs in pagination
deda629 Fix wrong hue-livy process name and move installation
0b89714 Fix wrong owner setting for config files
3340aff copying oozie.warden to prevent failure
ca5986d Updated from global requirements
13fcb05 Image argument validation and declaration
c28f98c [ambari] support kerberos deployment
1851067 [cdh] kerberos support implementation
758f38a kerberos infra deployment impl
dae16db Fixed the error with updating the job via command line
9cf7c30 Add sorting ability to Sahara-API
0383199 Health check for Designate
189e6a8 Fix configs for repos and swift urls in CDH 5.7
124abc1 Added documentation for Designate feature
8d9b2fd Documentation for image gen CLI and framework
6039058 Updated from global requirements
3441978 Updated from global requirements
d769212 Updated from global requirements
d9a2f00 Designate integration
de89c9d Updated from global requirements
e750d49 Correct reraising of exception
5c04f10 Updated from global requirements
60763fc Updated from global requirements
57f8cd1 Updated from global requirements
ffd9b8e labels for CDH plugin
4bb6437 Changing zookeeper path while updating conf
7b4091a labels for MapR plugin
d29b4cf Remove hardcoded password for Oozie service
49b63d5 Refactor the logic around use of floating ips
6eb1937 Adding argument-related validators for image configurability
cb9b45e Configuration engine for image generation CLI
4ba99fa Use assertEqual() instead of assertDictEqual()
3d5f745 improve error message for execution with retries
837a1dc remove infrastructure engine option
2d9c8ab Add pagination ability to Sahara-API
e552a61 [DOC] Added docs for sahara+ironic
e1b9ff8 [DOC] Inform operators about limited quotas
6265773 delete two unused LOG
ce7c3da Updated from global requirements
74991fe Remove unused LOG
f5fcc36 Updated from global requirements
e839480 Fixing unit tests for image create
ea44774 improved scaling for cdh plugin
0246945 Adding Pyleus configs to Storm plugin
d9bd498 Add Python 3.5 classifier and venv
61dd4c0 Docs should use "--plugin-version" instead of "--version"
4b70223 CLI for Plugin-Declared Image Declaration
5e91182 make ability to return real plugins in list ops
76f1a81 Failed to download ext-2.2.zip from dev.sencha.com
9789e6c Adding Python Jobs using Pyleus
6d492a2 Simplify tox hacking rule to match other projects
c90a1da [DOC] Cleanup time for incomplete clusters
4cebb9c improvements on api for plugins
d067680 Resolves issue where to allow custom repo URLS
e5d50d2 Updated from global requirements
feb46bd Updated from global requirements
c8869f7 don't serialize auto security group if not needed
28ca79d Fix typo in ambari_plugin.rst
f4cb71d replace import of future to the top
694549d fix building api ref docs
5dfc7a8 The addition of the parentheses for py3
30bba52 [DOC] Update installation guide
9b50406 use sessions for creating heatclient
fdb37d5 Fixed spelling error
1bb6c99 forbid cluster creation without secondarynamenode
6d0d359 Fix subdirectory typo in sahara db template Readme file
357ec36 Updated from global requirements
3f43a76 Upgrade Storm plugin to version 1.0.1
60dcbd5 Updated from global requirements
9d6b648 Add Impala 2.2 to MapR plugin
8db9a47 Support of CDH 5.7
27be399 fixing sahara-engine setup in devstack
745e384 Fix typo in configs_recommendations.rst
145a41a Remove outdated tools
feac29b [DOC] improve docs
fe6392f Fix typo in cdh_plugin.rst
3766836 Fix glanceclient.v2.images
f48eb7d Remove unecessary decorators from private interface
cf57c1f Ignore Nova config drive in devices list
879d2a6 plugins api impl
ef00d94 sleep before waiting requests
6bf92e7 allow to specify notifications transport url
890f341 ability to configure endpoint type for services
a36dfbc Updated from global requirements
fba2d67 novaclient.v2.images to glanceclient migration
f51e04e Updated from global requirements
3ad8bab Update documentation for hadoop-swift
535b8a2 Updated from global requirements
ddc2eeb Updated from global requirements
8f0eba2 [DOC] updated docs about keystone cli
b8d99ec Trivial: Fix wrong button name in dashboard user guide
b5a04b9 Updated from global requirements
cadfbdc implement db ops for plugin's api
7077cd2 replace seriailization of plugin to PluginManager
c27c5ca Moving WADL docs to Sahara repository
f41c51a Remove convert to cluster template feature
2758511 Trivial: Remove useless words in CDN image builder doc
38b629e Updated from global requirements
1a2f118 remove ability to create barbicanclient
9d42820 Fix the ca certificate handling in the client sessions
b122ffb fix grenade from mitaka upgrade
9158062 remove config groups associated with removed hosts
905e104 Updated from global requirements
6329a0a workaround to fix ambari start on centos7
165172f Updated from global requirements
3bdeeb1 Fix provision events for installing services
12281b4 New version of HDP plugin 2.4
8c7cfb7 Display credentials info in cluster general info
9a1300b Updated from global requirements
ef2103e Improve timeout message when cluster create fails
e72e9fb Updated from global requirements
7f32aed Modify HDP plugin doc for Ambari plugin
2460408 Fix retrieve auth_url and python 3 jobs
e3e3b7e Readable logging for Heat templates
e50c211 Use split_path from oslo.utils
0e499c7 Added "\" In quickstart guide
5396abe Corrects MapR distro selection for RHEL
b9b2dca Fix cluster creation with another tenant
f096c91 Updated from global requirements
947d20a Added unit tests for CDH 5.5.0 deploy file
9274c8d Updated from global requirements
252e6ef [Trivial] Remove unnecessary executable privilege
b9e3c17 Updated from global requirements
99127d5 Code refactoring of ambari deploy processes
e718b28 Fix down scaling of ambari cluster
8f365af HDP hive HDFS support
1aa4364 improve description of ambari plugin
037ba02 Remove hdp 2.0.6 plugin
78a981b Updated from global requirements
3bc9f05 Fix grenade
966bb6f Updated from global requirements
64355f5 Minimise number of auto security groups
54d4647 remove verbose option in devstack plugin
beba6e7 use the only method to initialize client
8ee0fae Updated from global requirements
ea68895 Resolve bug with long value to RANDSTR function.
2a338f5 Change 'Hbase' to 'HBase' string in spark service
1a7c0b0 Updated from global requirements
de5977d Remove openstack/common related stuff
14bf94b Added unit tests for ha_helper file
9ede053 Updated from global requirements
3de43e2 Updated from global requirements
7f3a594 Fix typo in Spark service
44c5332 Renamed job execution and templates endpoints
d9acf6e Fix doc about scenario and Tempest tests
f24cfa9 keystoneclient to keystoneauth migration
0bf0dda Helper method to use dnf instead of yum on fedora >=22
aa79252 PrettyTable and rfc3986 are no longer used in tests
2425aff Update the links to the RDO project
ef0bf04 Focus the documentation on distributed mode
75c5e8d Updated from global requirements
ac82ffc cdh plugin yum install option "-y" missing
954e227 update options mentioned in tempest readme
501f88c Update hadoop swift docs
b5827af Updated from global requirements
e36d2c6 Fix doc build if git is absent
b30b09a Added new unittest to oozie module
ebb044d Updated from global requirements
bde808f SPI Method to Validate Images
a48d29e Added tests for sahara cli
a16baae Fix unavailable MCS link
590ccac Define context.roles with base class
e417b17 Update the Administrator Guide link
b942a08 Updated from global requirements
45baf17 Updated from global requirements
818db68 Change property for auto creating schema
1a450ed Remove unsupported services from 5.1.0
df341a5 Updated from global requirements
dcdcf24 Updated from global requirements
021d441 Bandit password tests
b57c5f3 Workaround for temporary Oozie bug
72b5a58 Fixing the bandit config
fe7adb5 Pkg installation to ssh_remote
6764aef fix syntax error in ui dev docs
65330b8 Set libext path for Oozie 4.0.1, 4.1.0
ef38159 rename service api modules
ef05a56 Fixing grenade job
b5bb9f9 Add hadoop openstack swift jar to ambari cluster
09a7c3a Fix Hue integration with Spark and Hive
eba054c Move bandit to pep8
1e973cb Revert "Remove PyMySQL and psycopg2 from test-requirements.txt"
866514e Do not build config example for readthedocs.org
581ba2e Remove PyMySQL and psycopg2 from test-requirements.txt
fb238a0 Correctly configure Spark with Hive, HBase
0374f93 Set libext path for Oozie 4.0.1, 4.1.0
379ccf8 Add hive property for Hue < 0.9.0
38b793d Updated Sahara arch diagram
974db26 Fix incorrect visualization of MapR versions
1af4701 Updated volumes section in docs
eb1b308 Update reno for stable/mitaka
6daf4c0 Update .gitreview for stable/mitaka


Diffstat (except docs and test files)
-------------------------------------

.coveragerc                                        |    3 +-
.gitignore                                         |    1 +
.gitreview                                         |    1 +
api-ref/source/cluster-templates.inc               |  255 ++
api-ref/source/clusters.inc                        |  338 ++
api-ref/source/conf.py                             |  237 ++
api-ref/source/data-sources.inc                    |  214 ++
api-ref/source/event-log.inc                       |   42 +
api-ref/source/image-registry.inc                  |  251 ++
api-ref/source/index.rst                           |   20 +
api-ref/source/job-binaries.inc                    |  266 ++
api-ref/source/job-binary-internals.inc            |  261 ++
api-ref/source/job-executions.inc                  |  329 ++
api-ref/source/job-types.inc                       |   61 +
api-ref/source/jobs.inc                            |  267 ++
api-ref/source/node-group-templates.inc            |  271 ++
api-ref/source/parameters.yaml                     | 1124 +++++++
api-ref/source/plugins.inc                         |  187 ++
.../cluster-template-create-request.json           |   17 +
.../cluster-template-create-response.json          |   82 +
.../cluster-template-show-response.json            |   82 +
.../cluster-template-update-request.json           |   11 +
.../cluster-template-update-response.json          |   67 +
.../cluster-templates-list-response.json           |  140 +
.../samples/clusters/cluster-create-request.json   |    9 +
.../samples/clusters/cluster-create-response.json  |  128 +
.../samples/clusters/cluster-scale-request.json    |   15 +
.../samples/clusters/cluster-scale-response.json   |  370 ++
.../samples/clusters/cluster-show-response.json    |  128 +
.../samples/clusters/cluster-update-request.json   |    4 +
.../samples/clusters/cluster-update-response.json  |  128 +
.../samples/clusters/clusters-list-response.json   |  327 ++
.../clusters/multiple-clusters-create-request.json |   11 +
.../multiple-clusters-create-response.json         |    6 +
.../data-source-register-hdfs-request.json         |    6 +
.../data-source-register-hdfs-response.json        |   14 +
.../data-source-register-swift-request.json        |   10 +
.../data-source-register-swift-response.json       |   14 +
.../data-sources/data-source-show-response.json    |   14 +
.../data-sources/data-source-update-request.json   |    4 +
.../data-sources/data-source-update-response.json  |   14 +
.../data-sources/data-sources-list-response.json   |   28 +
.../event-log/cluster-progress-response.json       |   72 +
.../image-registry/image-register-request.json     |    4 +
.../image-registry/image-register-response.json    |   25 +
.../image-registry/image-show-response.json        |   24 +
.../image-registry/image-tags-add-request.json     |    7 +
.../image-registry/image-tags-add-response.json    |   27 +
.../image-registry/image-tags-delete-request.json  |    5 +
.../image-registry/image-tags-delete-response.json |   25 +
.../image-registry/images-list-response.json       |   48 +
.../samples/job-binaries/create-request.json       |    9 +
.../samples/job-binaries/create-response.json      |   13 +
.../source/samples/job-binaries/list-response.json |   37 +
.../source/samples/job-binaries/show-data-response |    3 +
.../source/samples/job-binaries/show-response.json |   13 +
.../samples/job-binaries/update-request.json       |    5 +
.../samples/job-binaries/update-response.json      |   13 +
.../job-binary-internals/create-response.json      |   12 +
.../job-binary-internals/list-response.json        |   24 +
.../job-binary-internals/show-data-response        |    3 +
.../job-binary-internals/show-response.json        |   12 +
.../job-binary-internals/update-request.json       |    4 +
.../job-binary-internals/update-response.json      |   12 +
.../samples/job-executions/cancel-response.json    |  120 +
.../samples/job-executions/job-ex-response.json    |  120 +
.../job-executions/job-ex-update-request.json      |    3 +
.../job-executions/job-ex-update-response.json     |  120 +
.../samples/job-executions/list-response.json      |  122 +
.../samples/job-types/job-types-list-response.json |  209 ++
.../source/samples/jobs/job-create-request.json    |   11 +
.../source/samples/jobs/job-create-response.json   |   35 +
.../source/samples/jobs/job-execute-request.json   |   19 +
.../source/samples/jobs/job-execute-response.json  |   30 +
api-ref/source/samples/jobs/job-show-response.json |   26 +
.../source/samples/jobs/job-update-request.json    |    4 +
.../source/samples/jobs/job-update-response.json   |   26 +
.../source/samples/jobs/jobs-list-response.json    |   66 +
.../node-group-template-create-request.json        |   13 +
.../node-group-template-create-response.json       |   33 +
.../node-group-template-show-response.json         |   37 +
.../node-group-template-update-request.json        |   10 +
.../node-group-template-update-response.json       |   30 +
.../node-group-templates-list-response.json        |   76 +
.../samples/plugins/plugin-show-response.json      |   12 +
.../samples/plugins/plugin-update-request.json     |    7 +
.../samples/plugins/plugin-update-response.json    |   32 +
.../plugins/plugin-version-show-response.json      |   92 +
.../samples/plugins/plugins-list-response.json     |   41 +
bandit.yaml                                        |    4 +-
devstack/plugin.sh                                 |   25 +-
devstack/settings                                  |    3 +-
devstack/upgrade/cluster-create.json               |    8 -
devstack/upgrade/cluster-template.json             |   12 -
devstack/upgrade/from-mitaka/upgrade-sahara        |   15 +
devstack/upgrade/ng-template.json                  |   10 -
devstack/upgrade/resources.sh                      |  256 +-
devstack/upgrade/settings                          |    2 +-
devstack/upgrade/shutdown.sh                       |    3 +-
.../userdoc/advanced.configuration.guide.rst       |  131 +-
etc/edp-examples/README.rst                        |    2 +-
etc/sahara/policy.json                             |    1 +
etc/sahara/sahara.conf.sample-basic                |    6 +
.../notes/add-impala-2.2-c1649599649aff5c.yaml     |    3 +
.../notes/add-mapr-520-3ed6cd0ae9688e17.yaml       |    3 +
.../notes/add-mapr-sentry-6012c08b55d679de.yaml    |    3 +
.../notes/add_kafka_in_cdh-774c7c051480c892.yaml   |    3 +
.../notes/ambari-downscaling-b9ba759ce9c7325e.yaml |    3 +
.../notes/ambari-hive-92b911e0a759ee88.yaml        |    3 +
.../ambari-server-start-856403bc280dfba3.yaml      |    3 +
.../auto_configs_for_hdp-011d460d37dcdf02.yaml     |    4 +
.../notes/ca-cert-fix-5c434a82f9347039.yaml        |    4 +
.../notes/cdh-labels-5695d95bce226051.yaml         |    7 +
.../notes/cdh_5_7_support-9522cb9b4dce2378.yaml    |    3 +
.../config-groups-ambari-837de6d33eb0fa87.yaml     |    4 +
...nvert-to-cluster-template-43d502496d18625e.yaml |    4 +
.../designate-integration-784c5f7f29546015.yaml    |    4 +
.../notes/engine-opt-258ff1ae9b04d628.yaml         |    3 +
.../notes/event_log_for_hdp-a114511c477ef16d.yaml  |    3 +
...-install-provision-events-c1bd2e05bf2be6bd.yaml |    3 +
...doop-swift-jar-for-ambari-4439913b01d42468.yaml |    4 +
...nor-endpoint-type-neutron-4583128c383d9745.yaml |    4 +
releasenotes/notes/kerberos-76dd297462b7337c.yaml  |    5 +
...-to-keystonauth-migration-c75988975ad1a506.yaml |    4 +
.../notes/mapr-health-check-2eba3d742a2b853f.yaml  |    3 +
.../notes/mapr-labels-5cc318616db59403.yaml        |    7 +
...r-remove-spark-standalone-293ca864de9a7848.yaml |    3 +
...apr-services-new-versions-b32c2e8fe07d1600.yaml |    8 +
...nt_images_to_glanceclient-0266a2bd92b4be05.yaml |    3 +
.../rack_awareness_for_cdh-e0cd5d4ab46aa1b5.yaml   |    3 +
.../rack_awareness_for_hdp-6e3d44468cc141a5.yaml   |    3 +
...factor-floating-ips-logic-9d37d9297f3621b3.yaml |    5 +
...hard-coded-oozie-password-b97475c8772aa1bd.yaml |    4 +
...dcoded-password-from-hive-eb923b518974e853.yaml |    5 +
.../notes/remove-hdp-137d0ad3d2389b7a.yaml         |    4 +
.../notes/transport_url-5bbbf0bb54d81727.yaml      |    5 +
...eeper-configuration-steps-48c3d9706c86f227.yaml |    7 +
releasenotes/source/index.rst                      |    3 +-
releasenotes/source/mitaka.rst                     |    6 +
requirements.txt                                   |   48 +-
sahara/api/middleware/auth_valid.py                |   23 +-
sahara/api/v10.py                                  |   49 +-
sahara/api/v11.py                                  |   51 +-
sahara/api/v2/cluster_templates.py                 |   10 +-
sahara/api/v2/clusters.py                          |    8 +-
sahara/api/v2/data_sources.py                      |   10 +-
sahara/api/v2/images.py                            |    2 +-
sahara/api/v2/job_binaries.py                      |   16 +-
sahara/api/v2/job_executions.py                    |   22 +-
sahara/api/v2/job_types.py                         |    2 +-
sahara/api/v2/jobs.py                              |   26 +-
sahara/api/v2/node_group_templates.py              |   11 +-
sahara/api/v2/plugins.py                           |   15 +-
sahara/cli/image_pack/__init__.py                  |    0
sahara/cli/image_pack/api.py                       |  125 +
sahara/cli/image_pack/cli.py                       |  125 +
sahara/cli/sahara_all.py                           |    4 -
sahara/cli/sahara_api.py                           |    4 -
sahara/conductor/api.py                            |   23 +-
sahara/conductor/manager.py                        |   21 +
sahara/conductor/objects.py                        |   30 +-
sahara/conductor/resource.py                       |   25 +-
sahara/config.py                                   |   24 +-
sahara/context.py                                  |   16 +-
sahara/db/api.py                                   |   38 +-
.../versions/031_added_plugins_table.py            |   46 +
.../versions/032_add_domain_name.py                |   38 +
sahara/db/sqlalchemy/api.py                        |  254 +-
sahara/db/sqlalchemy/models.py                     |   19 +
sahara/db/templates/README.rst                     |    2 +-
sahara/exceptions.py                               |   18 +-
sahara/main.py                                     |   21 +-
sahara/openstack/__init__.py                       |    0
sahara/openstack/commons.py                        |   67 -
sahara/plugins/ambari/client.py                    |   87 +-
sahara/plugins/ambari/common.py                    |    5 +
sahara/plugins/ambari/configs.py                   |   20 +-
sahara/plugins/ambari/decomission_helper.py        |  118 -
sahara/plugins/ambari/deploy.py                    |  438 ++-
sahara/plugins/ambari/edp_engine.py                |    6 +
sahara/plugins/ambari/health.py                    |    2 +-
sahara/plugins/ambari/plugin.py                    |   50 +-
sahara/plugins/ambari/requests_helper.py           |  145 +
sahara/plugins/ambari/resources/configs-2.4.json   | 1331 ++++++++
sahara/plugins/ambari/resources/images/image.yaml  |    6 +
sahara/plugins/ambari/validation.py                |    6 +
sahara/plugins/base.py                             |   46 +-
sahara/plugins/cdh/abstractversionhandler.py       |    2 +-
sahara/plugins/cdh/client/clusters.py              |   60 +
sahara/plugins/cdh/client/cms.py                   |   22 +
sahara/plugins/cdh/client/hosts.py                 |    5 +-
sahara/plugins/cdh/client/resource.py              |    6 +-
sahara/plugins/cdh/client/types.py                 |    1 +
sahara/plugins/cdh/cloudera_utils.py               |  103 +-
sahara/plugins/cdh/commands.py                     |    4 +-
sahara/plugins/cdh/config_helper.py                |    5 +-
sahara/plugins/cdh/deploy.py                       |   42 +
sahara/plugins/cdh/edp_engine.py                   |    6 +
sahara/plugins/cdh/plugin.py                       |   16 +
sahara/plugins/cdh/plugin_utils.py                 |    6 +
sahara/plugins/cdh/v5_3_0/deploy.py                |   18 +-
sahara/plugins/cdh/v5_4_0/deploy.py                |   18 +-
sahara/plugins/cdh/v5_5_0/cloudera_utils.py        |   25 +-
sahara/plugins/cdh/v5_5_0/config_helper.py         |    7 +
sahara/plugins/cdh/v5_5_0/deploy.py                |   29 +-
sahara/plugins/cdh/v5_5_0/plugin_utils.py          |   11 +-
.../cdh/v5_5_0/resources/kafka-kafka_broker.json   |  476 +++
.../v5_5_0/resources/kafka-kafka_mirror_maker.json |  482 +++
.../cdh/v5_5_0/resources/kafka-service.json        |  374 +++
sahara/plugins/cdh/v5_5_0/versionhandler.py        |    8 +
sahara/plugins/cdh/v5_7_0/__init__.py              |    0
sahara/plugins/cdh/v5_7_0/cloudera_utils.py        |  470 +++
sahara/plugins/cdh/v5_7_0/config_helper.py         |  250 ++
sahara/plugins/cdh/v5_7_0/db_helper.py             |   41 +
sahara/plugins/cdh/v5_7_0/deploy.py                |  242 ++
sahara/plugins/cdh/v5_7_0/edp_engine.py            |   54 +
sahara/plugins/cdh/v5_7_0/plugin_utils.py          |  167 +
sahara/plugins/cdh/v5_7_0/resources/cdh_config.py  |  139 +
sahara/plugins/cdh/v5_7_0/resources/cdh_config.sh  |    3 +
.../cdh/v5_7_0/resources/create_hive_db.sql        |    4 +
.../cdh/v5_7_0/resources/create_sentry_db.sql      |    4 +
.../plugins/cdh/v5_7_0/resources/flume-agent.json  |  428 +++
.../cdh/v5_7_0/resources/flume-service.json        |  164 +
.../cdh/v5_7_0/resources/hbase-gateway.json        |  110 +
.../v5_7_0/resources/hbase-hbaserestserver.json    |  440 +++
.../v5_7_0/resources/hbase-hbasethriftserver.json  |  446 +++
.../plugins/cdh/v5_7_0/resources/hbase-master.json |  506 +++
.../cdh/v5_7_0/resources/hbase-regionserver.json   |  836 +++++
.../cdh/v5_7_0/resources/hbase-service.json        |  740 ++++
.../cdh/v5_7_0/resources/hdfs-balancer.json        |   68 +
.../cdh/v5_7_0/resources/hdfs-datanode.json        |  644 ++++
.../v5_7_0/resources/hdfs-failovercontroller.json  |  332 ++
.../plugins/cdh/v5_7_0/resources/hdfs-gateway.json |  116 +
.../plugins/cdh/v5_7_0/resources/hdfs-httpfs.json  |  440 +++
.../cdh/v5_7_0/resources/hdfs-journalnode.json     |  446 +++
.../cdh/v5_7_0/resources/hdfs-namenode.json        |  812 +++++
.../cdh/v5_7_0/resources/hdfs-nfsgateway.json      |  386 +++
.../v5_7_0/resources/hdfs-secondarynamenode.json   |  446 +++
.../plugins/cdh/v5_7_0/resources/hdfs-service.json | 1400 ++++++++
.../plugins/cdh/v5_7_0/resources/hive-gateway.json |   98 +
.../cdh/v5_7_0/resources/hive-hivemetastore.json   |  392 +++
.../cdh/v5_7_0/resources/hive-hiveserver2.json     |  704 ++++
.../resources/hive-metastore-sentry-safety.xml     |   15 +
.../resources/hive-server2-sentry-safety.xml       |   12 +
.../plugins/cdh/v5_7_0/resources/hive-service.json |  722 ++++
sahara/plugins/cdh/v5_7_0/resources/hive-site.xml  |   61 +
.../plugins/cdh/v5_7_0/resources/hive-webhcat.json |  332 ++
.../v5_7_0/resources/hue-hue_load_balancer.json    |  236 ++
.../cdh/v5_7_0/resources/hue-hue_server.json       |  356 ++
.../cdh/v5_7_0/resources/hue-kt_renewer.json       |  200 ++
.../plugins/cdh/v5_7_0/resources/hue-service.json  |  674 ++++
.../cdh/v5_7_0/resources/impala-catalogserver.json |  506 +++
.../cdh/v5_7_0/resources/impala-impalad.json       |  710 ++++
.../plugins/cdh/v5_7_0/resources/impala-llama.json |  506 +++
.../cdh/v5_7_0/resources/impala-service.json       |  632 ++++
.../cdh/v5_7_0/resources/impala-statestore.json    |  374 +++
.../cdh/v5_7_0/resources/kafka-kafka_broker.json   |  476 +++
.../v5_7_0/resources/kafka-kafka_mirror_maker.json |  482 +++
.../cdh/v5_7_0/resources/kafka-service.json        |  374 +++
sahara/plugins/cdh/v5_7_0/resources/kms-kms.json   |  530 +++
.../plugins/cdh/v5_7_0/resources/kms-service.json  |   86 +
.../v5_7_0/resources/ks_indexer-hbase_indexer.json |  356 ++
.../cdh/v5_7_0/resources/ks_indexer-service.json   |  188 ++
.../plugins/cdh/v5_7_0/resources/mapred-site.xml   |  157 +
.../cdh/v5_7_0/resources/oozie-oozie_server.json   |  662 ++++
.../cdh/v5_7_0/resources/oozie-service.json        |  236 ++
.../cdh/v5_7_0/resources/priority-one-confs.json   |   45 +
.../resources/sentry-impala-client-safety.xml      |   16 +
.../cdh/v5_7_0/resources/sentry-sentry_server.json |  308 ++
.../cdh/v5_7_0/resources/sentry-service.json       |  278 ++
.../plugins/cdh/v5_7_0/resources/solr-gateway.json |   32 +
.../plugins/cdh/v5_7_0/resources/solr-service.json |  404 +++
.../cdh/v5_7_0/resources/solr-solr_server.json     |  440 +++
.../cdh/v5_7_0/resources/spark-gateway.json        |  170 +
.../cdh/v5_7_0/resources/spark-service.json        |  152 +
.../resources/spark-spark_yarn_history_server.json |  314 ++
.../cdh/v5_7_0/resources/sqoop-service.json        |  110 +
.../cdh/v5_7_0/resources/sqoop-sqoop_server.json   |  398 +++
.../plugins/cdh/v5_7_0/resources/yarn-gateway.json |  476 +++
.../cdh/v5_7_0/resources/yarn-jobhistory.json      |  476 +++
.../cdh/v5_7_0/resources/yarn-nodemanager.json     |  764 +++++
.../cdh/v5_7_0/resources/yarn-resourcemanager.json |  674 ++++
.../plugins/cdh/v5_7_0/resources/yarn-service.json |  542 +++
.../cdh/v5_7_0/resources/zookeeper-server.json     |  596 ++++
.../cdh/v5_7_0/resources/zookeeper-service.json    |  224 ++
sahara/plugins/cdh/v5_7_0/validation.py            |  232 ++
sahara/plugins/cdh/v5_7_0/versionhandler.py        |  100 +
sahara/plugins/exceptions.py                       |   36 +
sahara/plugins/fake/plugin.py                      |   29 +-
sahara/plugins/hdp/__init__.py                     |    0
sahara/plugins/hdp/ambariplugin.py                 |  450 ---
sahara/plugins/hdp/clusterspec.py                  |  385 ---
sahara/plugins/hdp/confighints_helper.py           |   81 -
sahara/plugins/hdp/configprovider.py               |   94 -
sahara/plugins/hdp/edp_engine.py                   |   42 -
sahara/plugins/hdp/hadoopserver.py                 |  279 --
sahara/plugins/hdp/saharautils.py                  |   33 -
sahara/plugins/hdp/versions/__init__.py            |    0
.../plugins/hdp/versions/abstractversionhandler.py |   75 -
.../plugins/hdp/versions/version_2_0_6/__init__.py |    0
.../hdp/versions/version_2_0_6/edp_engine.py       |   46 -
.../resources/ambari-config-resource.json          | 3536 --------------------
.../resources/default-cluster.template             | 1845 ----------
.../versions/version_2_0_6/resources/topology.sh   |   21 -
.../plugins/hdp/versions/version_2_0_6/services.py | 1271 -------
.../hdp/versions/version_2_0_6/versionhandler.py   | 1165 -------
.../plugins/hdp/versions/versionhandlerfactory.py  |   59 -
sahara/plugins/images.py                           |  992 ++++++
sahara/plugins/kerberos.py                         |  400 +++
sahara/plugins/labels.py                           |  226 ++
sahara/plugins/mapr/abstract/health_checker.py     |   24 +
.../plugins/mapr/base/base_cluster_configurer.py   |   90 +-
sahara/plugins/mapr/base/base_cluster_context.py   |   21 +
sahara/plugins/mapr/base/base_edp_engine.py        |   10 +-
sahara/plugins/mapr/base/base_health_checker.py    |  121 +
sahara/plugins/mapr/base/base_node_manager.py      |   26 +-
sahara/plugins/mapr/base/base_version_handler.py   |    6 +
sahara/plugins/mapr/domain/distro.py               |   10 +-
sahara/plugins/mapr/domain/node_process.py         |    2 +
sahara/plugins/mapr/domain/service.py              |   40 +-
sahara/plugins/mapr/plugin.py                      |   15 +
sahara/plugins/mapr/resources/add_mapr_repo.sh     |    4 +-
sahara/plugins/mapr/resources/add_mapr_user.sh     |    2 -
.../plugins/mapr/resources/add_security_repos.sh   |    1 -
sahara/plugins/mapr/services/drill/drill.py        |   12 +-
sahara/plugins/mapr/services/flume/flume.py        |    0
sahara/plugins/mapr/services/hbase/hbase.py        |   17 +-
.../services/hbase/resources/hbase-default.json    |    5 +
sahara/plugins/mapr/services/hive/hive.py          |   62 +-
.../mapr/services/hive/resources/hive-default.xml  |    4 +-
.../mapr/services/hive/resources/sentry-db.xml     |   27 +
.../services/hive/resources/sentry-default.xml     |   45 +
sahara/plugins/mapr/services/httpfs/httpfs.py      |    4 +-
sahara/plugins/mapr/services/hue/hue.py            |  157 +-
.../mapr/services/hue/resources/hue_3.9.0.template |   15 +-
sahara/plugins/mapr/services/impala/impala.py      |  116 +-
.../services/impala/resources/impala-env.sh.j2     |   20 +-
sahara/plugins/mapr/services/mahout/mahout.py      |   12 +
.../plugins/mapr/services/management/management.py |   14 +-
.../plugins/mapr/services/mapreduce/mapreduce.py   |   14 +-
sahara/plugins/mapr/services/maprfs/maprfs.py      |    7 +-
sahara/plugins/mapr/services/mysql/mysql.py        |   32 +-
sahara/plugins/mapr/services/oozie/oozie.py        |   75 +-
sahara/plugins/mapr/services/sentry/__init__.py    |    0
.../services/sentry/resources/global-policy.ini    |    6 +
.../services/sentry/resources/sentry-default.xml   |    4 +
sahara/plugins/mapr/services/sentry/sentry.py      |  165 +
.../services/spark/resources/spark-default.json    |   16 -
.../services/spark/resources/spark-env.template    |    2 +-
sahara/plugins/mapr/services/spark/spark.py        |  370 +-
sahara/plugins/mapr/services/sqoop/sqoop2.py       |    7 +-
sahara/plugins/mapr/services/swift/swift.py        |   28 +-
sahara/plugins/mapr/services/yarn/yarn.py          |   14 +-
sahara/plugins/mapr/util/general.py                |    4 +-
sahara/plugins/mapr/util/maprfs_helper.py          |   33 +-
sahara/plugins/mapr/util/password_utils.py         |   70 +
sahara/plugins/mapr/util/validation_utils.py       |   33 +
.../mapr/versions/v5_0_0_mrv2/version_handler.py   |    1 +
.../mapr/versions/v5_1_0_mrv2/version_handler.py   |    5 +-
.../plugins/mapr/versions/v5_2_0_mrv2/__init__.py  |    0
.../plugins/mapr/versions/v5_2_0_mrv2/context.py   |   60 +
.../mapr/versions/v5_2_0_mrv2/version_handler.py   |   70 +
.../mapr/versions/version_handler_factory.py       |    2 +-
sahara/plugins/opts.py                             |   26 +
sahara/plugins/provisioning.py                     |   83 +-
sahara/plugins/resources/create-principal-keytab   |   12 +
sahara/plugins/resources/cron-file                 |    2 +
sahara/plugins/resources/cron-script               |    3 +
sahara/plugins/resources/kdc_conf                  |   16 +
sahara/plugins/resources/kdc_conf_redhat           |   13 +
.../plugins/resources/krb-client-init.sh.template  |   14 +
sahara/plugins/resources/krb5_config               |   11 +
.../resources/mit-kdc-server-init.sh.template      |   34 +
sahara/plugins/spark/config_helper.py              |    2 +-
sahara/plugins/spark/plugin.py                     |   14 +-
sahara/plugins/storm/config_helper.py              |   29 +-
sahara/plugins/storm/edp_engine.py                 |   25 +-
sahara/plugins/storm/plugin.py                     |   39 +-
sahara/plugins/utils.py                            |   18 +-
sahara/plugins/vanilla/hadoop2/config.py           |   74 +-
sahara/plugins/vanilla/hadoop2/config_helper.py    |  103 +
sahara/plugins/vanilla/hadoop2/oozie_helper.py     |    6 +-
.../vanilla/hadoop2/resources/create_hive_db.sql   |    8 +-
.../vanilla/hadoop2/resources/create_oozie_db.sql  |    4 +-
.../vanilla/hadoop2/resources/spark-cleanup.cron   |    2 +
.../hadoop2/resources/tmp-cleanup.sh.template      |   48 +
sahara/plugins/vanilla/hadoop2/run_scripts.py      |   20 +
sahara/plugins/vanilla/hadoop2/starting_scripts.py |    6 +
sahara/plugins/vanilla/hadoop2/utils.py            |   44 +
sahara/plugins/vanilla/hadoop2/validation.py       |    6 +
sahara/plugins/vanilla/plugin.py                   |   10 +
sahara/plugins/vanilla/utils.py                    |   14 +
sahara/plugins/vanilla/v2_7_1/config_helper.py     |   18 +-
sahara/plugins/vanilla/v2_7_1/edp_engine.py        |   46 +
sahara/plugins/vanilla/v2_7_1/versionhandler.py    |   32 +-
sahara/service/api.py                              |  310 --
sahara/service/api/__init__.py                     |   23 +
sahara/service/api/v10.py                          |  286 ++
sahara/service/api/v11.py                          |  269 ++
sahara/service/api/v2/__init__.py                  |    0
sahara/service/api/v2/cluster_templates.py         |   43 +
sahara/service/api/v2/clusters.py                  |  175 +
sahara/service/api/v2/data_sources.py              |   41 +
sahara/service/api/v2/images.py                    |   68 +
sahara/service/api/v2/job_binaries.py              |   72 +
sahara/service/api/v2/job_executions.py            |  109 +
sahara/service/api/v2/job_types.py                 |   78 +
sahara/service/api/v2/jobs.py                      |   45 +
sahara/service/api/v2/node_group_templates.py      |   43 +
sahara/service/api/v2/plugins.py                   |   46 +
sahara/service/coordinator.py                      |    5 +-
sahara/service/edp/api.py                          |  277 --
sahara/service/edp/job_manager.py                  |   18 +-
sahara/service/edp/oozie/engine.py                 |   18 +-
sahara/service/edp/oozie/oozie.py                  |  117 +-
sahara/service/edp/storm/engine.py                 |  139 +-
sahara/service/engine.py                           |   39 +-
sahara/service/health/health_check_base.py         |  125 +-
sahara/service/heat/commons.py                     |    2 +-
sahara/service/heat/heat_engine.py                 |   15 +-
sahara/service/heat/templates.py                   |  138 +-
sahara/service/networks.py                         |   43 +-
sahara/service/ntp_service.py                      |    8 +-
sahara/service/ops.py                              |    5 +-
sahara/service/periodic.py                         |    2 +-
sahara/service/quotas.py                           |   18 +-
sahara/service/sessions.py                         |   42 +-
sahara/service/shares.py                           |    3 +-
sahara/service/validation.py                       |  106 +-
sahara/service/validations/base.py                 |   28 +-
.../service/validations/cluster_template_schema.py |    3 +
sahara/service/validations/cluster_templates.py    |    2 +-
sahara/service/validations/clusters.py             |    8 +-
sahara/service/validations/clusters_scaling.py     |   10 +-
sahara/service/validations/edp/data_source.py      |   25 +
sahara/service/validations/edp/job.py              |    7 +-
sahara/service/validations/edp/job_binary.py       |    7 +
.../service/validations/edp/job_binary_internal.py |   13 +
sahara/service/validations/edp/job_execution.py    |   37 +-
sahara/service/validations/node_group_templates.py |    2 +-
sahara/service/validations/plugins.py              |   16 +-
sahara/service/volumes.py                          |   14 +-
sahara/swift/utils.py                              |   22 +-
.../tempest/scenario/data_processing/README.rst    |  117 -
.../tempest/scenario/data_processing/__init__.py   |    0
.../tempest/scenario/data_processing/config.py     |   34 -
.../tempest/scenario/data_processing/plugin.py     |   37 -
.../unit/cli/image_pack/test_image_pack_api.py     |   72 +
.../plugins/ambari/test_decommission_helper.py     |   68 -
.../unit/plugins/ambari/test_requests_helper.py    |   96 +
.../unit/plugins/cdh/base_plugin_utils_test.py     |    3 +-
.../unit/plugins/cdh/v5/test_versionhandler.py     |   11 +-
.../unit/plugins/cdh/v5_3_0/test_versionhandler.py |   15 +-
.../unit/plugins/cdh/v5_4_0/test_versionhandler.py |   15 +-
.../plugins/cdh/v5_5_0/test_config_helper_550.py   |    5 +-
.../unit/plugins/cdh/v5_5_0/test_versionhandler.py |   15 +-
.../plugins/cdh/v5_7_0/test_config_helper_570.py   |  168 +
.../unit/plugins/cdh/v5_7_0/test_edp_engine.py     |  200 ++
.../plugins/cdh/v5_7_0/test_plugin_utils_570.py    |   25 +
.../unit/plugins/cdh/v5_7_0/test_spark_engine.py   |   69 +
.../unit/plugins/cdh/v5_7_0/test_validation.py     |  123 +
.../unit/plugins/cdh/v5_7_0/test_versionhandler.py |  140 +
.../plugins/hdp/resources/config-resource.json     |   42 -
.../hdp/resources/sample-ambari-blueprint.json     |  195 --
.../unit/plugins/hdp/test_clusterspec_hdp2.py      | 2035 -----------
.../unit/plugins/hdp/test_confighints_helper.py    |  147 -
.../unit/plugins/hdp/test_versionmanagerfactory.py |   35 -
.../plugins/hdp/versions/version_2_0_6/__init__.py |    0
.../hdp/versions/version_2_0_6/test_edp_engine.py  |   98 -
.../unit/plugins/mapr/test_cluster_context.py      |    5 +-
.../unit/plugins/vanilla/hadoop2/test_utils.py     |   75 +
.../service/validation/edp/test_data_source.py     |   21 +-
.../unit/service/validation/edp/test_job_binary.py |    2 +-
.../validation/edp/test_job_binary_internal.py     |    2 +-
.../service/validation/edp/test_job_executor.py    |    2 +-
.../service/validation/edp/test_job_interface.py   |    3 +-
.../validation/test_cluster_create_validation.py   |    8 +-
.../validation/test_cluster_delete_validation.py   |    4 +-
.../validation/test_cluster_scaling_validation.py  |    4 +-
.../test_cluster_template_create_validation.py     |   11 +-
.../test_cluster_template_update_validation.py     |    2 +-
.../validation/test_cluster_update_validation.py   |    6 +-
.../test_ng_template_validation_create.py          |    2 +-
.../test_ng_template_validation_update.py          |    2 +-
sahara/topology/topology_helper.py                 |    4 +
sahara/utils/api.py                                |   13 +-
sahara/utils/cluster.py                            |   62 +-
sahara/utils/edp.py                                |    7 +-
sahara/utils/files.py                              |   10 +
sahara/utils/hacking/checks.py                     |    4 -
sahara/utils/hacking/logging_checks.py             |   16 +-
sahara/utils/network.py                            |   43 +
sahara/utils/openstack/barbican.py                 |   29 -
sahara/utils/openstack/base.py                     |   37 +-
sahara/utils/openstack/glance.py                   |   47 +
sahara/utils/openstack/heat.py                     |   14 +-
sahara/utils/openstack/images.py                   |  178 +-
sahara/utils/openstack/keystone.py                 |   60 +-
sahara/utils/openstack/neutron.py                  |   12 +-
sahara/utils/openstack/nova.py                     |    2 -
sahara/utils/procutils.py                          |    5 +-
sahara/utils/remote.py                             |   27 +-
sahara/utils/rpc.py                                |   57 +-
sahara/utils/ssh_remote.py                         |  189 +-
sahara/utils/types.py                              |    7 +
sahara/utils/wsgi.py                               |    3 -
setup.cfg                                          |    8 +-
test-requirements.txt                              |   23 +-
tools/build_docs                                   |    3 -
tools/install_venv                                 |    3 -
tools/install_venv.py                              |   76 -
tools/install_venv_common.py                       |  212 --
tools/lintstack.py                                 |   39 +-
tools/run_fast_checks                              |    3 -
tools/run_pep8                                     |    3 -
tools/run_pylint                                   |    3 -
tools/with_venv.sh                                 |    4 -
tox.ini                                            |   29 +-
634 files changed, 51648 insertions(+), 18978 deletions(-)


Requirements updates
--------------------

diff --git a/requirements.txt b/requirements.txt
index 506f672..488089d 100644
--- a/requirements.txt
+++ b/requirements.txt
@@ -7,3 +7,3 @@ pbr>=1.6 # Apache-2.0
-alembic>=0.8.0 # MIT
-Babel>=1.3 # BSD
-castellan>=0.3.1 # Apache-2.0
+alembic>=0.8.4 # MIT
+Babel>=2.3.4 # BSD
+castellan>=0.4.0 # Apache-2.0
@@ -11,2 +11,2 @@ eventlet!=0.18.3,>=0.18.2 # MIT
-Flask<1.0,>=0.10 # BSD
-iso8601>=0.1.9 # MIT
+Flask!=0.11,<1.0,>=0.10 # BSD
+iso8601>=0.1.11 # MIT
@@ -15,5 +15,6 @@ jsonschema!=2.5.0,<3.0.0,>=2.0.0 # MIT
-keystonemiddleware!=4.1.0,>=4.0.0 # Apache-2.0
-oslo.config>=3.7.0 # Apache-2.0
-oslo.concurrency>=3.5.0 # Apache-2.0
-oslo.context>=0.2.0 # Apache-2.0
-oslo.db>=4.1.0 # Apache-2.0
+keystoneauth1>=2.10.0 # Apache-2.0
+keystonemiddleware!=4.1.0,!=4.5.0,>=4.0.0 # Apache-2.0
+oslo.config>=3.14.0 # Apache-2.0
+oslo.concurrency>=3.8.0 # Apache-2.0
+oslo.context>=2.9.0 # Apache-2.0
+oslo.db!=4.13.1,!=4.13.2,>=4.10.0 # Apache-2.0
@@ -22 +23 @@ oslo.log>=1.14.0 # Apache-2.0
-oslo.messaging>=4.0.0 # Apache-2.0
+oslo.messaging>=5.2.0 # Apache-2.0
@@ -24,2 +25,2 @@ oslo.middleware>=3.0.0 # Apache-2.0
-oslo.policy>=0.5.0 # Apache-2.0
-oslo.rootwrap>=2.0.0 # Apache-2.0
+oslo.policy>=1.9.0 # Apache-2.0
+oslo.rootwrap>=5.0.0 # Apache-2.0
@@ -27,7 +28,7 @@ oslo.serialization>=1.10.0 # Apache-2.0
-oslo.service>=1.0.0 # Apache-2.0
-oslo.utils>=3.5.0 # Apache-2.0
-paramiko>=1.16.0 # LGPL
-requests!=2.9.0,>=2.8.1 # Apache-2.0
-python-cinderclient>=1.3.1 # Apache-2.0
-python-keystoneclient!=1.8.0,!=2.1.0,>=1.6.0 # Apache-2.0
-python-manilaclient>=1.3.0 # Apache-2.0
+oslo.service>=1.10.0 # Apache-2.0
+oslo.utils>=3.16.0 # Apache-2.0
+paramiko>=2.0 # LGPLv2.1+
+requests>=2.10.0 # Apache-2.0
+python-cinderclient!=1.7.0,!=1.7.1,>=1.6.0 # Apache-2.0
+python-keystoneclient!=2.1.0,>=2.0.0 # Apache-2.0
+python-manilaclient>=1.10.0 # Apache-2.0
@@ -36,2 +37,3 @@ python-swiftclient>=2.2.0 # Apache-2.0
-python-neutronclient!=4.1.0,>=2.6.0 # Apache-2.0
-python-heatclient>=0.6.0 # Apache-2.0
+python-neutronclient>=5.1.0 # Apache-2.0
+python-heatclient>=1.4.0 # Apache-2.0
+python-glanceclient!=2.4.0,>=2.3.0 # Apache-2.0
@@ -39 +41 @@ six>=1.9.0 # MIT
-stevedore>=1.5.0 # Apache-2.0
+stevedore>=1.16.0 # Apache-2.0
diff --git a/test-requirements.txt b/test-requirements.txt
index b7d345e..a456df3 100644
--- a/test-requirements.txt
+++ b/test-requirements.txt
@@ -7,3 +7,2 @@ hacking<0.11,>=0.10.0
-Mako>=0.4.0 # MIT
-PrettyTable<0.8,>=0.7 # BSD
-PyMySQL>=0.6.2 # MIT License
+PyMySQL!=0.7.7,>=0.6.2 # MIT License
+bandit>=1.1.0 # Apache-2.0
@@ -13,2 +12,2 @@ doc8 # Apache-2.0
-fixtures>=1.3.1 # Apache-2.0/BSD
-mock>=1.2 # BSD
+fixtures>=3.0.0 # Apache-2.0/BSD
+mock>=2.0 # BSD
@@ -17 +16,2 @@ oslotest>=1.10.0 # Apache-2.0
-os-testr>=0.4.1 # Apache-2.0
+os-api-ref>=1.0.0 # Apache-2.0
+os-testr>=0.7.0 # Apache-2.0
@@ -19,4 +19,3 @@ psycopg2>=2.5 # LGPL/ZPL
-pylint==1.4.5 # GNU GPL v2
-reno>=0.1.1 # Apache2
-rfc3986>=0.2.0 # Apache-2.0
-sphinx!=1.2.0,!=1.3b1,<1.3,>=1.1.2 # BSD
+pylint==1.4.5 # GPLv2
+reno>=1.8.0 # Apache2
+sphinx!=1.3b1,<1.3,>=1.2.1 # BSD
@@ -24,2 +22,0 @@ sphinxcontrib-httpdomain # BSD
-tempest-lib>=0.14.0 # Apache-2.0
-testrepository>=0.0.18 # Apache-2.0/BSD
@@ -29,2 +25,0 @@ testtools>=1.4.0 # MIT
-
-python-saharaclient>=0.13.0 # Apache-2.0





More information about the OpenStack-announce mailing list