We are excited to announce the release of: sahara 5.0.0: Sahara project This release is part of the newton release series. With source available at: http://git.openstack.org/cgit/openstack/sahara For more details, please see below. 5.0.0 ^^^^^ Documentation about distributed periodics are extended with steps about installation additional libs required for correct work of coordination backend. Please refer Advanced Configuration Guide for details. New Features ************ * Add impala 2.2 to MapR plugin * MaR 5.2.0 is supported in MapR plugin. * Add Sentry to MapR plugin * Kafka was added in CDH 5.5 and CDH 5.7 * Add ability to automaticaly generate better configurations for Ambari cluster by using 'ALWAYS_APPLY' strategy * Versions 5.5.0 and 5.7.0 of Cloudera plugin are declared as stable. * CDH 5.7 is supported in CDH plugin. * Added integration of Designate for hostname resolution through dns servers * Added event log for HDP plugin * Kerberos support implemented for Cloudera and Ambari plugins. New oozie client implemented to support authentication for oozie in kerberized cluster. * Custom health check is added to MapR plugin * MapR 5.1.0.mrv2 is now Enabled. * Remove support for Spark standalone in MapR plugin * The following service versions were added to MapR 5.2.0 plugin - HBase 1.1 - Drill 1.6 - Mahout 0.11 0.12 - Spark 1.6.1 - Impala 2.5 * Added rack awareness feature for CDH 5.5 and CDH 5.7 * Added rack awareness feature for HDP plugin * Refactoring the logic on how floating ips are used by Sahara. This change will allow the coexistence of cluster using floating ips with cluster that do not. * Separate transport url can be used for notifications purposes now, to enable this feature 'transport_url' should be provided in 'oslo_messaging_notifications' section. Upgrade Notes ************* * migration from keystoneclient to keystoneauth is done for using auth features of keystone. * Migration from novaclient.v2.images to glanceclient Deprecation Notes ***************** * Versions 5, 5.3.0, 5.4.0 of Cloudera plugin are deprecated. It is no longer maintainted and supposed to be removed in P release. * Convert to cluster template feature is no longer supported by all plugins. * Option 'infrastructure engine' is removed from sahara configs. * MapR 5.0.0.mrv2 is now Deprecated. It is not recommended for usage. It is better to use MapR 5.1.0.mrv2 instead. This version of plugin will be removed in Ocata release. * Support of HDP 2.0.6 plugin was removed. Use Ambari plugin instead. Bug Fixes ********* * Fixed incorrect down scaling of ambari cluster * Fixed launching Hive jobs in Ambari plugin. * Starting Ambari clusters on Centos 7 is fixed. * CA certificate handling in keystone, nova, neutron and cinder clients are fixed (#330635) * After decommissioning hosts all assoicated configs groups will be removed in ambari plugin. * Fix uncompleted event logs for Oozie and Drill in MapR plugin. * This patch adds ability to work with swift by using Keystone API v3 * Fixed issue with handling endpoint_type during creation neutron client, closed bug 1564805 * Fixed issues with hardcoded password during creation MySQL database for Oozie, bug 1541122. * Fixed issues with hardcoded password during starting hive process, bug 1498035. Changes in sahara 4.0.0.0rc1..5.0.0 ----------------------------------- bb96d84 Fix API compatibility issue 8622ca6 Fix incorrect event log for ambari 6e12a9f Documentation updates for stable/newton 5c9c023 Add workaround for Hue on CentOS 7 b178798 Fix ZooKeeper check for CentOS 7 5c775d2 Fill tempest.conf with Sahara-specific values 47579ee Update .gitreview for stable/newton 55f6eae Update link reference c5baed4 [DOC] update doc about vanilla image builder 356417f [DOC] update doc about vanilla plugin 777b425 do not use artifacts at sahara files 602a771 fix docs env c4d3474 [doc] change location of swiftfs jars f18096a [DOC] update doc about cluster statuses a01c3a1 [DOC] update doc about registering image d693946 write docs about enabling kerberos d0e47db [DOC] update doc about CDH image builder 1a738fd [DOC] update user doc about CDH plugin d8e69c5 [Doc] Small fixes according to Spark on Vanilla supporting fcc7bfe [Ambari] fix Ubuntu deploy 83a6a28 Remove entry point of sahara tempest plugin a2a07ae Updated from global requirements b3447fb Remove Tempest-like tests for clients (see sahara-tests) f825ab3 standardize release note page ordering 5120dd7 reimplement oozie client as abstract 0d8af80 allow configuration of strategy for UI f41bb7d [DOC] Add docs about pagination abilities 5b0960b Add MapR core 5.2 3a40553 [api-ref] Stop supporting os-api-ref 1.0.0 eb408c5 Add new version pack for services 2de626a Add event log for HDP plugin e4207c8 Update api-ref docs for Designate feature 38784a4 Add Sentry service v1.6 to MapR plugin cf7ed7f Add custom health check for MapR plugin a2cf981 Rename all ClusterContext variables to 'cluster_context' 53f7854 Replace mfs.exchange with g.copy_file where it is possible 3b70e65 [DOC] Update user doc about Designate 89708bb [DOC] Fix misprints in api-ref ff3e431 Spark on Vanilla Clusters d44716f Added rack awareness in CDH plugin 3a4a3a0 [Doc] add description of "plugin update" to api ref 836e6fe Updated from global requirements 36640a8 Remove support for Spark standalone af1a6bd Remove ssl config for Hue 94bb5a2 Refactor service home dir owner setting 8635ef6 [Ambari] More flexible auto configuration 1400bbe Fix invalid security repo 9f8c219 Added rack awareness in HDP plugin 5ccdc8e Updated from global requirements 9a322af use _LE() to wrap the error message 78beeb1 Added option to disable sahara db for storing job binaries. fe46ce8 Config logABug feature for Sahara api-ref 53c5089 Remove unused config.CONF 4278b95 improve logging for job execution failure abaf513 Updating DOC on floating IPs change 05b0dd0 Updated from global requirements 64cd756 Fix wait conditions with SSL deployments 2c7066a Enabling MapR on CentOS7 4eda721 Updated from global requirements 49d0e30 Fix wrong instance count in provision events 6427bc6 [doc] Fix some problems in docs 75053af delete unused LOG in some files 36c7b3d TrivialFix: Remove logging import usused 8efd656 Fix mapr cluster deployment cdf8d23 Remove MAPR_USER variable 2cb0a6d Delete useless 'pass' 9694735 Updated from global requirements 2d54607 replace assertListEqual() to assertEqual() 7af18b9 Updated from global requirements 153ea9a Error handling during hosts file generation 047ab5a Replace 'lsb_release -is' with the method 'get_os_distrib' 2e78134 Add auto configs to HDP plugin 1a24d87 Correct reraising of exception da70bca Fix wrong epel version for CentOS 7 c8dad2e Clean imports in code 3f6817a Adding release note to floating ips change 585c3af Updated from global requirements d7f1793 Remove hardcoded password from db schema 2e74ca0 Get ready for os-api-ref sphinx theme change e3c25ef Replace old CLI calls in grenade 4013eaa Updated from global requirements 7350d7b Add Kafka to CDH 5.5 and CDH 5.7 68e70f9 Updated from global requirements ce5b034 plugins:patch is now admin only operation 91f99b7 Fix small bugs in pagination deda629 Fix wrong hue-livy process name and move installation 0b89714 Fix wrong owner setting for config files 3340aff copying oozie.warden to prevent failure ca5986d Updated from global requirements 13fcb05 Image argument validation and declaration c28f98c [ambari] support kerberos deployment 1851067 [cdh] kerberos support implementation 758f38a kerberos infra deployment impl dae16db Fixed the error with updating the job via command line 9cf7c30 Add sorting ability to Sahara-API 0383199 Health check for Designate 189e6a8 Fix configs for repos and swift urls in CDH 5.7 124abc1 Added documentation for Designate feature 8d9b2fd Documentation for image gen CLI and framework 6039058 Updated from global requirements 3441978 Updated from global requirements d769212 Updated from global requirements d9a2f00 Designate integration de89c9d Updated from global requirements e750d49 Correct reraising of exception 5c04f10 Updated from global requirements 60763fc Updated from global requirements 57f8cd1 Updated from global requirements ffd9b8e labels for CDH plugin 4bb6437 Changing zookeeper path while updating conf 7b4091a labels for MapR plugin d29b4cf Remove hardcoded password for Oozie service 49b63d5 Refactor the logic around use of floating ips 6eb1937 Adding argument-related validators for image configurability cb9b45e Configuration engine for image generation CLI 4ba99fa Use assertEqual() instead of assertDictEqual() 3d5f745 improve error message for execution with retries 837a1dc remove infrastructure engine option 2d9c8ab Add pagination ability to Sahara-API e552a61 [DOC] Added docs for sahara+ironic e1b9ff8 [DOC] Inform operators about limited quotas 6265773 delete two unused LOG ce7c3da Updated from global requirements 74991fe Remove unused LOG f5fcc36 Updated from global requirements e839480 Fixing unit tests for image create ea44774 improved scaling for cdh plugin 0246945 Adding Pyleus configs to Storm plugin d9bd498 Add Python 3.5 classifier and venv 61dd4c0 Docs should use "--plugin-version" instead of "--version" 4b70223 CLI for Plugin-Declared Image Declaration 5e91182 make ability to return real plugins in list ops 76f1a81 Failed to download ext-2.2.zip from dev.sencha.com 9789e6c Adding Python Jobs using Pyleus 6d492a2 Simplify tox hacking rule to match other projects c90a1da [DOC] Cleanup time for incomplete clusters 4cebb9c improvements on api for plugins d067680 Resolves issue where to allow custom repo URLS e5d50d2 Updated from global requirements feb46bd Updated from global requirements c8869f7 don't serialize auto security group if not needed 28ca79d Fix typo in ambari_plugin.rst f4cb71d replace import of future to the top 694549d fix building api ref docs 5dfc7a8 The addition of the parentheses for py3 30bba52 [DOC] Update installation guide 9b50406 use sessions for creating heatclient fdb37d5 Fixed spelling error 1bb6c99 forbid cluster creation without secondarynamenode 6d0d359 Fix subdirectory typo in sahara db template Readme file 357ec36 Updated from global requirements 3f43a76 Upgrade Storm plugin to version 1.0.1 60dcbd5 Updated from global requirements 9d6b648 Add Impala 2.2 to MapR plugin 8db9a47 Support of CDH 5.7 27be399 fixing sahara-engine setup in devstack 745e384 Fix typo in configs_recommendations.rst 145a41a Remove outdated tools feac29b [DOC] improve docs fe6392f Fix typo in cdh_plugin.rst 3766836 Fix glanceclient.v2.images f48eb7d Remove unecessary decorators from private interface cf57c1f Ignore Nova config drive in devices list 879d2a6 plugins api impl ef00d94 sleep before waiting requests 6bf92e7 allow to specify notifications transport url 890f341 ability to configure endpoint type for services a36dfbc Updated from global requirements fba2d67 novaclient.v2.images to glanceclient migration f51e04e Updated from global requirements 3ad8bab Update documentation for hadoop-swift 535b8a2 Updated from global requirements ddc2eeb Updated from global requirements 8f0eba2 [DOC] updated docs about keystone cli b8d99ec Trivial: Fix wrong button name in dashboard user guide b5a04b9 Updated from global requirements cadfbdc implement db ops for plugin's api 7077cd2 replace seriailization of plugin to PluginManager c27c5ca Moving WADL docs to Sahara repository f41c51a Remove convert to cluster template feature 2758511 Trivial: Remove useless words in CDN image builder doc 38b629e Updated from global requirements 1a2f118 remove ability to create barbicanclient 9d42820 Fix the ca certificate handling in the client sessions b122ffb fix grenade from mitaka upgrade 9158062 remove config groups associated with removed hosts 905e104 Updated from global requirements 6329a0a workaround to fix ambari start on centos7 165172f Updated from global requirements 3bdeeb1 Fix provision events for installing services 12281b4 New version of HDP plugin 2.4 8c7cfb7 Display credentials info in cluster general info 9a1300b Updated from global requirements ef2103e Improve timeout message when cluster create fails e72e9fb Updated from global requirements 7f32aed Modify HDP plugin doc for Ambari plugin 2460408 Fix retrieve auth_url and python 3 jobs e3e3b7e Readable logging for Heat templates e50c211 Use split_path from oslo.utils 0e499c7 Added "\" In quickstart guide 5396abe Corrects MapR distro selection for RHEL b9b2dca Fix cluster creation with another tenant f096c91 Updated from global requirements 947d20a Added unit tests for CDH 5.5.0 deploy file 9274c8d Updated from global requirements 252e6ef [Trivial] Remove unnecessary executable privilege b9e3c17 Updated from global requirements 99127d5 Code refactoring of ambari deploy processes e718b28 Fix down scaling of ambari cluster 8f365af HDP hive HDFS support 1aa4364 improve description of ambari plugin 037ba02 Remove hdp 2.0.6 plugin 78a981b Updated from global requirements 3bc9f05 Fix grenade 966bb6f Updated from global requirements 64355f5 Minimise number of auto security groups 54d4647 remove verbose option in devstack plugin beba6e7 use the only method to initialize client 8ee0fae Updated from global requirements ea68895 Resolve bug with long value to RANDSTR function. 2a338f5 Change 'Hbase' to 'HBase' string in spark service 1a7c0b0 Updated from global requirements de5977d Remove openstack/common related stuff 14bf94b Added unit tests for ha_helper file 9ede053 Updated from global requirements 3de43e2 Updated from global requirements 7f3a594 Fix typo in Spark service 44c5332 Renamed job execution and templates endpoints d9acf6e Fix doc about scenario and Tempest tests f24cfa9 keystoneclient to keystoneauth migration 0bf0dda Helper method to use dnf instead of yum on fedora >=22 aa79252 PrettyTable and rfc3986 are no longer used in tests 2425aff Update the links to the RDO project ef0bf04 Focus the documentation on distributed mode 75c5e8d Updated from global requirements ac82ffc cdh plugin yum install option "-y" missing 954e227 update options mentioned in tempest readme 501f88c Update hadoop swift docs b5827af Updated from global requirements e36d2c6 Fix doc build if git is absent b30b09a Added new unittest to oozie module ebb044d Updated from global requirements bde808f SPI Method to Validate Images a48d29e Added tests for sahara cli a16baae Fix unavailable MCS link 590ccac Define context.roles with base class e417b17 Update the Administrator Guide link b942a08 Updated from global requirements 45baf17 Updated from global requirements 818db68 Change property for auto creating schema 1a450ed Remove unsupported services from 5.1.0 df341a5 Updated from global requirements dcdcf24 Updated from global requirements 021d441 Bandit password tests b57c5f3 Workaround for temporary Oozie bug 72b5a58 Fixing the bandit config fe7adb5 Pkg installation to ssh_remote 6764aef fix syntax error in ui dev docs 65330b8 Set libext path for Oozie 4.0.1, 4.1.0 ef38159 rename service api modules ef05a56 Fixing grenade job b5bb9f9 Add hadoop openstack swift jar to ambari cluster 09a7c3a Fix Hue integration with Spark and Hive eba054c Move bandit to pep8 1e973cb Revert "Remove PyMySQL and psycopg2 from test-requirements.txt" 866514e Do not build config example for readthedocs.org 581ba2e Remove PyMySQL and psycopg2 from test-requirements.txt fb238a0 Correctly configure Spark with Hive, HBase 0374f93 Set libext path for Oozie 4.0.1, 4.1.0 379ccf8 Add hive property for Hue < 0.9.0 38b793d Updated Sahara arch diagram 974db26 Fix incorrect visualization of MapR versions 1af4701 Updated volumes section in docs eb1b308 Update reno for stable/mitaka 6daf4c0 Update .gitreview for stable/mitaka Diffstat (except docs and test files) ------------------------------------- .coveragerc | 3 +- .gitignore | 1 + .gitreview | 1 + api-ref/source/cluster-templates.inc | 255 ++ api-ref/source/clusters.inc | 338 ++ api-ref/source/conf.py | 237 ++ api-ref/source/data-sources.inc | 214 ++ api-ref/source/event-log.inc | 42 + api-ref/source/image-registry.inc | 251 ++ api-ref/source/index.rst | 20 + api-ref/source/job-binaries.inc | 266 ++ api-ref/source/job-binary-internals.inc | 261 ++ api-ref/source/job-executions.inc | 329 ++ api-ref/source/job-types.inc | 61 + api-ref/source/jobs.inc | 267 ++ api-ref/source/node-group-templates.inc | 271 ++ api-ref/source/parameters.yaml | 1124 +++++++ api-ref/source/plugins.inc | 187 ++ .../cluster-template-create-request.json | 17 + .../cluster-template-create-response.json | 82 + .../cluster-template-show-response.json | 82 + .../cluster-template-update-request.json | 11 + .../cluster-template-update-response.json | 67 + .../cluster-templates-list-response.json | 140 + .../samples/clusters/cluster-create-request.json | 9 + .../samples/clusters/cluster-create-response.json | 128 + .../samples/clusters/cluster-scale-request.json | 15 + .../samples/clusters/cluster-scale-response.json | 370 ++ .../samples/clusters/cluster-show-response.json | 128 + .../samples/clusters/cluster-update-request.json | 4 + .../samples/clusters/cluster-update-response.json | 128 + .../samples/clusters/clusters-list-response.json | 327 ++ .../clusters/multiple-clusters-create-request.json | 11 + .../multiple-clusters-create-response.json | 6 + .../data-source-register-hdfs-request.json | 6 + .../data-source-register-hdfs-response.json | 14 + .../data-source-register-swift-request.json | 10 + .../data-source-register-swift-response.json | 14 + .../data-sources/data-source-show-response.json | 14 + .../data-sources/data-source-update-request.json | 4 + .../data-sources/data-source-update-response.json | 14 + .../data-sources/data-sources-list-response.json | 28 + .../event-log/cluster-progress-response.json | 72 + .../image-registry/image-register-request.json | 4 + .../image-registry/image-register-response.json | 25 + .../image-registry/image-show-response.json | 24 + .../image-registry/image-tags-add-request.json | 7 + .../image-registry/image-tags-add-response.json | 27 + .../image-registry/image-tags-delete-request.json | 5 + .../image-registry/image-tags-delete-response.json | 25 + .../image-registry/images-list-response.json | 48 + .../samples/job-binaries/create-request.json | 9 + .../samples/job-binaries/create-response.json | 13 + .../source/samples/job-binaries/list-response.json | 37 + .../source/samples/job-binaries/show-data-response | 3 + .../source/samples/job-binaries/show-response.json | 13 + .../samples/job-binaries/update-request.json | 5 + .../samples/job-binaries/update-response.json | 13 + .../job-binary-internals/create-response.json | 12 + .../job-binary-internals/list-response.json | 24 + .../job-binary-internals/show-data-response | 3 + .../job-binary-internals/show-response.json | 12 + .../job-binary-internals/update-request.json | 4 + .../job-binary-internals/update-response.json | 12 + .../samples/job-executions/cancel-response.json | 120 + .../samples/job-executions/job-ex-response.json | 120 + .../job-executions/job-ex-update-request.json | 3 + .../job-executions/job-ex-update-response.json | 120 + .../samples/job-executions/list-response.json | 122 + .../samples/job-types/job-types-list-response.json | 209 ++ .../source/samples/jobs/job-create-request.json | 11 + .../source/samples/jobs/job-create-response.json | 35 + .../source/samples/jobs/job-execute-request.json | 19 + .../source/samples/jobs/job-execute-response.json | 30 + api-ref/source/samples/jobs/job-show-response.json | 26 + .../source/samples/jobs/job-update-request.json | 4 + .../source/samples/jobs/job-update-response.json | 26 + .../source/samples/jobs/jobs-list-response.json | 66 + .../node-group-template-create-request.json | 13 + .../node-group-template-create-response.json | 33 + .../node-group-template-show-response.json | 37 + .../node-group-template-update-request.json | 10 + .../node-group-template-update-response.json | 30 + .../node-group-templates-list-response.json | 76 + .../samples/plugins/plugin-show-response.json | 12 + .../samples/plugins/plugin-update-request.json | 7 + .../samples/plugins/plugin-update-response.json | 32 + .../plugins/plugin-version-show-response.json | 92 + .../samples/plugins/plugins-list-response.json | 41 + bandit.yaml | 4 +- devstack/plugin.sh | 25 +- devstack/settings | 3 +- devstack/upgrade/cluster-create.json | 8 - devstack/upgrade/cluster-template.json | 12 - devstack/upgrade/from-mitaka/upgrade-sahara | 15 + devstack/upgrade/ng-template.json | 10 - devstack/upgrade/resources.sh | 256 +- devstack/upgrade/settings | 2 +- devstack/upgrade/shutdown.sh | 3 +- .../userdoc/advanced.configuration.guide.rst | 131 +- etc/edp-examples/README.rst | 2 +- etc/sahara/policy.json | 1 + etc/sahara/sahara.conf.sample-basic | 6 + .../notes/add-impala-2.2-c1649599649aff5c.yaml | 3 + .../notes/add-mapr-520-3ed6cd0ae9688e17.yaml | 3 + .../notes/add-mapr-sentry-6012c08b55d679de.yaml | 3 + .../notes/add_kafka_in_cdh-774c7c051480c892.yaml | 3 + .../notes/ambari-downscaling-b9ba759ce9c7325e.yaml | 3 + .../notes/ambari-hive-92b911e0a759ee88.yaml | 3 + .../ambari-server-start-856403bc280dfba3.yaml | 3 + .../auto_configs_for_hdp-011d460d37dcdf02.yaml | 4 + .../notes/ca-cert-fix-5c434a82f9347039.yaml | 4 + .../notes/cdh-labels-5695d95bce226051.yaml | 7 + .../notes/cdh_5_7_support-9522cb9b4dce2378.yaml | 3 + .../config-groups-ambari-837de6d33eb0fa87.yaml | 4 + ...nvert-to-cluster-template-43d502496d18625e.yaml | 4 + .../designate-integration-784c5f7f29546015.yaml | 4 + .../notes/engine-opt-258ff1ae9b04d628.yaml | 3 + .../notes/event_log_for_hdp-a114511c477ef16d.yaml | 3 + ...-install-provision-events-c1bd2e05bf2be6bd.yaml | 3 + ...doop-swift-jar-for-ambari-4439913b01d42468.yaml | 4 + ...nor-endpoint-type-neutron-4583128c383d9745.yaml | 4 + releasenotes/notes/kerberos-76dd297462b7337c.yaml | 5 + ...-to-keystonauth-migration-c75988975ad1a506.yaml | 4 + .../notes/mapr-health-check-2eba3d742a2b853f.yaml | 3 + .../notes/mapr-labels-5cc318616db59403.yaml | 7 + ...r-remove-spark-standalone-293ca864de9a7848.yaml | 3 + ...apr-services-new-versions-b32c2e8fe07d1600.yaml | 8 + ...nt_images_to_glanceclient-0266a2bd92b4be05.yaml | 3 + .../rack_awareness_for_cdh-e0cd5d4ab46aa1b5.yaml | 3 + .../rack_awareness_for_hdp-6e3d44468cc141a5.yaml | 3 + ...factor-floating-ips-logic-9d37d9297f3621b3.yaml | 5 + ...hard-coded-oozie-password-b97475c8772aa1bd.yaml | 4 + ...dcoded-password-from-hive-eb923b518974e853.yaml | 5 + .../notes/remove-hdp-137d0ad3d2389b7a.yaml | 4 + .../notes/transport_url-5bbbf0bb54d81727.yaml | 5 + ...eeper-configuration-steps-48c3d9706c86f227.yaml | 7 + releasenotes/source/index.rst | 3 +- releasenotes/source/mitaka.rst | 6 + requirements.txt | 48 +- sahara/api/middleware/auth_valid.py | 23 +- sahara/api/v10.py | 49 +- sahara/api/v11.py | 51 +- sahara/api/v2/cluster_templates.py | 10 +- sahara/api/v2/clusters.py | 8 +- sahara/api/v2/data_sources.py | 10 +- sahara/api/v2/images.py | 2 +- sahara/api/v2/job_binaries.py | 16 +- sahara/api/v2/job_executions.py | 22 +- sahara/api/v2/job_types.py | 2 +- sahara/api/v2/jobs.py | 26 +- sahara/api/v2/node_group_templates.py | 11 +- sahara/api/v2/plugins.py | 15 +- sahara/cli/image_pack/__init__.py | 0 sahara/cli/image_pack/api.py | 125 + sahara/cli/image_pack/cli.py | 125 + sahara/cli/sahara_all.py | 4 - sahara/cli/sahara_api.py | 4 - sahara/conductor/api.py | 23 +- sahara/conductor/manager.py | 21 + sahara/conductor/objects.py | 30 +- sahara/conductor/resource.py | 25 +- sahara/config.py | 24 +- sahara/context.py | 16 +- sahara/db/api.py | 38 +- .../versions/031_added_plugins_table.py | 46 + .../versions/032_add_domain_name.py | 38 + sahara/db/sqlalchemy/api.py | 254 +- sahara/db/sqlalchemy/models.py | 19 + sahara/db/templates/README.rst | 2 +- sahara/exceptions.py | 18 +- sahara/main.py | 21 +- sahara/openstack/__init__.py | 0 sahara/openstack/commons.py | 67 - sahara/plugins/ambari/client.py | 87 +- sahara/plugins/ambari/common.py | 5 + sahara/plugins/ambari/configs.py | 20 +- sahara/plugins/ambari/decomission_helper.py | 118 - sahara/plugins/ambari/deploy.py | 438 ++- sahara/plugins/ambari/edp_engine.py | 6 + sahara/plugins/ambari/health.py | 2 +- sahara/plugins/ambari/plugin.py | 50 +- sahara/plugins/ambari/requests_helper.py | 145 + sahara/plugins/ambari/resources/configs-2.4.json | 1331 ++++++++ sahara/plugins/ambari/resources/images/image.yaml | 6 + sahara/plugins/ambari/validation.py | 6 + sahara/plugins/base.py | 46 +- sahara/plugins/cdh/abstractversionhandler.py | 2 +- sahara/plugins/cdh/client/clusters.py | 60 + sahara/plugins/cdh/client/cms.py | 22 + sahara/plugins/cdh/client/hosts.py | 5 +- sahara/plugins/cdh/client/resource.py | 6 +- sahara/plugins/cdh/client/types.py | 1 + sahara/plugins/cdh/cloudera_utils.py | 103 +- sahara/plugins/cdh/commands.py | 4 +- sahara/plugins/cdh/config_helper.py | 5 +- sahara/plugins/cdh/deploy.py | 42 + sahara/plugins/cdh/edp_engine.py | 6 + sahara/plugins/cdh/plugin.py | 16 + sahara/plugins/cdh/plugin_utils.py | 6 + sahara/plugins/cdh/v5_3_0/deploy.py | 18 +- sahara/plugins/cdh/v5_4_0/deploy.py | 18 +- sahara/plugins/cdh/v5_5_0/cloudera_utils.py | 25 +- sahara/plugins/cdh/v5_5_0/config_helper.py | 7 + sahara/plugins/cdh/v5_5_0/deploy.py | 29 +- sahara/plugins/cdh/v5_5_0/plugin_utils.py | 11 +- .../cdh/v5_5_0/resources/kafka-kafka_broker.json | 476 +++ .../v5_5_0/resources/kafka-kafka_mirror_maker.json | 482 +++ .../cdh/v5_5_0/resources/kafka-service.json | 374 +++ sahara/plugins/cdh/v5_5_0/versionhandler.py | 8 + sahara/plugins/cdh/v5_7_0/__init__.py | 0 sahara/plugins/cdh/v5_7_0/cloudera_utils.py | 470 +++ sahara/plugins/cdh/v5_7_0/config_helper.py | 250 ++ sahara/plugins/cdh/v5_7_0/db_helper.py | 41 + sahara/plugins/cdh/v5_7_0/deploy.py | 242 ++ sahara/plugins/cdh/v5_7_0/edp_engine.py | 54 + sahara/plugins/cdh/v5_7_0/plugin_utils.py | 167 + sahara/plugins/cdh/v5_7_0/resources/cdh_config.py | 139 + sahara/plugins/cdh/v5_7_0/resources/cdh_config.sh | 3 + .../cdh/v5_7_0/resources/create_hive_db.sql | 4 + .../cdh/v5_7_0/resources/create_sentry_db.sql | 4 + .../plugins/cdh/v5_7_0/resources/flume-agent.json | 428 +++ .../cdh/v5_7_0/resources/flume-service.json | 164 + .../cdh/v5_7_0/resources/hbase-gateway.json | 110 + .../v5_7_0/resources/hbase-hbaserestserver.json | 440 +++ .../v5_7_0/resources/hbase-hbasethriftserver.json | 446 +++ .../plugins/cdh/v5_7_0/resources/hbase-master.json | 506 +++ .../cdh/v5_7_0/resources/hbase-regionserver.json | 836 +++++ .../cdh/v5_7_0/resources/hbase-service.json | 740 ++++ .../cdh/v5_7_0/resources/hdfs-balancer.json | 68 + .../cdh/v5_7_0/resources/hdfs-datanode.json | 644 ++++ .../v5_7_0/resources/hdfs-failovercontroller.json | 332 ++ .../plugins/cdh/v5_7_0/resources/hdfs-gateway.json | 116 + .../plugins/cdh/v5_7_0/resources/hdfs-httpfs.json | 440 +++ .../cdh/v5_7_0/resources/hdfs-journalnode.json | 446 +++ .../cdh/v5_7_0/resources/hdfs-namenode.json | 812 +++++ .../cdh/v5_7_0/resources/hdfs-nfsgateway.json | 386 +++ .../v5_7_0/resources/hdfs-secondarynamenode.json | 446 +++ .../plugins/cdh/v5_7_0/resources/hdfs-service.json | 1400 ++++++++ .../plugins/cdh/v5_7_0/resources/hive-gateway.json | 98 + .../cdh/v5_7_0/resources/hive-hivemetastore.json | 392 +++ .../cdh/v5_7_0/resources/hive-hiveserver2.json | 704 ++++ .../resources/hive-metastore-sentry-safety.xml | 15 + .../resources/hive-server2-sentry-safety.xml | 12 + .../plugins/cdh/v5_7_0/resources/hive-service.json | 722 ++++ sahara/plugins/cdh/v5_7_0/resources/hive-site.xml | 61 + .../plugins/cdh/v5_7_0/resources/hive-webhcat.json | 332 ++ .../v5_7_0/resources/hue-hue_load_balancer.json | 236 ++ .../cdh/v5_7_0/resources/hue-hue_server.json | 356 ++ .../cdh/v5_7_0/resources/hue-kt_renewer.json | 200 ++ .../plugins/cdh/v5_7_0/resources/hue-service.json | 674 ++++ .../cdh/v5_7_0/resources/impala-catalogserver.json | 506 +++ .../cdh/v5_7_0/resources/impala-impalad.json | 710 ++++ .../plugins/cdh/v5_7_0/resources/impala-llama.json | 506 +++ .../cdh/v5_7_0/resources/impala-service.json | 632 ++++ .../cdh/v5_7_0/resources/impala-statestore.json | 374 +++ .../cdh/v5_7_0/resources/kafka-kafka_broker.json | 476 +++ .../v5_7_0/resources/kafka-kafka_mirror_maker.json | 482 +++ .../cdh/v5_7_0/resources/kafka-service.json | 374 +++ sahara/plugins/cdh/v5_7_0/resources/kms-kms.json | 530 +++ .../plugins/cdh/v5_7_0/resources/kms-service.json | 86 + .../v5_7_0/resources/ks_indexer-hbase_indexer.json | 356 ++ .../cdh/v5_7_0/resources/ks_indexer-service.json | 188 ++ .../plugins/cdh/v5_7_0/resources/mapred-site.xml | 157 + .../cdh/v5_7_0/resources/oozie-oozie_server.json | 662 ++++ .../cdh/v5_7_0/resources/oozie-service.json | 236 ++ .../cdh/v5_7_0/resources/priority-one-confs.json | 45 + .../resources/sentry-impala-client-safety.xml | 16 + .../cdh/v5_7_0/resources/sentry-sentry_server.json | 308 ++ .../cdh/v5_7_0/resources/sentry-service.json | 278 ++ .../plugins/cdh/v5_7_0/resources/solr-gateway.json | 32 + .../plugins/cdh/v5_7_0/resources/solr-service.json | 404 +++ .../cdh/v5_7_0/resources/solr-solr_server.json | 440 +++ .../cdh/v5_7_0/resources/spark-gateway.json | 170 + .../cdh/v5_7_0/resources/spark-service.json | 152 + .../resources/spark-spark_yarn_history_server.json | 314 ++ .../cdh/v5_7_0/resources/sqoop-service.json | 110 + .../cdh/v5_7_0/resources/sqoop-sqoop_server.json | 398 +++ .../plugins/cdh/v5_7_0/resources/yarn-gateway.json | 476 +++ .../cdh/v5_7_0/resources/yarn-jobhistory.json | 476 +++ .../cdh/v5_7_0/resources/yarn-nodemanager.json | 764 +++++ .../cdh/v5_7_0/resources/yarn-resourcemanager.json | 674 ++++ .../plugins/cdh/v5_7_0/resources/yarn-service.json | 542 +++ .../cdh/v5_7_0/resources/zookeeper-server.json | 596 ++++ .../cdh/v5_7_0/resources/zookeeper-service.json | 224 ++ sahara/plugins/cdh/v5_7_0/validation.py | 232 ++ sahara/plugins/cdh/v5_7_0/versionhandler.py | 100 + sahara/plugins/exceptions.py | 36 + sahara/plugins/fake/plugin.py | 29 +- sahara/plugins/hdp/__init__.py | 0 sahara/plugins/hdp/ambariplugin.py | 450 --- sahara/plugins/hdp/clusterspec.py | 385 --- sahara/plugins/hdp/confighints_helper.py | 81 - sahara/plugins/hdp/configprovider.py | 94 - sahara/plugins/hdp/edp_engine.py | 42 - sahara/plugins/hdp/hadoopserver.py | 279 -- sahara/plugins/hdp/saharautils.py | 33 - sahara/plugins/hdp/versions/__init__.py | 0 .../plugins/hdp/versions/abstractversionhandler.py | 75 - .../plugins/hdp/versions/version_2_0_6/__init__.py | 0 .../hdp/versions/version_2_0_6/edp_engine.py | 46 - .../resources/ambari-config-resource.json | 3536 -------------------- .../resources/default-cluster.template | 1845 ---------- .../versions/version_2_0_6/resources/topology.sh | 21 - .../plugins/hdp/versions/version_2_0_6/services.py | 1271 ------- .../hdp/versions/version_2_0_6/versionhandler.py | 1165 ------- .../plugins/hdp/versions/versionhandlerfactory.py | 59 - sahara/plugins/images.py | 992 ++++++ sahara/plugins/kerberos.py | 400 +++ sahara/plugins/labels.py | 226 ++ sahara/plugins/mapr/abstract/health_checker.py | 24 + .../plugins/mapr/base/base_cluster_configurer.py | 90 +- sahara/plugins/mapr/base/base_cluster_context.py | 21 + sahara/plugins/mapr/base/base_edp_engine.py | 10 +- sahara/plugins/mapr/base/base_health_checker.py | 121 + sahara/plugins/mapr/base/base_node_manager.py | 26 +- sahara/plugins/mapr/base/base_version_handler.py | 6 + sahara/plugins/mapr/domain/distro.py | 10 +- sahara/plugins/mapr/domain/node_process.py | 2 + sahara/plugins/mapr/domain/service.py | 40 +- sahara/plugins/mapr/plugin.py | 15 + sahara/plugins/mapr/resources/add_mapr_repo.sh | 4 +- sahara/plugins/mapr/resources/add_mapr_user.sh | 2 - .../plugins/mapr/resources/add_security_repos.sh | 1 - sahara/plugins/mapr/services/drill/drill.py | 12 +- sahara/plugins/mapr/services/flume/flume.py | 0 sahara/plugins/mapr/services/hbase/hbase.py | 17 +- .../services/hbase/resources/hbase-default.json | 5 + sahara/plugins/mapr/services/hive/hive.py | 62 +- .../mapr/services/hive/resources/hive-default.xml | 4 +- .../mapr/services/hive/resources/sentry-db.xml | 27 + .../services/hive/resources/sentry-default.xml | 45 + sahara/plugins/mapr/services/httpfs/httpfs.py | 4 +- sahara/plugins/mapr/services/hue/hue.py | 157 +- .../mapr/services/hue/resources/hue_3.9.0.template | 15 +- sahara/plugins/mapr/services/impala/impala.py | 116 +- .../services/impala/resources/impala-env.sh.j2 | 20 +- sahara/plugins/mapr/services/mahout/mahout.py | 12 + .../plugins/mapr/services/management/management.py | 14 +- .../plugins/mapr/services/mapreduce/mapreduce.py | 14 +- sahara/plugins/mapr/services/maprfs/maprfs.py | 7 +- sahara/plugins/mapr/services/mysql/mysql.py | 32 +- sahara/plugins/mapr/services/oozie/oozie.py | 75 +- sahara/plugins/mapr/services/sentry/__init__.py | 0 .../services/sentry/resources/global-policy.ini | 6 + .../services/sentry/resources/sentry-default.xml | 4 + sahara/plugins/mapr/services/sentry/sentry.py | 165 + .../services/spark/resources/spark-default.json | 16 - .../services/spark/resources/spark-env.template | 2 +- sahara/plugins/mapr/services/spark/spark.py | 370 +- sahara/plugins/mapr/services/sqoop/sqoop2.py | 7 +- sahara/plugins/mapr/services/swift/swift.py | 28 +- sahara/plugins/mapr/services/yarn/yarn.py | 14 +- sahara/plugins/mapr/util/general.py | 4 +- sahara/plugins/mapr/util/maprfs_helper.py | 33 +- sahara/plugins/mapr/util/password_utils.py | 70 + sahara/plugins/mapr/util/validation_utils.py | 33 + .../mapr/versions/v5_0_0_mrv2/version_handler.py | 1 + .../mapr/versions/v5_1_0_mrv2/version_handler.py | 5 +- .../plugins/mapr/versions/v5_2_0_mrv2/__init__.py | 0 .../plugins/mapr/versions/v5_2_0_mrv2/context.py | 60 + .../mapr/versions/v5_2_0_mrv2/version_handler.py | 70 + .../mapr/versions/version_handler_factory.py | 2 +- sahara/plugins/opts.py | 26 + sahara/plugins/provisioning.py | 83 +- sahara/plugins/resources/create-principal-keytab | 12 + sahara/plugins/resources/cron-file | 2 + sahara/plugins/resources/cron-script | 3 + sahara/plugins/resources/kdc_conf | 16 + sahara/plugins/resources/kdc_conf_redhat | 13 + .../plugins/resources/krb-client-init.sh.template | 14 + sahara/plugins/resources/krb5_config | 11 + .../resources/mit-kdc-server-init.sh.template | 34 + sahara/plugins/spark/config_helper.py | 2 +- sahara/plugins/spark/plugin.py | 14 +- sahara/plugins/storm/config_helper.py | 29 +- sahara/plugins/storm/edp_engine.py | 25 +- sahara/plugins/storm/plugin.py | 39 +- sahara/plugins/utils.py | 18 +- sahara/plugins/vanilla/hadoop2/config.py | 74 +- sahara/plugins/vanilla/hadoop2/config_helper.py | 103 + sahara/plugins/vanilla/hadoop2/oozie_helper.py | 6 +- .../vanilla/hadoop2/resources/create_hive_db.sql | 8 +- .../vanilla/hadoop2/resources/create_oozie_db.sql | 4 +- .../vanilla/hadoop2/resources/spark-cleanup.cron | 2 + .../hadoop2/resources/tmp-cleanup.sh.template | 48 + sahara/plugins/vanilla/hadoop2/run_scripts.py | 20 + sahara/plugins/vanilla/hadoop2/starting_scripts.py | 6 + sahara/plugins/vanilla/hadoop2/utils.py | 44 + sahara/plugins/vanilla/hadoop2/validation.py | 6 + sahara/plugins/vanilla/plugin.py | 10 + sahara/plugins/vanilla/utils.py | 14 + sahara/plugins/vanilla/v2_7_1/config_helper.py | 18 +- sahara/plugins/vanilla/v2_7_1/edp_engine.py | 46 + sahara/plugins/vanilla/v2_7_1/versionhandler.py | 32 +- sahara/service/api.py | 310 -- sahara/service/api/__init__.py | 23 + sahara/service/api/v10.py | 286 ++ sahara/service/api/v11.py | 269 ++ sahara/service/api/v2/__init__.py | 0 sahara/service/api/v2/cluster_templates.py | 43 + sahara/service/api/v2/clusters.py | 175 + sahara/service/api/v2/data_sources.py | 41 + sahara/service/api/v2/images.py | 68 + sahara/service/api/v2/job_binaries.py | 72 + sahara/service/api/v2/job_executions.py | 109 + sahara/service/api/v2/job_types.py | 78 + sahara/service/api/v2/jobs.py | 45 + sahara/service/api/v2/node_group_templates.py | 43 + sahara/service/api/v2/plugins.py | 46 + sahara/service/coordinator.py | 5 +- sahara/service/edp/api.py | 277 -- sahara/service/edp/job_manager.py | 18 +- sahara/service/edp/oozie/engine.py | 18 +- sahara/service/edp/oozie/oozie.py | 117 +- sahara/service/edp/storm/engine.py | 139 +- sahara/service/engine.py | 39 +- sahara/service/health/health_check_base.py | 125 +- sahara/service/heat/commons.py | 2 +- sahara/service/heat/heat_engine.py | 15 +- sahara/service/heat/templates.py | 138 +- sahara/service/networks.py | 43 +- sahara/service/ntp_service.py | 8 +- sahara/service/ops.py | 5 +- sahara/service/periodic.py | 2 +- sahara/service/quotas.py | 18 +- sahara/service/sessions.py | 42 +- sahara/service/shares.py | 3 +- sahara/service/validation.py | 106 +- sahara/service/validations/base.py | 28 +- .../service/validations/cluster_template_schema.py | 3 + sahara/service/validations/cluster_templates.py | 2 +- sahara/service/validations/clusters.py | 8 +- sahara/service/validations/clusters_scaling.py | 10 +- sahara/service/validations/edp/data_source.py | 25 + sahara/service/validations/edp/job.py | 7 +- sahara/service/validations/edp/job_binary.py | 7 + .../service/validations/edp/job_binary_internal.py | 13 + sahara/service/validations/edp/job_execution.py | 37 +- sahara/service/validations/node_group_templates.py | 2 +- sahara/service/validations/plugins.py | 16 +- sahara/service/volumes.py | 14 +- sahara/swift/utils.py | 22 +- .../tempest/scenario/data_processing/README.rst | 117 - .../tempest/scenario/data_processing/__init__.py | 0 .../tempest/scenario/data_processing/config.py | 34 - .../tempest/scenario/data_processing/plugin.py | 37 - .../unit/cli/image_pack/test_image_pack_api.py | 72 + .../plugins/ambari/test_decommission_helper.py | 68 - .../unit/plugins/ambari/test_requests_helper.py | 96 + .../unit/plugins/cdh/base_plugin_utils_test.py | 3 +- .../unit/plugins/cdh/v5/test_versionhandler.py | 11 +- .../unit/plugins/cdh/v5_3_0/test_versionhandler.py | 15 +- .../unit/plugins/cdh/v5_4_0/test_versionhandler.py | 15 +- .../plugins/cdh/v5_5_0/test_config_helper_550.py | 5 +- .../unit/plugins/cdh/v5_5_0/test_versionhandler.py | 15 +- .../plugins/cdh/v5_7_0/test_config_helper_570.py | 168 + .../unit/plugins/cdh/v5_7_0/test_edp_engine.py | 200 ++ .../plugins/cdh/v5_7_0/test_plugin_utils_570.py | 25 + .../unit/plugins/cdh/v5_7_0/test_spark_engine.py | 69 + .../unit/plugins/cdh/v5_7_0/test_validation.py | 123 + .../unit/plugins/cdh/v5_7_0/test_versionhandler.py | 140 + .../plugins/hdp/resources/config-resource.json | 42 - .../hdp/resources/sample-ambari-blueprint.json | 195 -- .../unit/plugins/hdp/test_clusterspec_hdp2.py | 2035 ----------- .../unit/plugins/hdp/test_confighints_helper.py | 147 - .../unit/plugins/hdp/test_versionmanagerfactory.py | 35 - .../plugins/hdp/versions/version_2_0_6/__init__.py | 0 .../hdp/versions/version_2_0_6/test_edp_engine.py | 98 - .../unit/plugins/mapr/test_cluster_context.py | 5 +- .../unit/plugins/vanilla/hadoop2/test_utils.py | 75 + .../service/validation/edp/test_data_source.py | 21 +- .../unit/service/validation/edp/test_job_binary.py | 2 +- .../validation/edp/test_job_binary_internal.py | 2 +- .../service/validation/edp/test_job_executor.py | 2 +- .../service/validation/edp/test_job_interface.py | 3 +- .../validation/test_cluster_create_validation.py | 8 +- .../validation/test_cluster_delete_validation.py | 4 +- .../validation/test_cluster_scaling_validation.py | 4 +- .../test_cluster_template_create_validation.py | 11 +- .../test_cluster_template_update_validation.py | 2 +- .../validation/test_cluster_update_validation.py | 6 +- .../test_ng_template_validation_create.py | 2 +- .../test_ng_template_validation_update.py | 2 +- sahara/topology/topology_helper.py | 4 + sahara/utils/api.py | 13 +- sahara/utils/cluster.py | 62 +- sahara/utils/edp.py | 7 +- sahara/utils/files.py | 10 + sahara/utils/hacking/checks.py | 4 - sahara/utils/hacking/logging_checks.py | 16 +- sahara/utils/network.py | 43 + sahara/utils/openstack/barbican.py | 29 - sahara/utils/openstack/base.py | 37 +- sahara/utils/openstack/glance.py | 47 + sahara/utils/openstack/heat.py | 14 +- sahara/utils/openstack/images.py | 178 +- sahara/utils/openstack/keystone.py | 60 +- sahara/utils/openstack/neutron.py | 12 +- sahara/utils/openstack/nova.py | 2 - sahara/utils/procutils.py | 5 +- sahara/utils/remote.py | 27 +- sahara/utils/rpc.py | 57 +- sahara/utils/ssh_remote.py | 189 +- sahara/utils/types.py | 7 + sahara/utils/wsgi.py | 3 - setup.cfg | 8 +- test-requirements.txt | 23 +- tools/build_docs | 3 - tools/install_venv | 3 - tools/install_venv.py | 76 - tools/install_venv_common.py | 212 -- tools/lintstack.py | 39 +- tools/run_fast_checks | 3 - tools/run_pep8 | 3 - tools/run_pylint | 3 - tools/with_venv.sh | 4 - tox.ini | 29 +- 634 files changed, 51648 insertions(+), 18978 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 506f672..488089d 100644 --- a/requirements.txt +++ b/requirements.txt @@ -7,3 +7,3 @@ pbr>=1.6 # Apache-2.0 -alembic>=0.8.0 # MIT -Babel>=1.3 # BSD -castellan>=0.3.1 # Apache-2.0 +alembic>=0.8.4 # MIT +Babel>=2.3.4 # BSD +castellan>=0.4.0 # Apache-2.0 @@ -11,2 +11,2 @@ eventlet!=0.18.3,>=0.18.2 # MIT -Flask<1.0,>=0.10 # BSD -iso8601>=0.1.9 # MIT +Flask!=0.11,<1.0,>=0.10 # BSD +iso8601>=0.1.11 # MIT @@ -15,5 +15,6 @@ jsonschema!=2.5.0,<3.0.0,>=2.0.0 # MIT -keystonemiddleware!=4.1.0,>=4.0.0 # Apache-2.0 -oslo.config>=3.7.0 # Apache-2.0 -oslo.concurrency>=3.5.0 # Apache-2.0 -oslo.context>=0.2.0 # Apache-2.0 -oslo.db>=4.1.0 # Apache-2.0 +keystoneauth1>=2.10.0 # Apache-2.0 +keystonemiddleware!=4.1.0,!=4.5.0,>=4.0.0 # Apache-2.0 +oslo.config>=3.14.0 # Apache-2.0 +oslo.concurrency>=3.8.0 # Apache-2.0 +oslo.context>=2.9.0 # Apache-2.0 +oslo.db!=4.13.1,!=4.13.2,>=4.10.0 # Apache-2.0 @@ -22 +23 @@ oslo.log>=1.14.0 # Apache-2.0 -oslo.messaging>=4.0.0 # Apache-2.0 +oslo.messaging>=5.2.0 # Apache-2.0 @@ -24,2 +25,2 @@ oslo.middleware>=3.0.0 # Apache-2.0 -oslo.policy>=0.5.0 # Apache-2.0 -oslo.rootwrap>=2.0.0 # Apache-2.0 +oslo.policy>=1.9.0 # Apache-2.0 +oslo.rootwrap>=5.0.0 # Apache-2.0 @@ -27,7 +28,7 @@ oslo.serialization>=1.10.0 # Apache-2.0 -oslo.service>=1.0.0 # Apache-2.0 -oslo.utils>=3.5.0 # Apache-2.0 -paramiko>=1.16.0 # LGPL -requests!=2.9.0,>=2.8.1 # Apache-2.0 -python-cinderclient>=1.3.1 # Apache-2.0 -python-keystoneclient!=1.8.0,!=2.1.0,>=1.6.0 # Apache-2.0 -python-manilaclient>=1.3.0 # Apache-2.0 +oslo.service>=1.10.0 # Apache-2.0 +oslo.utils>=3.16.0 # Apache-2.0 +paramiko>=2.0 # LGPLv2.1+ +requests>=2.10.0 # Apache-2.0 +python-cinderclient!=1.7.0,!=1.7.1,>=1.6.0 # Apache-2.0 +python-keystoneclient!=2.1.0,>=2.0.0 # Apache-2.0 +python-manilaclient>=1.10.0 # Apache-2.0 @@ -36,2 +37,3 @@ python-swiftclient>=2.2.0 # Apache-2.0 -python-neutronclient!=4.1.0,>=2.6.0 # Apache-2.0 -python-heatclient>=0.6.0 # Apache-2.0 +python-neutronclient>=5.1.0 # Apache-2.0 +python-heatclient>=1.4.0 # Apache-2.0 +python-glanceclient!=2.4.0,>=2.3.0 # Apache-2.0 @@ -39 +41 @@ six>=1.9.0 # MIT -stevedore>=1.5.0 # Apache-2.0 +stevedore>=1.16.0 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index b7d345e..a456df3 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -7,3 +7,2 @@ hacking<0.11,>=0.10.0 -Mako>=0.4.0 # MIT -PrettyTable<0.8,>=0.7 # BSD -PyMySQL>=0.6.2 # MIT License +PyMySQL!=0.7.7,>=0.6.2 # MIT License +bandit>=1.1.0 # Apache-2.0 @@ -13,2 +12,2 @@ doc8 # Apache-2.0 -fixtures>=1.3.1 # Apache-2.0/BSD -mock>=1.2 # BSD +fixtures>=3.0.0 # Apache-2.0/BSD +mock>=2.0 # BSD @@ -17 +16,2 @@ oslotest>=1.10.0 # Apache-2.0 -os-testr>=0.4.1 # Apache-2.0 +os-api-ref>=1.0.0 # Apache-2.0 +os-testr>=0.7.0 # Apache-2.0 @@ -19,4 +19,3 @@ psycopg2>=2.5 # LGPL/ZPL -pylint==1.4.5 # GNU GPL v2 -reno>=0.1.1 # Apache2 -rfc3986>=0.2.0 # Apache-2.0 -sphinx!=1.2.0,!=1.3b1,<1.3,>=1.1.2 # BSD +pylint==1.4.5 # GPLv2 +reno>=1.8.0 # Apache2 +sphinx!=1.3b1,<1.3,>=1.2.1 # BSD @@ -24,2 +22,0 @@ sphinxcontrib-httpdomain # BSD -tempest-lib>=0.14.0 # Apache-2.0 -testrepository>=0.0.18 # Apache-2.0/BSD @@ -29,2 +25,0 @@ testtools>=1.4.0 # MIT - -python-saharaclient>=0.13.0 # Apache-2.0