April 2019 - Release-announce - lists.openstack.org

searchlight 6.0.0 (stein)
by no-reply＠openstack.org 10 Apr '19

10 Apr '19

We are stoked to announce the release of: searchlight 6.0.0: OpenStack Search Service This release is part of the stein release series. The source is available from: https://git.openstack.org/cgit/openstack/searchlight Download the package from: https://tarballs.openstack.org/searchlight/ Please report issues through: https://storyboard.openstack.org/#!/project/openstack/searchlight For more details, please see below. Changes in searchlight 4.0.0..6.0.0 ----------------------------------- acd19c3 Update setup.cfg a8c9a69 Replace keystone v2 by v3 in test eaeb059 Drop py35 tox test 33da7eb Drop py35 tests a3e072c Fix devstack elasticsearch issue with jdk on bionic 7038886 Add Dockerfile and docker-compose.yml to run searchlight in docker containers dc66127 Update requests version to the latest f4a6724 Replace httplib2 by requests e2107a5 Add a vision-reflection document for Searchlight e57ef4f add python 3.7 unit test job fd2b8ff Update json module to jsonutils a0210ab Split use cases and vision documents 6dabd5c Update hacking and fix pep8 b91394e Use oslo.reports for better debugging e1df777 Add Searchlight use cases and vision 6098046 Change openstack-dev to openstack-discuss 815fa37 Add missing ws separator between words 8d3d45f Change openstack-dev to openstack-discuss d72774f Update requirements and fix functional tests 0581969 Add cover job a9d52a8 Revert "Update requirements for stestr" c5b1079 Add searchlight-status upgrade check command framework 42b1bd1 Remove i18n.enable_lazy() call from searchlight.cmd 65ce134 Update requirements for stestr 190b013 [Trivial fix] Correct spelling error 95d79cb Update min tox version to 2.0 665a106 Enable versioned nova notifications a9a146a Replace Chinese quotes with English quotes 0ed416f Update the URL in notification_handler.py a933f8c Fix Error when fetching members of private image Story: #1758327 Task: #25278 Change-Id: I9e2764326b03ea8cd1fc8ef33ed1d5d632dee532 5707aa9 Add Apache license to elasticsearch{5-6}.txt 3cb10e8 Fix wrong local.conf link in devstack's README e733c84 Update vagrant file 02f21b7 Fix release note ElasticSearch 5.x 2d4043e Add support for ElasticSearch 5.x dc79371 Update storyboard project group link 75b9476 Change the local.conf ref c4cf0c1 Revert "Completely move zuul jobs from os infra to local" df18d99 Completely move zuul jobs from os infra to local 7fcb65b Update zuul config 4f8a687 Add oslo_debug_helper to test 9647988 Update indexingservice doc 1c0e62f Fix 2 broken links in the installation doc 8744a8e Update test to use ElasticSearch 2.3.4 as docs says 179b4e9 Fix py36 fail 938187c Change launchpad to storyboard links c8e7a57 Adjustments for WebOb 1.8.1 7386c7c Add oslotest to test-requirements c632fad Update devstack config 3044cc3 Add vagrant as a contrib folder b5f5f70 Add details of permissions required for listener/rabbitmq 4261786 Add simple script to help testing image membership 7dbf807 Fix broken incrementer be3ba4e Move some of the implementation notes lower cf749ea Update tox 6a65cda Converted String timestamp to Int bfc274f add python 3.6 unit test job 1dc6dfe Update doc requirements to reflect OS global requirements [1] 1e6b8ec Updated from global requirements 06c901e Update README a20a266 switch documentation job to new PTI dd60dce import zuul job settings from project-config 038bc95 Enable mutable config in searchlight 1f25711 Switch to use stestr for unit test f3833aa Fixes the default sample policy path 3d43ee4 Follow the new PTI for document build c5850c4 Add document and code repository links to README e104c6e fix tox python3 overrides 5e83f4d replace unicode with six.text_type 2a61944 Add 'system_scope' to context test 905797a Fix format of codeblock enumeration eb2b4a5 Remove moxstubout usage c95d991 add lower-constraints job 1a22909 Update "auth_url" in install docs 0d18d8f uncap eventlet ffa0078 Fix unreachable link in document ebd4f94 Update links in README 3952ab2 Imported Translations from Zanata 0f28ed6 Remove policy.json from devstack 94063fa fix typos in documentation 68500a2 Updated from global requirements e07d9e4 Imported Translations from Zanata f689b72 Update reno for stable/queens Diffstat (except docs and test files) ------------------------------------- .gitignore | 2 +- .stestr.conf | 4 + .testr.conf | 8 - .zuul.yaml | 10 + CONTRIBUTING.rst | 4 +- README.rst | 55 ++- api-ref/source/conf.py | 3 +- api-ref/source/searchlight-v1.inc | 49 +- bindep.txt | 2 + contrib/docker/Dockerfile | 30 ++ contrib/docker/README.rst | 76 +++ contrib/docker/docker-compose.example.yml | 24 + contrib/docker/entrypoint.sh | 52 ++ contrib/docker/searchlight.conf | 70 +++ contrib/vagrant/Vagrantfile | 77 +++ contrib/vagrant/local.conf | 81 ++++ devstack/README.rst | 9 +- devstack/{local.conf => local.conf.example} | 14 +- devstack/plugin.sh | 65 ++- elasticsearch5.txt | 2 + elasticsearch6.txt | 2 + etc/oslo-policy-generator/searchlight.conf | 2 +- images/SeaaS.png | Bin 0 -> 88834 bytes lower-constraints.txt | 50 ++ ...devstack-elasticsearch-5x-48934b931a31c823.yaml | 4 + ...a-versioned-notifications-ffa01feeaf688414.yaml | 17 + ...s-upgrade-check-framework-7ef75908acc5110f.yaml | 13 + releasenotes/source/index.rst | 1 + releasenotes/source/queens.rst | 6 + requirements.txt | 28 +- searchlight/api/v1/search.py | 9 +- searchlight/cmd/__init__.py | 2 - searchlight/cmd/api.py | 27 +- searchlight/cmd/control.py | 15 +- searchlight/cmd/listener.py | 2 +- searchlight/cmd/status.py | 55 +++ searchlight/common/exception.py | 6 + searchlight/common/utils.py | 2 +- searchlight/common/wsgi.py | 38 +- searchlight/elasticsearch/__init__.py | 8 +- searchlight/elasticsearch/plugins/base.py | 6 +- .../plugins/designate/notification_handlers.py | 2 +- .../elasticsearch/plugins/glance/__init__.py | 7 +- searchlight/elasticsearch/plugins/nova/__init__.py | 109 ++++- .../plugins/nova/notification_handler.py | 153 ++++-- searchlight/elasticsearch/plugins/nova/servers.py | 20 +- searchlight/elasticsearch/plugins/utils.py | 28 +- searchlight/i18n.py | 4 +- searchlight/listener.py | 2 +- searchlight/locale/de/LC_MESSAGES/searchlight.po | 139 +++++- .../locale/en_GB/LC_MESSAGES/searchlight.po | 524 +++++++++++++++++++++ .../locale/ko_KR/LC_MESSAGES/searchlight.po | 8 +- .../locale/pt_BR/LC_MESSAGES/searchlight.po | 8 +- .../locale/tr_TR/LC_MESSAGES/searchlight.po | 8 +- .../locale/zh_CN/LC_MESSAGES/searchlight.po | 8 +- .../locale/zh_TW/LC_MESSAGES/searchlight.po | 8 +- searchlight/service.py | 4 +- searchlight/version.py | 1 + setup.cfg | 12 +- test-requirements.txt | 17 +- test-scripts/generate-swift-data.py | 9 +- test-scripts/image_member_test.sh | 23 + test-scripts/listener.py | 8 +- test-scripts/resources.sh | 2 +- tools/install_venv_common.py | 6 +- tools/test-setup.sh | 14 +- tox.ini | 65 ++- 103 files changed, 2878 insertions(+), 544 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 044edc3..25853f6 100644 --- a/requirements.txt +++ b/requirements.txt @@ -12 +12 @@ greenlet>=0.4.10 # MIT -eventlet!=0.18.3,!=0.20.1,<0.21.0,>=0.18.2 # MIT +eventlet!=0.18.3,!=0.20.1,>=0.18.2 # MIT @@ -15,3 +15,3 @@ Routes>=2.3.1 # MIT -WebOb>=1.7.1 # MIT -oslo.config>=5.1.0 # Apache-2.0 -oslo.concurrency>=3.25.0 # Apache-2.0 +WebOb>=1.8.4 # MIT +oslo.config>=5.2.0 # Apache-2.0 +oslo.concurrency>=3.26.0 # Apache-2.0 @@ -20 +20,2 @@ oslo.middleware>=3.31.0 # Apache-2.0 -oslo.service!=1.28.1,>=1.24.0 # Apache-2.0 +oslo.service>=1.33.0 # Apache-2.0 +oslo.upgradecheck>=0.1.0 # Apache-2.0 @@ -30 +31 @@ python-keystoneclient>=3.8.0 # Apache-2.0 -pyOpenSSL>=16.2.0 # Apache-2.0 +pyOpenSSL>=17.1.0 # Apache-2.0 @@ -35,0 +37 @@ oslo.log>=3.36.0 # Apache-2.0 +oslo.reports>=1.18.0 # Apache-2.0 @@ -42 +44,9 @@ osprofiler>=1.4.0 # Apache-2.0 -elasticsearch<=3.0.0,>=2.0.0 # Apache-2.0 +# ElasticSearch 6.x +# elasticsearch>=6.0.0,<7.0.0 +# ElasticSearch 5.x +# elasticsearch>=5.0.0,<6.0.0 +# ElasticSearch 2.x +# elasticsearch>=2.0.0,<3.0.0 +# See: +# https://elasticsearch-py.readthedocs.io/en/master/#compatibility +elasticsearch<3.0.0,>=2.0.0 # Apache-2.0 @@ -48 +58 @@ python-novaclient>=9.1.0 # Apache-2.0 -python-neutronclient>=6.3.0 # Apache-2.0 +python-neutronclient>=6.11.0 # Apache-2.0 @@ -51 +61 @@ python-swiftclient>=3.2.0 # Apache-2.0 -python-ironicclient>=2.2.0 # Apache-2.0 +python-ironicclient>=2.3.0 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index 8ec8179..c23cc38 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -6 +6 @@ -hacking<0.11,>=0.10.0 +hacking>=1.1.0,<1.2.0 # Apache-2.0 @@ -12 +12 @@ Babel!=2.4.0,>=2.3.4 # BSD -coverage!=4.4,>=4.0 # Apache-2.0 +coverage>=4.5.2 # Apache-2.0 @@ -15,3 +15,3 @@ mock>=2.0.0 # BSD -sphinx!=1.6.6,>=1.6.2 # BSD -requests>=2.14.2 # Apache-2.0 -testrepository>=0.0.18 # Apache-2.0/BSD +oslotest>=3.2.0 # Apache-2.0 +requests>=2.21.0 # Apache-2.0 +stestr>=2.0.0 # Apache-2.0 @@ -20,2 +19,0 @@ psutil>=3.2.2 # BSD -oslotest>=3.2.0 # Apache-2.0 -reno>=2.5.0 # Apache-2.0 @@ -23,5 +20,0 @@ simplejson>=3.5.1 # MIT -httplib2>=0.9.1 # MIT - -# Documentation -openstackdocstheme>=1.18.1 # Apache-2.0 -os-api-ref>=1.4.0 # Apache-2.0

1 0

senlin 7.0.0 (stein)
by no-reply＠openstack.org 10 Apr '19

10 Apr '19

We are tickled pink to announce the release of: senlin 7.0.0: OpenStack Clustering This release is part of the stein release series. The source is available from: https://git.openstack.org/cgit/openstack/senlin Download the package from: https://tarballs.openstack.org/senlin/ Please report issues through: https://bugs.launchpad.net/senlin/+bugs For more details, please see below. Changes in senlin 6.0.0..7.0.0 ------------------------------ 27ce61f6 Add release note for hm fixes 9a52f4a3 Fix detach LB policy when LB is not in ACTIVE and ONLINE f52ac6fb cluster_resize with capacity is 0 9f49cfdf Fix Senlin performance issues 30cf0e33 Check health policy v1.0 before upgrade 070ad9d7 Add release notes for Stein 39a91603 Improve Health Manager to avoid duplicate health checks. 3e70333a Fix node delete with lifecycle hook bug 0bb87c4d add python 3.7 unit test job df5947ee Clean up devstack tempest jobs 67591b02 Fix cluster recovery and node recovery params 9d6c0a8d Use region_name when getting endpoint URL 97cd02b0 Remove unused batch_num variable. 01fe1997 Fix duplicating network ports on node recovery 8a1e44df Bump openstacksdk to 0.24.0 ad3f7bc5 Make py35 api and functional test voting 7581f527 Fix node lock aquire to force with node operation 8b7c4117 Catch DBDuplicateEntry when locking cluster 0367baa1 Do not set parent action status if stop node failed 9f3e4941 Add node_operation to lock and conflict bypass 7f01ff75 Add support for Oslo.Reports ec3c42a2 Fix member address selection in lbaas driver 3770d11a Add action_purge to senlin-manage b9c9cfaa Miscellaneous fixes 4270103c Add missing retry_on_deadlock 20e40cb4 Fix the misspelling of "required" f2fc46dd Enable health checks after failed operation 66a62021 Default argument value should not be mutable e9b8cf4d Log failed nova operations 719c1bc3 Set owner for actions in waiting for lifecycle 125e4033 Fix the misspelling of "except" 1e5e4dd8 Fix parameters for update node when recovery with lb_policy 44b5ae89 Add force to action_update 38e71876 Fix action failed status c220ce07 Fix `'NoneType' object has no attribute 'update'` when receiver params are not defined but a request contains data 64cf9d06 Convert requests response from byte to string 55329831 Update health manger to not spawn multiple tasks 29ed0237 fix misspelling in the unit test fb888e3f Use ThreadGroup.add_timer() API correctly ffbfa804 Add action_update api to cancel actions 8f340b2e Update mailinglist from dev to discuss 52d87022 Rework health check code c9858bd6 add line to fix Unexpected indentation 50d00c42 Add python 3.6 unit test job b2f6a03c Replace usage of get_legacy_facade() with get_engine() b421f39b Minor error 586ed616 Add missing www_authenticate_uri to devstack f06ec494 Cleaned up devstack logging f529ffe6 Add senlin-status upgrade check command framework e8633adf Remove i18n.enable_lazy() call from senlin.cmd ed4b8355 Update min tox version to 2.0 f381651c Start using glance instead of compute to find images af036cf7 Make CLUSTER_DELETE action ignore conflicts/locks d8df1f8c Add sphinx extension to document policies/profiles 364b1402 Update scaling policy logic to be applied before action acceptance 4059a3e3 Stop using deprecated version of enable_logging c7272cdf Increment versioning with pbr instruction a34e45b6 Reject actions if target resource is locked 86119a69 Fix cooldown check 2dcf3543 Don't quote {posargs} in tox.ini 7d5c0086 Cleanup .zuul.yaml 3e6a688d Support multiple detection types in health policy c5d4f5d2 Removed extra underlines in tests c55f6e59 Remove old tempest remanents from main repo facd502b Multiple detection modes spec 682304af Node poll URL improvements e1b8701f Propagate node creation errors 1c92710d Fail-fast on locked resource spec 8889c25b Bump openstacksdk version to 0.17.2 8d115be8 add python 3.6 unit test job f36b1b19 switch documentation job to new PTI 446c78a1 import zuul job settings from project-config 8a2fd8d2 Fix broken schema validation 32dfa177 Delete receiver doc exist "senlin command line" comment d27cba4d Fix net check return error when net_obj get value is "None" bb66cc1e Fix test_run_workflow unittests a0865a01 Imported Translations from Zanata 3b67e510 Update reno for stable/rocky Diffstat (except docs and test files) ------------------------------------- .zuul.yaml | 206 +-- README.rst | 2 +- api-ref/source/actions.inc | 44 + api-ref/source/clusters.inc | 5 + api-ref/source/nodes.inc | 3 + api-ref/source/parameters.yaml | 14 + api-ref/source/samples/action-get-request.json | 5 + .../source/samples/cluster-recover-request.json | 5 +- api-ref/source/samples/node-recover-request.json | 5 +- contrib/kubernetes/setup.cfg | 2 +- contrib/vdu/setup.cfg | 2 +- devstack/lib/senlin | 8 +- .../contributor/policies/load_balance_v1.rst | 8 +- lower-constraints.txt | 4 +- .../legacy/senlin-dsvm-tempest-py27-api/post.yaml | 67 - .../legacy/senlin-dsvm-tempest-py27-api/run.yaml | 80 - .../senlin-dsvm-tempest-py27-functional/post.yaml | 67 - .../senlin-dsvm-tempest-py27-functional/run.yaml | 80 - .../senlin-dsvm-tempest-py27-integration/post.yaml | 67 - .../senlin-dsvm-tempest-py27-integration/run.yaml | 99 -- .../legacy/senlin-dsvm-tempest-py35-api/post.yaml | 67 - .../legacy/senlin-dsvm-tempest-py35-api/run.yaml | 82 - .../senlin-dsvm-tempest-py35-functional/post.yaml | 67 - .../senlin-dsvm-tempest-py35-functional/run.yaml | 81 - .../senlin-dsvm-tempest-py35-integration/post.yaml | 67 - .../senlin-dsvm-tempest-py35-integration/run.yaml | 99 -- .../notes/action-purge-11db5d8018b8389a.yaml | 4 + .../notes/action-update-api-fc51b1582c0b5902.yaml | 7 + .../notes/bug-1789488-75ee756a53722cd1.yaml | 6 + .../notes/bug-1811161-c6416ad27ab0a2ce.yaml | 6 + .../notes/bug-1811294-262d4b9cced3f505.yaml | 6 + .../notes/bug-1813089-db57e7bdfd3983ac.yaml | 7 + .../notes/bug-1815540-2664a975db5fafc8.yaml | 6 + .../notes/bug-1817379-23dd2c925259d5f2.yaml | 5 + .../notes/bug-1817604-41d4b8f6c6f920e4.yaml | 9 + ...ter-scale-action-conflict-0e1e64591e943e25.yaml | 22 + ...l-fast-on-locked-resource-eee28572dc40009a.yaml | 15 + .../health-manager-fixes-d5955f9af88102fc.yaml | 9 + ...y-mutiple-detection-types-10bfdc80771278cb.yaml | 17 + ...s-upgrade-check-framework-b9db3bb9db8d1015.yaml | 13 + releasenotes/source/index.rst | 1 + .../locale/en_GB/LC_MESSAGES/releasenotes.po | 113 ++ .../source/locale/fr/LC_MESSAGES/releasenotes.po | 63 + releasenotes/source/rocky.rst | 6 + requirements.txt | 4 +- senlin/__init__.py | 15 - senlin/api/common/wsgi.py | 7 +- senlin/api/middleware/fault.py | 4 + senlin/api/openstack/history.rst | 11 + senlin/api/openstack/v1/actions.py | 23 + senlin/api/openstack/v1/router.py | 4 + senlin/api/openstack/v1/version.py | 2 +- senlin/cmd/api.py | 5 +- senlin/cmd/api_wsgi.py | 3 - senlin/cmd/engine.py | 6 +- senlin/cmd/manage.py | 55 +- senlin/cmd/status.py | 83 + senlin/common/config.py | 3 + senlin/common/consts.py | 48 +- senlin/common/exception.py | 32 +- senlin/common/policies/actions.py | 11 + senlin/common/schema.py | 10 +- senlin/common/utils.py | 12 +- senlin/db/api.py | 23 + senlin/db/sqlalchemy/api.py | 373 +++-- senlin/db/sqlalchemy/models.py | 12 + senlin/drivers/base.py | 1 + senlin/drivers/os/__init__.py | 2 + senlin/drivers/os/keystone_v3.py | 4 +- senlin/drivers/os/lbaas.py | 15 +- senlin/drivers/os/nova_v2.py | 8 +- senlin/drivers/os_test/__init__.py | 2 + senlin/drivers/os_test/glance_v2.py | 40 + senlin/drivers/os_test/nova_v2.py | 26 +- senlin/drivers/sdk.py | 7 +- senlin/engine/actions/base.py | 210 ++- senlin/engine/actions/cluster_action.py | 101 +- senlin/engine/actions/node_action.py | 31 +- senlin/engine/health_manager.py | 924 +++++++---- senlin/engine/node.py | 34 +- senlin/engine/scheduler.py | 2 +- senlin/engine/senlin_lock.py | 18 +- senlin/engine/service.py | 88 +- senlin/locale/de/LC_MESSAGES/senlin.po | 82 +- senlin/objects/action.py | 23 +- senlin/objects/cluster.py | 32 +- senlin/objects/cluster_lock.py | 4 + senlin/objects/cluster_policy.py | 9 - senlin/objects/fields.py | 14 + senlin/objects/node.py | 1 - senlin/objects/node_lock.py | 4 + senlin/objects/requests/actions.py | 11 + senlin/policies/batch_policy.py | 13 +- senlin/policies/health_policy.py | 268 ++-- senlin/policies/lb_policy.py | 9 +- senlin/policies/scaling_policy.py | 43 +- senlin/profiles/base.py | 69 +- senlin/profiles/os/nova/server.py | 163 +- .../api/middleware/test_version_negotiation.py | 16 +- .../unit/engine/actions/test_cluster_action.py | 42 +- .../unit/profiles/test_nova_server_validate.py | 6 +- senlin/version.py | 1 + setup.cfg | 4 +- tox.ini | 8 +- 196 files changed, 7123 insertions(+), 3423 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index c1c207aa..25e43337 100644 --- a/requirements.txt +++ b/requirements.txt @@ -14 +14 @@ microversion-parse>=0.2.1 # Apache-2.0 -openstacksdk>=0.11.2 # Apache-2.0 +openstacksdk>=0.24.0 # Apache-2.0 @@ -19,0 +20 @@ oslo.log>=3.36.0 # Apache-2.0 +oslo.reports>=1.18.0 # Apache-2.0 @@ -24,0 +26 @@ oslo.service!=1.28.1,>=1.24.0 # Apache-2.0 +oslo.upgradecheck>=0.1.0 # Apache-2.0

1 0

neutron-fwaas 14.0.0 (stein)
by no-reply＠openstack.org 10 Apr '19

10 Apr '19

We exuberantly announce the release of: neutron-fwaas 14.0.0: OpenStack Networking FWaaS This release is part of the stein release series. The source is available from: https://git.openstack.org/cgit/openstack/neutron-fwaas Download the package from: https://tarballs.openstack.org/neutron-fwaas/ Please report issues through: https://bugs.launchpad.net/neutron/+bugs For more details, please see below. Changes in neutron-fwaas 13.0.0.0rc1..14.0.0 -------------------------------------------- 4a8687e3f Add new upgrade check cc2e0a3f0 Update lower-constraints to be same as in Neutron 2860abca2 Change openstack-dev to openstack-discuss 9844e5e09 Fix firewall rule 'shared' check in updating fwp 68e25e05c fix tox python3 overrides ea08d6fd5 add python 3.7 unit test job 5694e2dba Add service checks before trying to configure it a48e1316f Remove midonet job 36ca752e8 Fix gate issues on master e7f2f781e FWaaS v1->v2 DB migration 0e968fa0c Removing FWaaS v1 source code 55874d06b Change netns tests with oslo.privsep to check netns links f1d40107e Define types for C calls in netlink_lib 9f8709b39 doc: Add policy reference 328874382 Convert policy.json into policy-in-code 781a06c98 Replace ryu with os_ken 2a7994851 Move port validation support into the driver fa48d16d6 ICMPv6 is not an available protocol when creating firewall rule 778ddb1ee Switch to tempest.common.utils.requires_ext f32927857 use neutron-lib for _model_query 1db799a09 Correct package name libnetfilter-log on CentOS c0d28ecc2 Add python 3.6 unit test job 68698cbe9 [Trivial Fix] modify spelling error of "resource" 2b685096d Update tox minversion to 2.0 d86921845 Increment versioning with pbr instruction 4dbb3a352 Adding UTs for firewall driver_api 48b82f7c9 Subscribe Neutron port update events for FWG Logging handling f8e4a193e Fix associating firewall group with DVR/L3HA port 314e1de7f opt in for neutron-lib consumption patches 55d9529c3 Add functional test for FWaaS L3 logging driver 3f6d79652 use common rpc and exceptions from neutron-lib fb14c43da add local tox targets for pep8 and py3 a968d8225 remove external_network_bridge option 956190357 Use templates for cover and lower-constraints 4d058ab38 add python 3.6 unit test job 536de58f3 switch documentation job to new PTI 9b4bb440f import zuul job settings from project-config 5519d771e Switch to neutron-lib version of fake_notifier 6ccdd943a Remove remaining NFLOG rules on deleting log resource 93c71ce98 Should forward only first accepted packet to table 91 and 92 9f6150a58 Update neutron import 14822da40 Add dependency for generating reno e63882d43 Load neutron_fwaas.conf with '--config-file' for neutron-server 55254d4bd Update reno for stable/rocky Diffstat (except docs and test files) ------------------------------------- .gitignore | 1 + .zuul.yaml | 56 +- devstack/README.rst | 28 +- devstack/plugin.sh | 81 +- devstack/settings | 2 - etc/neutron/policy.d/neutron-fwaas.json | 52 - etc/oslo-policy-generator/policy.conf | 3 + lower-constraints.txt | 34 +- neutron_fwaas/cmd/__init__.py | 0 neutron_fwaas/cmd/upgrade_checks/__init__.py | 0 neutron_fwaas/cmd/upgrade_checks/checks.py | 40 + neutron_fwaas/cmd/v1_to_v2_db_migration.py | 136 ++ neutron_fwaas/common/exceptions.py | 4 +- neutron_fwaas/db/firewall/firewall_db.py | 588 +------- .../db/firewall/firewall_router_insertion_db.py | 98 -- neutron_fwaas/db/firewall/v2/firewall_db_v2.py | 10 +- neutron_fwaas/db/models/head.py | 2 - neutron_fwaas/policies/base.py | 17 + neutron_fwaas/policies/firewall_group.py | 113 ++ neutron_fwaas/policies/firewall_policy.py | 113 ++ neutron_fwaas/policies/firewall_rule.py | 136 ++ .../privileged/netfilter_log/libnetfilter_log.py | 14 +- neutron_fwaas/privileged/netlink_lib.py | 37 +- neutron_fwaas/services/firewall/fwaas_plugin.py | 444 ------ neutron_fwaas/services/firewall/fwaas_plugin_v2.py | 44 +- .../firewall/service_drivers/agents/agents.py | 23 +- .../agents/drivers/linux/iptables_fwaas.py | 431 ------ .../agents/drivers/linux/iptables_fwaas_v2.py | 40 +- .../linux/l2/openvswitch_firewall/firewall.py | 32 +- .../drivers/linux/l2/openvswitch_firewall/rules.py | 11 +- .../service_drivers/agents/firewall_agent_api.py | 2 +- .../firewall/service_drivers/agents/l2/fwaas_v2.py | 2 +- .../agents/l3reference/firewall_l3_agent.py | 428 ------ .../agents/l3reference/firewall_l3_agent_v2.py | 2 +- .../firewall/service_drivers/driver_api.py | 6 + .../logapi/agents/drivers/iptables/driver.py | 4 + .../services/logapi/agents/drivers/iptables/log.py | 32 +- neutron_fwaas/services/logapi/common/log_db_api.py | 19 +- .../services/logapi/common/port_callback.py | 40 + .../functional/services/logapi/agents/__init__.py | 0 .../services/logapi/agents/drivers/__init__.py | 0 .../logapi/agents/drivers/iptables/__init__.py | 0 .../logapi/agents/drivers/iptables/test_log.py | 567 ++++++++ .../unit/db/firewall/v2/test_firewall_db_v2.py | 48 +- .../linux/l2/openvswitch_firewall/test_rules.py | 7 +- .../agents/drivers/linux/test_iptables_fwaas.py | 412 ------ .../agents/drivers/linux/test_iptables_fwaas_v2.py | 83 ++ .../service_drivers/agents/l2/test_fwaas_v2.py | 2 +- .../agents/l3reference/test_firewall_l3_agent.py | 361 ----- .../firewall/service_drivers/agents/test_agents.py | 4 +- .../firewall/service_drivers/test_driver_api.py | 291 ++++ .../unit/services/firewall/test_fwaas_plugin.py | 786 ---------- .../unit/services/firewall/test_fwaas_plugin_v2.py | 55 +- .../logapi/agents/drivers/iptables/test_log.py | 35 +- .../unit/services/logapi/agents/l3/test_fwg_log.py | 2 +- .../unit/services/logapi/common/test_log_db_api.py | 38 +- .../services/logapi/common/test_port_callback.py | 203 +++ .../notes/remove_fwaas_v1-15c6e19484f46d1b.yaml | 8 + releasenotes/source/index.rst | 1 + releasenotes/source/rocky.rst | 6 + requirements.txt | 19 +- setup.cfg | 17 +- test-requirements.txt | 4 +- tox.ini | 43 +- 90 files changed, 2422 insertions(+), 6478 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index f4bd3c06a..0d9e06614 100644 --- a/requirements.txt +++ b/requirements.txt @@ -4 +4 @@ -pbr!=2.1.0,>=2.0.0 # Apache-2.0 +pbr>=4.0.0 # Apache-2.0 @@ -8 +8 @@ netaddr>=0.7.18 # BSD -SQLAlchemy!=1.1.5,!=1.1.6,!=1.1.7,!=1.1.8,>=1.0.10 # MIT +SQLAlchemy>=1.2.0 # MIT @@ -11 +11,2 @@ six>=1.10.0 # MIT -neutron-lib>=1.18.0 # Apache-2.0 +neutron-lib>=1.25.0 # Apache-2.0 +os-ken >= 0.3.0 # Apache-2.0 @@ -13 +14 @@ oslo.config>=5.2.0 # Apache-2.0 -oslo.db>=4.27.0 # Apache-2.0 +oslo.db>=4.37.0 # Apache-2.0 @@ -18,2 +19,2 @@ oslo.utils>=3.33.0 # Apache-2.0 -oslo.privsep>=1.23.0 # Apache-2.0 -pyroute2>=0.4.21;sys_platform!='win32' # Apache-2.0 (+ dual licensed GPL2) +oslo.privsep>=1.32.0 # Apache-2.0 +pyroute2>=0.5.3;sys_platform!='win32' # Apache-2.0 (+ dual licensed GPL2) @@ -21,0 +23,6 @@ pyzmq>=14.3.1 # LGPL+BSD + +# The comment below indicates this project repo is current with neutron-lib +# and should receive neutron-lib consumption patches as they are released +# in neutron-lib. It also implies the project will stay current with TC +# and infra initiatives ensuring consumption patches can land. +# neutron-lib-current diff --git a/test-requirements.txt b/test-requirements.txt index ff121d7b7..82670ae2d 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -17 +17 @@ testscenarios>=0.4 # Apache-2.0/BSD -WebOb>=1.7.1 # MIT +WebOb>=1.8.2 # MIT @@ -21 +21 @@ PyMySQL>=0.7.6 # MIT License -psycopg2>=2.6.2 # LGPL/ZPL +psycopg2>=2.7.3 # LGPL/ZPL

1 0

neutron-dynamic-routing 14.0.0 (stein)
by no-reply＠openstack.org 10 Apr '19

10 Apr '19

We jubilantly announce the release of: neutron-dynamic-routing 14.0.0: Neutron Dynamic Routing This release is part of the stein release series. The source is available from: https://git.openstack.org/cgit/openstack/neutron-dynamic-routing Download the package from: https://tarballs.openstack.org/neutron-dynamic-routing/ Please report issues through: https://bugs.launchpad.net/neutron/+bugs For more details, please see below. Changes in neutron-dynamic-routing 13.0.0..14.0.0 ------------------------------------------------- c27bb1f Fix installation of docker when docker-engine is not available 69e9888 Implement DVR-aware fixed IP lookups fc2dae7 Enable MP-BGP capabilities in Ryu BGP driver 7358ad7 add python 3.7 unit test job 51986c5 stop using common db mixin methods a3a5470 doc: Add policy reference 19aed83 Fix gate issues on master a861327 Add agent_updated to BgpDrAgentNotifyApi notifier 1241f9b Convert policy.json into policy-in-code 34655a8 Migrate neutron-dynamic-routing from Ryu to os-ken a89b332 neutron-lib version bump to 1.21.0 266246f use common rpc and exceptions from neutron-lib 6709a26 use openstack-lower-constraints-jobs-neutron job template 434a604 Change openstack-dev to openstack-discuss 367201c load neutron objects using neutron-lib 06b8542 add local tox targets for pep8 and py3 8170e51 use neutron-lib for _model_query 155f663 use context manager from neutron-lib 3ff0ba1 Update min tox version to 2.0 7c013a4 removing older python version 3.4 from setup.cfg 7f82a19 Remove unnecessary mocking of get_admin_context f245c52 fix tox python3 overrides f358d79 Fix _get_config_generator_config_definition() typo 20b8f4c Increment versioning with pbr instruction 4e81e36 Use templates for cover and lower-constraints fe41d0a opt in for neutron-lib consumption patches 1624300 add python 3.6 unit test job de57190 Fix unit tests with py3.6 8708ced switch documentation job to new PTI a816e98 import zuul job settings from project-config b10e196 Update reno for stable/rocky 2a94485 Remove setting of DEVSTACK_GATE_EXERCISES 8e25331 Add release notes link in README bd61ead Improve patching of sys.argv 4808c72 Move 4byte_asn scenario test to basic dir Diffstat (except docs and test files) ------------------------------------- .gitignore | 1 + .zuul.yaml | 23 +- README.rst | 3 + devstack/lib/dr | 6 +- devstack/settings | 2 +- etc/README.txt | 15 +- etc/neutron/policy.d/dynamic_routing.conf | 22 -- etc/oslo-policy-generator/policy.conf | 3 + lower-constraints.txt | 4 +- .../api/rpc/agentnotifiers/bgp_dr_rpc_agent_api.py | 11 +- neutron_dynamic_routing/db/bgp_db.py | 248 +++++++++++++++------ .../db/bgp_dragentscheduler_db.py | 8 +- neutron_dynamic_routing/policies/__init__.py | 25 +++ neutron_dynamic_routing/policies/base.py | 17 ++ neutron_dynamic_routing/policies/bgp_dragent.py | 67 ++++++ neutron_dynamic_routing/policies/bgp_peer.py | 71 ++++++ neutron_dynamic_routing/policies/bgp_speaker.py | 127 +++++++++++ .../services/bgp/agent/bgp_dragent.py | 2 +- .../bgp/agent/driver/{ryu => os_ken}/__init__.py | 0 .../bgp/agent/driver/{ryu => os_ken}/driver.py | 43 ++-- neutron_dynamic_routing/services/bgp/bgp_plugin.py | 37 ++- .../bgp/scheduler/bgp_dragent_scheduler.py | 4 +- .../{4byte_asn => basic}/test_4byte_asn.py | 4 +- .../agentnotifiers/test_bgp_dr_rpc_agent_api.py | 7 + .../unit/services/bgp/agent/test_bgp_dragent.py | 22 +- .../services/bgp/driver/os_ken}/__init__.py | 0 .../bgp/driver/{ryu => os_ken}/test_driver.py | 182 +++++++-------- .../bgp/scheduler/test_bgp_dragent_scheduler.py | 13 +- .../run.yaml | 1 - .../run.yaml | 2 + .../post.yaml | 0 .../run.yaml | 12 +- .../dvr-aware-announcements-24bfcb8fee87161d.yaml | 8 + .../notes/mp-bgp-support-d408e8569e94d07f.yaml | 7 + releasenotes/source/index.rst | 1 + releasenotes/source/rocky.rst | 6 + requirements.txt | 9 +- setup.cfg | 10 +- test-requirements.txt | 1 - tox.ini | 34 ++- 60 files changed, 1089 insertions(+), 327 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 1ef7c17..26f2b38 100644 --- a/requirements.txt +++ b/requirements.txt @@ -12 +12,2 @@ six>=1.10.0 # MIT -neutron-lib>=1.18.0 # Apache-2.0 +neutron-lib>=1.21.0 # Apache-2.0 +os-ken>=0.3.0 # Apache-2.0 @@ -20,0 +22,6 @@ neutron>=13.0.0.0b2 # Apache-2.0 + +# The comment below indicates this project repo is current with neutron-lib +# and should receive neutron-lib consumption patches as they are released +# in neutron-lib. It also implies the project will stay current with TC +# and infra initiatives ensuring consumption patches can land. +# neutron-lib-current diff --git a/test-requirements.txt b/test-requirements.txt index e24f784..7e59b71 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -23 +22,0 @@ tempest>=17.1.0 # Apache-2.0 -ryu>=4.24 # Apache-2.0

1 0

neutron-lbaas-dashboard 6.0.0 (stein)
by no-reply＠openstack.org 10 Apr '19

10 Apr '19

We jubilantly announce the release of: neutron-lbaas-dashboard 6.0.0: Horizon panels for Neutron LBaaS This release is part of the stein release series. The source is available from: https://git.openstack.org/cgit/openstack/neutron-lbaas-dashboard Download the package from: https://pypi.org/project/neutron-lbaas-dashboard Please report issues through: https://storyboard.openstack.org/#!/project/907 For more details, please see below. Changes in neutron-lbaas-dashboard 5.0.0.0rc1..6.0.0 ---------------------------------------------------- cddbf69 Fix neutron-lbaas-dashboard and octavia-dashboard 2fde3c5 Add nodejs10 jobs on bionic. d51abb9 Switch to horizon-nodejs4-jobs template d50dc1e Display error when entering a non-integer ba14bba Imported Translations from Zanata 2ec679a Update home-page 2a9d513 Use template for lower-constraints ac4c333 Change openstack-dev to openstack-discuss f1327e0 Update min tox version to 2.0 7b8038b Update the hacking to latest 8d3a6d2 Increment versioning with pbr instruction 7c2a822 Update the URL in HACKING.rst d5c9f00 fix tox python3 overrides b010259 Imported Translations from Zanata c3a05d5 Add Python 3.6 unit test jobs c587ae6 Imported Translations from Zanata 10d09ca sni_container_refs needed if we want to use sni 8658ca4 Imported Translations from Zanata 56605ac switch documentation job to new PTI e17f70d import zuul job settings from project-config 0ddf877 Remove obsolete gate hooks 0f499eb Drop nose dependencies 9f7b22f Removes testr and switches cover to karma-coverage 29487dd Replace noop tests with registration test d87d0e3 Cannot update ssl certificate when update listener Diffstat (except docs and test files) ------------------------------------- .testr.conf | 7 - .zuul.yaml | 15 +- HACKING.rst | 4 +- lower-constraints.txt | 6 +- neutron_lbaas_dashboard/api/rest/__init__.py | 2 +- .../api/rest/{lbaasv2.py => nlbaasv2.py} | 41 +-- .../dashboards/project/ngloadbalancersv2/panel.py | 2 +- .../dashboards/project/ngloadbalancersv2/views.py | 2 +- .../_1481_project_ng_loadbalancersv2_panel.py | 4 +- neutron_lbaas_dashboard/karma.conf.js | 11 +- .../locale/de/LC_MESSAGES/djangojs.po | 218 ++++++++++++- .../locale/id/LC_MESSAGES/djangojs.po | 218 ++++++++++++- .../locale/ja/LC_MESSAGES/djangojs.po | 352 ++++++++++++++++++--- .../locale/ko_KR/LC_MESSAGES/djangojs.po | 205 +++++++++++- .../{lbaasv2.service.js => nlbaasv2.service.js} | 94 +++--- ...v2.service.spec.js => nlbaasv2.service.spec.js} | 54 ++-- .../actions/create/create.action.service.js | 10 +- .../actions/create/create.action.service.spec.js | 4 +- .../actions/create/wizard.controller.js | 8 +- .../actions/create/wizard.controller.spec.js | 8 +- .../actions/delete/delete.action.service.js | 8 +- .../actions/delete/delete.action.service.spec.js | 8 +- .../actions/edit/edit.action.service.js | 10 +- .../actions/edit/edit.action.service.spec.js | 4 +- .../actions/edit/wizard.controller.js | 8 +- .../actions/edit/wizard.controller.spec.js | 8 +- .../healthmonitors/actions/row-actions.service.js | 12 +- .../actions/row-actions.service.spec.js | 6 +- .../healthmonitors/detail.controller.js | 8 +- .../healthmonitors/detail.controller.spec.js | 8 +- .../healthmonitors/detail.html | 6 +- .../healthmonitors/healthmonitors.module.js | 4 +- .../healthmonitors/healthmonitors.module.spec.js | 2 +- .../listeners/actions/batch-actions.service.js | 14 +- .../actions/batch-actions.service.spec.js | 6 +- .../listeners/actions/create/wizard.controller.js | 8 +- .../actions/create/wizard.controller.spec.js | 8 +- .../actions/delete/delete.action.service.js | 8 +- .../actions/delete/delete.action.service.spec.js | 8 +- .../listeners/actions/edit/wizard.controller.js | 8 +- .../actions/edit/wizard.controller.spec.js | 8 +- .../listeners/actions/row-actions.service.js | 16 +- .../listeners/actions/row-actions.service.spec.js | 6 +- .../listeners/detail.controller.js | 8 +- .../listeners/detail.controller.spec.js | 8 +- .../{lbaasv2 => nlbaasv2}/listeners/detail.html | 6 +- .../listeners/listeners.module.js | 4 +- .../listeners/listeners.module.spec.js | 2 +- .../listeners/table.controller.js | 10 +- .../listeners/table.controller.spec.js | 12 +- .../{lbaasv2 => nlbaasv2}/listeners/table.html | 6 +- .../actions/associate-ip/modal.controller.js | 4 +- .../actions/associate-ip/modal.controller.spec.js | 20 +- .../loadbalancers/actions/associate-ip/modal.html | 0 .../actions/associate-ip/modal.service.js | 10 +- .../actions/associate-ip/modal.service.spec.js | 4 +- .../loadbalancers/actions/batch-actions.service.js | 16 +- .../actions/batch-actions.service.spec.js | 4 +- .../actions/create/wizard.controller.js | 8 +- .../actions/create/wizard.controller.spec.js | 8 +- .../actions/delete/delete.action.service.js | 8 +- .../actions/delete/delete.action.service.spec.js | 8 +- .../actions/disassociate-ip/modal.service.js | 6 +- .../actions/disassociate-ip/modal.service.spec.js | 4 +- .../actions/edit/wizard.controller.js | 8 +- .../actions/edit/wizard.controller.spec.js | 8 +- .../loadbalancers/actions/row-actions.service.js | 16 +- .../actions/row-actions.service.spec.js | 4 +- .../loadbalancers/detail.controller.js | 10 +- .../loadbalancers/detail.controller.spec.js | 8 +- .../loadbalancers/detail.html | 8 +- .../loadbalancers/loadbalancers.module.js | 4 +- .../loadbalancers/loadbalancers.module.spec.js | 2 +- .../loadbalancers/loadbalancers.service.js | 10 +- .../loadbalancers/loadbalancers.service.spec.js | 6 +- .../loadbalancers/table.controller.js | 12 +- .../loadbalancers/table.controller.spec.js | 8 +- .../{lbaasv2 => nlbaasv2}/loadbalancers/table.html | 6 +- .../members/actions/batch-actions.service.js | 10 +- .../members/actions/batch-actions.service.spec.js | 4 +- .../actions/edit-weight/modal.controller.js | 6 +- .../actions/edit-weight/modal.controller.spec.js | 8 +- .../members/actions/edit-weight/modal.html | 0 .../members/actions/edit-weight/modal.service.js | 10 +- .../actions/edit-weight/modal.service.spec.js | 4 +- .../members/actions/row-actions.service.js | 10 +- .../members/actions/row-actions.service.spec.js | 6 +- .../update-list/update-member-list.service.js | 10 +- .../update-list/update-member-list.service.spec.js | 4 +- .../actions/update-list/wizard.controller.js | 8 +- .../actions/update-list/wizard.controller.spec.js | 8 +- .../members/detail.controller.js | 12 +- .../members/detail.controller.spec.js | 14 +- .../{lbaasv2 => nlbaasv2}/members/detail.html | 4 +- .../members/members.module.js | 4 +- .../members/members.module.spec.js | 2 +- .../members/members.service.js | 10 +- .../members/members.service.spec.js | 6 +- .../members/table.controller.js | 14 +- .../members/table.controller.spec.js | 10 +- .../{lbaasv2 => nlbaasv2}/members/table.html | 6 +- .../nlbaasv2.module.js} | 22 +- .../nlbaasv2.module.spec.js} | 18 +- .../lbaasv2.scss => nlbaasv2/nlbaasv2.scss} | 10 +- .../pools/actions/create/create.action.service.js | 10 +- .../actions/create/create.action.service.spec.js | 4 +- .../pools/actions/create/wizard.controller.js | 8 +- .../pools/actions/create/wizard.controller.spec.js | 8 +- .../pools/actions/delete/delete.action.service.js | 8 +- .../actions/delete/delete.action.service.spec.js | 8 +- .../pools/actions/edit/edit.action.service.js | 10 +- .../pools/actions/edit/edit.action.service.spec.js | 4 +- .../pools/actions/edit/wizard.controller.js | 8 +- .../pools/actions/edit/wizard.controller.spec.js | 8 +- .../pools/actions/row-actions.service.js | 14 +- .../pools/actions/row-actions.service.spec.js | 6 +- .../pools/detail.controller.js | 8 +- .../pools/detail.controller.spec.js | 8 +- .../{lbaasv2 => nlbaasv2}/pools/detail.html | 8 +- .../{lbaasv2 => nlbaasv2}/pools/pools.module.js | 4 +- .../pools/pools.module.spec.js | 2 +- .../util/validators/validate-unique.js | 10 +- .../util/validators/validate-unique.spec.js | 6 +- .../widgets/detail/detail-status.directive.js | 8 +- .../widgets/detail/detail-status.directive.spec.js | 7 +- .../widgets/detail/detail-status.html | 0 .../widgets/table/table-status.directive.js | 8 +- .../widgets/table/table-status.directive.spec.js | 6 +- .../widgets/table/table-status.html | 0 .../certificates/certificates.controller.js | 4 +- .../certificates/certificates.controller.spec.js | 6 +- .../workflow/certificates/certificates.help.html | 0 .../workflow/certificates/certificates.html | 2 +- .../workflow/listener/listener.controller.js | 4 +- .../workflow/listener/listener.controller.spec.js | 6 +- .../workflow/listener/listener.help.html | 0 .../workflow/listener/listener.html | 8 +- .../loadbalancer/loadbalancer.controller.js | 6 +- .../loadbalancer/loadbalancer.controller.spec.js | 6 +- .../workflow/loadbalancer/loadbalancer.help.html | 0 .../workflow/loadbalancer/loadbalancer.html | 2 +- .../workflow/members/members.controller.js | 8 +- .../workflow/members/members.controller.spec.js | 12 +- .../workflow/members/members.help.html | 0 .../workflow/members/members.html | 2 +- .../workflow/modal.service.js | 8 +- .../workflow/modal.service.spec.js | 4 +- .../workflow/model.service.js | 8 +- .../workflow/model.service.spec.js | 6 +- .../workflow/monitor/monitor.controller.js | 6 +- .../workflow/monitor/monitor.controller.spec.js | 6 +- .../workflow/monitor/monitor.help.html | 0 .../workflow/monitor/monitor.html | 2 +- .../workflow/pool/pool.help.html | 0 .../{lbaasv2 => nlbaasv2}/workflow/pool/pool.html | 0 .../workflow/workflow.service.js | 6 +- .../workflow/workflow.service.spec.js | 4 +- .../pages/project/network/__init__.py | 0 .../pages/project/network/loadbalancerspage.py | 22 -- .../test_loadbalancers.py => unit/registration.py} | 23 +- requirements.txt | 2 +- setup.cfg | 4 +- test-requirements.txt | 3 - tools/gate/integration/commons | 5 - tools/gate/integration/post_test_hook.sh | 19 -- tools/gate/integration/pre_test_hook.sh | 30 -- tox.ini | 30 +- 176 files changed, 1616 insertions(+), 1067 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index f8d2bdf..4ae5423 100644 --- a/requirements.txt +++ b/requirements.txt @@ -5 +5 @@ -horizon>=13.0.0 # Apache-2.0 +horizon>=14.0.0.0b3 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index 8e391d4..c6474c7 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -8 +7,0 @@ ddt>=1.0.1 # MIT -django-nose>=1.4.4 # BSD @@ -10 +8,0 @@ python-subunit>=1.0.0 # Apache-2.0/BSD -nose-exclude>=0.3.0 # LGPL @@ -13 +10,0 @@ oslotest>=3.2.0 # Apache-2.0 -testrepository>=0.0.18 # Apache-2.0/BSD

1 0

neutron 14.0.0 (stein)
by no-reply＠openstack.org 10 Apr '19

10 Apr '19

We are excited to announce the release of: neutron 14.0.0: OpenStack Networking This release is part of the stein release series. The source is available from: https://git.openstack.org/cgit/openstack/neutron Download the package from: https://tarballs.openstack.org/neutron/ Please report issues through: https://bugs.launchpad.net/neutron/+bugs For more details, please see below. Changes in neutron 13.0.0.0rc1..14.0.0 -------------------------------------- d1696619c5 Reject min-bw rule operations on non-physnet networks/ports d33e5f5c17 Disable fullstack job from gate and make it non-voting 6ee786ab95 Add check for external_network_bridge in neutron-status 7369b69e2e Dynamically increase DHCP process queue green pool size aa221a3c09 Migrate legacy jobs to Ubuntu Bionic a5244d6d44 More accurate agent restart state transfer 636f1b5394 Define qos-rules-alias extension 303598289d Switch neutron-functional-with-wsgi job to zuul v3 syntax 4777633e8b Fix neutron-status upgrade check CLI tool 2dc61dfbcc Utilize bulk port creation ops in ml2 plugin 7cccaf0616 FUP Networking guide: Guaranteed Minimum Bandwidth b6550e568d Remove "msg" from tasks in ansible roles 252598b088 Networking guide: Guaranteed Minimum Bandwidth 6ef6f2b59b Migrate fullstack job definition to zuulv3 syntax 4350ed3c35 Better handle ports in security groups 66eb1e29f3 Enable ipv6_forwarding in HA router's namespace 8e4f625da6 Fix pylint R1717 (consider-using-dict-comprehension) refactor messages 1e9086f6e2 Use dynamic lazy mode for fetching security group rules 72e783f14e Add documentation for subnet onboard 86b3993cee Fix misuse of assertTrue/assertFalse 44382ac446 Specify tenant_id in TestRevisionPlugin objects 25c432a05a Add rootwrap filters to kill state change monitor 33110fb7e8 Migrate neutron-functional job to zuul v3 syntax c3ad500df0 [Fullstack] Don't compile ovs kernel module on Ubuntu Bionic b3d26ab2dd Migrate neutron-tempest-dvr-ha-multinode-full job to zuulv3 eaf990b2bc Fix pep8 E128 warnings in non-test code 634906b50c Use allocated trunk_id in TestOVSDBHandler 34627a5bb9 Fix fwaas_v2 driver string in docs 2ac0ee0b28 Fix pylint E1128 (assignment-from-no-return) in l3-agent 8fec1ffc83 Set initial ha router state in neutron-keepalived-state-change 1813ec74cc Do not rise exception if OVS Queue is not present when being deleted 732dbdaf5e Fail placement sync if _get_rp_by_name() fails 59600afc5a [doc] Add network segment ranges into admin guide 7a285a7fcc consume is_bsd from neutron-lib d3a119bbbe consume UnorderedList from neutron-lib beb2f2ef15 Fix handling no qos_queues while removing min bw limit rule c1999a2b22 Fix QoS rule update c04b8ddd90 Join on explcit relationship paths 08da9f8cce Fix a couple of bw burst calc unit tests for macs 33f404a519 Devstack plugin for network-segment-range api 5e0fc3d2da Allow sharing of security groups via RBAC mechanism c2ab2626f8 Mark dvr_ha_router_failover tests as unstable b09b44608b Remove deprecated 'external_network_bridge' option 8c2a16796b Fix fullstack test_dscp_marking_packets test 8c213e4590 When converting sg rules to iptables, do not emit dport if not supported a01b7125cd Use network segment ranges for segment allocation 74c51a2e53 Drive binding by placement allocation 93d556e434 Add TC filter functions implemented with pyroute2 92f1281b69 Add a more robust method to check OVSDB values in BaseOVSTestCase 70fb9c6479 Mock router info functions for a functional case 22f55822aa Catch OVSFWTagNotFound in update_port_filter d9e0bab6ac DVR-HA: Unbinding a HA router from agent does not clear HA interface 05b0144e83 [Fullstack] Use newer openvswitch 563a536d02 Support Network Segment Range CRUD as extensions 9c56f8386c Remove quota_db backward compat file 45a7a45961 Store journal log in functional tests results 9f41850ba3 remove neutron.db.api references f08de5cbe9 Make "phys_brs" argument in OVSAgentExtensionAPI optional 6ae228cc2e Spawn metadata proxy on dvr ha standby routers 8f656306f2 Revert "Restart all L3 agents in test that check no packet loss in HA routers" b197f7c1c4 Delete port binding level for deleted bindings 55f2336981 Add method to tox to use local neutron-lib with unit tests 798c6c731f [Functional tests] Change way how conntrack entries are checked 61b231a999 Change process name of neutron-server to match worker role fe4e7724cd Don't disable radvd if radvd if it wasn't initialized 1cf30c552d Add oslo.privsep to config-generator list e6351ab11e [Functional] Don't assert that HA router don't have IPs configured 9e8e987e6c Placement reporting service plugin bdd3540554 Restart all L3 agents in test that check no packet loss in HA routers 58f9c96877 Bump neutron-lib requirement to 1.25.0 22369ba7fe Do not print router resize messages when not resizing b3dae9fae4 add python 3.7 unit test job b593a4914c Cleanup DVR SNAT port list creation code cc4d5a2561 Fix regression with SG read API with empty ruleset d5896025b7 Enable adoption of subnets into a subnet pool 9bfe63cf07 Update appdirs to 1.4.3 cc8808d539 Add QoS minimum egress bandwidth rule into ovs-agent 1ee18775a9 DVR edge router: avoid accidental centralized floating IP remove abc8524db7 Use constant from neutron-lib c6ae4fb8a2 Bump pbr version to 4.0.0 e5e56ba0f0 Switch neutron-tempest-dvr-ha-multinode-full job to python3 1d41f39ddf Fix slow SG api calls when limiting fields 7b973d151e Fix pylint R1716 (chained-comparison) refactor messages fba5eb694b Fix pylint R1714 (consider-using-in) refactor messages facc4e94ca Reject QoS minimum bandwidth rule updates for bound ports as NotImplemented 84f8ae9d1f Add "rpc_response_max_timeout" config variable in OVS agent 7e208c3014 Bump pylint version to one that supports python3.7 4ab00d3471 Class to represent Placement state and sync 648ab82a4b New agent attribute: resources_synced 3f38c58cff Add job from openstacksdk to avoid regressing d802fad8a9 Avoid loading same service plugin more than once a05e1369b0 Add support for binding activate and deactivate 7e09b25b96 Modify api and rpc default number of workers 56ac61fac0 Use subnet without dhcp in portforwarding functional tests 789438ec9a Switch multinode grenade jobs to python3 cd31eae33d Use pyroute2 to check vlan/vxlan in use a10281bf23 Call _safe_router_removed during pool resize testing d841ce72bf Run revision bump operations en masse 01073caf52 Consume constant from neutron-lib: DHCPV6_CLIENT_PORT 05644f79ad Retrieve devices with link not present 5fff6e3b94 Bump pyroute2 version to 0.5.3 f0051e68f6 use api def ALIAS in _supported_extension_aliases 006d4d0735 Add delete_tc_policy_class using pyroute2 4a92b0b142 Add add_tc_policy_class and list_tc_policy_classes using pyroute2 17a7a62e84 Implement delete_tc_qdisc using pyroute2 e8b7e768a2 Add dependency for service plugin 769e971293 [OVS] Exception message when retrieving bridge-id and is not present ade5d52241 Add common neutron config options to status CLI tool 59706b4f3e Remove conntrackd comment f4eeac73e3 Fix _find_related_obj() RuntimeError output 1f104a093c Fix notification about arp entries for dvr routers c0fec67672 Add new test decorator skip_if_timeout 5b7d444b31 Not set the HA port down at regular l3-agent restart 837c9283ab Dynamically increase l3 router process queue green pool size 3c2a23ba94 Remove trunk rally scenario from plugins 84b30849c1 bump neutron-lib to 1.24.0 031a6e5246 rally-jobs: Add FloatingIP workloads: assoc/dissoc dbe04a40e5 Change common agent code to log message after failure 8362c0a050 Enhance rally-job for sec group rules to creates multiple rules 2147c70745 Change SR-IOV agent to log message after failure d8e8fe7db5 Improve invalid port ranges error message e2bb27fc34 doc: Use DocumentedRuleDefault 9926410886 Change OVS agent to log message after failure d83b3d3468 Remove redundant event listening logic from neutron/db/api ade38e4034 remove string use of neutron.common.rpc 6f927cc119 Clear old rules that have been applied before applying new rules. c4e755daa9 Remove redundant if condition check 9d5fb2fa77 Fix the way how upgrade checks are loaded 21cddc47b4 Fix update of ports cache in router_info class d7cefa56e4 Implement add_tc_qdisc and list_tc_qdiscs using pyroute2 024802aafd remove neutron.common.rpc 1746d7e0e6 Update the processing of assigned addresses when assigning addresses 7fdd6adc7a DHCP: fix default dns search name b083d39a83 Change agents to use get_devices_with_ip() a8afd1f124 Change Metering agent to log message after failure a721e6d7b9 doc: replace nova security_group_api option with use_neutron 64f2fe7060 Change log level for l3 agent router updates 414bdd4c59 Don't specify exactly IP in portforwarding functional test 98ef2ac8d6 Add some create subnet negative tests 68fd13af40 remove neutron.common.exceptions a6422ea8f9 Add Security Group scenarios to rally-jobs 24362fb973 Fix port forwarding functional tests logging d471a85931 Ensure dnsmasq is down before enabling it in restart method 4fb8b3fe4e Retrieve the device info in trunk_plumber using pyroute2 1687aaee3c use payloads for SECURITY_GROUP BEFORE_CREATE events 0239f163b1 [Configuration] Clean up .gitignore references to personal tools defdc64a9b Bump neutron-lib to 1.23.0 9a8f82a0d0 use payloads for SECURITY_GROUP BEFORE_DELETE events f2111e0354 Do not release DHCP lease when no client ID is set on port 8e29f67920 use payloads for all SUBNETPOOL_ADDRESS_SCOPE events 662512b7cc use payloads for all PORT_DEVICE events aa71530aaa Add VLAN and VXLAN link information in get_devices_info 453f39f23d use payloads for PORT BEFORE_DELETE callbacks 08bca27b93 remove unused methods in common_db_mixin c2bcb90895 Switch tempest-slow to be run on python 3 e22f1eca1e Switch tempest-multinode-full to be run on python 3 bd4c291cdf Restore tenant_id check on security group rule adds to previous semantic 6124f60297 Switch isolated metadata proxy to bind to 169.254.169.254 e108ac6bdf Add port forwarding floating IP QoS 9359366d93 Switch default functional tests to python3, add job for python2 b0d758e1b4 Fix port update deferred IP allocation with host_id + new MAC 8914f8247f Update neutron files for new over-indentation hacking rule (E117) 99f4495c94 Improve port dhcp Provisioning afdc77de05 Remove extra spaces in admin config files e7a2b6d179 Add IPWrapper.get_devices_info using PyRoute2 1382bf9a32 remove the neutron.db._model_query module 72cf434b16 shim remaining common exceptions 529f645883 Delete virtual interface "ovs-system" before load openvswitch module d50997dadb Use renamed template 'integrated-gate-py3' 4cbaa06031 Add test cases: invalidate CIDR 89efc132a5 Change DHCP agent to log message after failure a78bf152b1 Change L3 agent to log message after failure 4747de23d8 Remove IPv6 addresses in dnsmasq leases file 379a9faf62 Change duplicate OVS bridge datapath-ids 4d45699f15 Not set fip to ERROR if it exists on device ee19fa49b7 Change DVR to use ip_lib.add_ip_address() directly d519934c77 bump neutron-lib to 1.22.0 63ea9d7bcc Set lower addr to avoid IP out of range 85e1b1b0dc Correct arguments to nfct_open 26eb2509fe Always fill UDP checksums in DHCPv6 replies 2eb31f84c9 Fix performance regression adding rules to security groups 534e850392 Add lock_path in installation guide e788d29458 Support iproute2 4.15 in l3_tc_lib f1fa9529ee Revert "Skip ovsdb_monitor events for ports with ofport=-1" fd57088b36 Update team and bug ownership info f1592c42d9 Add a new configuration parameter rpc_response_max_timeout 1685982a97 Use status_code instead of status in requests abe8f6023b Fix indent level of netlink_lib.py 58de79a58b Clear residual qos rules after l2-agent restarts. f8e0a497ad Skip ovsdb_monitor events for ports with ofport=-1 ffbf65126f protect DHCP agent cache out of sync 4bb78e8c21 Fix l3-agent usage of L3AgentExtension class 65a2f86aaf Gracefully handle fetch network fail in qos extend port 0081aaa380 Remove hooks for dsvm-scenario-linuxbridge e4ab2ebcab Add neutron-tempest-iptables_hybrid job on Fedora eacdf1f18f Migrate neutron-tempest-linuxbridge job to zuulv3 and python 3 284afcf24f Lock privileged.agent.linux.ip_lib functions 4aa79ae4a5 Guideline on defining in-code policies b3416f5baf Cleanup pecan required version a055046e61 Refactor some l3_dvr_db code c6d358d4c6 Define types for C calls in netlink_lib b545c06bce Rename ironic job 374a4a1b92 use payloads for SEGMENT AFTER_DELETE events b7f0982957 Fix a minor typo in SR-IOV with ConnectX-3 section 3d70272f42 Rename README.policy.json.txt b0ed6bb04e Define missing policies for attributes with enforce_policy bc29d4843d Revert "Remove -u root as mysql is executed with root user" f36a3b35f6 Update SR-IOV configuration admin docs 7ae764eff9 Migrate neutron-tempest-dvr job to zuulv3 and python 3 ecfbc14148 port-resource-request policy rule to constant 1f3e5f91f6 neutron-tempest-iptables_hybrid job inherits from tempest-full-py3 433228dd78 Prevent bind fip to port has port forwarding 76c2881201 Make test service_plugins override simple 29f56478d1 remove the neutron.db._resource_extend module 41fe4e9629 Use ADMIN_ONLY constant in policy rules c8c201bca9 consume get_updatable_fields from neutron-lib b110264f5d cleanup SQLAlchemy required version 0364c05de1 Migrate neutron-tempest-iptables_hybrid job to zuulv3 and python 3 e83e5618b7 Don't modify global variables in unit tests 760eedf7f7 Use oslo_log instead of alembic.util in functional tests ae4b331725 fullstack: retry on updating port's IP address 92793efc06 Convert Port to OVO in db/ipam_pluggable_backend.py d1a3c2a379 Convert Subnet to OVO in ipam_pluggable_backend.py 30ba87e5e0 Revert "Log alembic migration script's output with oslo_log" 55c5139d79 doc: Add policy reference 5dd2bc0a3c Remove polling from test_create_bridges 6d99fb19ab Use publish for AGENT AFTER_CREATE/AFTER_UPDATE 6ad0c2908e Define popular policy rules by constants (part 2) 09311c34f9 Add ipxe6 dnsmasq tag to enable ipv6 dhcp client matching d6c6c68e46 Define popular policy rules by constants aa88be0689 remove context_manager from neutron 7197079a3f doc: Add NICs known to support ovs offload dffcf4b54a Log alembic migration script's output with oslo_log f5b01e0e12 Upgrade check command - add support for 3rd party checks e78f82e64f Fill port-resource-request 711a955116 tox: Hide deprecation warnings from distgit d01e309f2d Disable displaying warnings in functional tests 76c76a4225 use payloads for ROUTER_INTERFACE BEFORE_DELETE events 35d89fad1b rally-jobs: Set floating network as a parameter 05a54e8004 Implement IpAddrCommand.get_devices_with_ip using pyroute2 f2192f1226 Add logging for functional tests 0a4d2ee877 Fix mysql functional migration tests ef5342886e Revert "Make neutron-tempest-iptable_hybrid job non-voting" 518f9fe660 Remove unused get_<plural> rules a5ab915279 Drop 3rd-party plugin specific policies 489dd18530 Implement IpRuleCommand.delete() using pyroute2 02dabd6f10 Add debug information of the dhclient process f8984c6699 Convert policy.json into policy-in-code 176ce5ce30 shim _resource_extend for neutron-lib a02f8a95f7 Pass elevated admin context when fetching snat router for FIP to unbound port 20f8271b6b Prevent some L3 ports change IP address af55934341 Remove unnecessary 'set -x' at EOL in genconfig script 063b04de24 Add irrelevant-files for grenade-py3 jobs b75cf8743c Mark mysql related functional tests as unstable 7a2b4dcff1 Replace ryu with os_ken 97c9c4656d get_standard_device_mappings for mechdriver 97c98a1c6d [DVR] Allow multiple subnets per external network 89ba2416f2 Table name in "add_ip_rule" can be a string 3995abefb1 Do state report after setting start_flag on OVS restart bd2a1bc6c3 Do not delete trunk bridges if service port attached 7d44666e8d Update mailinglist from dev to discuss 462b510c50 Make neutron-tempest-iptable_hybrid job non-voting f24f422373 Support fetching specific db column in OVO dca4a16a1d Switch neutron-rally-task job to python 3 26a4b3eac0 tox: Reuse envdirs 1966ad3945 Check port VNIC type when associating a floating IP e7f4783096 Fix dnsmasq option6 tagging logic 6b54669694 Enable delete bound trunk for linux bridge agent 8588be3e43 Remove sqlalchemy osprofiler f999970755 Add debug information in BridgeCreateEvent fb506298b8 bump neutron-lib to 1.21.0 87926fddc0 Implement IpRuleCommand.add() using pyroute2 94542ff42b Add tempest-slow to gate queue 9aa7af8221 Fix the bug about DHCP port whose network has multiple subnets. 0385868848 Check if agent can reach neutron server c4061f4a78 [Doc] L3 router gateway IP rate limit 22c9cf3d95 Add native OVSDB implementation for bridge monitor 2ba9e95156 Reinitialize ovs firewall after ovs-vswitchd restart b617df2b21 Change "cmd" folder in fullstack tests cd3cc7e908 [L3][QoS] Agent side router gateway IP rate limit 00bf365025 [L3][QoS] Neutron server side router gateway IP QoS 75d83b9032 Send global_request_id for tracing calls from neutron to nova f0678b9b09 Add propagate_uplink_status to port e294845541 rally-jobs: Add FloatingIP workloads 80b48ebd4a Add bulk port creation of DB objects ae031d1886 Force all fdb entries update after ovs-vswitchd restart 0fce3ca2c1 Secure dnsmasq process against external abuse 3e2e2e5577 Sync up model_query module to neutron-lib 06ba6a1ace Only store segmenthostmapping when enable segment plugin 481211dc3a [Fullstack] Configure policy.json file only if it is set aaf215b5a5 Convert instance method to staticmethod in linuxbridge_neutron_agent c68ebd661b Implement IpRuleCommand.list_rules() using pyroute2 c1407db676 Store journal log from host in fullstack's job results 7d0e1ccd34 Get centralized FIP only on router's snat host 889bb1b3af Cleanup old jobs from experimental queue 01fe73f99c Trivial: Fix ovs cleanup script on Windows 4ad302af87 All functional tests logs results now 0745e32cd2 DVR Floating IP create don't raise exception if agent not found 31be154657 Add get_availability_zone rule to policy.json db06d24414 tox: Hide deprecation warnings a73deb9909 remove unused methods from CommonDbMixin 24eb49c55b segments use neutron_lib placement client 6541304d5e filter "updated_at" and "revision_number" in _gateway_ports_equal 06e38be42e Add bulk IP address assignment to ipam driver a26f5375e6 Duplicate words were deleted in openvswitch_agent.rst 65f1a7e521 Add missing ws seperator between words c8cb1454af Add test cases for port number 0 for port_forwarding ddc72ebd41 use payloads for SEGMENT BEFORE_DELETE callbacks 9b23abbdb6 Add kill_timeout to AsyncProcess b847cd02c5 Enable 'all' IPv6 forwarding knob correctly 2572c158f5 Change to use iproute2 instead of brctl 9dc5725996 Add networking-ovn job to Neutron's check pipeline aa19fa1c3f Implement ip_lib get_devices using pyroute2 e3dc447b90 raise priority of dead vlan drop cd0cc47a6a DVR: Centralized FloatingIPs are not cleared after migration. e67d99b654 Make neutron-fullstack job run py3 8c17df7138 Notify router_update after directly gateway IP change 90dd08b156 Removed duplicated word "and". 593c04d10d Import neutron.db.api module in common.utils 4d50adb592 Add port_forwarding to devstack plugin b8d2ab8543 Prevent create port forwarding to port which has binding fip 02e4efa01c Refactor _cache_related_dvr_routers_info_before_interface_removal() 13b7f4f7da Add python 3.6 unit test job 6098fc7430 Incorporate capability for multiple mac generation 8eee74f626 Use RBACBaseObject OVO in neutron/db/rbac_db_mixin.py e6dbef39d3 ml2/rpc: provide a small helper to avoid redundancy 4ba87b06d7 Switch to new engine facade in neutron/db/agents_db.py cdfeeaf2bc DevStack: OVS: Only install kernel-* packages when needed cf0b461836 Bump neutron-lib to version 1.20.0 f4089680b5 Add missing step for ovs deploy guides e17dac3ae9 Add protocol to port_forwarding uniq constraint 916e774516 Wait to ipv6 forwarding be really changed by L3 agent 3316b45665 use MAX_RETRIES from neutron-lib a000fb0855 Update lower-constraints to meet neutron-lib 4f3cde2322 Use NetworkRBAC OVO in tests/unit/db/test_db_base_plugin_v2.py f5842b304c Set router_id if floating IP has port_forwardings d860109bf6 supported_vnic_type configurable for sriov e9e374fa7d Increase timout of gate jobs c183781231 Add test cases to verify port number 0 for port_forwaring a58a527494 Scan for MAC through all devices in macvtap agent 5018d70241 Fix connection between 2 dvr routers 698e6d475c Update docs for disabling DNS server announcement 84a9a5ec57 iptables-restore wait period cannot be zero b70ee4df88 Block port update from unbound DHCP agent 20800389f1 Increase tempest-full jobs timeout f5d3a4159b Verify port_forwarding subnet and IP address both 221f386029 Fix incorrectly passing ext_ips as gateway ips 90cc4d087f Fix incorrect usage of '# flake8: noqa' 32cc8b63d7 Add capabilities for privsep 9b23e1be07 sriov-agent: fullstack test resource info report 1d98f0a7d4 Event driven periodic resync task for DHCP agents 69d6b86f56 ovs/sriov mech drivers: resource_provider_uuid5_namespace 8bd5ecd4fc notification: Add 'status' to agent after_create/update 152364dbc8 Add neutron-status upgrade check command framework 029f77e96c remove unused db api functions 60c50d9296 OVSNeutronAgent.rpc_loop is always called with "polling_manager" e4aa5902f7 use context manager from neutron-lib a98766d758 Revert "Add openstack/placement as a required project for neutron-grenade*" fb068f089c Increase tempest jobs timeout ea63c6ae40 Use NetworkRBAC OVO in neutron/db/external_net_db.py 00c816de01 Use NetworkRBAC OVO in neutron/db/db_base_plugin_v2.py c39afbd5fc [Functional] Increase test_timeout for db migration tests f787f12aa3 Make port binding attempt after agent is revived a69d92e0e8 use payloads for SUBNET BEFORE_DELETE events f4d438019e neutron.conf needs lock_path set for router to operate This change is adding required configuration in neutron.conf to set the lock_path parameter, which was missing in compute-install-ubuntu.rst fc95db987d Fix flake8 N534 untranslated exception message 1973a037c2 Fix dvr ha router gateway goes wrong host 975953f69e Add Network RBAC functional tests for External_net_db_mixin 50c75e9e51 Add a request validator for SNAT logging eb4221e6f0 Introduce Port resource request extension 4df02ee93c Enable ingress direction for min_bw rule b62ae3d522 Fix enable_distributed_routing option section in docs 6352b944a4 Introduce L3 agent extension for SNAT logging c094da83cb use payloads for NETWORK BEFORE_DELETE events a85c5ed3fb supported_vnic_type configurable for ovs 2e43aae370 Use l3plugin property in neutron/db/l3_dvr_db.py module 3b5373b4ef Allow update request with current segment_id c2c37272bf [Functional] Increase test_timeout for db migration tests 6d9f1c662f use retry_if_session_inactive from neutron-lib ad50a7a453 Increment versioning with pbr instruction 81652cd939 DVR-HA: Configure extra routes on router namespace in dvr_snat node 7df684df0f Introduce functional testing for Network RBAC policies ea2103d6db Use tempest-pg-full f3dfb82fe9 use ovo for L3HARouterAgentPortBinding in l3_hamode. cf37563c83 Remove deprecated vsctl ovsdb_interface api 9174e6d3d1 Delete tempest config module ac5815a110 Add permanent ARP entries for DVR fip/qrouter veth pair 277c1e77b2 ovs-agent: fullstack test resource info report d7d433f729 sriov-agent: Report resource info in heartbeat f352f9faaa ovs-agent: Report resource info in heartbeat 85588ad38e Allow Ipv6 addresses for nova_metadata_host b785199010 Modify the QoS doc in Neutron 97fdc0f50d Replace openSUSE experimental check with newer version f44e5bcfb2 Make grenade-multinode-dvr job voting again f849eba286 Add both directions for minimum bw rule in doc 8e60531d11 Exclude fallback tunnel devices from netns cleanup f30fc92adf netns_cleanup: Remove unused parameter from unplug_devices() 360fde9f88 Ingress direction for min bandwidth rule e1943d9711 Fix ADMIN output examples 2b57f08576 Fix flake8 H404 errors ee7660f593 Install centralized floating IP nat rules to all ha nodes 452b282412 Trigger router update only when gateway port IP changed 1307cb7587 fix tox python3 overrides 2530ccff8f Upgrade pylint to a version that works with python3 4e3fb31919 Introduce floating IP pool resource ebfed6090b remove trailing comma for linter d82a5d3c14 Update tests neutron.conf to use transport_url f721c3dcc7 Add argument to get ports by SG to allow excluding owners ed225d3f57 Optimize OVS DVR CSNAT port code a little eea5aaac4f Fix corner case in failure assigning MAC to SR-IOV NIC bc4f93c232 Fix best_match() deprecation warning 9a103c3c2a Update code review policies for sub-projects. 3d5bed139c bump neutron-lib version to 1.19.0 0014c0c373 Add openstack/placement as a required project for neutron-grenade* bb7b5a1e81 Create temp file in setUp() to avoid warning 995744c576 Always set ovs bridge name in vif:binding-details 6a24efcb70 use payloads for AGENT BEFORE_DELETE callbacks 87d98dcbe2 Disable some pylint checks a8e8f88cde Remove a bare raise noticed by the linter cf463cce43 tell pylint to ignore python2 version of gettext b43b8c446d Remove population of is_filter keyword 00de8f9a9e Do not fail deleting namespace if it does not exist 82d7c2beed Make binding statement singular. 3e96bbade5 Fix doc output examples 656a8f8729 Do not install centralized FIP if HA port is down 6ef54ff379 Refactor l3hamode for ha migration. 920f3e7fb5 Fix pep8 F402 import shadowing 66991f1c8b Add PortForwarding to neutron.objects entrypoint. f502bbc2ac Use extension 'empty-string-filtering' from neutron-lib 40ba4ebe6a Bump pecan version to 1.3.2 253db749a7 Remove async_process, moved to "common" 9849209bbd use is_retriable from neutron-lib 15ba1d7d64 Make neutron-fullstack-python36 job voting fdaf24bead doc: OpenVSwitch firewall internal design, improvements (+ newline fix) 7d5b1bfd27 Use templates for cover and lower-constraints 9ff9a5c69e Fix broken link to Open vSwitch installation instructions c5d55d692a Use mktemp instead of tempfile in gate_hook.sh f265c5365b Use Tempest slow job to run all slow tests e33300a981 use TenantIdProjectIdFilterConflict from neutron-lib d19dcf1ef2 Fix IPv6 prefix delegation issue on agent restart 9278d79aa6 remove _setUpExtension cfec395b8f Integration of Port Binding Level OVO 760870b6c2 Don't uninstall flow tables in setup_dvr_flows_on_integ_br 157e3218da Use tempest-multinode-full job from Tempest 8ed2ba8798 Update FIP QoS Docs 52f0096d13 [Docs] Update note about default burst value in QoS bw limit 91d6151a4d Revert "Use nested virt in scenario jobs" db7e19d2ba Fix pylint warning with eventlet > 0.22.0 e4df5d695c Follow-up: add fullstack test for logging e4feed0af2 doc: Small clearances for fullstack testing 4f2f5eeb8b Delete ovs port if namespace is corrupted 0649112113 Add fullstack test for logging 9feb5db61c ovs fw: apply the NORMAL action on egress traffic in a single table 37212adb61 doc: Address nits from I45fdc8e40121698bf144d0e0a65537edda2c805d 987e8b0cc4 Fix devstack/lib/ovs to run with Fedora 28 e7c7ae807d doc: Additional fixes to the SR-IOV doc b32db30874 l2 pop: check for more than 1 first active port on a node 7d14d8797e Consolidate irrelevant files added for py3 project daeea79e76 add python 3.6 unit test job 6c9e5df5dd use security_groups_port_filtering from neutron-lib b0ffcf5f31 Update abandon_old_reviews script to check Zuul votes 0d1fb74464 switch documentation job to new PTI 3e9506a01d import zuul job settings from project-config addcddbe18 Remove deprecated RamFilter from admin guide f6d98a747b ovsdb monitor: do not die on ovsdb-client stderr output fd17815228 Use Tag OVO in neutron/services/tag/tag_plugin.py f9dc83eb95 [Fullstack] Mark securitygroups tests as unstable 979de972f5 fix spell error 310bfa326f Fix incorrect log resources querying deb84b6756 Skip L3 ha functional IPv6 test if IPv6 is disabled c57fede20f Disallow networks with first ip 0.0.0.0 with dhcp enabled 46913a69fd Use constant IP_VERSION_4/6 in functional tests 12bb26fd0e Use constant IP_VERSION_4/6 in unit tests 2e91736df0 Modify abandon_old_reviews script c6aac9041f DVR: Add IPv6 csnat port address correctly 3e1512873a Fix the RFC and private internet network address 8a3ff8a19e Parse dhcp leases file in a more robust way 95766f20bc Remove Future work from OVS-fw docs fd72643a61 Revert "DVR: Inter Tenant Traffic between networks not possible with shared net" 267eea50fd Revert "DVR: Add error handling for get_network_info_for_id rpc call" 4bd2f0e8f7 shim neutron rpc with neutron-lib 72ef0e7814 Fetch specific columns rather than full ORM entities 7e0dd2f18d metadata: use requests for comms with nova api 60a9248b17 doc: add known limitation about attaching SR-IOV ports 73f111e7e8 Use nested virt in scenario jobs 0bd1cec676 [Fullstack] Add debug_iptables=True in security groups tests 6cdc84a37e Enable nonvoting python 3.6 unit test job template 82224347de Update list of skipped bandit plugins 28e07d4c5e Doc: update the qos devref about SR-IOV support 7a27e24447 Reduce qos rpc times on the ovs-agent side 9ea9163689 Docs: Update API & Scenario Tests 383c7b5c05 add pycodestyle to test-requirements 7d2ac2d0af Fix lost connection when create security group log 5c208a313a shim model query hooks to use neutron-lib c8b04827a9 Revert "Update network revision only when it needs" 3bebbc1f69 Consolidate irrelevant-files in zuul config 585b6f0af7 Windows OVS: minimize polling 89915a752e Trivial: Move platform independent modules to common dir ae81d403f7 Pass context in l3 flavor notifications e9a7ed8c63 Update network revision only when it needs 38309ca4dc Update metering driver to load interface driver c1b1dac132 Update vpnaas-scenario docs 99567388ac Create veth pair devices using pyroute2 6c300b1a9b Remove fdb entries for ha router interfaces when going DOWN c6de172e58 get_subnet_for_dvr returns SNAT mac instead of distributed gateway in subnet_info 4d3e4542f4 Update reno for stable/rocky adf38349c4 Fix iptables metering driver entrypoint 40d92d40ec Config privsep in the metering agent 034db863a0 Use system protocol assigments for iptables protocol map 5a2a6d2861 Fix import style 215498373e Open Stein DB branch b652a6ee89 Enable filter validation for portforwarding plugin f046031456 Remove _migrate_python_ns_metadata_proxy_if_needed method 9caf87bb0c Add delete rule for auto_allocated_topology f937dd2a15 Fix no packet log data when debug is set False in configuration faa4438dae ipam_backend_mixin: Segments model to OVO ced78395a7 Fix no ACCEPT event can get for security group logging 40c9c7f0bc Use OVO for tests/unit/plugins/ml2/drivers/l2pop/test_db.py f4a684cdcb use autonested_transaction from neutron-lib da5b13df2b Trivial: avoid KeyError while processing ports f24f3b6b7b Rename router processing queue code to be more generic fee630efaa Fix neutron-openvswitch-agent Windows support 0fe31bc8ae Add osprofiler to api-paste pipeline 88a0ebbe7f Add fullstack test to restart agent with active l3-ha router d62d82b0fe Generate correct url in api pagination 8ac92aa946 Select service_provider on the basis of service_module Diffstat (except docs and test files) ------------------------------------- .gitignore | 89 ++- .pylintrc | 9 +- .zuul.yaml | 449 +++++++----- README.rst | 2 +- TESTING.rst | 74 +- devstack/lib/fip_port_forwarding | 4 + devstack/lib/network_segment_range | 3 + devstack/lib/ovs | 21 +- devstack/lib/qos | 4 + devstack/lib/uplink_status_propagation | 3 + devstack/plugin.sh | 13 + .../deploy-ha-vrrp-verifynetworkoperation.txt | 10 +- .../deploy-provider-verifynetworkoperation.txt | 10 +- .../deploy-selfservice-verifynetworkoperation.txt | 10 +- .../contributor/internals/api_extensions.rst | 1 + .../contributor/internals/openvswitch_agent.rst | 2 +- .../contributor/internals/openvswitch_firewall.rst | 303 +++++--- .../contributor/internals/quality_of_service.rst | 45 +- .../contributor/internals/services_and_agents.rst | 6 +- .../policies/contributor-onboarding.rst | 2 +- .../contributor/policies/gate-failure-triage.rst | 12 +- .../install/controller-install-option1-obs.rst | 12 + .../install/controller-install-option1-ubuntu.rst | 12 + .../install/controller-install-option2-obs.rst | 12 + .../install/controller-install-option2-ubuntu.rst | 12 + etc/README.policy.yaml.txt | 4 + etc/api-paste.ini | 4 +- etc/neutron/rootwrap.d/dhcp.filters | 7 - etc/neutron/rootwrap.d/l3.filters | 21 +- etc/oslo-config-generator/neutron.conf | 1 + etc/oslo-policy-generator/policy.conf | 3 + etc/policy.json | 259 ------- lower-constraints.txt | 29 +- neutron/__init__.py | 4 +- neutron/agent/{linux => common}/async_process.py | 41 +- neutron/agent/common/ip_lib.py | 2 + neutron/agent/common/ovs_lib.py | 236 +++++- neutron/agent/{linux => common}/ovsdb_monitor.py | 58 +- neutron/agent/common/placement_report.py | 230 ++++++ neutron/agent/common/polling.py | 64 +- .../resource_processing_queue.py} | 127 ++-- neutron/agent/common/utils.py | 4 + neutron/agent/dhcp/agent.py | 325 +++++--- neutron/agent/l2/extensions/qos.py | 12 +- neutron/agent/l2/l2_agent_extensions_manager.py | 4 +- neutron/agent/l3/agent.py | 335 ++++++--- neutron/agent/l3/dvr_edge_ha_router.py | 12 +- neutron/agent/l3/dvr_edge_router.py | 58 +- neutron/agent/l3/dvr_fip_ns.py | 92 ++- neutron/agent/l3/dvr_local_router.py | 113 +-- neutron/agent/l3/dvr_snat_ns.py | 3 +- neutron/agent/l3/extensions/port_forwarding.py | 2 +- neutron/agent/l3/extensions/qos/base.py | 2 +- neutron/agent/l3/extensions/qos/fip.py | 6 +- neutron/agent/l3/extensions/qos/gateway_ip.py | 191 +++++ neutron/agent/l3/extensions/snat_log.py | 39 + neutron/agent/l3/ha.py | 37 +- neutron/agent/l3/ha_router.py | 26 +- neutron/agent/l3/item_allocator.py | 8 +- neutron/agent/l3/keepalived_state_change.py | 22 + neutron/agent/l3/l3_agent_extensions_manager.py | 4 +- neutron/agent/l3/namespaces.py | 1 - neutron/agent/l3/router_info.py | 116 +-- neutron/agent/linux/bridge_lib.py | 20 +- neutron/agent/linux/daemon.py | 2 +- neutron/agent/linux/dhcp.py | 87 ++- neutron/agent/linux/interface.py | 77 +- neutron/agent/linux/ip_conntrack.py | 10 +- neutron/agent/linux/ip_lib.py | 604 +++++++++------ neutron/agent/linux/ip_monitor.py | 2 +- neutron/agent/linux/ipset_manager.py | 2 +- neutron/agent/linux/iptables_firewall.py | 71 +- neutron/agent/linux/iptables_manager.py | 17 +- neutron/agent/linux/l3_tc_lib.py | 11 +- .../agent/linux/openvswitch_firewall/firewall.py | 71 +- neutron/agent/linux/openvswitch_firewall/rules.py | 16 +- neutron/agent/linux/polling.py | 74 -- neutron/agent/linux/ra.py | 28 +- neutron/agent/linux/tc_lib.py | 509 ++++++++++--- neutron/agent/linux/utils.py | 34 +- neutron/agent/metadata/agent.py | 68 +- neutron/agent/metadata/driver.py | 45 +- neutron/agent/ovsdb/api.py | 26 - neutron/agent/ovsdb/impl_idl.py | 12 +- neutron/agent/ovsdb/impl_vsctl.py | 345 --------- neutron/agent/ovsdb/native/connection.py | 98 ++- neutron/agent/resource_cache.py | 5 +- neutron/agent/rpc.py | 21 +- neutron/agent/securitygroups_rpc.py | 2 + neutron/agent/windows/ip_lib.py | 6 + neutron/agent/windows/utils.py | 62 +- neutron/api/api_common.py | 29 +- neutron/api/extensions.py | 2 +- .../api/rpc/agentnotifiers/dhcp_rpc_agent_api.py | 56 +- neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py | 2 +- .../rpc/agentnotifiers/metering_rpc_agent_api.py | 2 +- neutron/api/rpc/callbacks/version_manager.py | 2 +- neutron/api/rpc/handlers/dhcp_rpc.py | 18 +- neutron/api/rpc/handlers/dvr_rpc.py | 19 +- neutron/api/rpc/handlers/l3_rpc.py | 20 +- neutron/api/rpc/handlers/resources_rpc.py | 8 +- neutron/api/rpc/handlers/securitygroups_rpc.py | 2 +- neutron/api/v2/base.py | 12 +- neutron/cmd/eventlet/usage_audit.py | 2 +- neutron/cmd/netns_cleanup.py | 4 +- neutron/cmd/ovs_cleanup.py | 65 +- neutron/cmd/pd_notify.py | 2 +- neutron/cmd/sanity/checks.py | 18 +- neutron/cmd/sanity_check.py | 18 +- neutron/cmd/status.py | 85 +++ .../cmd => cmd/upgrade_checks}/__init__.py | 0 neutron/cmd/upgrade_checks/base.py | 36 + neutron/cmd/upgrade_checks/checks.py | 91 +++ neutron/common/_deprecate.py | 4 +- neutron/common/config.py | 6 +- neutron/common/constants.py | 25 + neutron/common/exceptions.py | 355 --------- neutron/common/ipv6_utils.py | 12 + neutron/common/rpc.py | 329 --------- neutron/common/utils.py | 108 ++- neutron/conf/agent/cmd.py | 3 +- neutron/conf/agent/common.py | 11 - neutron/conf/agent/dhcp.py | 12 +- neutron/conf/agent/l3/config.py | 13 +- neutron/conf/agent/l3/ha.py | 3 +- neutron/conf/agent/ovs_conf.py | 1 - neutron/conf/agent/ovsdb_api.py | 11 - neutron/conf/common.py | 9 +- neutron/conf/plugins/ml2/drivers/l2pop.py | 7 +- .../plugins/ml2/drivers/mech_sriov/agent_common.py | 29 + .../ml2/drivers/mech_sriov/mech_sriov_conf.py | 35 + .../plugins/ml2/drivers/openvswitch/__init__.py | 0 .../ml2/drivers/openvswitch/mech_ovs_conf.py | 40 + neutron/conf/plugins/ml2/drivers/ovs_conf.py | 28 + neutron/conf/policies/__init__.py | 79 ++ neutron/conf/policies/address_scope.py | 103 +++ neutron/conf/policies/agent.py | 177 +++++ neutron/conf/policies/auto_allocated_topology.py | 48 ++ neutron/conf/policies/availability_zone.py | 34 + neutron/conf/policies/base.py | 92 +++ neutron/conf/policies/flavor.py | 160 ++++ neutron/conf/policies/floatingip.py | 86 +++ neutron/conf/policies/floatingip_pools.py | 34 + .../conf/policies/floatingip_port_forwarding.py | 76 ++ neutron/conf/policies/logging.py | 86 +++ neutron/conf/policies/metering.py | 104 +++ neutron/conf/policies/network.py | 202 +++++ neutron/conf/policies/network_ip_availability.py | 38 + neutron/conf/policies/network_segment_range.py | 78 ++ neutron/conf/policies/port.py | 256 +++++++ neutron/conf/policies/qos.py | 342 +++++++++ neutron/conf/policies/rbac.py | 104 +++ neutron/conf/policies/router.py | 181 +++++ neutron/conf/policies/security_group.py | 119 +++ neutron/conf/policies/segment.py | 75 ++ neutron/conf/policies/service_type.py | 34 + neutron/conf/policies/subnet.py | 96 +++ neutron/conf/policies/subnetpool.py | 126 ++++ neutron/conf/policies/trunk.py | 108 +++ neutron/conf/service.py | 17 +- neutron/conf/services/extdns_designate_driver.py | 10 +- neutron/core_extensions/qos.py | 7 +- neutron/db/_model_query.py | 305 -------- neutron/db/_resource_extend.py | 138 ---- neutron/db/address_scope_db.py | 6 +- neutron/db/agents_db.py | 44 +- neutron/db/agentschedulers_db.py | 2 +- neutron/db/allowedaddresspairs_db.py | 8 +- neutron/db/api.py | 324 -------- neutron/db/availability_zone/network.py | 2 +- neutron/db/availability_zone/router.py | 2 +- neutron/db/common_db_mixin.py | 49 +- neutron/db/data_plane_status_db.py | 3 +- neutron/db/db_base_plugin_common.py | 44 +- neutron/db/db_base_plugin_v2.py | 267 ++++--- neutron/db/dns_db.py | 8 +- neutron/db/dvr_mac_db.py | 20 +- neutron/db/external_net_db.py | 62 +- neutron/db/extradhcpopt_db.py | 15 +- neutron/db/extraroute_db.py | 4 +- neutron/db/flavors_db.py | 16 +- neutron/db/ipam_backend_mixin.py | 156 +--- neutron/db/ipam_pluggable_backend.py | 100 ++- neutron/db/l3_agentschedulers_db.py | 22 +- neutron/db/l3_attrs_db.py | 2 +- neutron/db/l3_db.py | 185 +++-- neutron/db/l3_dvr_db.py | 251 +++++-- neutron/db/l3_dvr_ha_scheduler_db.py | 9 +- neutron/db/l3_dvrscheduler_db.py | 187 +++-- neutron/db/l3_fip_pools_db.py | 77 ++ neutron/db/l3_fip_port_details.py | 3 +- neutron/db/l3_fip_qos.py | 2 +- neutron/db/l3_gateway_ip_qos.py | 129 ++++ neutron/db/l3_gwmode_db.py | 8 +- neutron/db/l3_hamode_db.py | 94 ++- neutron/db/metering/metering_db.py | 6 +- neutron/db/migration/__init__.py | 2 + .../migration/alembic_migrations/cisco_init_ops.py | 9 +- .../migration/alembic_migrations/core_init_ops.py | 4 +- .../alembic_migrations/versions/EXPAND_HEAD | 2 +- ...86_add_binding_index_to_routerl3agentbinding.py | 2 +- .../7d9d8eeec6ad_rename_tenant_to_project.py | 3 +- .../8fd3918ef6f4_add_segment_host_mapping.py | 3 +- .../newton/contract/97c25b0d2353_add_name_desc.py | 3 +- .../a8b517cff8ab_add_routerport_bindings_for_ha.py | 7 +- .../c879c5e1ee90_add_segment_id_to_subnet.py | 2 +- ...0f5bef0f87d4_add_qos_minimum_bandwidth_rules.py | 3 +- .../5abc0278ca73_add_support_for_vlan_trunking.py | 9 +- .../a5648cfeeadf_add_subnet_service_types.py | 3 +- .../a9c43481023c_extend_ml2_port_bindings.py | 11 +- ...9da_qos_add_direction_to_bw_limit_rule_table.py | 3 +- .../expand/0ff9e3881597_network_segment_range.py | 56 ++ .../expand/195176fb410d_router_gateway_ip_qos.py | 45 ++ .../9bfad3f1e780_support_shared_security_groups.py | 49 ++ ...2437bf41_add_propagate_uplink_status_to_port.py | 41 ++ .../d72db3e25539_modify_uniq_port_forwarding.py | 83 +++ .../expand/fb0167bd9639_agent_resources_synced.py} | 36 +- neutron/db/migration/autogen.py | 5 +- neutron/db/migration/cli.py | 63 +- neutron/db/models/agent.py | 3 + neutron/db/models/flavor.py | 3 +- neutron/db/models/l3.py | 2 +- neutron/db/models/network_segment_range.py | 79 ++ neutron/db/models/plugins/ml2/geneveallocation.py | 6 +- .../models/plugins/ml2/gre_allocation_endpoints.py | 4 + neutron/db/models/plugins/ml2/vlanallocation.py | 4 + neutron/db/models/plugins/ml2/vxlanallocation.py | 4 + neutron/db/models/port_forwarding.py | 9 +- neutron/db/models/securitygroup.py | 7 +- neutron/db/models/uplink_status_propagation.py | 33 + neutron/db/network_ip_availability_db.py | 6 +- neutron/db/portbindings_base.py | 3 +- neutron/db/portbindings_db.py | 12 +- neutron/db/portsecurity_db.py | 2 +- neutron/db/provisioning_blocks.py | 16 +- neutron/db/qos/models.py | 20 + neutron/db/quota/api.py | 15 +- neutron/db/quota/driver.py | 9 +- neutron/db/rbac_db_mixin.py | 89 ++- neutron/db/rbac_db_models.py | 20 +- neutron/db/securitygroups_db.py | 286 ++++---- neutron/db/securitygroups_rpc_base.py | 2 +- neutron/db/segments_db.py | 66 +- neutron/db/servicetype_db.py | 12 +- neutron/db/standard_attr.py | 38 +- neutron/db/standardattrdescription_db.py | 3 +- neutron/db/subnet_service_type_mixin.py | 3 +- neutron/db/tag_db.py | 89 --- neutron/db/uplink_status_propagation_db.py | 33 + neutron/db/vlantransparent_db.py | 3 +- neutron/debug/debug_agent.py | 12 +- neutron/debug/shell.py | 1 - neutron/extensions/agent_resources_synced.py | 20 + neutron/extensions/dhcpagentscheduler.py | 2 +- neutron/extensions/empty_string_filtering.py | 3 +- neutron/extensions/floatingip_pools.py | 53 ++ .../extensions/l3_port_ip_change_not_allowed.py | 18 + neutron/extensions/l3agentscheduler.py | 2 +- neutron/extensions/network_ip_availability.py | 13 - neutron/extensions/network_segment_range.py | 165 +++++ .../port_resource_request.py} | 12 +- neutron/extensions/portbindings_extended.py | 11 - neutron/extensions/qos.py | 23 + neutron/extensions/qos_bw_minimum_ingress.py | 20 + neutron/extensions/qos_gateway_ip.py | 24 + neutron/extensions/qos_rules_alias.py | 37 + neutron/extensions/quotasv2.py | 5 +- neutron/extensions/quotasv2_detail.py | 2 +- .../rbac_security_groups.py} | 20 +- .../extensions/security_groups_port_filtering.py | 5 +- .../security_groups_port_filtering_lib.py | 59 -- neutron/extensions/securitygroup.py | 55 +- neutron/extensions/subnet_onboard.py | 39 + neutron/extensions/subnet_service_types.py | 13 +- neutron/extensions/tagging.py | 2 +- neutron/extensions/uplink_status_propagation.py | 18 + neutron/hacking/checks.py | 2 +- neutron/ipam/drivers/neutrondb_ipam/db_api.py | 4 +- neutron/ipam/drivers/neutrondb_ipam/driver.py | 97 ++- neutron/ipam/exceptions.py | 4 + neutron/ipam/requests.py | 30 +- neutron/ipam/subnet_alloc.py | 77 +- neutron/manager.py | 76 +- neutron/notifiers/nova.py | 24 +- neutron/objects/agent.py | 11 +- neutron/objects/base.py | 169 ++++- neutron/objects/common_types.py | 5 + neutron/objects/db/api.py | 12 +- neutron/objects/l3agent.py | 2 +- neutron/objects/network.py | 42 +- neutron/objects/network_segment_range.py | 127 ++++ .../port/extensions/uplink_status_propagation.py | 34 + neutron/objects/port_forwarding.py | 5 +- neutron/objects/ports.py | 39 +- neutron/objects/qos/binding.py | 16 + neutron/objects/qos/policy.py | 147 ++-- neutron/objects/qos/qos_policy_validator.py | 29 +- neutron/objects/qos/rule_type.py | 5 + neutron/objects/rbac.py | 62 ++ neutron/objects/rbac_db.py | 74 +- neutron/objects/router.py | 9 +- neutron/objects/securitygroup.py | 38 +- neutron/objects/subnet.py | 121 +++ neutron/objects/tag.py | 97 +++ neutron/opts.py | 23 +- neutron/pecan_wsgi/controllers/resource.py | 2 +- neutron/pecan_wsgi/controllers/root.py | 9 +- neutron/pecan_wsgi/hooks/context.py | 2 +- neutron/pecan_wsgi/hooks/notifier.py | 2 +- neutron/pecan_wsgi/hooks/quota_enforcement.py | 6 +- neutron/pecan_wsgi/hooks/translation.py | 7 +- neutron/plugins/ml2/db.py | 93 ++- neutron/plugins/ml2/driver_context.py | 17 +- neutron/plugins/ml2/drivers/agent/_common_agent.py | 22 +- neutron/plugins/ml2/drivers/helpers.py | 126 +++- neutron/plugins/ml2/drivers/l2pop/db.py | 6 +- neutron/plugins/ml2/drivers/l2pop/mech_driver.py | 45 +- neutron/plugins/ml2/drivers/l2pop/rpc.py | 3 +- .../agent/extension_drivers/qos_driver.py | 2 +- .../linuxbridge/agent/linuxbridge_neutron_agent.py | 43 +- .../drivers/macvtap/agent/macvtap_neutron_agent.py | 14 +- neutron/plugins/ml2/drivers/mech_agent.py | 98 +++ .../drivers/mech_sriov/agent/eswitch_manager.py | 29 +- .../agent/extension_drivers/qos_driver.py | 13 + .../ml2/drivers/mech_sriov/agent/pci_lib.py | 30 +- .../drivers/mech_sriov/agent/sriov_nic_agent.py | 134 +++- .../drivers/mech_sriov/mech_driver/mech_driver.py | 39 +- .../drivers/openvswitch/agent/common/constants.py | 3 + .../agent/extension_drivers/qos_driver.py | 72 +- .../agent/openflow/native/br_dvr_process.py | 22 +- .../openvswitch/agent/openflow/native/br_int.py | 13 +- .../openvswitch/agent/openflow/native/br_phys.py | 5 +- .../openvswitch/agent/openflow/native/br_tun.py | 4 +- .../openvswitch/agent/openflow/native/main.py | 12 +- .../openvswitch/agent/openflow/native/ofswitch.py | 27 +- .../agent/openflow/native/ovs_bridge.py | 3 +- .../native/{ovs_ryuapp.py => ovs_oskenapp.py} | 18 +- .../openvswitch/agent/openflow/ovs_ofctl/br_int.py | 3 + .../agent/openflow/ovs_ofctl/br_phys.py | 2 +- .../openvswitch/agent/openflow/ovs_ofctl/br_tun.py | 6 +- .../agent/openflow/ovs_ofctl/ofswitch.py | 2 +- .../openvswitch/agent/ovs_agent_extension_api.py | 13 +- .../openvswitch/agent/ovs_dvr_neutron_agent.py | 70 +- .../drivers/openvswitch/agent/ovs_neutron_agent.py | 165 +++-- .../openvswitch/mech_driver/mech_openvswitch.py | 61 +- neutron/plugins/ml2/drivers/type_flat.py | 20 +- neutron/plugins/ml2/drivers/type_geneve.py | 4 + neutron/plugins/ml2/drivers/type_gre.py | 3 + neutron/plugins/ml2/drivers/type_local.py | 13 +- neutron/plugins/ml2/drivers/type_tunnel.py | 142 +++- neutron/plugins/ml2/drivers/type_vlan.py | 127 +++- neutron/plugins/ml2/drivers/type_vxlan.py | 3 + neutron/plugins/ml2/extensions/dns_integration.py | 22 +- .../ml2/extensions/uplink_status_propagation.py | 42 ++ neutron/plugins/ml2/managers.py | 209 +++++- neutron/plugins/ml2/ovo_rpc.py | 8 +- neutron/plugins/ml2/plugin.py | 427 ++++++++--- neutron/plugins/ml2/rpc.py | 56 +- neutron/policy.py | 35 + neutron/privileged/__init__.py | 5 +- neutron/privileged/agent/linux/ip_lib.py | 296 +++++++- .../privileged/agent/linux/netlink_constants.py | 2 +- neutron/privileged/agent/linux/netlink_lib.py | 45 +- neutron/privileged/agent/linux/tc_lib.py | 203 +++++ neutron/quota/__init__.py | 7 +- neutron/quota/resource.py | 36 +- neutron/quota/resource_registry.py | 4 +- neutron/scheduler/base_scheduler.py | 2 +- neutron/scheduler/dhcp_agent_scheduler.py | 5 +- neutron/scheduler/l3_agent_scheduler.py | 5 +- neutron/service.py | 63 +- neutron/services/auto_allocate/db.py | 21 +- neutron/services/l3_router/l3_router_plugin.py | 53 +- .../service_providers/driver_controller.py | 5 +- neutron/services/logapi/agent/l3/base.py | 2 +- neutron/services/logapi/common/constants.py | 2 + neutron/services/logapi/common/db_api.py | 20 +- neutron/services/logapi/common/exceptions.py | 17 + neutron/services/logapi/common/snat_validate.py | 60 ++ neutron/services/logapi/common/validators.py | 3 +- neutron/services/logapi/drivers/manager.py | 2 +- .../openvswitch/{log_ryuapp.py => log_oskenapp.py} | 10 +- .../logapi/drivers/openvswitch/ovs_firewall_log.py | 32 +- neutron/services/logapi/logging_plugin.py | 9 +- neutron/services/logapi/rpc/agent.py | 2 +- neutron/services/logapi/rpc/server.py | 2 +- neutron/services/metering/agents/metering_agent.py | 9 +- .../metering/drivers/iptables/iptables_driver.py | 9 +- neutron/services/metering/metering_plugin.py | 2 +- neutron/services/network_ip_availability/plugin.py | 5 +- neutron/services/network_segment_range/__init__.py | 0 neutron/services/network_segment_range/plugin.py | 274 +++++++ neutron/services/placement_report/__init__.py | 0 neutron/services/placement_report/plugin.py | 237 ++++++ .../services/portforwarding/common/exceptions.py | 13 + neutron/services/portforwarding/pf_plugin.py | 85 ++- neutron/services/provider_configuration.py | 8 +- neutron/services/qos/drivers/manager.py | 2 +- neutron/services/qos/drivers/openvswitch/driver.py | 5 + neutron/services/qos/drivers/sriov/driver.py | 2 +- neutron/services/qos/qos_plugin.py | 221 +++++- neutron/services/revisions/revision_plugin.py | 166 ++++- neutron/services/segments/db.py | 68 +- neutron/services/segments/placement_client.py | 179 ----- neutron/services/segments/plugin.py | 33 +- neutron/services/tag/tag_plugin.py | 26 +- neutron/services/timestamp/timestamp_db.py | 4 +- .../trunk/drivers/linuxbridge/agent/driver.py | 13 +- .../drivers/linuxbridge/agent/trunk_plumber.py | 48 +- .../drivers/openvswitch/agent/ovsdb_handler.py | 14 + .../drivers/openvswitch/agent/trunk_manager.py | 2 +- neutron/services/trunk/plugin.py | 6 +- neutron/services/trunk/rpc/agent.py | 2 +- neutron/services/trunk/rpc/server.py | 4 +- neutron/services/trunk/rules.py | 13 +- .../l2/extensions/test_ovs_agent_qos_extension.py | 8 +- .../l3/extensions/qos/test_fip_qos_extension.py | 19 +- .../l3/extensions/test_gateway_ip_qos_extension.py | 197 +++++ .../agent/l3/test_keepalived_state_change.py | 30 +- .../functional/agent/l3/test_legacy_router.py | 82 ++- .../functional/agent/l3/test_metadata_proxy.py | 56 -- .../functional/agent/linux/test_async_process.py | 6 +- .../functional/agent/linux/test_ip_monitor.py | 2 +- .../functional/agent/linux/test_netlink_lib.py | 8 +- .../functional/agent/linux/test_ovsdb_monitor.py | 2 +- .../functional/agent/linux/test_process_monitor.py | 4 +- .../functional/agent/ovsdb/native/__init__.py | 0 .../agent/ovsdb/native/test_connection.py | 67 ++ .../test_3b935b28e7a0_migrate_to_pluggable_ipam.py | 4 +- .../functional/privileged/agent/linux/__init__.py | 0 .../privileged/agent/linux/test_ip_lib.py | 452 ++++++++++++ .../privileged/agent/linux/test_tc_lib.py | 293 ++++++++ .../scheduler/test_dhcp_agent_scheduler.py | 2 +- .../scheduler/test_l3_agent_scheduler.py | 2 +- .../l3_router/test_l3_dvr_ha_router_plugin.py | 4 +- .../l3_router/test_l3_dvr_router_plugin.py | 64 +- .../functional/services/logapi/test_logging.py | 31 +- .../portforwarding/test_port_forwarding.py | 118 ++- .../openvswitch/agent/test_ovsdb_handler.py | 8 + .../agent/{linux => common}/test_async_process.py | 49 +- .../agent/{linux => common}/test_ovsdb_monitor.py | 52 +- .../unit/agent/common/test_placement_report.py | 188 +++++ .../test_resource_processing_queue.py} | 65 +- .../agent/l3/extensions/qos/test_gateway_ip.py | 221 ++++++ .../agent/l3/extensions/test_port_forwarding.py | 2 +- .../unit/agent/l3/extensions/test_snat_log.py | 50 ++ .../linux/openvswitch_firewall/test_firewall.py | 13 +- .../agent/linux/openvswitch_firewall/test_rules.py | 13 +- .../unit/agent/linux/test_iptables_firewall.py | 60 +- .../unit/agent/linux/test_iptables_manager.py | 9 +- .../unit/agent/ovsdb/native/test_connection.py | 212 ++++-- .../rpc/agentnotifiers/test_dhcp_rpc_agent_api.py | 37 +- .../rpc/agentnotifiers/test_l3_rpc_agent_api.py | 6 +- .../api/rpc/handlers/test_securitygroups_rpc.py | 4 +- .../unit/extensions/test_data_plane_status.py | 4 +- .../unit/extensions/test_default_subnetpools.py | 8 +- .../test_expose_port_forwarding_in_fip.py | 253 ++++++- .../extensions/test_floating_ip_port_forwarding.py | 102 +++ .../extensions/test_network_ip_availability.py | 19 +- .../unit/extensions/test_network_segment_range.py | 350 +++++++++ .../extensions/test_uplink_status_propagation.py | 71 ++ .../ipam/drivers/neutrondb_ipam/test_driver.py | 61 +- .../extensions/test_uplink_status_propagation.py | 33 + .../unit/objects/test_network_segment_range.py | 138 ++++ .../ml2/drivers/agent/test__common_agent.py | 10 +- .../unit/plugins/ml2/drivers/base_type_tunnel.py | 52 +- .../unit/plugins/ml2/drivers/l2pop/test_db.py | 15 +- .../plugins/ml2/drivers/l2pop/test_mech_driver.py | 119 ++- .../agent/extension_drivers/test_qos_driver.py | 24 +- .../agent/test_linuxbridge_neutron_agent.py | 24 +- .../macvtap/agent/test_macvtap_neutron_agent.py | 22 +- .../unit/plugins/ml2/drivers/mech_fake_agent.py | 4 + .../mech_sriov/agent/test_eswitch_manager.py | 35 +- .../ml2/drivers/mech_sriov/agent/test_pci_lib.py | 4 +- .../mech_sriov/agent/test_sriov_nic_agent.py | 163 ++++- .../mech_driver/test_mech_sriov_nic_switch.py | 138 +++- .../unit/plugins/ml2/drivers/mechanism_test.py | 17 + .../agent/extension_drivers/test_qos_driver.py | 64 +- .../ml2/drivers/openvswitch/agent/fake_oflib.py | 114 +-- .../agent/openflow/native/ovs_bridge_test_base.py | 18 +- .../agent/openflow/native/test_br_int.py | 7 + .../agent/openflow/native/test_ofswitch.py | 4 +- .../agent/openflow/native/test_ovs_bridge.py | 2 +- .../agent/openflow/ovs_ofctl/test_br_int.py | 2 + .../ml2/drivers/openvswitch/agent/ovs_test_base.py | 15 +- .../agent/test_ovs_agent_extension_api.py | 26 +- .../openvswitch/agent/test_ovs_neutron_agent.py | 569 ++++++-------- .../drivers/openvswitch/agent/test_ovs_tunnel.py | 24 +- .../mech_driver/test_mech_openvswitch.py | 139 +++- .../unit/plugins/ml2/drivers/test_type_flat.py | 3 +- .../unit/plugins/ml2/drivers/test_type_geneve.py | 1 + .../unit/plugins/ml2/drivers/test_type_gre.py | 1 + .../unit/plugins/ml2/drivers/test_type_vlan.py | 45 +- .../unit/plugins/ml2/drivers/test_type_vxlan.py | 1 + .../extensions/test_uplink_status_propagation.py | 70 ++ .../unit/plugins/ml2/test_extension_driver_api.py | 3 +- .../privileged/agent/linux/test_netlink_lib.py | 54 +- .../unit/scheduler/test_dhcp_agent_scheduler.py | 2 +- .../unit/scheduler/test_l3_agent_scheduler.py | 100 ++- .../service_providers/test_driver_controller.py | 10 +- .../services/logapi/agent/test_log_extension.py | 3 +- .../unit/services/logapi/common/test_db_api.py | 25 + .../services/logapi/common/test_snat_validate.py | 120 +++ .../drivers/openvswitch/test_ovs_firewall_log.py | 11 +- .../unit/services/logapi/drivers/test_manager.py | 2 +- .../metering/agents/test_metering_agent.py | 2 +- .../unit/services/metering/test_metering_plugin.py | 2 +- .../services/network_segment_range/__init__.py | 0 .../services/network_segment_range/test_plugin.py | 240 ++++++ .../unit/services/placement_report/__init__.py | 0 .../unit/services/placement_report/test_plugin.py | 243 ++++++ .../unit/services/portforwarding/test_pf_plugin.py | 41 +- .../unit/services/qos/drivers/test_manager.py | 2 +- .../services/revisions/test_revision_plugin.py | 24 +- .../trunk/drivers/linuxbridge/agent/test_driver.py | 22 +- .../linuxbridge/agent/test_trunk_plumber.py | 91 +-- .../openvswitch/agent/test_ovsdb_handler.py | 14 +- neutron/worker.py | 18 +- neutron/wsgi.py | 44 +- playbooks/configure_functional_job.yaml | 4 + playbooks/dvr-multinode-scenario-pre-run.yaml | 3 + .../legacy/neutron-fullstack-python35/post.yaml | 80 -- .../legacy/neutron-fullstack-python35/run.yaml | 54 -- .../legacy/neutron-fullstack-with-uwsgi/post.yaml | 80 -- .../legacy/neutron-fullstack-with-uwsgi/run.yaml | 67 -- playbooks/legacy/neutron-fullstack/post.yaml | 80 -- playbooks/legacy/neutron-fullstack/run.yaml | 54 -- .../legacy/neutron-functional-python35/post.yaml | 80 -- .../legacy/neutron-functional-python35/run.yaml | 54 -- .../legacy/neutron-functional-with-uwsgi/post.yaml | 80 -- .../legacy/neutron-functional-with-uwsgi/run.yaml | 67 -- playbooks/legacy/neutron-functional/post.yaml | 80 -- playbooks/legacy/neutron-functional/run.yaml | 54 -- .../legacy/neutron-grenade-dvr-multinode/run.yaml | 1 + .../legacy/neutron-grenade-multinode/run.yaml | 1 + .../neutron-tempest-dvr-ha-multinode-full/run.yaml | 63 -- playbooks/legacy/neutron-tempest-dvr/post.yaml | 15 - playbooks/legacy/neutron-tempest-dvr/run.yaml | 44 -- .../neutron-tempest-iptables_hybrid/post.yaml | 15 - .../neutron-tempest-iptables_hybrid/run.yaml | 48 -- .../legacy/neutron-tempest-linuxbridge/post.yaml | 15 - .../legacy/neutron-tempest-linuxbridge/run.yaml | 57 -- .../neutron-tempest-multinode-full/post.yaml | 15 - .../legacy/neutron-tempest-multinode-full/run.yaml | 64 -- .../post.yaml | 0 .../run.yaml | 10 +- .../neutron-tempest-with-ryu-master/post.yaml | 15 - playbooks/post_functional_job.yaml | 5 + playbooks/run_functional_job.yaml | 10 + rally-jobs/plugins/trunk_scenario.py | 61 -- rally-jobs/task-neutron.yaml | 170 ++++- ...s-upgrade-check-framework-fc34d03c8829672c.yaml | 16 + .../add-floatingip-pool-api-6927362ef87fdbe5.yaml | 8 + ...k-segment-range-extension-0893a67cbf3f10fe.yaml | 25 + ...d-port-forwarding-fip-qos-f808d6b4826fb849.yaml | 7 + ...ate_uplink_status-to-port-f4e53395e86eb3cb.yaml | 15 + ...sponse_max_timeout-option-cfaad5ef6af31632.yaml | 5 + .../add-security-groups-rbac-6f133ec4d40e7641.yaml | 4 + ...fication-signature-status-6a9b9dbce9cb9740.yaml | 12 + .../bandwidth-config-ovs-5bede7fb43b0a574.yaml | 12 + .../bandwidth-config-sriov-bd8ff8b4d84c8792.yaml | 12 + ...orwarding-uniq-constraint-78ba3db20bce5fd2.yaml | 12 + ...t_binding_levels-function-84012e104ac572a1.yaml | 7 + ...nc-throttle-config-option-9f2375e3baf683ad.yaml | 17 + .../dnsmasq-local-service-c8eaa91894a7d6d4.yaml | 8 + ...resize-agent-greenthreads-c163ab37d36fcafe.yaml | 10 + ...ork_bridge-option-removed-bbf50fb803f04f82.yaml | 6 + ...ch-specific-column-in-ovo-69c0b087c8c7ee36.yaml | 6 + .../fip-binding-limitation-1d2509950847b085.yaml | 7 + ...g-logging-and-fwg-logging-ef16077880d76449.yaml | 7 + ...e-request-as-binding-data-2a01c1ed1a8eff66.yaml | 10 + .../notes/gateway-rate-limit-905bee1ed60c6b8e.yaml | 15 + ...e_mappings_for_mechdriver-bc039d478ea0b162.yaml | 7 + ...ypes-configurable-for-ovs-fc73422daffd42b0.yaml | 9 + ...es-configurable-for-sriov-094f7663e8975e9b.yaml | 9 + ...ver-load-interface-driver-ca397f1db40ec643.yaml | 7 + ...y_api_rpc_worker_defaults-1acd62728b2b55fa.yaml | 15 + ...cise-agent-state-transfer-67c771cb1ee04dd0.yaml | 32 + ...mum-bw-reject-non-physnet-2f4ccddf484369fd.yaml | 5 + ...qos-rules-alias-extension-ebf23b87460ee36e.yaml | 9 + .../reject-min-bw-updates-30bd0e3201dafce1.yaml | 8 + ...terface-ovs-vsctl-timeout-a618ec8e27552202.yaml | 7 + ...service-plugin-dependency-c8bf620b2526b869.yaml | 22 + .../setproctitle_workers-bc27a8baa5ef2279.yaml | 20 + ...y-group-port-check-in-api-d1fd84d9663e04ab.yaml | 11 + .../notes/subnet-onboard-e4d09fa403a1053e.yaml | 13 + ...E-and-AFTER_UPDATE-events-839d8dcb0ac5ff26.yaml | 5 + releasenotes/source/index.rst | 1 + releasenotes/source/rocky.rst | 6 + requirements.txt | 26 +- roles/fetch_journal_log/README.rst | 16 + roles/fetch_journal_log/defaults/main.yaml | 2 + roles/fetch_journal_log/tasks/main.yaml | 22 + roles/setup_logdir/README.rst | 8 + roles/setup_logdir/defaults/main.yaml | 1 + roles/setup_logdir/tasks/main.yaml | 8 + setup.cfg | 24 +- test-requirements.txt | 6 +- tools/abandon_old_reviews.sh | 53 +- tools/configure_for_func_testing.sh | 2 +- tools/deploy_rootwrap.sh | 2 +- tools/generate_config_file_samples.sh | 2 - tools/misc-sanity-checks.sh | 13 - tools/pip_install_src_modules.sh | 25 + tox.ini | 68 +- 856 files changed, 31665 insertions(+), 13417 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 2961e8a509..5b425e3711 100644 --- a/requirements.txt +++ b/requirements.txt @@ -4 +4 @@ -pbr!=2.1.0,>=2.0.0 # Apache-2.0 +pbr>=4.0.0 # Apache-2.0 @@ -11 +11 @@ eventlet!=0.18.3,!=0.20.1,>=0.18.2 # MIT -pecan!=1.0.2,!=1.0.3,!=1.0.4,!=1.2,>=1.1.1 # BSD +pecan>=1.3.2 # BSD @@ -12,0 +13 @@ httplib2>=0.9.1 # MIT +requests>=2.14.2 # Apache-2.0 @@ -17 +18 @@ netifaces>=0.10.4 # MIT -neutron-lib>=1.18.0 # Apache-2.0 +neutron-lib>=1.25.0 # Apache-2.0 @@ -20,3 +21,2 @@ tenacity>=3.2.1 # Apache-2.0 -ryu>=4.24 # Apache-2.0 -SQLAlchemy!=1.1.5,!=1.1.6,!=1.1.7,!=1.1.8,>=1.2.0 # MIT -WebOb>=1.7.1 # MIT +SQLAlchemy>=1.2.0 # MIT +WebOb>=1.8.2 # MIT @@ -28,2 +28,2 @@ oslo.cache>=1.26.0 # Apache-2.0 -oslo.concurrency>=3.25.0 # Apache-2.0 -oslo.config>=5.1.0 # Apache-2.0 +oslo.concurrency>=3.26.0 # Apache-2.0 +oslo.config>=5.2.0 # Apache-2.0 @@ -31 +31 @@ oslo.context>=2.19.2 # Apache-2.0 -oslo.db>=4.27.0 # Apache-2.0 +oslo.db>=4.37.0 # Apache-2.0 @@ -37 +37 @@ oslo.policy>=1.30.0 # Apache-2.0 -oslo.privsep>=1.23.0 # Apache-2.0 +oslo.privsep>=1.32.0 # Apache-2.0 @@ -41,0 +42 @@ oslo.service!=1.28.1,>=1.24.0 # Apache-2.0 +oslo.upgradecheck>=0.1.0 # Apache-2.0 @@ -43 +44 @@ oslo.utils>=3.33.0 # Apache-2.0 -oslo.versionedobjects>=1.31.2 # Apache-2.0 +oslo.versionedobjects>=1.35.1 # Apache-2.0 @@ -44,0 +46 @@ osprofiler>=1.4.0 # Apache-2.0 +os-ken >= 0.3.0 # Apache-2.0 @@ -48 +50 @@ psutil>=3.2.2 # BSD -pyroute2>=0.4.21;sys_platform!='win32' # Apache-2.0 (+ dual licensed GPL2) +pyroute2>=0.5.3;sys_platform!='win32' # Apache-2.0 (+ dual licensed GPL2) diff --git a/test-requirements.txt b/test-requirements.txt index 5806b7c503..c1f849f4c5 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -9,0 +10 @@ flake8-import-order==0.12 # LGPLv3 +pycodestyle>=2.0.0 # MIT @@ -20 +21,4 @@ ddt>=1.0.1 # MIT -pylint==1.4.5 # GPLv2 +astroid==1.6.5;python_version<"3.0" # LGPLv2.1 +astroid==2.1.0;python_version>="3.0" # LGPLv2.1 +pylint==1.9.2;python_version<"3.0" # GPLv2 +pylint==2.2.0;python_version>="3.0" # GPLv2

1 0

searchlight-ui 6.0.0 (stein)
by no-reply＠openstack.org 10 Apr '19

10 Apr '19

We are pleased to announce the release of: searchlight-ui 6.0.0: Horizon panels and libraries for Searchlight This release is part of the stein release series. The source is available from: https://git.openstack.org/cgit/openstack/searchlight-ui Download the package from: https://pypi.org/project/searchlight-ui Please report issues through: https://storyboard.openstack.org/#!/project/openstack/searchlight- ui For more details, please see below. Changes in searchlight-ui 4.0.0..6.0.0 -------------------------------------- ee2e371 Add nodejs10 jobs on bionic. b8dad65 Update setup.cfg d7d1760 Drop py35 tox test ce77522 Drop py35 tests 0dcb3e8 Update storyboard links 3c5f619 Switch to horizon-nodejs4-jobs template 828935d Add py37 unit tests c50d9a7 Update json module to jsonutils a3b185d Imported Translations from Zanata 5f636bc Update hacking version f00bb6e Change openstack-dev to openstack-discuss d30c298 Imported Translations from Zanata faef59b Make search settings themeable and simpler d86ed52 Add Favorites ability for search queries 768b614 Update min tox version to 2.0 0ff2869 Imported Translations from Zanata 0b2cf9c Correct project git urls 7232827 Add Searclight Policy README ef25285 Deprecated error method 439513e Update .gitignore ee2797c Update tests 9582e8a Revert "Update zuul config" d7d1af7 Update zuul config a47b6e4 Reorganize docs and add py36 test 6953c72 fix tox python3 overrides a1bd0b0 Update zuul config to include horizon tests d5024e0 Change launchpad to storyboard links 1ff4c61 Update index webpage bb91b8f Add some notes regarding JS dev installation 8006bf7 Remove os-nova-servers resource type a612c1a Fix links to subnets and ports 42043f3 Update package.json da2191e switch documentation job to new PTI 1a5ba87 import zuul job settings from project-config db1810f Switch to use stestr for unit test 20e67cf Follow the new PTI for building docs ee79da8 Add releasenotes link to README 346f15d Rename test files to test_* pattern 7fb6b2d Imported Translations from Zanata 14befb0 Update old doc links in docs 42f8635 [Trivialfix]Modify a grammatical error c58bad3 Imported Translations from Zanata 5b5aef3 Update reno for stable/queens Diffstat (except docs and test files) ------------------------------------- .gitignore | 6 +- .mailmap | 3 - .stestr.conf | 3 + .testr.conf | 7 - .zuul.yaml | 17 + CONTRIBUTING.rst | 8 +- HACKING.rst | 2 +- README.rst | 107 +---- devstack/plugin.sh | 2 +- devstack/README.rst => doc/source/devstack.rst | 0 lower-constraints.txt | 18 + package.json | 16 +- releasenotes/source/conf.py | 8 +- releasenotes/source/index.rst | 1 + .../source/locale/de/LC_MESSAGES/releasenotes.po | 18 +- .../locale/en_GB/LC_MESSAGES/releasenotes.po | 18 +- .../source/locale/fr/LC_MESSAGES/releasenotes.po | 10 +- .../source/locale/id/LC_MESSAGES/releasenotes.po | 16 +- .../locale/ko_KR/LC_MESSAGES/releasenotes.po | 8 +- .../source/locale/ru/LC_MESSAGES/releasenotes.po | 10 +- .../locale/zh_CN/LC_MESSAGES/releasenotes.po | 8 +- releasenotes/source/queens.rst | 6 + requirements.txt | 7 +- searchlight_ui/api/rest/searchlight.py | 5 +- searchlight_ui/conf/README.rst | 7 + searchlight_ui/karma.conf.js | 53 +-- searchlight_ui/locale/cs/LC_MESSAGES/djangojs.po | 278 +---------- searchlight_ui/locale/de/LC_MESSAGES/djangojs.po | 356 ++------------ searchlight_ui/locale/en_AU/LC_MESSAGES/django.po | 12 +- searchlight_ui/locale/en_GB/LC_MESSAGES/django.po | 8 +- .../locale/en_GB/LC_MESSAGES/djangojs.po | 351 ++------------ searchlight_ui/locale/fr/LC_MESSAGES/djangojs.po | 252 +--------- searchlight_ui/locale/id/LC_MESSAGES/djangojs.po | 305 +----------- searchlight_ui/locale/ja/LC_MESSAGES/djangojs.po | 281 +---------- searchlight_ui/locale/ko_KR/LC_MESSAGES/django.po | 8 +- .../locale/ko_KR/LC_MESSAGES/djangojs.po | 515 ++++++++++----------- searchlight_ui/locale/pt_BR/LC_MESSAGES/django.po | 8 +- searchlight_ui/locale/ru/LC_MESSAGES/djangojs.po | 314 +------------ searchlight_ui/locale/tr_TR/LC_MESSAGES/django.po | 8 +- .../locale/tr_TR/LC_MESSAGES/djangojs.po | 309 +------------ searchlight_ui/locale/zh_CN/LC_MESSAGES/django.po | 8 +- .../locale/zh_CN/LC_MESSAGES/djangojs.po | 298 +----------- searchlight_ui/locale/zh_TW/LC_MESSAGES/django.po | 10 +- .../openstack-service-api/searchlight.service.js | 4 +- .../os-nova-servers/actions/actions.module.js | 176 ------- .../actions/attach-interface.service.js | 56 --- .../actions/create-snapshot.controller.js | 67 --- .../actions/create-snapshot.controller.spec.js | 65 --- .../os-nova-servers/actions/create-snapshot.html | 32 -- .../actions/create-snapshot.service.js | 156 ------- .../actions/create-snapshot.service.spec.js | 200 -------- .../actions/delete-instance.service.js | 196 -------- .../actions/delete-instance.service.spec.js | 179 ------- .../actions/generic-actions.service.spec.js | 195 -------- .../actions/generic-simple.service.js | 98 ---- .../os-nova-servers/actions/hard-reboot.service.js | 56 --- .../actions/launch-instance.service.js | 68 --- .../actions/launch-instance.service.spec.js | 58 --- .../os-nova-servers/actions/pause.service.js | 57 --- .../os-nova-servers/actions/resume.service.js | 56 --- .../os-nova-servers/actions/soft-reboot.service.js | 56 --- .../os-nova-servers/actions/start.service.js | 55 --- .../os-nova-servers/actions/stop.service.js | 56 --- .../os-nova-servers/actions/suspend.service.js | 56 --- .../os-nova-servers/actions/unpause.service.js | 56 --- .../details/action-log.controller.js | 93 ---- .../details/action-log.controller.spec.js | 68 --- .../os-nova-servers/details/action-log.html | 15 - .../os-nova-servers/details/console.controller.js | 72 --- .../details/console.controller.spec.js | 72 --- .../resources/os-nova-servers/details/console.html | 22 - .../os-nova-servers/details/details.module.js | 79 ---- .../os-nova-servers/details/log.controller.js | 59 --- .../os-nova-servers/details/log.controller.spec.js | 87 ---- .../resources/os-nova-servers/details/log.html | 15 - .../os-nova-servers/details/overview.controller.js | 91 ---- .../details/overview.controller.spec.js | 121 ----- .../os-nova-servers/details/overview.html | 92 ---- .../os-nova-servers/instance-status.service.js | 109 ----- .../os-nova-servers/os-nova-servers.module.js | 187 -------- .../static/resources/os-nova-servers/summary.html | 9 - .../static/resources/resources.module.js | 1 - .../static/searchlight-ui/searchlight-ui.scss | 13 + .../settings/add-favorite-modal.controller.js | 27 ++ .../settings/add-favorite-modal.html | 46 ++ .../settings/manage-favorites-modal.controller.js | 39 ++ .../settings/manage-favorites-modal.html | 46 ++ .../searchlight-ui/settings/search-settings.html | 302 ++++++------ .../settings/search-settings.service.js | 51 +- .../table/search-table.controller.js | 25 +- .../static/searchlight-ui/table/search-table.html | 58 ++- .../util/resource-locator.service.js | 6 +- .../util/searchlight-facet-utils.service.js | 2 +- .../util/searchlight-query-utils.service.js | 2 +- setup.cfg | 10 +- test-requirements.txt | 12 +- tools/gate/integration/pre_test_hook.sh | 2 +- tox.ini | 66 ++- 108 files changed, 1217 insertions(+), 6524 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index b2608e4..3248488 100644 --- a/requirements.txt +++ b/requirements.txt @@ -5 +5,2 @@ -pbr>=1.6 # Apache-2.0 +oslo.log>=3.36.0 # Apache-2.0 +pbr!=2.1.0,>=2.0.0 # Apache-2.0 @@ -6,0 +8,4 @@ Babel>=1.3 # BSD + +# This will be installed from git in OpenStack CI if the job setting +# required-projects for horizon: +horizon>=14.0.0.0b3 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index bd8df91..1d63146 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -5 +5 @@ -hacking>=0.12.0,!=0.13.0,<0.14 # Apache-2.0 +hacking>=1.1.0,<1.2.0 # Apache-2.0 @@ -7 +6,0 @@ hacking>=0.12.0,!=0.13.0,<0.14 # Apache-2.0 -http://tarballs.openstack.org/horizon/horizon-master.tar.gz#egg=horizon @@ -10 +9 @@ ddt>=1.0.1 # MIT -django-nose>=1.2 # BSD +nodeenv>=1.3.2 # BSD @@ -12 +10,0 @@ python-subunit>=0.0.18 # Apache-2.0/BSD -nose-exclude # LGPL @@ -14,2 +12 @@ selenium>=2.50.1 # Apache-2.0 -sphinx!=1.2.0,!=1.3b1,<1.3,>=1.1.2 # BSD -oslosphinx!=3.4.0,>=2.5.0 # Apache-2.0 +sphinx>=1.6.2 # BSD @@ -17,2 +14 @@ oslotest>=1.10.0 # Apache-2.0 -reno>=1.6.2 # Apache2 -testrepository>=0.0.18 # Apache-2.0/BSD +stestr>=2.0.0 # Apache-2.0

1 0

networking-bgpvpn 10.0.0 (stein)
by no-reply＠openstack.org 10 Apr '19

10 Apr '19

We are delighted to announce the release of: networking-bgpvpn 10.0.0: API and Framework to interconnect bgpvpn to neutron networks This release is part of the stein release series. The source is available from: https://git.openstack.org/cgit/openstack/networking-bgpvpn Download the package from: https://pypi.org/project/networking-bgpvpn Please report issues through: https://bugs.launchpad.net/bgpvpn/+bugs For more details, please see below. Changes in networking-bgpvpn 9.0.0..10.0.0 ------------------------------------------ 1c2b7c7 fix tox python3 overrides 5b43aff stop using common db mixin 47c8a5b add python 3.7 unit test job a11d46e use rpc from neutron-lib 9203bfe tox: make pep8-dev use python3 like pep8 b2a6a7b Remove tripleo newton and ocata jobs ddb459a Upgrade pylint to a version that works with python3 40951db make tempest bgpvpn tests voting again 2ba48eb Convert policy.json into policy-in-code 1a4cf31 use neutron-lib for model_query bab36be Replace tripleo scenario004-multinode with scenario004-standalone 3654b49 use payloads for ROUTER_INTERFACE BEFORE_DELETE events 201b3ee Change openstack-dev to openstack-discuss 0a795fe Trival-fix: Missing parameter in declaration 1ce7922 Update min tox version to 2.0 612a325 use context manager from neutron-lib 60a852c Increment versioning with pbr instruction d6776fd Remove extra publish-openstack-python-branch-tarball job c33002f add local tox targets for pep8 and py3 6d37119 opt in for neutron-lib consumption patches 96b850e Import legacy jobs a0c4b6c Fix lower-constraints.txt 892c9f9 Drop nose dependencies 2e3ad7c Cleanup .zuul.yaml 8c22696 mark test_router_association_update unit test as unreliable aa96e0e tempest: reenable tests now that bug 1789878 is fixed aaa13ab Remove opencontrail configurations bbee944 Remove dead code ad69810 adjust requirements 7d519b5 remove deprecated drivers with out-of-tree alternatives c30e20d add python 3.6 unit test job 4897b5c tempest: temporarily disable some tests until bug 1789878 is fixed 67d9717 switch documentation job to new PTI 82db938 import zuul job settings from project-config 532465a Remove use_mox directive dda00b2 Update reno for stable/rocky Diffstat (except docs and test files) ------------------------------------- .pylintrc | 3 + .zuul.yaml | 124 +++++- bgpvpn_dashboard/test/helpers.py | 6 - devstack/plugin.sh | 1 - .../configuration/samples/opencontrail-driver.rst | 9 - etc/neutron/policy.d/bgpvpn.conf | 45 --- etc/oslo-config-generator/opencontrail-driver.conf | 5 - etc/oslo-policy-generator/policy.conf | 3 + lower-constraints.txt | 16 +- networking_bgpvpn/neutron/db/bgpvpn_db.py | 122 +++--- networking_bgpvpn/neutron/opts.py | 9 - .../neutron/services/common/constants.py | 2 +- .../services/service_drivers/bagpipe/bagpipe.py | 20 +- .../services/service_drivers/bagpipe/bagpipe_v2.py | 20 +- .../neutron/services/service_drivers/driver_api.py | 29 +- .../service_drivers/opencontrail/__init__.py | 0 .../service_drivers/opencontrail/exceptions.py | 65 ---- .../service_drivers/opencontrail/opencontrail.py | 431 --------------------- .../opencontrail/opencontrail_client.py | 359 ----------------- .../service_drivers/opendaylight/__init__.py | 0 .../services/service_drivers/opendaylight/odl.py | 127 ------ networking_bgpvpn/policies/__init__.py | 27 ++ networking_bgpvpn/policies/base.py | 17 + networking_bgpvpn/policies/bgpvpn.py | 232 +++++++++++ networking_bgpvpn/policies/network_association.py | 91 +++++ networking_bgpvpn/policies/port_association.py | 90 +++++ networking_bgpvpn/policies/router_association.py | 90 +++++ .../unit/extensions/test_bgpvpn_routes_control.py | 4 + .../post.yaml | 15 + .../run.yaml | 80 ++++ .../post.yaml | 15 + .../run.yaml | 80 ++++ .../networking-bgpvpn-dsvm-functional/post.yaml | 15 + .../networking-bgpvpn-dsvm-functional/run.yaml | 78 ++++ playbooks/networking-bgpvpn-dsvm-install/post.yaml | 15 + playbooks/networking-bgpvpn-dsvm-install/run.yaml | 78 ++++ .../remove_obsolete_drivers-3706e080098a5cb6.yaml | 5 + releasenotes/source/index.rst | 1 + releasenotes/source/rocky.rst | 6 + requirements.txt | 10 +- setup.cfg | 9 +- test-requirements.txt | 6 +- tox.ini | 34 +- 55 files changed, 1287 insertions(+), 1353 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index cf79fea..c344f3a 100644 --- a/requirements.txt +++ b/requirements.txt @@ -17,2 +17,8 @@ debtcollector>=1.2.0 # Apache-2.0 -neutron>=13.0.0.0b1 # Apache-2.0 -horizon>=13.0.0 # Apache-2.0 +neutron>=13.0.0 # Apache-2.0 +horizon>=14.0.0 # Apache-2.0 + +# The comment below indicates this project repo is current with neutron-lib +# and should receive neutron-lib consumption patches as they are released +# in neutron-lib. It also implies the project will stay current with TC +# and infra initiatives ensuring consumption patches can land. +# neutron-lib-current diff --git a/test-requirements.txt b/test-requirements.txt index 6b268b6..90d5751 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -8 +7,0 @@ coverage!=4.4,>=4.0 # Apache-2.0 -django-nose>=1.4.4 # BSD @@ -18 +17 @@ testtools>=2.2.0 # MIT -pylint==1.4.5 # GPLv2 +pylint==1.9.2 # GPLv2 @@ -23,2 +22 @@ tempest>=17.1.0 # Apache-2.0 -networking-bagpipe>=8.0.0 # Apache-2.0 -networking-odl>=12.0.0 # Apache-2.0 +networking-bagpipe>=9.0.0 # Apache-2.0

1 0

sahara 10.0.0 (stein)
by no-reply＠openstack.org 10 Apr '19

10 Apr '19

We are pumped to announce the release of: sahara 10.0.0: Sahara project This release is part of the stein release series. The source is available from: https://git.openstack.org/cgit/openstack/sahara Download the package from: https://tarballs.openstack.org/sahara/ Please report issues through: https://bugs.launchpad.net/sahara/+bugs For more details, please see below. Changes in sahara 9.0.0.0rc1..10.0.0 ------------------------------------ bb5f75db doc: refer to the split plugin documentation dc17f190 Making Sahara Python 3 compatible 8010e24a grenade: re-enable, really test rocky->master f0a1cc99 Fix the lower-requirements job: libpq-dev, psycopg 2.7 cd68ad36 Add missing ws seperator between words b95503f3 Use authorize instead of enforce for policies f422b31b Fixing policies inconsistencies 423a9bf5 Add API v2 jobs (scenario, tempest); buildimages fixes 47ca63ae add python 3.7 unit test job b21e6969 Adapt to the additional rules from pycodestyle 2.5.0 8f62975a Fixing NTP issues for CDH plugin f6afe5b7 Adding spark build image job 21791d1f Changing hdfs fs to hdfs dfs 55bd5da5 Dynamically loading plugins 7f8c565d Add missing ws separator between words e51dd010 Make sure that default_ntp_server option is exported 1c16c48b Fix version discovery for Python 3 92686f5a Prepare Sahara core for plugin split a83c97f4 Declare APIv2 stable and CURRENT 33489a1f Give the illusion of microversion support 69d74c1a Some polish for APIv2 4bfd800f API v2: fix "local variable 'c' referenced before assignment" 7105a891 APIv2 - Fix 500 on malformed query string on 359b89de Enhance boot from volume 0b8002a9 APIv2 - api-ref documentation for APIv2 81d05942 Deploying Sahara with unversioned endpoints 596c2599 Fix validation of job binary with Python3 904d70f1 Migrate away from oslo_i18n.enable_lazy() 9bf50ce5 APIv2 Changing return payload to project_id 0b8ab036 Fixing cluster scale 5bb7f379 doc: Fix the snippet in "The Script Validator" section 7e24f288 String-related fixes for Python 3 3c165262 fixed word error c4554ccd Add DEBIAN_FRONTEND=noninteractive in front of apt-get install commands 61b0b2e0 Bump the version of hacking to 1.1.0, with few fixes 425c8256 Update devel info: mailing list, meeting time 98ac996d Update http link to https 7a815ac0 Add python 3.6 unit test job cc41e862 Add framework for sahara-status upgrade check 4a44010f doc: restructure the image building documentation 01d465dd Fixing image validation for Ambari 2.3 3f22c4a9 Cleanup tox.ini constraint handling 8bded6c9 Increase the startup time of ambari-server to 180s 3f292dbc Increment versioning with pbr instruction 059457e8 Fix a typo on Storm plugin cluster info (Strom -> Storm) 12b270b0 sahara-image-pack: use curl for tarballs.openstack.org 3a2b3f63 sahara-image-pack: remove bashisms from shell scripts 4e39a45f adds unit test for ssh_remote.replace_remote_line e0fd845d Force the format of ssh key to PEM, at least for now e7a4b58c Add template param for ambari pkg install timeout 98777adc Use templates lower-constraints, update cover job 45714289 grenade: relevant fixes for master (sahara-api/apache) 10e48a37 doc: update distro information and cloud-init users aa514b51 Fixed link for more information about Ambari images c59780a9 Correct repo_id_map for hdp 2.5 b4535e5d Make sahara-grenade job voting on the "gate" queue too 5a3ae85c Import the legacy grenade sahara job b248ef27 Correct Hbase ports in Ambari plugin 4ac73ea6 Fixing anti-affinity for Sahara f8566f6d add python 3.6 unit test job 10b64c23 switch documentation job to new PTI 25369d92 import zuul job settings from project-config 1b659db8 Imported Translations from Zanata 1cf0c5c6 Update reno for stable/rocky 77a106a8 Adapt to Keystone changes: use member instead of Member Diffstat (except docs and test files) ------------------------------------- .gitignore | 1 + .zuul.yaml | 75 +- api-ref/source/index.rst | 1 + api-ref/source/v1.1/index.rst | 6 +- api-ref/source/v2/cluster-templates.inc | 241 + api-ref/source/v2/clusters.inc | 293 + api-ref/source/v2/data-sources.inc | 202 + api-ref/source/v2/event-log.inc | 42 + api-ref/source/v2/image-registry.inc | 244 + api-ref/source/v2/index.rst | 20 + api-ref/source/v2/job-binaries.inc | 256 + api-ref/source/v2/job-templates.inc | 257 + api-ref/source/v2/job-types.inc | 61 + api-ref/source/v2/jobs.inc | 262 + api-ref/source/v2/node-group-templates.inc | 289 + api-ref/source/v2/parameters.yaml | 1183 ++++ api-ref/source/v2/plugins.inc | 179 + .../cluster-template-create-request.json | 17 + .../cluster-template-create-response.json | 82 + .../cluster-template-show-response.json | 82 + .../cluster-template-update-request.json | 11 + .../cluster-template-update-response.json | 67 + .../cluster-templates-list-response.json | 140 + .../samples/clusters/cluster-create-request.json | 9 + .../samples/clusters/cluster-create-response.json | 128 + .../v2/samples/clusters/cluster-scale-request.json | 15 + .../samples/clusters/cluster-scale-response.json | 370 ++ .../v2/samples/clusters/cluster-show-response.json | 128 + .../samples/clusters/cluster-update-request.json | 4 + .../samples/clusters/cluster-update-response.json | 128 + .../samples/clusters/clusters-list-response.json | 327 ++ .../clusters/multiple-clusters-create-request.json | 11 + .../multiple-clusters-create-response.json | 6 + .../data-source-register-hdfs-request.json | 6 + .../data-source-register-hdfs-response.json | 14 + .../data-source-register-swift-request.json | 10 + .../data-source-register-swift-response.json | 14 + .../data-sources/data-source-show-response.json | 14 + .../data-sources/data-source-update-request.json | 4 + .../data-sources/data-source-update-response.json | 14 + .../data-sources/data-sources-list-response.json | 28 + .../event-log/cluster-progress-response.json | 72 + .../image-registry/image-register-request.json | 4 + .../image-registry/image-register-response.json | 25 + .../image-registry/image-show-response.json | 24 + .../image-registry/image-tags-add-request.json | 7 + .../image-registry/image-tags-add-response.json | 27 + .../image-registry/image-tags-delete-request.json | 5 + .../image-registry/image-tags-delete-response.json | 25 + .../image-registry/images-list-response.json | 48 + .../v2/samples/job-binaries/create-request.json | 9 + .../v2/samples/job-binaries/create-response.json | 13 + .../v2/samples/job-binaries/list-response.json | 37 + .../v2/samples/job-binaries/show-data-response | 3 + .../v2/samples/job-binaries/show-response.json | 13 + .../v2/samples/job-binaries/update-request.json | 5 + .../v2/samples/job-binaries/update-response.json | 13 + .../job-templates/job-template-create-request.json | 11 + .../job-template-create-response.json | 35 + .../job-templates/job-template-show-response.json | 26 + .../job-templates/job-template-update-request.json | 4 + .../job-template-update-response.json | 26 + .../job-templates/job-templates-list-response.json | 66 + .../samples/job-types/job-types-list-response.json | 209 + .../source/v2/samples/jobs/cancel-response.json | 120 + api-ref/source/v2/samples/jobs/job-request.json | 20 + api-ref/source/v2/samples/jobs/job-response.json | 30 + .../source/v2/samples/jobs/job-update-request.json | 3 + .../v2/samples/jobs/job-update-response.json | 120 + api-ref/source/v2/samples/jobs/list-response.json | 122 + .../node-group-template-create-request.json | 13 + .../node-group-template-create-response.json | 33 + .../node-group-template-show-response.json | 37 + .../node-group-template-update-request.json | 10 + .../node-group-template-update-response.json | 30 + .../node-group-templates-list-response.json | 76 + .../v2/samples/plugins/plugin-show-response.json | 12 + .../v2/samples/plugins/plugin-update-request.json | 7 + .../v2/samples/plugins/plugin-update-response.json | 32 + .../plugins/plugin-version-show-response.json | 92 + .../v2/samples/plugins/plugins-list-response.json | 41 + bindep.txt | 1 + devstack/plugin.sh | 75 +- devstack/settings | 21 + devstack/upgrade/from-rocky/upgrade-sahara | 18 + devstack/upgrade/resources.sh | 2 +- devstack/upgrade/settings | 13 +- devstack/upgrade/shutdown.sh | 3 +- devstack/upgrade/upgrade.sh | 3 +- .../user/building-guest-images/baremetal.rst | 14 + .../building-guest-images/sahara-image-create.rst | 80 + .../building-guest-images/sahara-image-pack.rst | 90 + lower-constraints.txt | 12 +- playbooks/buildimages/run.yaml | 2 +- playbooks/sahara-grenade/post.yaml | 15 + playbooks/sahara-grenade/run.yaml | 72 + ...d-upgrade-check-framework-9cd18dbc47b0efbd.yaml | 13 + ...pkg-install-timeout-param-d50e5c15e06fa51e.yaml | 4 + .../api-v2-return-payload-a84a609db410228a.yaml | 4 + .../notes/apiv2-microversion-4c1a58ee8090e5a9.yaml | 5 + .../apiv2-stable-release-25ba9920c8e4632a.yaml | 3 + .../notes/enhance-bfv-12bac06c4438675f.yaml | 6 + ...ng-policy-inconsistencies-984020000cc3882a.yaml | 12 + releasenotes/notes/hdfs-dfs-94a9c4f64cf8994f.yaml | 5 + .../notes/ntp-config-51ed9d612132e2fa.yaml | 6 + ...ns-split-from-sahara-core-9ffc5e5d06c9239c.yaml | 5 + .../proxy-user-lowercase-f116f7b7e89274cb.yaml | 6 + .../notes/some-polish-api-v2-2d2e390a74b088f9.yaml | 12 + ...t-validation-query-string-a6cadbf2f9c57d06.yaml | 5 + releasenotes/source/index.rst | 1 + .../locale/en_GB/LC_MESSAGES/releasenotes.po | 8 +- .../source/locale/fr/LC_MESSAGES/releasenotes.po | 63 + releasenotes/source/rocky.rst | 6 + requirements.txt | 2 + roles/build-sahara-images-cli/tasks/main.yaml | 5 + sahara/api/acl.py | 4 +- sahara/api/microversion.py | 30 + sahara/api/middleware/version_discovery.py | 11 +- sahara/api/v2/cluster_templates.py | 31 +- sahara/api/v2/clusters.py | 43 +- sahara/api/v2/data_sources.py | 29 +- sahara/api/v2/images.py | 21 +- sahara/api/v2/job_binaries.py | 33 +- sahara/api/v2/job_templates.py | 58 +- sahara/api/v2/job_types.py | 11 +- sahara/api/v2/jobs.py | 28 +- sahara/api/v2/node_group_templates.py | 31 +- sahara/api/v2/plugins.py | 12 +- sahara/cli/image_pack/api.py | 4 + sahara/cli/image_pack/cli.py | 4 +- sahara/cli/sahara_all.py | 7 - sahara/cli/sahara_api.py | 8 - sahara/cli/sahara_engine.py | 9 - sahara/cli/sahara_status.py | 53 + sahara/cli/sahara_subprocess.py | 17 +- sahara/common/policies/__init__.py | 24 +- sahara/common/policies/base.py | 13 +- sahara/common/policies/cluster.py | 60 + sahara/common/policies/cluster_template.py | 57 + sahara/common/policies/cluster_templates.py | 12 +- sahara/common/policies/clusters.py | 12 - sahara/common/policies/data_source.py | 57 + sahara/common/policies/data_sources.py | 12 +- sahara/common/policies/image.py | 65 + sahara/common/policies/images.py | 27 +- sahara/common/policies/job.py | 49 + sahara/common/policies/job_binaries.py | 14 +- sahara/common/policies/job_binary.py | 62 + .../policies/{job_templates.py => job_template.py} | 12 +- .../edp_engine.py => common/policies/job_type.py} | 22 +- sahara/common/policies/job_types.py | 2 - sahara/common/policies/jobs.py | 11 +- sahara/common/policies/node_group_template.py | 57 + sahara/common/policies/node_group_templates.py | 12 +- sahara/common/policies/plugin.py | 49 + sahara/common/policies/plugins.py | 8 - sahara/conductor/__init__.py | 1 + sahara/conductor/manager.py | 3 + sahara/conductor/objects.py | 9 + sahara/config.py | 2 + sahara/db/migration/alembic_migrations/env.py | 1 + .../versions/035_boot_from_volume_enhancements.py | 70 + sahara/db/sqlalchemy/model_base.py | 1 + sahara/db/sqlalchemy/models.py | 9 + sahara/db/templates/api.py | 1 + sahara/plugins/ambari/__init__.py | 0 sahara/plugins/ambari/client.py | 363 -- sahara/plugins/ambari/common.py | 155 - sahara/plugins/ambari/configs.py | 327 -- sahara/plugins/ambari/deploy.py | 709 --- sahara/plugins/ambari/edp_engine.py | 130 - sahara/plugins/ambari/ha_helper.py | 252 - sahara/plugins/ambari/health.py | 149 - sahara/plugins/ambari/plugin.py | 294 - sahara/plugins/ambari/requests_helper.py | 145 - sahara/plugins/ambari/resources/configs-2.3.json | 1276 ----- sahara/plugins/ambari/resources/configs-2.4.json | 1331 ----- sahara/plugins/ambari/resources/configs-2.5.json | 2008 ------- sahara/plugins/ambari/resources/configs-2.6.json | 2008 ------- sahara/plugins/ambari/resources/generate_config.py | 80 - .../ambari/resources/images/centos/disable_ambari | 8 - .../images/centos/disable_certificate_check | 12 - .../resources/images/centos/disable_firewall | 20 - .../ambari/resources/images/centos/disable_selinux | 12 - .../ambari/resources/images/centos/setup_java_home | 31 - .../images/centos/unlimited_security_artifacts | 11 - .../ambari/resources/images/centos/wget_repo | 9 - .../plugins/ambari/resources/images/common/add_jar | 31 - .../resources/images/common/fix_tls_ambari_agent | 17 - .../images/common/mysql_connector_java_link | 14 - .../ambari/resources/images/common/oracle_java | 41 - sahara/plugins/ambari/resources/images/image.yaml | 111 - .../ambari/resources/images/ubuntu/wget_repo | 10 - sahara/plugins/ambari/validation.py | 226 - sahara/plugins/base.py | 12 +- .../v5_7_0/plugin_utils.py => castellan_utils.py} | 18 +- sahara/plugins/cdh/__init__.py | 0 sahara/plugins/cdh/abstractversionhandler.py | 234 - sahara/plugins/cdh/client/__init__.py | 0 sahara/plugins/cdh/client/api_client.py | 145 - sahara/plugins/cdh/client/clusters.py | 240 - sahara/plugins/cdh/client/cms.py | 84 - sahara/plugins/cdh/client/hosts.py | 90 - sahara/plugins/cdh/client/http_client.py | 143 - sahara/plugins/cdh/client/resource.py | 166 - sahara/plugins/cdh/client/role_config_groups.py | 108 - sahara/plugins/cdh/client/roles.py | 187 - sahara/plugins/cdh/client/services.py | 528 -- sahara/plugins/cdh/client/types.py | 684 --- sahara/plugins/cdh/client/users.py | 62 - sahara/plugins/cdh/cloudera_utils.py | 837 --- sahara/plugins/cdh/commands.py | 116 - sahara/plugins/cdh/config_helper.py | 307 - sahara/plugins/cdh/confighints_helper.py | 46 - sahara/plugins/cdh/db_helper.py | 120 - sahara/plugins/cdh/db_resources/create_hive_db.sql | 4 - .../plugins/cdh/db_resources/create_sentry_db.sql | 4 - sahara/plugins/cdh/deploy.py | 124 - sahara/plugins/cdh/edp_engine.py | 103 - sahara/plugins/cdh/exceptions.py | 78 - sahara/plugins/cdh/health.py | 145 - sahara/plugins/cdh/plugin.py | 125 - sahara/plugins/cdh/plugin_utils.py | 471 -- sahara/plugins/cdh/v5_11_0/__init__.py | 0 sahara/plugins/cdh/v5_11_0/cloudera_utils.py | 28 - sahara/plugins/cdh/v5_11_0/config_helper.py | 101 - sahara/plugins/cdh/v5_11_0/deploy.py | 168 - sahara/plugins/cdh/v5_11_0/edp_engine.py | 47 - sahara/plugins/cdh/v5_11_0/images.py | 43 - sahara/plugins/cdh/v5_11_0/plugin_utils.py | 23 - sahara/plugins/cdh/v5_11_0/resources/cdh_config.py | 63 - sahara/plugins/cdh/v5_11_0/resources/cdh_config.sh | 14 - .../plugins/cdh/v5_11_0/resources/flume-agent.json | 440 -- .../cdh/v5_11_0/resources/flume-service.json | 164 - .../cdh/v5_11_0/resources/hbase-gateway.json | 122 - .../v5_11_0/resources/hbase-hbaserestserver.json | 452 -- .../v5_11_0/resources/hbase-hbasethriftserver.json | 458 -- .../cdh/v5_11_0/resources/hbase-master.json | 518 -- .../cdh/v5_11_0/resources/hbase-regionserver.json | 878 --- .../cdh/v5_11_0/resources/hbase-service.json | 668 --- .../cdh/v5_11_0/resources/hdfs-balancer.json | 128 - .../cdh/v5_11_0/resources/hdfs-datanode.json | 656 --- .../v5_11_0/resources/hdfs-failovercontroller.json | 344 -- .../cdh/v5_11_0/resources/hdfs-gateway.json | 116 - .../plugins/cdh/v5_11_0/resources/hdfs-httpfs.json | 452 -- .../cdh/v5_11_0/resources/hdfs-journalnode.json | 458 -- .../cdh/v5_11_0/resources/hdfs-namenode.json | 872 --- .../cdh/v5_11_0/resources/hdfs-nfsgateway.json | 410 -- .../v5_11_0/resources/hdfs-secondarynamenode.json | 458 -- .../cdh/v5_11_0/resources/hdfs-service.json | 1340 ----- .../cdh/v5_11_0/resources/hive-gateway.json | 98 - .../cdh/v5_11_0/resources/hive-hivemetastore.json | 434 -- .../cdh/v5_11_0/resources/hive-hiveserver2.json | 848 --- .../resources/hive-metastore-sentry-safety.xml | 15 - .../resources/hive-server2-sentry-safety.xml | 12 - .../cdh/v5_11_0/resources/hive-service.json | 656 --- sahara/plugins/cdh/v5_11_0/resources/hive-site.xml | 61 - .../cdh/v5_11_0/resources/hive-webhcat.json | 344 -- .../v5_11_0/resources/hue-hue_load_balancer.json | 248 - .../cdh/v5_11_0/resources/hue-hue_server.json | 392 -- .../cdh/v5_11_0/resources/hue-kt_renewer.json | 212 - .../plugins/cdh/v5_11_0/resources/hue-service.json | 692 --- .../resources/images/centos/disable_firewall | 20 - .../resources/images/centos/selinux_permissive | 13 - .../resources/images/centos/turn_off_services | 33 - .../cdh/v5_11_0/resources/images/centos/wget_repo | 33 - .../cdh/v5_11_0/resources/images/common/add_jar | 22 - .../resources/images/common/install_cloudera | 17 - .../v5_11_0/resources/images/common/install_extjs | 30 - .../images/common/unlimited_security_artifacts | 11 - .../cdh/v5_11_0/resources/images/image.yaml | 131 - .../resources/images/ubuntu/turn_off_services | 33 - .../cdh/v5_11_0/resources/images/ubuntu/wget_repo | 34 - .../v5_11_0/resources/impala-catalogserver.json | 542 -- .../cdh/v5_11_0/resources/impala-impalad.json | 746 --- .../cdh/v5_11_0/resources/impala-llama.json | 518 -- .../cdh/v5_11_0/resources/impala-service.json | 572 -- .../cdh/v5_11_0/resources/impala-statestore.json | 404 -- .../cdh/v5_11_0/resources/kafka-gateway.json | 62 - .../cdh/v5_11_0/resources/kafka-kafka_broker.json | 566 -- .../resources/kafka-kafka_mirror_maker.json | 626 -- .../cdh/v5_11_0/resources/kafka-service.json | 404 -- sahara/plugins/cdh/v5_11_0/resources/kms-kms.json | 638 --- .../plugins/cdh/v5_11_0/resources/kms-service.json | 86 - .../resources/ks_indexer-hbase_indexer.json | 374 -- .../cdh/v5_11_0/resources/ks_indexer-service.json | 188 - .../plugins/cdh/v5_11_0/resources/mapred-site.xml | 157 - .../cdh/v5_11_0/resources/oozie-oozie_server.json | 674 --- .../cdh/v5_11_0/resources/oozie-service.json | 260 - .../cdh/v5_11_0/resources/priority-one-confs.json | 45 - .../cdh/v5_11_0/resources/sentry-gateway.json | 62 - .../resources/sentry-impala-client-safety.xml | 16 - .../v5_11_0/resources/sentry-sentry_server.json | 320 -- .../cdh/v5_11_0/resources/sentry-service.json | 230 - .../cdh/v5_11_0/resources/solr-gateway.json | 50 - .../cdh/v5_11_0/resources/solr-service.json | 350 -- .../cdh/v5_11_0/resources/solr-solr_server.json | 464 -- .../cdh/v5_11_0/resources/spark-gateway.json | 242 - .../cdh/v5_11_0/resources/spark-service.json | 158 - .../resources/spark-spark_yarn_history_server.json | 404 -- .../cdh/v5_11_0/resources/sqoop-service.json | 110 - .../cdh/v5_11_0/resources/sqoop-sqoop_server.json | 410 -- .../cdh/v5_11_0/resources/yarn-gateway.json | 506 -- .../cdh/v5_11_0/resources/yarn-jobhistory.json | 494 -- .../cdh/v5_11_0/resources/yarn-nodemanager.json | 794 --- .../v5_11_0/resources/yarn-resourcemanager.json | 686 --- .../cdh/v5_11_0/resources/yarn-service.json | 554 -- .../cdh/v5_11_0/resources/zookeeper-server.json | 608 -- .../cdh/v5_11_0/resources/zookeeper-service.json | 236 - sahara/plugins/cdh/v5_11_0/versionhandler.py | 37 - sahara/plugins/cdh/v5_13_0/__init__.py | 0 sahara/plugins/cdh/v5_13_0/cloudera_utils.py | 34 - sahara/plugins/cdh/v5_13_0/config_helper.py | 89 - sahara/plugins/cdh/v5_13_0/deploy.py | 168 - sahara/plugins/cdh/v5_13_0/edp_engine.py | 47 - sahara/plugins/cdh/v5_13_0/images.py | 43 - sahara/plugins/cdh/v5_13_0/resources/cdh_config.py | 68 - .../plugins/cdh/v5_13_0/resources/flume-agent.json | 440 -- .../cdh/v5_13_0/resources/flume-service.json | 164 - .../cdh/v5_13_0/resources/hbase-gateway.json | 122 - .../v5_13_0/resources/hbase-hbaserestserver.json | 452 -- .../v5_13_0/resources/hbase-hbasethriftserver.json | 458 -- .../cdh/v5_13_0/resources/hbase-master.json | 530 -- .../cdh/v5_13_0/resources/hbase-regionserver.json | 884 --- .../cdh/v5_13_0/resources/hbase-service.json | 692 --- .../cdh/v5_13_0/resources/hdfs-balancer.json | 128 - .../cdh/v5_13_0/resources/hdfs-datanode.json | 656 --- .../v5_13_0/resources/hdfs-failovercontroller.json | 344 -- .../cdh/v5_13_0/resources/hdfs-gateway.json | 116 - .../plugins/cdh/v5_13_0/resources/hdfs-httpfs.json | 464 -- .../cdh/v5_13_0/resources/hdfs-journalnode.json | 458 -- .../cdh/v5_13_0/resources/hdfs-namenode.json | 884 --- .../cdh/v5_13_0/resources/hdfs-nfsgateway.json | 410 -- .../v5_13_0/resources/hdfs-secondarynamenode.json | 458 -- .../cdh/v5_13_0/resources/hdfs-service.json | 1352 ----- .../cdh/v5_13_0/resources/hive-gateway.json | 98 - .../cdh/v5_13_0/resources/hive-hivemetastore.json | 434 -- .../cdh/v5_13_0/resources/hive-hiveserver2.json | 866 --- .../resources/hive-metastore-sentry-safety.xml | 15 - .../resources/hive-server2-sentry-safety.xml | 12 - .../cdh/v5_13_0/resources/hive-service.json | 656 --- sahara/plugins/cdh/v5_13_0/resources/hive-site.xml | 61 - .../cdh/v5_13_0/resources/hive-webhcat.json | 356 -- .../v5_13_0/resources/hue-hue_load_balancer.json | 260 - .../cdh/v5_13_0/resources/hue-hue_server.json | 404 -- .../cdh/v5_13_0/resources/hue-kt_renewer.json | 212 - .../plugins/cdh/v5_13_0/resources/hue-service.json | 692 --- .../resources/images/centos/disable_firewall | 20 - .../resources/images/centos/selinux_permissive | 13 - .../resources/images/centos/turn_off_services | 33 - .../cdh/v5_13_0/resources/images/centos/wget_repo | 27 - .../cdh/v5_13_0/resources/images/common/add_jar | 22 - .../resources/images/common/install_cloudera | 17 - .../v5_13_0/resources/images/common/install_extjs | 30 - .../images/common/unlimited_security_artifacts | 11 - .../cdh/v5_13_0/resources/images/image.yaml | 128 - .../resources/images/ubuntu/turn_off_services | 33 - .../cdh/v5_13_0/resources/images/ubuntu/wget_repo | 31 - .../v5_13_0/resources/impala-catalogserver.json | 542 -- .../cdh/v5_13_0/resources/impala-impalad.json | 746 --- .../cdh/v5_13_0/resources/impala-llama.json | 518 -- .../cdh/v5_13_0/resources/impala-service.json | 572 -- .../cdh/v5_13_0/resources/impala-statestore.json | 404 -- .../cdh/v5_13_0/resources/kafka-gateway.json | 62 - .../cdh/v5_13_0/resources/kafka-kafka_broker.json | 584 -- .../resources/kafka-kafka_mirror_maker.json | 644 --- .../cdh/v5_13_0/resources/kafka-service.json | 404 -- sahara/plugins/cdh/v5_13_0/resources/kms-kms.json | 656 --- .../plugins/cdh/v5_13_0/resources/kms-service.json | 86 - .../resources/ks_indexer-hbase_indexer.json | 374 -- .../cdh/v5_13_0/resources/ks_indexer-service.json | 188 - .../plugins/cdh/v5_13_0/resources/mapred-site.xml | 157 - .../cdh/v5_13_0/resources/oozie-oozie_server.json | 674 --- .../cdh/v5_13_0/resources/oozie-service.json | 260 - .../cdh/v5_13_0/resources/priority-one-confs.json | 45 - .../cdh/v5_13_0/resources/sentry-gateway.json | 62 - .../resources/sentry-impala-client-safety.xml | 16 - .../v5_13_0/resources/sentry-sentry_server.json | 320 -- .../cdh/v5_13_0/resources/sentry-service.json | 230 - .../cdh/v5_13_0/resources/solr-gateway.json | 50 - .../cdh/v5_13_0/resources/solr-service.json | 350 -- .../cdh/v5_13_0/resources/solr-solr_server.json | 470 -- .../cdh/v5_13_0/resources/spark-gateway.json | 242 - .../cdh/v5_13_0/resources/spark-service.json | 170 - .../resources/spark-spark_yarn_history_server.json | 422 -- .../cdh/v5_13_0/resources/sqoop-service.json | 116 - .../cdh/v5_13_0/resources/sqoop-sqoop_server.json | 410 -- .../v5_13_0/resources/sqoop_client-gateway.json | 92 - .../v5_13_0/resources/sqoop_client-service.json | 80 - .../cdh/v5_13_0/resources/yarn-gateway.json | 530 -- .../cdh/v5_13_0/resources/yarn-jobhistory.json | 500 -- .../cdh/v5_13_0/resources/yarn-nodemanager.json | 794 --- .../v5_13_0/resources/yarn-resourcemanager.json | 686 --- .../cdh/v5_13_0/resources/yarn-service.json | 554 -- .../cdh/v5_13_0/resources/zookeeper-server.json | 608 -- .../cdh/v5_13_0/resources/zookeeper-service.json | 236 - sahara/plugins/cdh/v5_13_0/versionhandler.py | 37 - sahara/plugins/cdh/v5_7_0/__init__.py | 0 sahara/plugins/cdh/v5_7_0/cloudera_utils.py | 28 - sahara/plugins/cdh/v5_7_0/config_helper.py | 101 - sahara/plugins/cdh/v5_7_0/deploy.py | 168 - sahara/plugins/cdh/v5_7_0/edp_engine.py | 47 - sahara/plugins/cdh/v5_7_0/images.py | 43 - sahara/plugins/cdh/v5_7_0/resources/cdh_config.py | 139 - sahara/plugins/cdh/v5_7_0/resources/cdh_config.sh | 3 - .../plugins/cdh/v5_7_0/resources/flume-agent.json | 428 -- .../cdh/v5_7_0/resources/flume-service.json | 164 - .../cdh/v5_7_0/resources/hbase-gateway.json | 110 - .../v5_7_0/resources/hbase-hbaserestserver.json | 440 -- .../v5_7_0/resources/hbase-hbasethriftserver.json | 446 -- .../plugins/cdh/v5_7_0/resources/hbase-master.json | 506 -- .../cdh/v5_7_0/resources/hbase-regionserver.json | 836 --- .../cdh/v5_7_0/resources/hbase-service.json | 740 --- .../cdh/v5_7_0/resources/hdfs-balancer.json | 68 - .../cdh/v5_7_0/resources/hdfs-datanode.json | 644 --- .../v5_7_0/resources/hdfs-failovercontroller.json | 332 -- .../plugins/cdh/v5_7_0/resources/hdfs-gateway.json | 116 - .../plugins/cdh/v5_7_0/resources/hdfs-httpfs.json | 440 -- .../cdh/v5_7_0/resources/hdfs-journalnode.json | 446 -- .../cdh/v5_7_0/resources/hdfs-namenode.json | 812 --- .../cdh/v5_7_0/resources/hdfs-nfsgateway.json | 386 -- .../v5_7_0/resources/hdfs-secondarynamenode.json | 446 -- .../plugins/cdh/v5_7_0/resources/hdfs-service.json | 1400 ----- .../plugins/cdh/v5_7_0/resources/hive-gateway.json | 98 - .../cdh/v5_7_0/resources/hive-hivemetastore.json | 392 -- .../cdh/v5_7_0/resources/hive-hiveserver2.json | 704 --- .../resources/hive-metastore-sentry-safety.xml | 15 - .../resources/hive-server2-sentry-safety.xml | 12 - .../plugins/cdh/v5_7_0/resources/hive-service.json | 722 --- sahara/plugins/cdh/v5_7_0/resources/hive-site.xml | 61 - .../plugins/cdh/v5_7_0/resources/hive-webhcat.json | 332 -- .../v5_7_0/resources/hue-hue_load_balancer.json | 236 - .../cdh/v5_7_0/resources/hue-hue_server.json | 356 -- .../cdh/v5_7_0/resources/hue-kt_renewer.json | 200 - .../plugins/cdh/v5_7_0/resources/hue-service.json | 674 --- .../resources/images/centos/disable_firewall | 20 - .../resources/images/centos/selinux_permissive | 13 - .../resources/images/centos/turn_off_services | 33 - .../cdh/v5_7_0/resources/images/centos/wget_repo | 33 - .../cdh/v5_7_0/resources/images/common/add_jar | 22 - .../resources/images/common/install_cloudera | 17 - .../v5_7_0/resources/images/common/install_extjs | 30 - .../images/common/unlimited_security_artifacts | 11 - .../plugins/cdh/v5_7_0/resources/images/image.yaml | 132 - .../resources/images/ubuntu/turn_off_services | 33 - .../cdh/v5_7_0/resources/images/ubuntu/wget_repo | 36 - .../cdh/v5_7_0/resources/impala-catalogserver.json | 506 -- .../cdh/v5_7_0/resources/impala-impalad.json | 710 --- .../plugins/cdh/v5_7_0/resources/impala-llama.json | 506 -- .../cdh/v5_7_0/resources/impala-service.json | 632 --- .../cdh/v5_7_0/resources/impala-statestore.json | 374 -- .../cdh/v5_7_0/resources/kafka-kafka_broker.json | 476 -- .../v5_7_0/resources/kafka-kafka_mirror_maker.json | 482 -- .../cdh/v5_7_0/resources/kafka-service.json | 374 -- sahara/plugins/cdh/v5_7_0/resources/kms-kms.json | 530 -- .../plugins/cdh/v5_7_0/resources/kms-service.json | 86 - .../v5_7_0/resources/ks_indexer-hbase_indexer.json | 356 -- .../cdh/v5_7_0/resources/ks_indexer-service.json | 188 - .../plugins/cdh/v5_7_0/resources/mapred-site.xml | 157 - .../cdh/v5_7_0/resources/oozie-oozie_server.json | 662 --- .../cdh/v5_7_0/resources/oozie-service.json | 236 - .../cdh/v5_7_0/resources/priority-one-confs.json | 45 - .../resources/sentry-impala-client-safety.xml | 16 - .../cdh/v5_7_0/resources/sentry-sentry_server.json | 308 - .../cdh/v5_7_0/resources/sentry-service.json | 278 - .../plugins/cdh/v5_7_0/resources/solr-gateway.json | 32 - .../plugins/cdh/v5_7_0/resources/solr-service.json | 404 -- .../cdh/v5_7_0/resources/solr-solr_server.json | 440 -- .../cdh/v5_7_0/resources/spark-gateway.json | 170 - .../cdh/v5_7_0/resources/spark-service.json | 152 - .../resources/spark-spark_yarn_history_server.json | 314 -- .../cdh/v5_7_0/resources/sqoop-service.json | 110 - .../cdh/v5_7_0/resources/sqoop-sqoop_server.json | 398 -- .../plugins/cdh/v5_7_0/resources/yarn-gateway.json | 476 -- .../cdh/v5_7_0/resources/yarn-jobhistory.json | 476 -- .../cdh/v5_7_0/resources/yarn-nodemanager.json | 764 --- .../cdh/v5_7_0/resources/yarn-resourcemanager.json | 674 --- .../plugins/cdh/v5_7_0/resources/yarn-service.json | 542 -- .../cdh/v5_7_0/resources/zookeeper-server.json | 596 -- .../cdh/v5_7_0/resources/zookeeper-service.json | 224 - sahara/plugins/cdh/v5_7_0/versionhandler.py | 37 - sahara/plugins/cdh/v5_9_0/__init__.py | 0 sahara/plugins/cdh/v5_9_0/cloudera_utils.py | 28 - sahara/plugins/cdh/v5_9_0/config_helper.py | 101 - sahara/plugins/cdh/v5_9_0/deploy.py | 168 - sahara/plugins/cdh/v5_9_0/edp_engine.py | 47 - sahara/plugins/cdh/v5_9_0/images.py | 43 - sahara/plugins/cdh/v5_9_0/plugin_utils.py | 23 - sahara/plugins/cdh/v5_9_0/resources/cdh_config.py | 139 - sahara/plugins/cdh/v5_9_0/resources/cdh_config.sh | 3 - .../plugins/cdh/v5_9_0/resources/flume-agent.json | 428 -- .../cdh/v5_9_0/resources/flume-service.json | 164 - .../cdh/v5_9_0/resources/hbase-gateway.json | 110 - .../v5_9_0/resources/hbase-hbaserestserver.json | 440 -- .../v5_9_0/resources/hbase-hbasethriftserver.json | 446 -- .../plugins/cdh/v5_9_0/resources/hbase-master.json | 506 -- .../cdh/v5_9_0/resources/hbase-regionserver.json | 842 --- .../cdh/v5_9_0/resources/hbase-service.json | 746 --- .../cdh/v5_9_0/resources/hdfs-balancer.json | 68 - .../cdh/v5_9_0/resources/hdfs-datanode.json | 644 --- .../v5_9_0/resources/hdfs-failovercontroller.json | 332 -- .../plugins/cdh/v5_9_0/resources/hdfs-gateway.json | 116 - .../plugins/cdh/v5_9_0/resources/hdfs-httpfs.json | 440 -- .../cdh/v5_9_0/resources/hdfs-journalnode.json | 446 -- .../cdh/v5_9_0/resources/hdfs-namenode.json | 854 --- .../cdh/v5_9_0/resources/hdfs-nfsgateway.json | 386 -- .../v5_9_0/resources/hdfs-secondarynamenode.json | 446 -- .../plugins/cdh/v5_9_0/resources/hdfs-service.json | 1418 ----- .../plugins/cdh/v5_9_0/resources/hive-gateway.json | 98 - .../cdh/v5_9_0/resources/hive-hivemetastore.json | 416 -- .../cdh/v5_9_0/resources/hive-hiveserver2.json | 806 --- .../resources/hive-metastore-sentry-safety.xml | 15 - .../resources/hive-server2-sentry-safety.xml | 12 - .../plugins/cdh/v5_9_0/resources/hive-service.json | 758 --- sahara/plugins/cdh/v5_9_0/resources/hive-site.xml | 61 - .../plugins/cdh/v5_9_0/resources/hive-webhcat.json | 332 -- .../v5_9_0/resources/hue-hue_load_balancer.json | 236 - .../cdh/v5_9_0/resources/hue-hue_server.json | 368 -- .../cdh/v5_9_0/resources/hue-kt_renewer.json | 200 - .../plugins/cdh/v5_9_0/resources/hue-service.json | 674 --- .../resources/images/centos/disable_firewall | 20 - .../resources/images/centos/selinux_permissive | 13 - .../resources/images/centos/turn_off_services | 33 - .../cdh/v5_9_0/resources/images/centos/wget_repo | 33 - .../cdh/v5_9_0/resources/images/common/add_jar | 22 - .../resources/images/common/install_cloudera | 17 - .../v5_9_0/resources/images/common/install_extjs | 30 - .../images/common/unlimited_security_artifacts | 11 - .../plugins/cdh/v5_9_0/resources/images/image.yaml | 132 - .../resources/images/ubuntu/turn_off_services | 33 - .../cdh/v5_9_0/resources/images/ubuntu/wget_repo | 36 - .../cdh/v5_9_0/resources/impala-catalogserver.json | 530 -- .../cdh/v5_9_0/resources/impala-impalad.json | 734 --- .../plugins/cdh/v5_9_0/resources/impala-llama.json | 506 -- .../cdh/v5_9_0/resources/impala-service.json | 644 --- .../cdh/v5_9_0/resources/impala-statestore.json | 392 -- .../cdh/v5_9_0/resources/kafka-kafka_broker.json | 476 -- .../v5_9_0/resources/kafka-kafka_mirror_maker.json | 482 -- .../cdh/v5_9_0/resources/kafka-service.json | 374 -- sahara/plugins/cdh/v5_9_0/resources/kms-kms.json | 530 -- .../plugins/cdh/v5_9_0/resources/kms-service.json | 86 - .../v5_9_0/resources/ks_indexer-hbase_indexer.json | 362 -- .../cdh/v5_9_0/resources/ks_indexer-service.json | 188 - .../plugins/cdh/v5_9_0/resources/mapred-site.xml | 157 - .../cdh/v5_9_0/resources/oozie-oozie_server.json | 662 --- .../cdh/v5_9_0/resources/oozie-service.json | 260 - .../cdh/v5_9_0/resources/priority-one-confs.json | 45 - .../cdh/v5_9_0/resources/sentry-gateway.json | 62 - .../resources/sentry-impala-client-safety.xml | 16 - .../cdh/v5_9_0/resources/sentry-sentry_server.json | 308 - .../cdh/v5_9_0/resources/sentry-service.json | 290 - .../plugins/cdh/v5_9_0/resources/solr-gateway.json | 50 - .../plugins/cdh/v5_9_0/resources/solr-service.json | 416 -- .../cdh/v5_9_0/resources/solr-solr_server.json | 452 -- .../cdh/v5_9_0/resources/spark-gateway.json | 176 - .../cdh/v5_9_0/resources/spark-service.json | 152 - .../resources/spark-spark_yarn_history_server.json | 314 -- .../cdh/v5_9_0/resources/sqoop-service.json | 110 - .../cdh/v5_9_0/resources/sqoop-sqoop_server.json | 398 -- .../plugins/cdh/v5_9_0/resources/yarn-gateway.json | 506 -- .../cdh/v5_9_0/resources/yarn-jobhistory.json | 476 -- .../cdh/v5_9_0/resources/yarn-nodemanager.json | 770 --- .../cdh/v5_9_0/resources/yarn-resourcemanager.json | 674 --- .../plugins/cdh/v5_9_0/resources/yarn-service.json | 632 --- .../cdh/v5_9_0/resources/zookeeper-server.json | 596 -- .../cdh/v5_9_0/resources/zookeeper-service.json | 224 - sahara/plugins/cdh/v5_9_0/versionhandler.py | 37 - sahara/plugins/cdh/validation.py | 438 -- sahara/plugins/cdh/versionfactory.py | 57 - sahara/plugins/conductor.py | 38 + sahara/plugins/context.py | 74 + sahara/plugins/db.py | 29 + sahara/plugins/edp.py | 96 + sahara/plugins/exceptions.py | 26 + sahara/plugins/fake/edp_engine.py | 15 +- sahara/plugins/fake/plugin.py | 3 +- .../health => plugins}/health_check_base.py | 0 sahara/plugins/images.py | 49 +- .../plugins/{cdh/v5_13_0/validation.py => main.py} | 13 +- sahara/plugins/mapr/__init__.py | 0 sahara/plugins/mapr/abstract/__init__.py | 0 sahara/plugins/mapr/abstract/cluster_context.py | 157 - sahara/plugins/mapr/abstract/cluster_validator.py | 29 - sahara/plugins/mapr/abstract/configurer.py | 29 - sahara/plugins/mapr/abstract/health_checker.py | 24 - sahara/plugins/mapr/abstract/node_manager.py | 37 - sahara/plugins/mapr/abstract/version_handler.py | 81 - sahara/plugins/mapr/base/__init__.py | 0 .../plugins/mapr/base/base_cluster_configurer.py | 405 -- sahara/plugins/mapr/base/base_cluster_context.py | 444 -- sahara/plugins/mapr/base/base_cluster_validator.py | 35 - sahara/plugins/mapr/base/base_edp_engine.py | 94 - sahara/plugins/mapr/base/base_health_checker.py | 121 - sahara/plugins/mapr/base/base_node_manager.py | 200 - sahara/plugins/mapr/base/base_version_handler.py | 198 - sahara/plugins/mapr/domain/__init__.py | 0 sahara/plugins/mapr/domain/configuration_file.py | 194 - sahara/plugins/mapr/domain/distro.py | 96 - sahara/plugins/mapr/domain/node_process.py | 177 - sahara/plugins/mapr/domain/service.py | 246 - sahara/plugins/mapr/images.py | 43 - sahara/plugins/mapr/plugin.py | 110 - sahara/plugins/mapr/resources/add_mapr_repo.sh | 37 - .../plugins/mapr/resources/add_security_repos.sh | 6 - .../mapr/resources/create_disk_list_file.sh | 13 - .../mapr/resources/images/centos/disable_firewall | 20 - .../mapr/resources/images/centos/epel_dependencies | 6 - .../images/centos/install_mapr_core_repository | 27 - .../images/centos/install_mapr_eco_repository | 27 - .../mapr/resources/images/centos/install_openjdk | 14 - .../mapr/resources/images/centos/install_scala | 34 - .../mapr/resources/images/centos/requiretty | 6 - .../resources/images/centos/selinux_permissive | 12 - .../mapr/resources/images/centos/update_repository | 5 - .../mapr/resources/images/common/configure_extjs | 31 - .../mapr/resources/images/common/oracle_java | 42 - .../images/common/resources/package_utils.sh | 226 - .../images/common/resources/packages.json | 140 - .../images/common/resources/spec_5.1.0.json | 46 - .../images/common/resources/spec_5.2.0.json | 50 - .../images/common/resources/spec_5.2.0_ubuntu.json | 47 - .../resources/images/common/resources/versions.py | 83 - sahara/plugins/mapr/resources/images/image.yaml | 205 - .../images/ubuntu/install_mapr_core_repository | 27 - .../images/ubuntu/install_mapr_dependencies | 22 - .../images/ubuntu/install_mapr_eco_repository | 32 - .../mapr/resources/images/ubuntu/install_openjdk | 16 - .../mapr/resources/images/ubuntu/install_scala | 37 - .../mapr/resources/images/ubuntu/update_repository | 5 - sahara/plugins/mapr/resources/install_java.sh | 69 - sahara/plugins/mapr/resources/install_mysql.sh | 31 - .../plugins/mapr/resources/install_mysql_client.sh | 12 - sahara/plugins/mapr/resources/install_scala.sh | 28 - sahara/plugins/mapr/resources/topology.sh | 20 - sahara/plugins/mapr/services/__init__.py | 0 sahara/plugins/mapr/services/drill/__init__.py | 0 sahara/plugins/mapr/services/drill/drill.py | 112 - sahara/plugins/mapr/services/flume/__init__.py | 0 sahara/plugins/mapr/services/flume/flume.py | 47 - sahara/plugins/mapr/services/hbase/__init__.py | 0 sahara/plugins/mapr/services/hbase/hbase.py | 120 - .../services/hbase/resources/hbase-default.json | 31 - sahara/plugins/mapr/services/hive/__init__.py | 0 sahara/plugins/mapr/services/hive/hive.py | 184 - .../mapr/services/hive/resources/hive-default.xml | 59 - .../mapr/services/hive/resources/sentry-db.xml | 27 - .../services/hive/resources/sentry-default.xml | 45 - sahara/plugins/mapr/services/httpfs/__init__.py | 0 sahara/plugins/mapr/services/httpfs/httpfs.py | 40 - .../services/httpfs/resources/httpfs-default.json | 12 - sahara/plugins/mapr/services/hue/__init__.py | 0 sahara/plugins/mapr/services/hue/hue.py | 365 -- .../services/hue/resources/hue_3.10.0.template | 1403 ----- .../mapr/services/hue/resources/hue_3.6.0.template | 947 ---- .../mapr/services/hue/resources/hue_3.7.0.template | 1001 ---- .../mapr/services/hue/resources/hue_3.8.1.template | 1143 ---- .../mapr/services/hue/resources/hue_3.9.0.template | 1184 ---- .../services/hue/resources/hue_sh_3.10.0.template | 130 - .../services/hue/resources/hue_sh_3.7.0.template | 116 - .../services/hue/resources/hue_sh_3.8.1.template | 130 - .../services/hue/resources/hue_sh_3.9.0.template | 130 - .../hue/resources/livy_conf_3.10.0.template | 80 - .../services/hue/resources/livy_sh_3.10.0.template | 35 - sahara/plugins/mapr/services/impala/__init__.py | 0 sahara/plugins/mapr/services/impala/impala.py | 192 - .../services/impala/resources/impala-env.sh.j2 | 64 - sahara/plugins/mapr/services/kafka/__init__.py | 0 sahara/plugins/mapr/services/kafka/kafka.py | 73 - sahara/plugins/mapr/services/mahout/__init__.py | 0 sahara/plugins/mapr/services/mahout/mahout.py | 58 - .../plugins/mapr/services/management/__init__.py | 0 .../plugins/mapr/services/management/management.py | 63 - sahara/plugins/mapr/services/mapreduce/__init__.py | 0 .../plugins/mapr/services/mapreduce/mapreduce.py | 127 - .../mapreduce/resources/mapreduce-cluster.json | 91 - sahara/plugins/mapr/services/maprfs/__init__.py | 0 sahara/plugins/mapr/services/maprfs/maprfs.py | 157 - .../mapr/services/maprfs/resources/cldb.conf | 63 - sahara/plugins/mapr/services/mysql/__init__.py | 0 sahara/plugins/mapr/services/mysql/mysql.py | 207 - .../services/mysql/resources/create_database.sql | 7 - .../mapr/services/mysql/resources/grant_access.sql | 6 - .../mapr/services/mysql/resources/hive_schema.sql | 2 - sahara/plugins/mapr/services/oozie/__init__.py | 0 sahara/plugins/mapr/services/oozie/oozie.py | 168 - .../services/oozie/resources/oozie-default.json | 28 - sahara/plugins/mapr/services/pig/__init__.py | 0 sahara/plugins/mapr/services/pig/pig.py | 57 - sahara/plugins/mapr/services/sentry/__init__.py | 0 .../services/sentry/resources/global-policy.ini | 6 - .../services/sentry/resources/sentry-default.xml | 4 - sahara/plugins/mapr/services/sentry/sentry.py | 171 - sahara/plugins/mapr/services/spark/__init__.py | 0 .../services/spark/resources/spark-env.template | 134 - sahara/plugins/mapr/services/spark/spark.py | 316 -- sahara/plugins/mapr/services/sqoop/__init__.py | 0 sahara/plugins/mapr/services/sqoop/sqoop2.py | 46 - sahara/plugins/mapr/services/swift/__init__.py | 0 .../swift/resources/hadoop-swift-latest.jar | Bin 117363 -> 0 bytes .../services/swift/resources/swift-default.json | 61 - sahara/plugins/mapr/services/swift/swift.py | 58 - sahara/plugins/mapr/services/yarn/__init__.py | 0 .../mapr/services/yarn/resources/yarn-cluster.json | 16 - .../mapr/services/yarn/resources/yarn-node.json | 23 - sahara/plugins/mapr/services/yarn/yarn.py | 144 - sahara/plugins/mapr/util/__init__.py | 0 sahara/plugins/mapr/util/commands.py | 25 - sahara/plugins/mapr/util/event_log.py | 63 - sahara/plugins/mapr/util/general.py | 204 - sahara/plugins/mapr/util/maprfs_helper.py | 108 - sahara/plugins/mapr/util/password_utils.py | 69 - sahara/plugins/mapr/util/service_utils.py | 51 - sahara/plugins/mapr/util/validation_utils.py | 262 - sahara/plugins/mapr/versions/__init__.py | 0 .../plugins/mapr/versions/v5_2_0_mrv2/__init__.py | 0 .../plugins/mapr/versions/v5_2_0_mrv2/context.py | 61 - .../mapr/versions/v5_2_0_mrv2/version_handler.py | 75 - .../mapr/versions/version_handler_factory.py | 57 - .../{cdh/v5_9_0/validation.py => objects.py} | 9 +- sahara/plugins/provisioning.py | 1 + .../test_plugin_utils.py => plugins/resource.py} | 23 +- .../{cdh/v5_7_0/validation.py => service_api.py} | 9 +- sahara/plugins/spark/__init__.py | 0 sahara/plugins/spark/config_helper.py | 517 -- sahara/plugins/spark/edp_engine.py | 62 - sahara/plugins/spark/plugin.py | 575 -- sahara/plugins/spark/resources/README.rst | 21 - sahara/plugins/spark/resources/core-default.xml | 632 --- sahara/plugins/spark/resources/hdfs-default.xml | 709 --- sahara/plugins/spark/resources/spark-cleanup.cron | 2 - .../plugins/spark/resources/spark-env.sh.template | 21 - .../spark/resources/tmp-cleanup.sh.template | 48 - sahara/plugins/spark/resources/topology.sh | 21 - sahara/plugins/spark/run_scripts.py | 92 - sahara/plugins/spark/scaling.py | 111 - sahara/plugins/spark/shell_engine.py | 28 - sahara/plugins/storm/__init__.py | 0 sahara/plugins/storm/config_helper.py | 159 - sahara/plugins/storm/edp_engine.py | 52 - sahara/plugins/storm/plugin.py | 410 -- sahara/plugins/storm/run_scripts.py | 54 - .../v5_13_0/plugin_utils.py => swift_helper.py} | 17 +- .../{cdh/v5_11_0/validation.py => swift_utils.py} | 9 +- sahara/plugins/testutils.py | 34 + .../topology_helper.py} | 22 +- sahara/plugins/utils.py | 149 +- sahara/plugins/vanilla/__init__.py | 0 sahara/plugins/vanilla/abstractversionhandler.py | 71 - sahara/plugins/vanilla/confighints_helper.py | 45 - sahara/plugins/vanilla/edp_engine.py | 40 - sahara/plugins/vanilla/hadoop2/__init__.py | 0 sahara/plugins/vanilla/hadoop2/config.py | 479 -- sahara/plugins/vanilla/hadoop2/config_helper.py | 329 -- sahara/plugins/vanilla/hadoop2/keypairs.py | 94 - sahara/plugins/vanilla/hadoop2/oozie_helper.py | 51 - .../vanilla/hadoop2/recommendations_utils.py | 48 - .../vanilla/hadoop2/resources/create_oozie_db.sql | 5 - .../vanilla/hadoop2/resources/post_conf.template | 33 - .../vanilla/hadoop2/resources/spark-cleanup.cron | 2 - .../hadoop2/resources/tmp-cleanup.sh.template | 48 - .../plugins/vanilla/hadoop2/resources/topology.sh | 21 - .../vanilla/hadoop2/resources/zoo_sample.cfg | 29 - sahara/plugins/vanilla/hadoop2/run_scripts.py | 293 - sahara/plugins/vanilla/hadoop2/scaling.py | 147 - sahara/plugins/vanilla/hadoop2/starting_scripts.py | 85 - sahara/plugins/vanilla/hadoop2/utils.py | 89 - sahara/plugins/vanilla/hadoop2/validation.py | 158 - sahara/plugins/vanilla/plugin.py | 108 - sahara/plugins/vanilla/utils.py | 69 - sahara/plugins/vanilla/v2_7_1/__init__.py | 0 sahara/plugins/vanilla/v2_7_1/config_helper.py | 151 - sahara/plugins/vanilla/v2_7_1/edp_engine.py | 81 - sahara/plugins/vanilla/v2_7_1/resources/README.rst | 28 - .../vanilla/v2_7_1/resources/core-default.xml | 1902 ------- .../vanilla/v2_7_1/resources/create_hive_db.sql | 9 - .../vanilla/v2_7_1/resources/hdfs-default.xml | 2323 -------- .../vanilla/v2_7_1/resources/hive-default.xml | 1873 ------ .../vanilla/v2_7_1/resources/mapred-default.xml | 2128 ------- .../vanilla/v2_7_1/resources/oozie-default.xml | 2546 --------- .../vanilla/v2_7_1/resources/yarn-default.xml | 1623 ------ sahara/plugins/vanilla/v2_7_1/versionhandler.py | 170 - sahara/plugins/vanilla/v2_7_5/__init__.py | 0 sahara/plugins/vanilla/v2_7_5/config_helper.py | 151 - sahara/plugins/vanilla/v2_7_5/edp_engine.py | 81 - sahara/plugins/vanilla/v2_7_5/resources/README.rst | 27 - .../vanilla/v2_7_5/resources/core-default.xml | 1997 ------- .../vanilla/v2_7_5/resources/create_hive_db.sql | 9 - .../vanilla/v2_7_5/resources/hdfs-default.xml | 2677 --------- .../vanilla/v2_7_5/resources/hive-default.xml | 5959 -------------------- .../vanilla/v2_7_5/resources/mapred-default.xml | 2221 -------- .../vanilla/v2_7_5/resources/oozie-default.xml | 2843 ---------- .../vanilla/v2_7_5/resources/yarn-default.xml | 1713 ------ sahara/plugins/vanilla/v2_7_5/versionhandler.py | 170 - sahara/plugins/vanilla/v2_8_2/__init__.py | 0 sahara/plugins/vanilla/v2_8_2/config_helper.py | 151 - sahara/plugins/vanilla/v2_8_2/edp_engine.py | 81 - sahara/plugins/vanilla/v2_8_2/resources/README.rst | 27 - .../vanilla/v2_8_2/resources/core-default.xml | 2414 -------- .../vanilla/v2_8_2/resources/create_hive_db.sql | 9 - .../vanilla/v2_8_2/resources/hdfs-default.xml | 3138 ----------- .../vanilla/v2_8_2/resources/hive-default.xml | 5959 -------------------- .../vanilla/v2_8_2/resources/mapred-default.xml | 1892 ------- .../vanilla/v2_8_2/resources/oozie-default.xml | 2843 ---------- .../vanilla/v2_8_2/resources/yarn-default.xml | 2635 --------- sahara/plugins/vanilla/v2_8_2/versionhandler.py | 170 - sahara/plugins/vanilla/versionfactory.py | 57 - sahara/service/coordinator.py | 3 +- sahara/service/edp/hdfs_helper.py | 2 +- sahara/service/edp/job_manager.py | 2 +- sahara/service/edp/resources/launch_command.py | 1 + sahara/service/health/common.py | 2 +- sahara/service/health/verification_base.py | 2 +- sahara/service/heat/templates.py | 34 +- sahara/service/ntp_service.py | 4 +- sahara/service/ops.py | 45 +- sahara/service/quotas.py | 2 +- sahara/service/validation.py | 19 + sahara/service/validations/cluster_templates.py | 2 +- sahara/service/validations/clusters_schema.py | 8 +- .../service/validations/edp/job_binary_internal.py | 3 +- sahara/service/validations/edp/job_execution.py | 8 +- .../validations/node_group_template_schema.py | 9 + sahara/service/validations/shares.py | 2 +- sahara/swift/swift_helper.py | 2 +- .../unit/plugins/ambari/test_requests_helper.py | 96 - .../unit/plugins/cdh/base_config_helper_test.py | 187 - .../unit/plugins/cdh/base_plugin_utils_test.py | 323 -- .../unit/plugins/cdh/test_confighints_helper.py | 59 - .../unit/plugins/cdh/v5_11_0/test_config_helper.py | 25 - .../plugins/cdh/v5_11_0/test_config_helper_5110.py | 168 - .../unit/plugins/cdh/v5_11_0/test_edp_engine.py | 168 - .../unit/plugins/cdh/v5_11_0/test_spark_engine.py | 69 - .../unit/plugins/cdh/v5_11_0/test_validation.py | 24 - .../plugins/cdh/v5_11_0/test_versionhandler.py | 140 - .../unit/plugins/cdh/v5_7_0/test_config_helper.py | 25 - .../plugins/cdh/v5_7_0/test_config_helper_570.py | 168 - .../unit/plugins/cdh/v5_7_0/test_edp_engine.py | 200 - .../unit/plugins/cdh/v5_7_0/test_plugin_utils.py | 25 - .../plugins/cdh/v5_7_0/test_plugin_utils_570.py | 25 - .../unit/plugins/cdh/v5_7_0/test_spark_engine.py | 69 - .../unit/plugins/cdh/v5_7_0/test_validation.py | 24 - .../unit/plugins/cdh/v5_7_0/test_versionhandler.py | 140 - .../unit/plugins/cdh/v5_9_0/test_config_helper.py | 25 - .../plugins/cdh/v5_9_0/test_config_helper_590.py | 168 - .../unit/plugins/cdh/v5_9_0/test_edp_engine.py | 200 - .../unit/plugins/cdh/v5_9_0/test_plugin_utils.py | 25 - .../plugins/cdh/v5_9_0/test_plugin_utils_590.py | 25 - .../unit/plugins/cdh/v5_9_0/test_spark_engine.py | 69 - .../unit/plugins/cdh/v5_9_0/test_validation.py | 24 - .../unit/plugins/cdh/v5_9_0/test_versionhandler.py | 140 - .../unit/plugins/mapr/test_cluster_context.py | 284 - .../unit/plugins/test_base_plugins_support.py | 7 +- .../vanilla/hadoop2/resources/dfs-report.txt | 62 - .../vanilla/hadoop2/resources/yarn-report.txt | 6 - .../plugins/vanilla/hadoop2/test_config_helper.py | 196 - .../unit/plugins/vanilla/hadoop2/test_configs.py | 41 - .../plugins/vanilla/hadoop2/test_edp_engine.py | 89 - .../plugins/vanilla/hadoop2/test_oozie_helper.py | 66 - .../unit/plugins/vanilla/hadoop2/test_plugin.py | 47 - .../vanilla/hadoop2/test_recommendation_utils.py | 60 - .../plugins/vanilla/hadoop2/test_run_scripts.py | 313 - .../unit/plugins/vanilla/hadoop2/test_scaling.py | 259 - .../vanilla/hadoop2/test_starting_scripts.py | 152 - .../unit/plugins/vanilla/hadoop2/test_utils.py | 141 - .../plugins/vanilla/hadoop2/test_validation.py | 111 - .../plugins/vanilla/test_confighints_helper.py | 59 - .../plugins/vanilla/v2_7_1/test_config_helper.py | 73 - .../unit/plugins/vanilla/v2_7_1/test_edp_engine.py | 96 - .../plugins/vanilla/v2_7_1/test_versionhandler.py | 253 - .../plugins/vanilla/v2_7_5/test_config_helper.py | 73 - .../unit/plugins/vanilla/v2_7_5/test_edp_engine.py | 96 - .../plugins/vanilla/v2_7_5/test_versionhandler.py | 253 - .../plugins/vanilla/v2_8_2/test_config_helper.py | 73 - .../unit/plugins/vanilla/v2_8_2/test_edp_engine.py | 96 - .../plugins/vanilla/v2_8_2/test_versionhandler.py | 253 - .../internal_db/test_internal_db_type.py | 144 +- .../edp/job_binaries/job_binary_manager_support.py | 62 +- .../edp/job_binaries/manila/test_manila_type.py | 286 +- .../unit/service/edp/job_binaries/test_base.py | 18 +- .../unit/service/health/test_verification_base.py | 4 +- .../validation/edp/test_job_binary_internal.py | 2 +- .../service/validation/edp/test_job_executor.py | 36 +- .../service/validation/edp/test_job_interface.py | 1 + .../test_cluster_template_create_validation.py | 2 +- .../service/validation/test_share_validations.py | 4 +- sahara/utils/api.py | 89 +- sahara/utils/crypto.py | 4 + sahara/utils/files.py | 8 +- sahara/utils/hacking/checks.py | 7 +- sahara/utils/hacking/import_checks.py | 9 +- sahara/utils/openstack/keystone.py | 1 + sahara/utils/procutils.py | 8 +- sahara/utils/proxy.py | 2 +- sahara/utils/ssh_remote.py | 74 +- sahara/utils/xmlutils.py | 11 +- setup.cfg | 9 +- test-requirements.txt | 4 +- tools/gate/build-images | 5 +- tox.ini | 14 +- 985 files changed, 9723 insertions(+), 205579 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 6cea8b0d..28d95414 100644 --- a/requirements.txt +++ b/requirements.txt @@ -17,0 +18 @@ keystonemiddleware>=4.17.0 # Apache-2.0 +microversion-parse>=0.2.1 # Apache-2.0 @@ -29,0 +31 @@ oslo.service!=1.28.1,>=1.24.0 # Apache-2.0 +oslo.upgradecheck>=0.1.0 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index 52c06260..12dde8e4 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -5 +5 @@ -hacking!=0.13.0,<0.14,>=0.12.0 # Apache-2.0 +hacking>=1.1.0 # Apache-2.0 @@ -16 +16 @@ stestr>=1.0.0 # Apache-2.0 -psycopg2>=2.6.2 # LGPL/ZPL +psycopg2>=2.7.3 # LGPL/ZPL

1 0

sahara-image-elements 10.0.0 (stein)
by no-reply＠openstack.org 10 Apr '19

10 Apr '19

We are glad to announce the release of: sahara-image-elements 10.0.0: Image elements for Sahara This release is part of the stein release series. The source is available from: https://git.openstack.org/cgit/openstack/sahara-image-elements Download the package from: https://tarballs.openstack.org/sahara-image-elements/ Please report issues through: https://bugs.launchpad.net/sahara/+bugs For more details, please see below. Changes in sahara-image-elements 9.0.0..10.0.0 ---------------------------------------------- 48491ed archive-primary.cloudera.com -> archive.cloudera.com e9a16e9 Use template for lower-constraints 29c817d Plain Ubuntu image are still based on Xenial 578cb48 firstboot: make rc-local start after cloud-init 9851391 Update devel info: mailing list aae9ed8 Update the min version of tox to 2.0 020d1bb Increment versioning with pbr instruction 2f0fbdf import zuul job settings from project-config Diffstat (except docs and test files) ------------------------------------- .zuul.yaml | 12 +++++++++--- diskimage-create/diskimage-create.sh | 2 ++ elements/hadoop-cloudera/README.rst | 6 +++--- elements/hadoop-cloudera/pre-install.d/10-add-mirror | 16 ++++++++-------- elements/hadoop/install.d/40-setup-hadoop | 11 +++++++++++ setup.cfg | 2 +- tox.ini | 2 +- 7 files changed, 35 insertions(+), 16 deletions(-)

1 0