We are happy to announce the release of: congress 7.0.0: Congress: The open policy framework for the cloud. This release is part of the queens release series. Download the package from: https://tarballs.openstack.org/congress/ For more details, please see below. Changes in congress 6.0.0..7.0.0 -------------------------------- 17575ad Add release note to avoid mistralclient 3.2.0 cc52f0b Stubs the loading of namespace in config-agent unit tests. 7799ab4 Update UPPER_CONSTRAINTS_FILE for stable/queens e3df6a8 Update .gitreview for stable/queens 6ac80ca Miscellaneous release notes additions for Queens 1070727 Updated from global requirements 7db74cb DB operations retry on deadlock c2df009 Fix swift auth issue by specifying version in url 94c9daf Modify grammatical errors 3f5c7fd Update congress documentation e888c22 Update manual testing script and output e5c648d Reasenotes get some grammer problem b8b0d31 Remove intree tempest tests aa779c5 Configure tempest service_availability correctly e518946 Zuul: Remove project name 837f4ce eventlet workaround to avoid import cycle issue 32549af eventlet.monkey_patch upfront in __init__ cd1c347 use . instead of source. a9e46f7 Updated from global requirements 7248108 Fix serialization of choices and reenable congress-agent. 27c3bb5 Enable congress-tempest-plugin to use in congress d9f6b25 Mistral driver f85f53e Updated from global requirements aacbf5d Modify broken link de2e4f1 temporarily skip local haht test under py27 fd1838d Updated from global requirements 25112c6 Remove config options which are deprecated 2af942a Distinguish between PUT and PATCH in API models e42615e Updated from global requirements 8eebec4 Updated from global requirements c12425c [Trivialfix]Fix typos in congress 5ae8f99 simplify dict-to-list conversion d86f680 Update cfgvalidator_driver for oslo.config 5.2 b5d06a1 Switched all jobs from q-qos to neutron-qos 734997a Add attach/detach security group action to neutron driver d26aac3 Update monasca driver to use keystoneauth1 f573ed2 Updated from global requirements 11236f4 Updated from global requirements b69d234 Updated from global requirements fa10dbc Library policy for tag-based network security zone 7220b8b Documentation of the config datasource. bed97f1 Devstack integration for configuration file validation 4e1eca8 Updated from global requirements 1a2c252 Remove reference of policy.json from setup.cfg c27218f Fix the deprecated usage of "get_transport" 3ac806a Move policy into code 0415309 Builtins for configuration file validation 15565a6 Datasource for configuration file validation 872f1b9 Agent for configuration file validation 650bd8f Remove voting:false from gate-py35 job af536f6 Updated from global requirements 1401e36 gate on py35 dsvm e2b244b Updated from global requirements 60f8051 Add coverage check job f56db6b Remove ceilometerclient from requirements.txt 89b4d29 Enable policy library panel through devstack 53b280c Fix include_rules option to work properly ecc0ad6 Fix py3 failures and enable py3 dsvm job 42afa87 Modify to use libraries compatible with python3 be29458 Fix postgresql jobs and cleanup zuul job files f2cb62b zuul: run TripleO jobs with new zuulv3 layout 4eeeac9 Remove congress_dashboard from congress repo d187dd6 Fix intermittent gate failure on key file generation 8ead7a6 Fix failure in devstack single node deployment of congress 9246fc7 Remove setting of version/release from releasenotes be28abb Disable tempest jobs for doc only changes 056358c Updated from global requirements 9ce4da8 Replace the usage of some aliases in tempest 0c720cc Updated from global requirements c799988 library policy activation to accept item as {} 1c9a933 Update the doc link b72ae35 Remove ceilometer datasource driver from congress 4fcbd25 Expose include_rules param in library policy API GET methods 6264851 Migrate to Zuul v3 bfaf81f Updated from global requirements da43f70 Fix rule in permitted image library policy b7b1a82 Add tags table to nova driver 48bd2ca Add default configuration files to data_files 8bdf2e6 Fix test mocking and disable ceilometer tempest test b40fcbe Call base from_dict in RequestContext a729a09 Update tests to do not use deprecated test.services() b5db865 Replace the usage of some aliases in tempest 06cd6a2 Updated from global requirements 77efd73 Add diagnostic output for replica test instability 136315c add tempest test to activate library policies 88e7f54 Fix sphinx warnings in docstring and re-enable autodoc 242f127 Add Qos translator in neutron datasource drive. a168c9a omit openstackdocstheme for READTHEDOCS 1335688 fix gate failure rabbitmq auth rejected and oslo policy mock 9c20850 Updated from global requirements 6501029 Updated from global requirements 367ed94 Updated from global requirements a1cf5da temporarily disable unstable dse tests ddb1c5b writing convention set to use "." to source script files 39c49ae Updated from global requirements b681469 Updated from global requirements 1d55e93 Fixed confusing cls param in instance methods d014b91 use encryption key only on datasource node caf5ad2 Add test loading policy files into library a2b02ea Update reno for stable/pike de0bf60 Update and replace http with https for doc links in congress Diffstat (except docs and test files) ------------------------------------- .gitreview | 1 + .zuul.yaml | 138 +++ HACKING.rst | 2 +- congress/api/action_model.py | 14 +- congress/api/application.py | 14 +- congress/api/datasource_model.py | 26 +- congress/api/library_policy_model.py | 86 +- congress/api/policy_model.py | 60 +- congress/api/router.py | 2 +- congress/api/row_model.py | 45 +- congress/api/rule_model.py | 47 +- congress/api/schema_model.py | 12 +- congress/api/status_model.py | 12 +- congress/api/system/driver_model.py | 19 +- congress/api/table_model.py | 25 +- congress/api/webservice.py | 184 ++-- congress/cfg_validator/__init__.py | 0 congress/cfg_validator/agent/__init__.py | 9 + congress/cfg_validator/agent/agent.py | 433 +++++++++ congress/cfg_validator/agent/generator.py | 134 +++ congress/cfg_validator/agent/opts.py | 58 ++ congress/cfg_validator/agent/rpc.py | 89 ++ congress/cfg_validator/parsing.py | 213 +++++ congress/cfg_validator/utils.py | 67 ++ congress/common/config.py | 19 - congress/common/policies/__init__.py | 17 + congress/common/policies/base.py | 43 + congress/common/policy.py | 28 +- congress/context.py | 11 +- congress/datalog/arithmetic_solvers.py | 51 +- congress/datalog/builtin.py | 78 +- congress/datalog/compile.py | 29 +- congress/datalog/nonrecursive.py | 2 +- congress/datalog/utility.py | 2 +- congress/datasources/aodh_driver.py | 8 +- congress/datasources/ceilometer_driver.py | 284 ------ congress/datasources/cfgvalidator_driver.py | 618 +++++++++++++ congress/datasources/datasource_driver.py | 14 +- congress/datasources/mistral_driver.py | 204 +++++ congress/datasources/monasca_driver.py | 29 +- congress/datasources/murano_driver.py | 34 +- congress/datasources/neutronv2_driver.py | 59 ++ congress/datasources/neutronv2_qos_driver.py | 147 ++++ congress/datasources/nova_driver.py | 25 +- congress/datasources/push_driver.py | 2 +- congress/datasources/swift_driver.py | 40 +- congress/db/datasources.py | 8 + congress/db/db_ds_table_data.py | 4 + congress/db/db_library_policies.py | 11 +- congress/db/db_policy_rules.py | 15 +- congress/db/utils.py | 47 + congress/dse2/control_bus.py | 2 - congress/dse2/data_service.py | 17 +- congress/dse2/dse_node.py | 110 ++- congress/encryption.py | 1 + congress/exception.py | 4 +- congress/harness.py | 12 +- congress/library_service/library_service.py | 74 +- congress/policy_engines/agnostic.py | 24 +- congress/policy_engines/vm_placement.py | 32 +- congress/server/__init__.py | 9 + congress/server/congress_server.py | 10 +- congress/synchronizer/policy_rule_synchronizer.py | 4 +- congress_dashboard/README.md | 25 - congress_dashboard/api/__init__.py | 0 congress_dashboard/api/congress.py | 304 ------- congress_dashboard/datasources/__init__.py | 0 congress_dashboard/datasources/panel.py | 26 - congress_dashboard/datasources/tables.py | 75 -- .../templates/datasources/_detail_overview.html | 14 - .../datasources/templates/datasources/detail.html | 14 - .../datasources/templates/datasources/index.html | 19 - congress_dashboard/datasources/urls.py | 30 - congress_dashboard/datasources/utils.py | 187 ---- congress_dashboard/datasources/views.py | 238 ----- congress_dashboard/enabled/_50_policy.py | 3 - congress_dashboard/enabled/_60_policies.py | 9 - congress_dashboard/enabled/_70_datasources.py | 5 - congress_dashboard/policies/__init__.py | 0 congress_dashboard/policies/forms.py | 69 -- congress_dashboard/policies/panel.py | 26 - congress_dashboard/policies/rules/__init__.py | 0 congress_dashboard/policies/rules/tables.py | 127 --- congress_dashboard/policies/rules/views.py | 31 - congress_dashboard/policies/rules/workflows.py | 441 ---------- congress_dashboard/policies/tables.py | 94 -- .../policies/templates/policies/_create.html | 22 - .../templates/policies/_detail_overview.html | 18 - .../policies/templates/policies/create.html | 11 - .../policies/templates/policies/detail.html | 20 - .../policies/templates/policies/index.html | 13 - .../policies/rules/_create_conditions.html | 174 ---- .../templates/policies/rules/_create_output.html | 65 -- .../templates/policies/rules/_mapping_row.html | 21 - .../policies/templates/policies/rules/create.html | 24 - congress_dashboard/policies/urls.py | 36 - congress_dashboard/policies/views.py | 157 ---- congress_dashboard/static/admin/css/policies.css | 134 --- congress_dashboard/static/admin/js/policies.js | 288 ------ congress_dashboard/templates/admin/_scripts.html | 5 - congress_dashboard/templates/admin/base.html | 14 - .../services/policy/policy_client.py | 208 ----- .../scenario/congress_datasources/__init__.py | 0 .../congress_datasources/_test_keystonev2.py | 171 ---- .../scenario/congress_datasources/test_aodh.py | 106 --- .../congress_datasources/test_ceilometer.py | 85 -- .../scenario/congress_datasources/test_cinder.py | 116 --- .../scenario/congress_datasources/test_doctor.py | 87 -- .../scenario/congress_datasources/test_glancev2.py | 136 --- .../scenario/congress_datasources/test_heat.py | 45 - .../scenario/congress_datasources/test_ironic.py | 45 - .../congress_datasources/test_keystonev3.py | 206 ----- .../scenario/congress_datasources/test_murano.py | 208 ----- .../congress_datasources/test_neutronv2.py | 399 --------- .../scenario/congress_datasources/test_nova.py | 152 ---- .../scenario/congress_datasources/test_swift.py | 47 - devstack/plugin.sh | 172 +++- devstack/settings | 17 +- .../configuration/samples/congress-agent.rst | 8 + etc/congress-agent-config-generator.conf | 7 + etc/congress-policy-generator.conf | 3 + etc/policy.json | 6 - examples/cfg_validator/deploy.sh | 169 ++++ .../rules/vxlan_conflicting_ovs_lb_udp_ports.rule | 17 + examples/murano/predeploy_simulate.sh | 4 +- library/disallowed_images/disallowed_images.yaml | 4 +- library/server_utilization.yaml | 19 - library/tag_based_network_security_zone.yaml | 89 ++ .../legacy/congress-devstack-api-base/post.yaml | 80 ++ .../legacy/congress-devstack-api-base/run.yaml | 90 ++ .../congress-devstack-py35-api-mysql/post.yaml | 80 ++ .../congress-devstack-py35-api-mysql/run.yaml | 90 ++ .../legacy/congress-pe-replicated-base/post.yaml | 80 ++ .../legacy/congress-pe-replicated-base/run.yaml | 89 ++ .../notes/config-datasource-3017c604d98b29e2.yaml | 11 + .../notes/mistral-driver-457e325bdae1a3bd.yaml | 9 + .../notes/queens-misc-bf5bc31163edc798.yaml | 48 + ...ove-ceilometer-datasource-16e9cbbf15751c05.yaml | 6 + .../notes/swift-auth-9593642ad5ec18f7.yaml | 8 + releasenotes/source/conf.py | 12 +- releasenotes/source/index.rst | 1 + releasenotes/source/pike.rst | 6 + requirements.txt | 47 +- scripts/manual_testing/doctor_pushdriver.sh | 2 +- .../doctor_pushdriver.sh.sample_output | 16 +- scripts/manual_testing/general.sh | 3 +- scripts/manual_testing/general.sh.sample_output | 469 +++++----- setup.cfg | 34 +- test-requirements.txt | 19 +- tox.ini | 8 +- 208 files changed, 6305 insertions(+), 8292 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 89c5a7d..d68087f 100644 --- a/requirements.txt +++ b/requirements.txt @@ -7 +7 @@ eventlet!=0.18.3,!=0.20.1,<0.21.0,>=0.18.2 # MIT -jsonschema!=2.5.0,<3.0.0,>=2.0.0 # MIT +jsonschema<3.0.0,>=2.6.0 # MIT @@ -9,3 +9,3 @@ PuLP>=1.4.1 # MIT -keystoneauth1>=3.1.0 # Apache-2.0 -keystonemiddleware>=4.12.0 # Apache-2.0 -Paste # MIT +keystoneauth1>=3.3.0 # Apache-2.0 +keystonemiddleware>=4.17.0 # Apache-2.0 +Paste>=2.0.2 # MIT @@ -14 +14 @@ pbr!=2.1.0,>=2.0.0 # Apache-2.0 -aodhclient>=0.7.0 # Apache-2.0 +aodhclient>=0.9.0 # Apache-2.0 @@ -16 +16 @@ python-keystoneclient>=3.8.0 # Apache-2.0 -python-heatclient>=1.6.1 # Apache-2.0 +python-heatclient>=1.10.0 # Apache-2.0 @@ -19 +19 @@ python-muranoclient>=0.8.2 # Apache-2.0 -python-novaclient>=9.0.0 # Apache-2.0 +python-novaclient>=9.1.0 # Apache-2.0 @@ -21,2 +21 @@ python-neutronclient>=6.3.0 # Apache-2.0 -python-ceilometerclient>=2.5.0 # Apache-2.0 -python-cinderclient>=3.1.0 # Apache-2.0 +python-cinderclient>=3.3.0 # Apache-2.0 @@ -24 +23,2 @@ python-swiftclient>=3.2.0 # Apache-2.0 -python-ironicclient>=1.14.0 # Apache-2.0 +python-ironicclient>=2.2.0 # Apache-2.0 +python-mistralclient>=3.1.0 # Apache-2.0 @@ -26 +26 @@ alembic>=0.8.10 # MIT -cryptography!=2.0,>=1.6 # BSD/Apache-2.0 +cryptography!=2.0,>=1.9 # BSD/Apache-2.0 @@ -30,11 +30,12 @@ Routes>=2.3.1 # MIT -six>=1.9.0 # MIT -oslo.concurrency>=3.8.0 # Apache-2.0 -oslo.config!=4.3.0,!=4.4.0,>=4.0.0 # Apache-2.0 -oslo.context>=2.14.0 # Apache-2.0 -oslo.db>=4.24.0 # Apache-2.0 -oslo.messaging!=5.25.0,>=5.24.2 # Apache-2.0 -oslo.policy>=1.23.0 # Apache-2.0 -oslo.serialization!=2.19.1,>=1.10.0 # Apache-2.0 -oslo.service>=1.10.0 # Apache-2.0 -oslo.utils>=3.20.0 # Apache-2.0 -oslo.middleware>=3.27.0 # Apache-2.0 +six>=1.10.0 # MIT +tenacity>=3.2.1 # Apache-2.0 +oslo.concurrency>=3.25.0 # Apache-2.0 +oslo.config>=5.1.0 # Apache-2.0 +oslo.context>=2.19.2 # Apache-2.0 +oslo.db>=4.27.0 # Apache-2.0 +oslo.messaging>=5.29.0 # Apache-2.0 +oslo.policy>=1.30.0 # Apache-2.0 +oslo.serialization!=2.19.1,>=2.18.0 # Apache-2.0 +oslo.service!=1.28.1,>=1.24.0 # Apache-2.0 +oslo.utils>=3.33.0 # Apache-2.0 +oslo.middleware>=3.31.0 # Apache-2.0 @@ -42 +43 @@ oslo.vmware>=2.17.0 # Apache-2.0 -oslo.log>=3.22.0 # Apache-2.0 +oslo.log>=3.36.0 # Apache-2.0 diff --git a/test-requirements.txt b/test-requirements.txt index a94b649..6e1f0eb 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -8,5 +8,5 @@ fixtures>=3.0.0 # Apache-2.0/BSD -mock>=2.0 # BSD -mox3!=0.19.0,>=0.7.0 # Apache-2.0 -oslotest>=1.10.0 # Apache-2.0 -requests-mock>=1.1 # Apache-2.0 -python-subunit>=0.0.18 # Apache-2.0/BSD +mock>=2.0.0 # BSD +mox3>=0.20.0 # Apache-2.0 +oslotest>=3.2.0 # Apache-2.0 +requests-mock>=1.1.0 # Apache-2.0 +python-subunit>=1.0.0 # Apache-2.0/BSD @@ -15,2 +15 @@ testscenarios>=0.4 # Apache-2.0/BSD -testtools>=1.4.0 # MIT -tenacity>=3.2.1 # Apache-2.0 +testtools>=2.2.0 # MIT @@ -19,2 +18,2 @@ tenacity>=3.2.1 # Apache-2.0 -openstackdocstheme>=1.16.0 # Apache-2.0 -sphinx>=1.6.2 # BSD +openstackdocstheme>=1.18.1 # Apache-2.0 +sphinx!=1.6.6,>=1.6.2 # BSD @@ -23 +22 @@ sphinx>=1.6.2 # BSD -reno!=2.3.1,>=1.8.0 # Apache-2.0 +reno>=2.5.0 # Apache-2.0