We are excited to announce the release of: ansible-role-collect-logs 1.1.0: ansible-role-collect-logs - An Ansible role for aggregating logs from different nodes. The source is available from: https://opendev.org/openstack/ansible-role-collect-logs Download the package from: https://tarballs.openstack.org/ansible-role-collect-logs/ For more details, please see below. Changes in ansible-role-collect-logs 1.0.0..1.1.0 ------------------------------------------------- ef45eb7 include main container build log in logstash 7505370 make repoquery compatible with older versions of yum b51766f Upgrade molecule requirements e0176da Migrate to content provider jobs/templates a7044e0 Use root when listing installed packages 1272382 Also collect info on podman networks 480e33b Write selinux denials in separate file 0d20ac4 use sova to check for selinux denials a8c67af Replace top with vmstat c127900 Use ansible <2.10 for linters 27a7ec9 capture all available packages from enabled repos c16805f Run commands in /var/log/extra 9c29426 Add artcl_commands as infrared argument 8c93d27 add build-err.log to logstash d3dfb4e Add patterns for mirror failures 0da2f24 Add another rate limit error log pattern b411f77 add sova pattern for new tc exception, ratelimit b811510 add provision failures in deployment bcf90b7 Added sova pattern for failed containers 881310a Add patterns for sova 715b115 Exclude tripleo jobs from patterns patches c8610c6 Add pattern for undercloud failure detection 9733aaa Disable voting of broken job 62857fc Add node provision timeout pattern 2dd8f51 Add tempest failure pattern to sova d18bd2d Add another introspection pattern to sova 29f4684 Add pattern to prividing node failure e248a44 Add pattern to not manageable nodes f8ae4de Add new introspection pattern to sova 5f0bc9c Add new files to track in logstash b0e8d9e Correct logstash.txt generation 01ad1bb Add missing artcl_publish in infrared plugin 124b7f5 Remove jinja2 templating from when condition 3da107e Add new tests to molecule/infrared f1a4519 Run container collection in parallel a37e64c Add standalone timeout patterns e633da1 add ipa server install to logstash d087a23 [Readme] Update infrared plugin installation 19da20c Add artcl_build_url to infrared plugin.spec fda88f8 Add memory allocation error tracking bec9bd6 Add free ports error to track in sova 098f2a2 remove scen-10-ovn-provider from collect logs 18564ba Fail check jobs if logs collection failed 0da67a2 Move openstack collection into artcl_commands 45cce74 Gather more detailed selinux information 89f48be Allow artcl to be run by Zuul 2279543 Remove deprecated get_host_info template d91f891 Add ignore_errors in the ir plugin playbook 7627568 Added fail-safe test about file collection d5fd461 Collect OVN logs 069cb81 Lower number of jobs used to check and gate 1cb1e14 Migrate system collection commands to arctl_commands 84b90a2 Remove unnecessary pipe in jinja default value 00757e4 Add dmesg, pcs and top to system collect commands d78abae Improve default molecule scenario 1e14f3a Add standard infrared collect lists b6d8c84 Add timeout for containers logs collection b1d1684 Convert flatten_nested_dict filter into a module c0c53b1 Improve molecule testing of collect arguments bdce81b Extend infrared molecule tests 1464911 Add option to not delete artifacts in IR plugin ff0ac8f Infrared plugin, add roles_path 6fa88b2 Make collection commands configurable 61a6a63 Add pattern for image prepare error 0c2a34d Alter readme path for collect logs 6cfb1ff Fix container logs collections d431d12 collect-container-logs: get inspect infos from non-running containers 833328b Add the DLRN build projects.ini to the log files 15fa6f0 Add disk usage statistics 93d207c Fix regex for sova helathcheck pattern a9ba9d8 Dynamically generate a list of files for rsync 837d662 Upgrade to molecule 3.0 277087f Assure pyyaml is installed before running sova test 91bdae6 Fix idempotence of infrared scenario e2bccc1 Enable compression option and tar on xfer prior to publish e1a1b85 Add var to append to exclude list 2cdf3ee Enable testing of publish code b3d225f Refactoring ara tasks f4bf555 Moves container log collection to standalone script 8990c8a Use ansible_python.executable to determine pip module c2049a3 Add sova reasons to influxdb 2dd3370 Pin molecule to known good b2e898b Improve containers logs collection d784c1e Fix logs collection with new docker 0fc86f5 Make collect package list distro-aware a0d6986 Fix artcl_gzip variable in infrared plugin spec 98adb01 Improve molecule testing 5bd0db6 Fix undefined variable in infrared tasks f68cf6a Assure we respect artcl_gzip parameter 25d6288 Create infrared plugin 1a537a6 Allow archival for big files 075b69a Disable gzipping of text logs 4e79dbd Fix set -o pipefail failures on non RHEL distros d8801e7 add the log README back to the base log dir e8b67c5 Fix molecule report 460bfd5 Fix netns listing on network logs collection 061f90f Add functionality to sanitize collected logs 1b8ed19 Render undercloud ara results c76ac7d add molecule tox jobs for sova, collect 50e357a Run Sova patterns parsing in CI jobs a102512 lint: maintenance chores bf119fb remove unrequired copy 4b445fb Add ironic node list to collect 91014ff Fix linters 3a344a0 add note about ignore_errors dfcf99c add a check for selinux da49463 Don't gzip ARA when generating HTML 4bef161 Split the collect logs task 9dc533d Fix warnings of unquoted strings in influxdb module 152c077 Add information about enabled repos dd06e42 Suppress redundant output for ARA tasks with no_log 10c1679 [Trivial Fix]misspelling Diffstat (except docs and test files) ------------------------------------- .ansible-lint | 7 + .envrc | 3 + .gitignore | 1 + .pre-commit-config.yaml | 16 +- README.rst | 176 ++++- bindep.txt | 1 + defaults/main.yml | 234 +++++- .../ovb-openstack-cloud/calling-quickstart.rst | 2 +- files/collect-container-logs.sh | 103 +++ infrared_plugin/main.yml | 65 ++ infrared_plugin/plugin.spec | 203 ++++++ library/ara_influxdb.py | 38 +- library/flatten_nested_dict.py | 88 +++ library/sova.py | 192 +++++ module_utils/sova_lib.py | 102 +++ molecule/default/converge.yml | 93 +++ molecule/default/molecule.yml | 44 ++ molecule/default/prepare.yml | 16 + molecule/default/verify.yml | 8 + molecule/infrared/converge.yml | 97 +++ molecule/infrared/molecule.yml | 44 ++ molecule/infrared/verify.yml | 84 +++ molecule/sova/converge.yml | 10 + molecule/sova/molecule.yml | 15 + molecule/sova/prepare.yml | 15 + molecule/sova/verify.yml | 24 + requirements.txt | 2 +- setup.cfg | 6 +- tasks/collect.yml | 494 ++++--------- tasks/collect/container.yml | 45 ++ tasks/collect/monitoring.yml | 39 + tasks/collect/network.yml | 42 ++ tasks/collect/system.yml | 39 + tasks/create-docs.yml | 12 +- tasks/main.yml | 23 +- tasks/publish.yml | 104 ++- tasks/publish_ara.yml | 43 ++ .../{ara_graphite.yml => publish_ara_graphite.yml} | 8 +- .../{ara_influxdb.yml => publish_ara_influxdb.yml} | 19 +- tasks/sanitize_log_strings.yaml | 14 + tasks/sova.yml | 24 + templates/get_host_info.sh.j2 | 59 -- test-playbooks/zuul-ansible-role-collect-logs.yaml | 6 + test-requirements.txt | 6 +- tox.ini | 51 +- vars/family-redhat.yml | 7 + vars/infrared-collect-exclude-list.yml | 66 ++ vars/sova-patterns.yml | 783 +++++++++++++++++++++ vars/unsecure.yml | 10 + zuul.d/layout.yaml | 64 +- 53 files changed, 3172 insertions(+), 584 deletions(-) Requirements updates -------------------- diff --git a/requirements.txt b/requirements.txt index 08756f4..1545424 100644 --- a/requirements.txt +++ b/requirements.txt @@ -2 +2 @@ pbr>=1.6 -ansible>=2.5 +ansible>=2.5,<2.10 diff --git a/test-requirements.txt b/test-requirements.txt index 94dba19..34e064e 100644 --- a/test-requirements.txt +++ b/test-requirements.txt @@ -1 +1,5 @@ -pre-commit # MIT +mock +pre-commit>=1.20.0 # MIT +pytest +pytest-mock +pyyaml