We high-spiritedly announce the release of: tripleo-common 9.1.0: A common library for TripleO workflows. This release is part of the rocky release series. The source is available from: http://git.openstack.org/cgit/openstack/tripleo-common Download the package from: https://tarballs.openstack.org/tripleo-common/ Please report issues through launchpad: https://bugs.launchpad.net/tripleo-common For more details, please see below. 9.1.0 ^^^^^ New Features ************ * Adds a workflow to create a container so the underlying action does not need to be called directly. * Add a workflow to generate fencing parameters so action tripleo.parameters.generate_fencing does not need to be called directly. * Allow uploading files bigger than 5GB to swift. Currently we have support for uploading files to swift using the swift client class, this class does not allow to upload files bigger than 5GB. This change enables the upload of files bigger than 5GB by using the swift service class and adjusting the headers to allow this operations. This new helper will be used for the Undercloud backup, to be able to store files bigger than 5GB. * Adds a workflow to generate the overcloudrc files in a given deployment so the tripleo.deployment.overcloudrc action does not need to be called directly. * Adds support to specify additional parameters for Bare Metal ports when registering nodes. The "mac" key in nodes_json (instackenv.json) is replaced by the new "ports" key. Each port-entry supports the following keys: "address", "physical_network" and "local_link_connection". (The keys in "ports" mirror a subset off the Bare Metal service API (https://developer.openstack.org/api-ref/baremetal/#ports-ports) .) Example specifying port mac address only: "ports": [ { "address": "52:54:00:87:c8:2e" } ] Example specifying additional parameters: "ports": [ { "address": "52:54:00:87:c8:2f", "physical_network": "network", "local_link_connection": { "switch_info": "switch", "port_id": "gi1/0/11", "switch_id": "a6:18:66:33:cb:49" } } ] * Install Octavia amphora image on the undercloud if Red Hat. * Sets "rescue_kernel" and "rescue_ramdisk" to the same values as "deploy_kernel" and "deploy_ramdisk" on node enrollment or configuration. * Adds support for "rescue_interface" when enrolling nodes. * On enrollment, all classic drivers are replaced with their hardware type equivalents (e.g. "pxe_ipmitool" is replaced with "ipmi"). The "fake_pxe" classic driver is replaced with the "manual- management" hardware type (which must be enabled in the undercloud). * Create keypair for SSH access to Octavia amphorae. * ContainerImagePrepare entries can now take an *includes* option, which like *excludes* will take a list of regex patterns. *includes* will filter entries which do not match at least one of the include expressions. * Enhance lb-mgmt-subnet to be a class B subnet, so the global amount of Octavia loadbalancers won't be constrained to a very low number. Deprecation Notes ***************** * The "mac" key in nodes_json is replaced by "ports". The "ports" key expect a list of dictionaries specifying "address" (mac address), and optional keys "physical_network" and "local_link_connection". * The "os_auth" argument to the "generate_fencing_parameters" workflow is deprecated and should not be provided. It will be removed in a future version. Bug Fixes ********* * Fix bug 1760659 by updating the derived parameters workflow to use scheduler hints associated with a given role. The scheduler hints are used to identify overcloud nodes associated with the role, and take precedence over nodes identified by their profile/flavor. * Fixes handling hardware types (new-style Ironic drivers) when generating fencing parameters. Also completely removes support for no longer existing "pxe_ssh" driver. * Fix Octavia amphora image RPM install on undercloud node for Red Hat based deployments (*bug 1772880 <https://bugs.launchpad.net/tripleo/+bug/1772880>*) * Check pub key file permissions and default to pub key data for Octavia. * Fix syntax error in octavia-undercloud role. Changes in tripleo-common 9.0.1..9.1.0 -------------------------------------- 8f7f5d2 Get deployment_stack_id via deployment_ref for config download 2458872 Add docker packages to OVN metadata agent container 027868b overcloud: include openssh element 4dd9a77 Ignore errors when checking result of previous deployments c500c1e Use correct modify_append_tag key 383ae0a Deploy ceph-ansible in mistral containers e8c521a Workflow and action for deployment failures 6e36336 Ansible json error callback plugin 5ef16ad Add ssh_network input cd2532f Remove extra parenthesis from container-update.py 55a78c5 Migrate to the new Mistral context class ed760d7 Fix heat api cfn healthcheck 334eda0 Remove the tripleo.container_images.prepare_upload action 8872187 Fix readme doc c27024a Increase services project secgroup-rules quotas when deploying Octavia 812d7e6 Fix handling hardware types and drivers when generating fencing parameters 3345557 Lowercase any hostname comparisons in bootstrap_* scripts fc026a5 Test target image exists before modifying 2102bda Add a dry-run behaviour to image image_uploader b2e6edf Fix Octavia amphora image RPM install 84461a8 Remove the upgrade-non-controller.sh and disable_upgrade_deployment 5640ca8 Add an "includes" prepare filter to match "excludes" db47c12 Update heat api healtchecks 5f9e974 Remove horizon ui plugins we don't support 2b6204f Add an action to upload validations to Swift 04afa0c Add workflow for plan deployment status 6f3acdb Set deployment_status from config_download_deploy aa226f9 Make lb-mgmt-subnet a class B subnet c10d309 Fix redis healthcheck 26b4459 Revert "TLS by default for the overcloud" 274b2d3 Convert classic drivers to hardware types on enrollment 26ea79f (cleanup) remove usage of role_name 9ce1c07 Include 'tripleo_role_name' in the inventory 411514d Install Octavia amphora image if Red Hat 287f110 Increase services project quotas when deploying Octavia 0c2305a Run yum clean to reduce size of docker image layer 5578770 Add validation for empty file system backup on Undercloud 8a69b69 Check pub key file perms and default to pub key data 2afc6ba Support packages list for updates in container 3f12a00 Add yum update to base 4f22d12 Incorrect plan name in send_message task f3f8993 Implement image customization during upload 6fa7a09 TLS by default for the overcloud b90bfe9 add tripleo update job as voting 5c77d51 Refactor functions out of ProcessTemplateAction f4cb0b1 Add type and plan_name to message sent from ansible-playbook action 8407b9b Add special 'all' for deploy_on_servers server name to match all f098ca9 Allow image prepare to only filter by role data fe090ff Add nvmetcli to cinder volume packages 53b1704 Use the standard messaging in the derive_parameters workbook bcd72d2 Send a message every time we get the stack a1ef44c Optionally run config download at the end of stack create/update 8998679 Add a 'trash_output' flag to ansible playbook action b2978e3 Revert: "Remove ceph-ansible workflow." a6498ad Persist package update ansible logs 3b28b87 Use the standard messaging in the baremetal workbook 4c124f6 Use the standard messaging in the fernet-key-rotate workbook 6b47b36 Use the standard messaging in the networks workbook deb8480 Script to update RPM's in containers. 2f91f4c Standardise Workflow messaging and optionally persist messages 549f9e0 Octavia amphora image handles updates and symlinks b94a67c Raise ansible forks to 25 480aead Fix dynamic inventory e2d98b8 Enable ControlMaster for ansible ssh b2b5b25 Workflows for wiping overcloud nodes ca0b4ad Fix tarball generation when downloading logs 46baa0e Add healthcheck script to mistral-event-engine image 86117a7 Fix missing docker package in neutron L3 agent container e30586e Use Designate Worker container for config 471ca8c Add Workflow To Create Overcloudrc Files 351b5a1 Fix the passlib deprecation warning 2c7fb29 Add workflow to generate fencing parameters 94886c3 Fix nova-placement healthcheck 13f2704 Allow uploading big files to swift (5GB) bd710fd Create keypair for SSH access to Octavia amphorae 2d0116d Adds Create Container Workflow 19f3e7a Allow fencing config generation before deployment. 039dbcc Add in a STOPSIGNAL configuration 5bceeee Update the horizon vhost filename 35654d5 Configurable host network for inventory 45a296c Remove ceph-ansible workflow. 074d4d7 Bump Ceph container image from 3.0.1 to 3.0.3 61dfe32 Use ansible_queue_name only for upgrade/update f2affa0 Only update plan on upgrade converge 635f6a4 Find deployment name in config download 8a58a48 Add fluentd health check 5b98699 Remove no-ops from user-env too e25e856 Use scheduler hints in derived_parameters workflow 1621bdb Fix healthcheck script for neutron-api service 4603ef6 Enrich integration with ironic networking features 1e6fa0b Add support for rescue mode in enrollment and node configuration workflows 71e30ee Return any errors from called actions in node delete Diffstat (except docs and test files) ------------------------------------- README.rst | 2 +- ansible_plugins/callback/json_error.py | 62 +++ container-images/overcloud_containers.yaml | 2 +- container-images/overcloud_containers.yaml.j2 | 2 +- .../tripleo_kolla_template_overrides.j2 | 30 +- healthcheck/fluentd | 7 + healthcheck/heat-api | 2 +- healthcheck/heat-api-cfn | 2 +- healthcheck/horizon | 4 +- healthcheck/neutron-api | 11 +- healthcheck/nova-placement | 2 +- healthcheck/redis | 4 +- image-yaml/overcloud-hardened-images.yaml | 1 + image-yaml/overcloud-images.yaml | 1 + image-yaml/overcloud-realtime-compute.yaml | 1 + playbooks/octavia-files.yaml | 10 +- playbooks/roles/common/defaults/main.yml | 16 +- .../roles/octavia-overcloud-config/tasks/main.yml | 1 + .../octavia-overcloud-config/tasks/quotas.yml | 4 + .../roles/octavia-undercloud/tasks/image_mgmt.yml | 57 +++ playbooks/roles/octavia-undercloud/tasks/main.yml | 70 +++- ...create-container-workflow-77ee4557779563c0.yaml | 5 + ...nerate-fencing-parameters-e2ea121247779db3.yaml | 5 + .../allow-upload-big-files-f67ff35fcd166612.yaml | 12 + ...eate-overcloudrc-workflow-e5150b6b0af462f0.yaml | 6 + ...ers-using-scheduler-hints-5bb65bc78c1f6f91.yaml | 7 + ...des-json-ironic-port-data-0905da3f7b13d149.yaml | 38 ++ .../notes/fencing-hw-types-fddcdb6bf6d79414.yaml | 11 + ...e-rpm-install-permissions-846cd6780a527084.yaml | 5 + .../fix-octavia-pub-key-d195fbf1976a8d36.yaml | 3 + ...n-octavia-undercloud-role-c02b0c5b0f1ece34.yaml | 3 + ...via-amphora-image-red-hat-bc8545e36d88f951.yaml | 3 + .../notes/ironic-rescue-ce08f432ccdcece4.yaml | 8 + .../notes/no-classic-drivers-d56f8c3ff15af2c3.yaml | 7 + .../octavia-amphora-ssh-5dee3678d7b66476.yaml | 3 + .../notes/prepare-includes-0c9a077369e99619.yaml | 6 + ...lb-mgmt-subnet-to-class-b-1cd832ef08a30c85.yaml | 5 + scripts/bootstrap_host_exec | 2 +- scripts/bootstrap_host_only_eval | 2 +- scripts/bootstrap_host_only_exec | 2 +- scripts/container-update.py | 258 ++++++++++++ scripts/upgrade-non-controller.sh | 217 ---------- setup.cfg | 6 +- sudoers | 1 + tripleo_common/actions/ansible.py | 34 +- tripleo_common/actions/baremetal.py | 28 +- tripleo_common/actions/base.py | 77 +++- tripleo_common/actions/deployment.py | 52 +++ tripleo_common/actions/logging_to_swift.py | 6 +- tripleo_common/actions/parameters.py | 38 +- tripleo_common/actions/plan.py | 31 +- tripleo_common/actions/scale.py | 2 +- tripleo_common/actions/templates.py | 106 +---- tripleo_common/actions/undercloud.py | 23 +- tripleo_common/actions/validations.py | 7 + tripleo_common/constants.py | 12 + tripleo_common/image/image_uploader.py | 129 ++++-- tripleo_common/image/kolla_builder.py | 68 +++- tripleo_common/inventory.py | 37 +- tripleo_common/templates/deployments.yaml | 6 +- tripleo_common/utils/config.py | 30 ++ tripleo_common/utils/nodes.py | 162 +++++--- tripleo_common/utils/passwords.py | 30 +- tripleo_common/utils/plan.py | 104 +++++ tripleo_common/utils/roles.py | 1 - tripleo_common/utils/swift.py | 75 +++- workbooks/baremetal.yaml | 411 ++++++++++--------- workbooks/deployment.yaml | 436 +++++++++++++++------ workbooks/derive_params.yaml | 82 ++-- workbooks/fernet-key-rotate.yaml | 28 +- workbooks/messaging.yaml | 151 +++++++ workbooks/networks.yaml | 59 ++- workbooks/octavia_post.yaml | 13 + workbooks/package_update.yaml | 14 +- workbooks/parameters.yaml | 61 +++ workbooks/plan_management.yaml | 37 ++ workbooks/stack.yaml | 46 ++- zuul.d/layout.yaml | 12 + 92 files changed, 3329 insertions(+), 1095 deletions(-)