We are pumped to announce the release of: ironic-python-agent 6.1.2: Ironic Python Agent Ramdisk This release is part of the ussuri stable release series. The source is available from: https://opendev.org/openstack/ironic-python-agent Download the package from: https://tarballs.openstack.org/ironic-python-agent/ Please report issues through: https://storyboard.openstack.org/#!/project/openstack/ironic- python-agent For more details, please see below. 6.1.2 ^^^^^ New Features ************ * Adds an configuration option which can be encoded into the ramdisk itself or the PXE parameters being provided to instruct the agent to ignore bootloader installation or configuration failures. This functionality is useful to work around well-intentioned hardware which is auto-populating all possible device into the UEFI nvram firmware in order to try and help ensure the machine boots. Except, this can also mean any explict configuration attempt will fail. Operators needing this bypass can use the "ipa-ignore-bootloader- failure" configuration option on the PXE command line or utilize the "ignore_bootloader_failure" option for the Ramdisk configuration. In a future version of ironic, this setting may be able to be overriden by ironic node level configuration. * Adds the capability into the agent to read and act upon bootloader CSV files which serve as authoritative indicators of what bootloader to load instead of leaning towards utilizing the default. Known Issues ************ * If multiple bootloader CSV files are present on the EFI filesystem, the first CSV file discovered will be utilized. The Ironic team considers multiple files to be a defect in the image being deployed. This may be changed in the future. Bug Fixes ********* * Setting the new "ipa-ignore-bootloader-failure" config option prevents errors due to bootloader installation failure generated by automatic bootloader entries configuration from multiple attached devices. * The system file system configuration file for Linux machines, the "/etc/fstab" file is now updated to include a reference to the EFI partition in the case of a partition image base deployment. Without this reference, images deployed using partition images could end up in situations where upgrading the bootloader could fail. * Fixes an issue where the bootloader installation can fail on a software RAID volume when no root_device hint is set. See Story 2007905 (https://storyboard.openstack.org/#!/story/2007905) * Fixes an issue with the IntelCnaHardwareManager which prevented hardware managers with lower priority to be executed and therefore may blocked the initialization and collection of hardware these managers are supposed to take care of. * Fixes an error with UEFI based deployments where using a partition image a NVMe device was previously failing due to the different device name pattern. * Fixes a bug where the partitions created during software RAID setup are cleaned too early and therefore may prevent the proper cleaning of the md superblocks. Leaving superblocks behind will impact the creation of new md devices later on. * Fixes retry logic issues with the Agent Lookup which can result in the lookup failing prematurely before being completed, typically resulting in an abrupt end to the agent logging and potentially weird errors like TypeError being reported on the agent process standard error output. For more information see bug 2007968 (https://storyboard.openstack.org/#!/story/2007968). * Detects md component devices by their UUID, rather than by scanning the output of mdadm. This will prevent that devices miss md superblock cleanup when they are currently not part of an array. * Fixes failures with disk image conversions which result in memory allocation or input/output errors due to memory limitations by limiting the number of available memory allocation pools to a non- dynamic reasonable number which should not exceed the available system memory. * The lshw package version B.02.19.2-5 on CentOS 8.4 and 8.5 contains a bug (https://bugzilla.redhat.com/show_bug.cgi?id=1955250) that prevents the size of individual memory banks from being reported, with the result that the total memory size would be reported as 0 in some places. The total memory size is now taken from lshw's total memory size output (which does not suffer from the same problem) when available. * Fixes the agent's EFI boot handling such that EFI assets from a partition image are preserved and used instead of overridden. This should permit operators to use Secure Boot with partition images IF the assets are already present in the partition image. * Since the Ussuri release, IPA has ignored the listen_host and listen_port directives. This fixes the behavior and restores those configuration values to working status. https://storyboard.openstack.org/#!/story/2008016 * Fixes nodes failing after deployment completes due to issues in the Grub2 EFI loader entry addition where a "BOOT.CSV" file provides the authoritative pointer to the bootloader to be used for booting the OS. The base issue with Grub2 is that it would update the UEFI bootloader NVRAM entries with whatever is present in a vendor specific "BOOT.CSV" or "BOOTX64.CSV" file. In some cases, a baremetal machine *can* crash when this occurs. More information can be found at story 2008962 (https://storyboard.openstack.org/#!/story/2008962). * Increase memory usage limit for "qemu-img convert" command to 2 GiB. See Story 2008667 (https://storyboard.openstack.org/#!/story/2008667) for details. Changes in ironic-python-agent 6.1.1..6.1.2 ------------------------------------------- 746f65b Fix getting memory size in some lshw output e03d80d Add function to calculate memory 76d061e Reduce logging verbosity when collecting logs 8287b96 Utilize CSV file for EFI loader selection a4beb1b Make _get_efi_bootloaders return relative paths bc849e2 Limit qemu-img execution arenas d8c116a Increase the memory limit for qemu-img 6324b37 Fix NVMe Partition image on UEFI 7007ea0 Add fstab pointer to EFI partition 9783992 Prevent broken partition image UEFI deploys 8f77a01 Option to enable bootloader config failure bypass ca70841 More refactoring of the image module d59360f Mount all vfat partitions before calling grub2 d0f69e9 Refactor part of image module d8eefc9 Re-enable the ussuri tinyipa jobs 7f3a7e1 Prepare to use ussuri jobs from ipa-builder b9c9b0b Use UPPER_CONSTRAINTS_FILE to deal with ipa-builder 90b79c2 Pin version of ipa-builder when publishing image c23c107 Software RAID: Get component devices by md UUID 80b1492 Remove lower-constraints job 38e6c36 Log a warning of target_boot_mode does not match current boot mode 43fdcb3 Software RAID: Don't delete partitions too early 3c54867 Fix: make Intel CNA hardware manager none generic 3769174 CI: Lower memory usage of VMs/Increase swap 665219e Make WSGI server respect listen_* directives a6f96eb Increase memory for tinyipa jobs 0153622 Fix TypeError on agent lookup failure c78d6be Fix bootloader install issue with MDRAID Diffstat (except docs and test files) ------------------------------------- ironic_python_agent/api/app.py | 13 +- ironic_python_agent/config.py | 13 +- ironic_python_agent/extensions/image.py | 561 ++++++++-- ironic_python_agent/hardware.py | 156 ++- ironic_python_agent/hardware_managers/cna.py | 23 +- ironic_python_agent/ironic_api_client.py | 37 +- ironic_python_agent/shell/write_image.sh | 13 +- ironic_python_agent/utils.py | 3 +- ...all-failure-to-be-ignored-b99667b13afa9759.yaml | 21 + ...nd-efi-partition-to-fstab-e9f945a4dd19bd7a.yaml | 8 + ...oader-install-with-mdraid-0a254035df9d0bed.yaml | 7 + ...nx-hardware-mgr-never-run-72072580be4d6e7a.yaml | 7 + ...-partition-image-handling-b8487133a188fd32.yaml | 6 + .../fix_partition_cleanup-46491861c930db12.yaml | 6 + ...ixes-agent-lookup-retries-1b4bb90b8e783aca.yaml | 9 + ...get_md_components_by_uuid-7f08d423ea9e7c94.yaml | 6 + ...mit-qemu-img-malloc-arena-025ed84115481eae.yaml | 7 + .../lshw-no-memory-bank-size-05ea71987362986e.yaml | 9 + ...serve-efi-folder-contents-ea1e278b3093ec55.yaml | 7 + ...respect-listen-directives-94fb863c5b692c07.yaml | 7 + ...t-bootloader-csv-file-use-c815b520c600cd98.yaml | 22 + .../notes/up-qemuimg-mem-1536183a02b3a235.yaml | 7 + tox.ini | 2 +- zuul.d/ironic-python-agent-jobs.yaml | 12 +- zuul.d/project.yaml | 5 +- 30 files changed, 2255 insertions(+), 294 deletions(-)