We are thrilled to announce the release of: ironic 15.0.2: OpenStack Bare Metal Provisioning This release is part of the ussuri stable release series. The source is available from: https://opendev.org/openstack/ironic Download the package from: https://tarballs.openstack.org/ironic/ Please report issues through: https://storyboard.openstack.org/#!/project/943 For more details, please see below. 15.0.2 ^^^^^^ Known Issues ************ * Some "ipmitool" builds, in particular on machines running Red Hat Enterprise Linux 8.2, have changed the default cipher suite being offered which can cause "ipmitool" to completely fail to negotiate a connection with the BMC. Operators who encounter this situation should use the "ipmi_cipher_suite" parameter in the "driver_info" field to override and directly assert the required cipher. Because of potential security implications of attempting second level auto- negotiation and known BMC vendor behaviors, this must be identified by the operator and explicitly set as logic to attempt to navigate through situations like this may have undesirable results. * When "redfish-virtual-media" is used, fast-track mode will not work as expected, nodes will be rebooted between operations. Upgrade Notes ************* * An automated detection of a IPMI BMC hardware vendor has been added to appropriately handle IPMI BMC variations. Ironic will now query this and save this value if not already set in order to avoid querying for every single operation. Operators upgrading should expect an elongated first power state synchronization if for nodes with the "ipmi" hardware type. Bug Fixes ********* * Fixes the deployment failure with Ussuri (and older) ramdisks that happens when another IPA command runs after "prepare_image". * Fixes an issue with the "ansible" deployment interface where automatic root deviec selection would accidently choose the system CD-ROM device, which was likely to occur when the ansible deployment interface was used with virtual media boot. The "ansible" deployment interface now ignores all Ramdisks, Loopbacks, CD-ROMs, and floppy disk devices. * Fixes the "[deploy]configdrive_use_object_store" option that was broken during the Python 3 transition. * Fixes the problem about grub2 config file. Some higher versions of grub2 (e.g. 2.05 or 2.06-rc1) use grub.cfg-01-MAC, while another lower versions of grub2 (e.g. 2.04) use MAC.conf, so we generate both paths in order to be compatible with both. * Fixes an issue with agent token handling where the agent has not been upgraded resulting in an AgentAPIError, when the token is not required. The conductor now retries without sending an agent token. * Fixes issues when "UEFI" boot mode has been requested with persistent boot to "DISK" where some versions of "ipmitool" do not properly handle multiple options being set at the same time. While some of this logic was addressed in upstream ipmitool (https://github.com/ipmitool/ipmitool/issues/163) development, new versions are not released and vendors maintain downstream forks of the ipmitool utility. When considering vendor specific selector differences (https://storyboard.openstack.org/#!/story/2008241) along with the current stance of new versions from the upstream "ipmitool" community, it only made sense to handle this logic with- in Ironic. In part this was because if already set the selector value would not be updated. Now ironic always transmits the selector value for "UEFI". * Fixes handling of Supermicro "UEFI" supporting BMCs with the "ipmi" hardware type such that an appropriate boot device selector value is sent to the remote BMC to indicate boot from local storage. This is available for both persistent and one-time boot applications. For more information, please consult story 2008241 (https://storyboard.openstack.org/#!/story/2008241). * Fixes handling of the "ipmi" hardware type where "UEFI" boot mode and "one-time" boot to PXE has been requested. As Ironic now specifically transmits the raw commands, this setting should be properly appied where previously PXE boot operations may have previously occured in "Legacy BIOS" mode. * Fixes a potential race in the hash ring code that could result in the hash rings never updated after their initial load. * Fixes the virtual disks creation by changing PERC H740P controller mode from *Enhanced HBA* to *RAID* in delete_configuration clean step. PERC H740P controllers supports RAID mode and Enhanced HBA mode. When the controller is in Enhanced HBA, it creates single disk RAID0 virtual disks of NON-RAID physical disks. Hence the request for VD creation with supported RAID fails due to no available physical disk. This patch converts the PERC H740P RAID controllers to RAID mode if enhanced HBA mode found enabled See bug bug 2007711 (https://storyboard.openstack.org/#!/story/2007711) for more details * Fixes the deprecated "idrac" hardware interface implementation "__init__" methods to call their base class "__init__" methods before emitting a log message warning about their deprecation. For more information, see story 2008197 (https://storyboard.openstack.org/#!/story/2008197). * Allows configuring IPMI cipher suite via the new "driver_info" parameter "ipmi_cipher_suite" to enable operators to navigate "ipmitool" behavior changes around supported ciphers. * When configured to use json-rpc, the "[DEFAULT].host" configuration option to ironic-conductor can now be set to an IPv6 address. Previously it could only be an IPv4 address or a DNS name. * Fixes the issue that when the MAC address of a port group is not set and been attached to instance, the landed bond port cannot get IP address due to inconsistent MAC address between the tenant port and the initially allocated one in the config drive. * Fixes wiping the agent secret token on manual power off or reboot. Also makes sure to remove the agent URL since it may potentially change. * Fixes cleaning and managed inspection not respecting the "default_boot_mode" configuration option. * Fixes cleaning and managed inspection not following the standard boot mode handling logic, particularly, not trying to assert the requested boot mode if the driver allows it. * Adds handling of Redfish BMC's which lack a "BootSourceOverrideMode" flag, such that it is no longer a fatal error for a deployment if the BMC does not support this field. This most common on BMCs which feature only a partial implementation of the "ComputerSystem" resource "boot", but may also be observable on some older generations of BMCs which recieved updates to have partial Redfish support. * The fix for story 2008252 (https://storyboard.openstack.org/#!/story/2008252) synced the boot mode after changing the boot device because Supermicro nodes reset the boot mode if not included in the boot device set. However this can cause a problem on Dell nodes when changing the mode uefi->bios or bios->uefi, see story 2008712 (https://storyboard.openstack.org/#!/story/2008712) for details. Restrict the syncing of the boot mode to Supermicro. * When Ironic configures the BootSourceOverrideTarget setting via Redfish, on Supermicro BMCs it must always configure BootSourceOverrideEnabled or that will revert to default (Once) on the BMC, see story 2008547 (https://storyboard.openstack.org/#!/story/2008547) for details. This is different than what is currently implemented for other BMCs in which the BootSourceOverrideEnabled is not configured if it matches the current setting (see story 2007355 (https://storyboard.openstack.org/#!/story/2007355)). This requires that node.properties['vendor'] be 'supermicro' which will be set by Ironic from the Redfish system response or can be set manually. * After changing the boot device via Redfish, check that the boot mode being reported matches what is configured and, if not, set it to the configured value. Some BMCs change the boot mode when the device is set via Redfish, see story 2008252 for details. * Introduces lazy-loading of ports, portgroups, volume connections and volume targets in task manager to fix performance issues. For periodic tasks which create a task manager object but don't require the aforementioned data (e.g. power sync), this change should reduce the number of database interactions by around two thirds, speeding up overall execution. * Removes stale agent tokens when rebooting nodes using API. This prevents lookup failures for nodes that get rebooted between fast- track operations. * Fixes an issue of powering off with the "idrac-wsman" management interface while the execution of a clear job queue cleaning step is proceeding. Prior to this fix, the clean step would fail when powering off a node. * Fixes timeout in fast-track mode with "redfish-virtual-media" when running one operation after another (e.g. cleaning after inspection). Other Notes *********** * Adds a "detect_vendor" management interface method to the "ipmi" hardware type. This method is being promoted as a higher level interface as the fundimental need to be able to have logic aware of the hardware vendor is necessary with vendor agnostic drivers where slight differences require slightly different behavior. Changes in ironic 15.0.1..15.0.2 -------------------------------- f33bc52b0 Remove grenade jobs from old stable branches c68e50e6c Update the clear job id's constant 8d6cf57bb Make test-setup.sh compatible with mysql8 86a855d61 Delete unavailable py2 package 54376836e update grub2 file name 72fd48b9c Restrict syncing of boot mode to Supermicro 2e4e87556 For Supermicro BMCs set enable when changing boot device 4df73e47e Refactor vendor detection and add Redfish implementation 8bf3f4747 IPMI: Handle vendor set boot device differences 97390e427 Allow unsupported redfish set_boot_mode 691211b10 Lazy-load node details from the DB 5e2eeb311 [Trivial] Fix testing of volume connector exception 0da73cdd3 Fix broken configdrive_use_object_store 8c0568f34 Enable swift temporary URLs in grenade and provide a good error message c3c6cda65 DRAC: Fix a failure to create virtual disk 85a1e3d23 CI: switch the multinode job to tempest-multinode-full-base b2ae2af3f Fixes the issue that instance bond port can't get IP address a6f38ab05 Sync boot mode when changing the boot device via Redfish cfc681817 Use assertCountEqual instead of assertItemsEqual 2248f2ac7 json-rpc: surround IPv6 address with [] in conductor URL a7cfcd181 clean up mac address with the pxe configuration files 6ef6180bd Prevent timeouts when using fast-track with redfish-virtual-media 96a719e4e opt: Enhance old stable branches to use latest python-ibmcclient d48b39430 CI: Making some of the older jobs more specific 7ce314804 CI: Additional minor job changes to improve CI reliability c15d6fd70 Fix a race condition in the hash ring code e5f886e8c Use correct error handler instead of calling process_event('fail') 20de88441 Fix deprecated 'idrac' interface '__init__'s 3943bd143 CI: Patch to fix CI jobs in bugfix/stable branches b9a02e9ab CI: Remove the build check for pre-build ramdisks only ac2d4c086 Allow configuring IPMI cipher suite d9183a0a3 Also wipe agent token on manual power off or reboot 041f1b89e Handle default_boot_mode during cleaning/inspection with PXE/iPXE b4c6d7be4 Do not assume that prepare_image is the last command to run b67ac0c40 Handle an older agent with agent_token 2b740a0c7 Increase memory of tinyipa vms 145d68e8f Ansible deploy - Ignore invalid devices bce1d33e5 Wipe agent token during reboot or power off Diffstat (except docs and test files) ------------------------------------- devstack/lib/ironic | 9 +- .../include/configure-ironic-api-mod_wsgi.inc | 10 +- .../install/include/configure-ironic-api.inc | 2 +- driver-requirements.txt | 2 +- ironic/common/hash_ring.py | 28 ++-- ironic/common/json_rpc/client.py | 5 +- ironic/common/neutron.py | 6 +- ironic/common/pxe_utils.py | 16 +- ironic/common/swift.py | 7 +- ironic/conductor/deployments.py | 3 +- ironic/conductor/manager.py | 7 + ironic/conductor/task_manager.py | 72 ++++++++- ironic/conductor/utils.py | 67 +++++++- ironic/drivers/base.py | 18 +++ ironic/drivers/modules/agent.py | 46 +++--- ironic/drivers/modules/agent_client.py | 45 +++++- .../ansible/playbooks/library/root_hints.py | 6 + ironic/drivers/modules/boot_mode_utils.py | 5 +- ironic/drivers/modules/deploy_utils.py | 3 + ironic/drivers/modules/drac/inspect.py | 1 + ironic/drivers/modules/drac/management.py | 5 +- ironic/drivers/modules/drac/power.py | 1 + ironic/drivers/modules/drac/raid.py | 166 ++++++++++++++++++- ironic/drivers/modules/drac/vendor_passthru.py | 1 + ironic/drivers/modules/ibmc/utils.py | 10 +- ironic/drivers/modules/ilo/management.py | 9 +- ironic/drivers/modules/ilo/raid.py | 6 +- ironic/drivers/modules/ipmitool.py | 138 +++++++++++++--- ironic/drivers/modules/network/common.py | 4 +- ironic/drivers/modules/network/neutron.py | 6 +- ironic/drivers/modules/pxe_base.py | 3 +- ironic/drivers/modules/redfish/management.py | 62 +++++++- .../unit/api/controllers/v1/test_allocation.py | 4 +- .../unit/api/controllers/v1/test_conductor.py | 4 +- .../api/controllers/v1/test_deploy_template.py | 4 +- .../unit/api/controllers/v1/test_portgroup.py | 4 +- .../api/controllers/v1/test_volume_connector.py | 4 +- .../unit/api/controllers/v1/test_volume_target.py | 4 +- .../unit/drivers/modules/drac/test_management.py | 4 +- .../unit/drivers/modules/ilo/test_management.py | 8 +- .../unit/drivers/modules/irmc/test_inspect.py | 17 -- .../unit/drivers/modules/network/test_common.py | 24 +-- .../unit/drivers/modules/network/test_neutron.py | 92 ++++++++++- .../drivers/modules/redfish/test_management.py | 101 ++++++++++-- .../unit/drivers/modules/test_agent_client.py | 58 +++++++ .../unit/drivers/modules/test_boot_mode_utils.py | 11 ++ .../unit/drivers/modules/test_deploy_utils.py | 31 ++++ .../drivers/modules/xclarity/test_management.py | 2 +- .../run.yaml | 2 +- .../notes/agent-uuid-5d86bc18849acda3.yaml | 5 + ...ble-device-name-filtering-0adfca7d8ba4cbcc.yaml | 9 ++ ...figdrive_use_object_store-93cfd7dc27d90003.yaml | 5 + ...ix-grub2-config-file-name-88e689a982a21684.yaml | 7 + ...andle-older-agent-command-5930124fd03bb327.yaml | 6 + ...uefi-disk-pxe-persistance-0d871825591918b5.yaml | 37 +++++ releasenotes/notes/hash-ring-6ce212ab86c2592d.yaml | 5 + .../idrac-add-ehba-support-10b90c92b8865364.yaml | 15 ++ ...-idrac-interface-__init__-362696b389c86d5d.yaml | 8 + .../notes/ipmi-cipher-suite-499097740f7c86ee.yaml | 18 +++ .../notes/json-rpc-ipv6-host-30eca350f34bc091.yaml | 6 + .../notes/portgroup-mac-649ed31c3525e4f0.yaml | 7 + .../notes/power-off-token-0403e8a054f31125.yaml | 5 + .../notes/pxe-boot-mode-9084ccf35e54bbc0.yaml | 9 ++ ...ride-not-present-handling-92e7263617e467c4.yaml | 9 ++ ...fter-device-to-supermicro-218e8cb57735c685.yaml | 11 ++ ...-redfish-override-enabled-aa51686ed33d3061.yaml | 15 ++ ...r-changing-redfish-device-f60ef90ba5675215.yaml | 8 + .../taskmanager-lazy-load-32a14526c647c2f0.yaml | 9 ++ .../notes/token-reboot-b48b5981a58a30ae.yaml | 5 + ...clear-job-id-constant-fix-c69cf96c55364bb3.yaml | 7 + .../notes/vmedia-fast-track-903076c33c4aca04.yaml | 9 ++ tools/test-setup.sh | 4 +- zuul.d/ironic-jobs.yaml | 48 ++++-- zuul.d/project.yaml | 17 +- 108 files changed, 2034 insertions(+), 393 deletions(-) Requirements updates -------------------- diff --git a/driver-requirements.txt b/driver-requirements.txt index 2d8c9671c..f47c0b783 100644 --- a/driver-requirements.txt +++ b/driver-requirements.txt @@ -20 +20 @@ ansible>=2.7 -python-ibmcclient>=0.1.0,<0.2.0 +python-ibmcclient>=0.1.0,!=0.2.1,<0.3.0