<div dir="ltr"><div>Hi Julia,</div><div><br></div><div>I have also upgraded my firmware to <b>P89 v2.90 (10/16/2020) </b>but still the result is the same.</div><div>For your reference, the output of is openstack baremetal node show for whole disk image is as follows:<br></div><div><br></div><div>[ansible@localhost ~]$ openstack baremetal node show baremetal-node -f json<br>{<br> "allocation_uuid": null,<br> "automated_clean": null,<br> "bios_interface": "no-bios",<br> "boot_interface": "ipxe",<br> "chassis_uuid": null,<br> "clean_step": {},<br> "conductor": "controller",<br> "conductor_group": "",<br> "console_enabled": false,<br> "console_interface": "no-console",<br> "created_at": "2021-08-25T04:51:32+00:00",<br> "deploy_interface": "direct",<br> "deploy_step": {},<br> "description": null,<br> "driver": "ipmi",<br> "driver_info": {<br> "ipmi_port": 623,<br> "ipmi_username": "hsc",<br> "ipmi_password": "******",<br> "ipmi_address": "10.0.1.207",<br> "deploy_kernel": "a34b7e57-f324-40fe-8fe4-04eb7ea49c3a",<br> "deploy_ramdisk": "8db38567-4923-4322-b1bf-e12cce5cafc4"<br> },<br> "driver_internal_info": {<br> "clean_steps": null,<br> "agent_erase_devices_iterations": 1,<br> "agent_erase_devices_zeroize": true,<br> "agent_continue_if_secure_erase_failed": false,<br> "agent_continue_if_ata_erase_failed": false,<br> "agent_enable_nvme_secure_erase": true,<br> "agent_enable_ata_secure_erase": true,<br> "disk_erasure_concurrency": 1,<br> "agent_erase_skip_read_only": false,<br> "last_power_state_change": "2021-08-25T05:10:16.671639",<br> "agent_version": "7.0.2.dev10",<br> "agent_last_heartbeat": "2021-08-25T05:09:34.904605",<br> "hardware_manager_version": {<br> "MellanoxDeviceHardwareManager": "1",<br> "generic_hardware_manager": "1.1"<br> },<br> "agent_cached_clean_steps_refreshed": "2021-08-25 04:59:28.312524",<br> "is_whole_disk_image": true,<br> "deploy_steps": null,<br> "agent_cached_deploy_steps_refreshed": "2021-08-25 05:08:58.530633",<br> "root_uuid_or_disk_id": "0x3f3df0d8"<br> },<br> "extra": {},<br> "fault": null,<br> "inspect_interface": "no-inspect",<br> "inspection_finished_at": null,<br> "inspection_started_at": null,<br> "instance_info": {<br> "image_source": "da92cd5d-e1d6-458d-a2b2-86e897a982c6",<br> "root_gb": "470",<br> "swap_mb": "0",<br> "display_name": "server1",<br> "vcpus": "24",<br> "nova_host_id": "controller-ironic",<br> "memory_mb": "62700",<br> "local_gb": "470",<br> "configdrive": "******",<br> "image_disk_format": "raw",<br> "image_checksum": null,<br> "image_os_hash_algo": "sha512",<br> "image_os_hash_value": "3b16d3a6734c23fb43fbd6deee16c907ea8e398bfd5163cd08f16ccd07a74399bb35f16a4713c3847058b445bf4150448f22eb11e75debcc548b8eaacf777e70",<br> "image_url": "******",<br> "image_container_format": "bare",<br> "image_tags": [],<br> "image_properties": {<br> "stores": "file",<br> "os_hidden": false,<br> "virtual_size": 3511681024,<br> "owner_specified.openstack.object": "images/centos-d",<br> "owner_specified.openstack.sha256": "",<br> "owner_specified.openstack.md5": ""<br> },<br> "image_type": "whole-disk-image"<br> },<br> "instance_uuid": "e29c267f-8ddb-4dce-a07c-18c4f7210010",<br> "last_error": null,<br> "lessee": null,<br> "maintenance": false,<br> "maintenance_reason": null,<br> "management_interface": "ipmitool",<br> "name": "baremetal-node",<br> "network_data": {},<br> "network_interface": "flat",<br> "owner": null,<br> "power_interface": "ipmitool",<br> "power_state": "power on",<br> "properties": {<br> "cpus": 30,<br> "memory_mb": 62700,<br> "local_gb": 470,<br> "cpu_arch": "x86_64",<br> "capabilities": "boot_mode:uefi,boot_option:local",<br> "vendor": "hewlett-packard"<br> },<br> "protected": false,<br> "protected_reason": null,<br> "provision_state": "active",<br> "provision_updated_at": "2021-08-25T05:10:37+00:00",<br> "raid_config": {},<br> "raid_interface": "no-raid",<br> "rescue_interface": "no-rescue",<br> "reservation": null,<br> "resource_class": "baremetal-resource-class",<br> "retired": false,<br> "retired_reason": null,<br> "storage_interface": "noop",<br> "target_power_state": null,<br> "target_provision_state": null,<br> "target_raid_config": {},<br> "traits": [],<br> "updated_at": "2021-08-25T05:10:37+00:00",<br> "uuid": "3caaffe3-a6be-4b8c-b3dd-d302c4367670",<br> "vendor_interface": "ipmitool"<br>}<br></div><div><br></div><div><br></div><div>I am not getting why this issue is not being reproduced with the partition disk image.<br></div><div><br></div><div>Regards</div><div>Anirudh Gupta</div><div><br></div><div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Aug 23, 2021 at 7:11 PM Julia Kreger <<a href="mailto:juliaashleykreger@gmail.com">juliaashleykreger@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Greetings Anirudh,<br>
<br>
If you could post your ``openstack baremetal node show <uuid>`` output<br>
for a node which is in this state, where it is configured to boot from<br>
local storage, and is booting to network. Along with that, it would be<br>
helpful to understand if the machine is configured for UEFI or not.<br>
Realistically this is where using IPMI on modern hardware becomes a<br>
problem, because there is no actual standard for the signaling<br>
behavior as it relates to UEFI boot with IPMI. We encourage operators<br>
to use Redfish instead as it is clearly delineated as part of the<br>
standard.<br>
<br>
One last thing. You may want to check and update BMC and system<br>
firmware on your hardware.<br>
<br>
On Mon, Aug 23, 2021 at 12:41 AM Anirudh Gupta <<a href="mailto:anyrude10@gmail.com" target="_blank">anyrude10@gmail.com</a>> wrote:<br>
><br>
> Hi Julia,<br>
><br>
> Thanks for your reply.<br>
><br>
> There is also an update that with Centos 8.4 Partition Disk Image, I am able to successfully provision the baremetal node. With Centos 8.4 ISO and Wholedisk Image the behaviour is the same that it doesn't boot from Hard disk.<br>
><br>
> Please find below my setup details:<br>
><br>
> I am using HP server DL380 Gen9 with BIOS P89 v2.76 (10/21/2019) with IPMI utility<br>
><br>
> Hard disk is the first priority followed by 1GB NIC which I have set to PXE<br>
><br>
> I don't find any logs in /var/log/ironic/deploy_logs. However there is a folder /var/log/kolla/ironic/, but there are no deploy_logs in that folder<br>
><br>
> I have downloaded the kolla source image from docker hub<br>
><br>
> docker pull kolla/centos-source-ironic-conductor:wallaby<br>
><br>
> Similar images have been downloaded by kolla ansible for other ironic components<br>
><br>
> Regards<br>
> Anirudh Gupta<br>
><br>
> On Fri, Aug 20, 2021 at 9:56 PM Julia Kreger <<a href="mailto:juliaashleykreger@gmail.com" target="_blank">juliaashleykreger@gmail.com</a>> wrote:<br>
>><br>
>><br>
>><br>
>> On Fri, Aug 20, 2021 at 7:07 AM Anirudh Gupta <<a href="mailto:anyrude10@gmail.com" target="_blank">anyrude10@gmail.com</a>> wrote:<br>
>>><br>
>>> Hi Mark,<br>
>>><br>
>>> There was some issue with the cleaning image due to which the issue reported in previous conversation was observed.<br>
>>><br>
>>> This was successfully resolved.<br>
>>> By setting the parameter in ironic.conf file<br>
>>> [pxe]<br>
>>> uefi_ipxe_bootfile_name = ipxe-x86_64.efi<br>
>>><br>
>>> The "node provide" command successfully executed and the node came in "available" state.<br>
>>><br>
>>> In Legacy:<br>
>>> When I am trying to create the server using "server create " command and a userimage is passed in the command, the procedure is that the node will install userimage over the network and then will be rebooted<br>
>>> After the reboot, it will boot up with the Hard disk and with the OS specified in userimage.<br>
>>><br>
>>> In UEFI:<br>
>>> When I am trying to create the server using "server create " command and a userimage is passed in the command, the procedure of installing user image and rebooting remains the same.<br>
>>> But After the reboot, despite setting the hard disk as the first priority, it again starts booting over the network and eventually fails.<br>
>>><br>
>> This is very very likely an issue with the vendor's firmware. We've seen some instances where the bmc refuses to honor the request to change *or* where it is honored for a single boot operation only. In part some of this may be due to improved support in handling UEFI boot signaling where the wrong thing could occur, at least with IPMI.<br>
>><br>
>> In order to create a fix or workaround, we need the following information:<br>
>><br>
>> Are you using IPMI or Redfish? If your using IPMI, you should consider using Redfish.<br>
>><br>
>> What is the hardware vendor?<br>
>><br>
>> What is the BMC firmware version?<br>
>><br>
>> Is the BMC set to always network boot by default completely?<br>
>><br>
>> In UEFI, what does the machine report for the efibootmgr output. Your deployment agent logs actually have this output already in the journal. Typically /var/log/ironic/deploy_logs. We've seen some hardware act completely disjointed from the EFI NVRAM, or where it resets the EFI NVRAM when we request a one time override.<br>
>><br>
>> Most importantly, what is the version of ironic and ironic-python-agent?<br>
>><br>
>>><br>
>>> I have also tried passing the capabilities='boot_option:local' both in baremetal node and flavor, but the behaviour is the same.<br>
>>><br>
>>> Regards<br>
>>> Anirudh Gupta<br>
>>><br>
>>><br>
>>><br>
>>><br>
>>> [trim]<br>
</blockquote></div></div>