<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Exchange Server">
<!-- converted from rtf -->
<style><!-- .EmailQuote { margin-left: 1pt; padding-left: 4pt; border-left: #800000 2px solid; } --></style>
</head>
<body>
<font face="Calibri" size="2"><span style="font-size:11pt;">
<div>Hi Clark,</div>
<div> </div>
<div>Thank you for your response.</div>
<a name="_MailEndCompose"></a>
<div>I think the infiniband MAC address should be mac[36:-14] + mac[51:] as suggested here[1]. I have specified the right MAC address as per this but it still fails. Please see the following output:</div>
<div> </div>
<div><b>i</b><b>b0 in</b><b>t</b><b>erface details:</b></div>
<div>4: ib0: <BROADCAST,MULTICAST> mtu 4092 qdisc noop state DOWN group default qlen 256</div>
<div> link/infiniband 80:00:00:02:fe:80:00:00:00:00:00:00:00:11:75:01:01:67:0f:b9 brd 00:ff:ff:ff:ff:12:40:1b:80:00:00:00:00:00:00:00:ff:ff:ff:ff</div>
<div> </div>
<div><b>Ironic port details:</b></div>
<div>+-----------------------+----------------------------------------------------------------+</div>
<div>| Field | Value |</div>
<div>+-----------------------+----------------------------------------------------------------+</div>
<div>| address | <span style="background-color:yellow;">00:11:75:67:0f:b9</span> |</div>
<div>| created_at | 2020-01-16T08:24:15+00:00 |</div>
<div>| extra | {'client-id': '0xfe800000000000000011750101670fb9'} |</div>
<div>| internal_info | {'tenant_vif_port_id': 'c71b2b31-4231-423c-b512-962623220ddf'} |</div>
<div>| is_smartnic | False |</div>
<div>| local_link_connection | {} |</div>
<div>| node_uuid | 05cce921-931f-4755-ad87-fc41d79a8988 |</div>
<div>| physical_network | None |</div>
<div>| portgroup_uuid | None |</div>
<div>| pxe_enabled | False |</div>
<div>| updated_at | 2020-01-16T08:59:47+00:00 |</div>
<div>| uuid | 9921139a-63cc-4456-8e85-f7673c5c2b3b |</div>
<div>+-----------------------+----------------------------------------------------------------+</div>
<div> </div>
<div>[1] <a href="https://github.com/canonical/cloud-init/blob/9bfb2ba7268e2c3c932023fc3d3020cdc6d6cc18/cloudinit/net/__init__.py"><font color="#0563C1"><u>https://github.com/canonical/cloud-init/blob/9bfb2ba7268e2c3c932023fc3d3020cdc6d6cc18/cloudinit/net/__init__.py#L795</u></font></a></div>
<div> </div>
<a name="_____replyseparator"></a>
<div>>>-----Original Message-----</div>
<div>>>From: Clark Boylan <cboylan@sapwetik.org></div>
<div>>>Sent: Saturday, January 18, 2020 3:41 AM</div>
<div>>>To: openstack-discuss@lists.openstack.org</div>
<div>>>Subject: Re: [ironic][nova][neutron][cloud-init] Infiniband Support in</div>
<div>>>OpenStack</div>
<div>>></div>
<div>>>On Fri, Jan 17, 2020, at 7:31 AM, Kumari, Madhuri wrote:</div>
<div>>>></div>
<div>>>> Hi,</div>
<div>>>></div>
<div>>>></div>
<div>>>> I am trying to deploy a node with infiniband in Ironic without any success.</div>
<div>>>></div>
<div>>>></div>
<div>>>> The node has two interfaces, eth0 and ib0. The deployment is</div>
<div>>>> successful, node becomes active but is not reachable. I debugged and</div>
<div>>>> checked that the issue is with cloud-init. The cloud-init fails to</div>
<div>>>> configure the network interfaces on the node complaining that the MAC</div>
<div>>>> address of infiniband port(ib0) is not known to the node. Ironic</div>
<div>>>> provides a fake MAC address for infiniband ports and cloud-init is</div>
<div>>>> supposed to generate the actual MAC address of infiband ports[1]. But</div>
<div>>>> it fails[2] before reaching there.</div>
<div>>></div>
<div>>>Reading the cloud-init code [4][5] it appears that the ethernet format MAC</div>
<div>>>should match bytes 13-15 + 18-20 of the infiniband address. Is the problem</div>
<div>>>here that the fake MAC supplied is unrelated to the actual infiniband</div>
<div>>>address? If so I think you'll either need cloud-init to ignore unknown</div>
<div>>>interfaces (as proposed in the cloud-init bug), or have Ironic supply the mac</div>
<div>>>address as bytes 13-15 + 18-20 of the actual infiniband address.</div>
<div>>></div>
<div>>>></div>
<div>>>> I have posted the issue in cloud-init[3] as well.</div>
<div>>>></div>
<div>>>></div>
<div>>>> Can someone please help me with this issue? How do we specify</div>
<div>>>> “TYPE=InfiniBand” from OpenStack? Currently the type sent is “phy” only.</div>
<div>>>></div>
<div>>>></div>
<div>>>> [1]</div>
<div>>>> <a href="https://github.com/canonical/cloud-init/blob/master/cloudinit/sources/">https://github.com/canonical/cloud-init/blob/master/cloudinit/sources/</a></div>
<div>>>> helpers/openstack.py#L686</div>
<div>>>></div>
<div>>>> [2]</div>
<div>>>> <a href="https://github.com/canonical/cloud-init/blob/master/cloudinit/sources/">https://github.com/canonical/cloud-init/blob/master/cloudinit/sources/</a></div>
<div>>>> helpers/openstack.py#L677</div>
<div>>>></div>
<div>>>> [3] <a href="https://bugs.launchpad.net/cloud-init/+bug/1857031">https://bugs.launchpad.net/cloud-init/+bug/1857031</a></div>
<div>>></div>
<div>>>[4] <a href="https://github.com/canonical/cloud-init/blob/9bfb2ba7268e2c3c932023fc3d3020cdc6d6cc18/cloudinit/net/__init__.py#L793-L795">https://github.com/canonical/cloud-</a></div>
<div>>>init/blob/9bfb2ba7268e2c3c932023fc3d3020cdc6d6cc18/cloudinit/net/__init</div>
<div>>>__.py#L793-L795</div>
<div>>>[5] <a href="https://github.com/canonical/cloud-init/blob/9bfb2ba7268e2c3c932023fc3d3020cdc6d6cc18/cloudinit/net/__init__.py#L844-L846">https://github.com/canonical/cloud-</a></div>
<div>>>init/blob/9bfb2ba7268e2c3c932023fc3d3020cdc6d6cc18/cloudinit/net/__init</div>
<div>>>__.py#L844-L846</div>
<div> </div>
<div> </div>
</span></font>
</body>
</html>