<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:SimSun;
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:"MS Gothic";
panose-1:2 11 6 9 7 2 5 8 2 4;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"\@MS Gothic";
panose-1:2 11 6 9 7 2 5 8 2 4;}
@font-face
{font-family:"\@SimSun";
panose-1:2 1 6 0 3 1 1 1 1 1;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:#1F497D;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">The SR-IOV agent support only Ethernet.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">For InfiniBand should mlnx_ib mechanism driver. <o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Lenny Verkhovsky [mailto:lennyb@mellanox.com]
<br>
<b>Sent:</b> Wednesday, November 30, 2016 9:27 AM<br>
<b>To:</b> OpenStack Development Mailing List (not for usage questions) <openstack-dev@lists.openstack.org><br>
<b>Subject:</b> Re: [openstack-dev] [neutron][sriov]mellanox infiniband sr-iov with openstack neutron sriov agent error<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Yang,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Please try following WikiPage[1].<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">[1]
<a href="https://wiki.openstack.org/wiki/Mellanox-Neutron-Liberty-Redhat-InfiniBand">
https://wiki.openstack.org/wiki/Mellanox-Neutron-Liberty-Redhat-InfiniBand</a><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">
</span><span style="font-size:11.0pt;font-family:"MS Gothic"">李阳</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> [<a href="mailto:yang.li@easystack.cn">mailto:yang.li@easystack.cn</a>]
<br>
<b>Sent:</b> Wednesday, November 30, 2016 6:55 AM<br>
<b>To:</b> <a href="mailto:openstack-dev@lists.openstack.org">openstack-dev@lists.openstack.org</a><br>
<b>Subject:</b> [openstack-dev] [neutron][sriov]mellanox infiniband sr-iov with openstack neutron sriov agent error<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:14.0pt;color:#1F4E79">Hi all</span><span style="font-size:14.0pt;font-family:SimSun;color:#1F4E79">；</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:14.0pt;color:#1F4E79">I got an issue for sriov-nic-agent .</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:14.0pt;font-family:SimSun;color:#1F4E79">environment ：</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-indent:28.0pt">
<span style="font-size:14.0pt;color:#1F4E79">OpenStack</span><span style="font-size:14.0pt;font-family:SimSun;color:#1F4E79">：</span><span style="font-size:14.0pt;color:#1F4E79">liberty</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-indent:28.0pt">
<span style="font-size:14.0pt;font-family:SimSun;color:#1F4E79">OS：</span><span style="font-size:14.0pt;color:#1F4E79">CentOS 7.2</span><span style="font-size:14.0pt;font-family:SimSun;color:#1F4E79">，</span><span style="font-size:14.0pt;color:#1F4E79">3.10.0-327.20.1.es2.el7.x86_64</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-indent:28.0pt">
<span style="font-size:14.0pt;color:#1F4E79">Mellanox type</span><span style="font-size:14.0pt;font-family:SimSun;color:#1F4E79">：</span><span style="font-size:14.0pt;color:#1F4E79">Mellanox MT27500 Family [ConnectX-3]</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-indent:28.0pt">
<span style="font-size:14.0pt;color:#1F4E79">Mellanox driver</span><span style="font-size:14.0pt;font-family:SimSun;color:#1F4E79">：</span><span style="font-size:14.0pt;color:#1F4E79">OFED_LINUX-3.4-1.0.0.0-rhel7.2-x86_64</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:14.0pt;font-family:SimSun;color:#1F4E79">what I need：</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:14.0pt;color:#1F4E79"> With sriov configuration on mellanox ib with <b>infiniband mode</b></span><span style="font-size:14.0pt;font-family:SimSun;color:#1F4E79">，use </span><span style="font-size:14.0pt;color:#1F4E79">neutron
sriov agent to attache vf port to VMs</span><span style="font-size:14.0pt;font-family:SimSun;color:#1F4E79">。</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:14.0pt;font-family:SimSun;color:#1F4E79">issue ：</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:14.0pt;color:#1F4E79"> the Mellanox ib SR-IOV has been configured</span><span style="font-size:14.0pt;font-family:SimSun;color:#1F4E79">：</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:14.0pt;color:#1F4E79">
</span><img border="0" width="949" height="159" id="图片_x0020_1" src="cid:image001.png@01D24AEC.E9368F90"><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:14.0pt;color:#1F4E79"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:14.0pt;color:#1F4E79"> </span><span style="font-size:14.0pt;font-family:SimSun;color:#1F4E79">and </span><span style="font-size:14.0pt;color:#1F4E79">neutron
sriov nic agent is also running </span><span style="font-size:14.0pt;font-family:SimSun;color:#1F4E79">，bug the </span><span style="font-size:14.0pt;color:#1F4E79">log showed like this</span><span style="font-size:14.0pt;font-family:SimSun;color:#1F4E79">：</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:14.0pt;color:#1F4E79">
</span><img border="0" width="1319" height="232" id="图片_x0020_3" src="cid:image002.png@01D24AEC.E9368F90"><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:14.0pt;color:#1F4E79"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:14.0pt;font-family:SimSun;color:#1F4E79">after reading the code of </span><span style="font-size:14.0pt;color:#1F4E79">sriov nic agent</span><span style="font-size:14.0pt;font-family:SimSun;color:#1F4E79">,
the </span><span style="font-size:14.0pt;color:#1F4E79">agent use ip link show ib0 to get vfs, but in <b>infiniband mode</b>, it doesn't work</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:14.0pt;color:#1F4E79">
</span><img border="0" width="1145" height="59" id="图片_x0020_4" src="cid:image003.png@01D24AEC.E9368F90"><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:14.0pt;color:#1F4E79"> when the mode is Ethernet, it worked well:</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:14.0pt;color:#1F4E79">
</span><img border="0" width="796" height="522" id="图片_x0020_5" src="cid:image004.png@01D24AEC.E9368F90"><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:14.0pt;color:#1F4E79">It seems the sriov nic agent doesn't support infiniband mode.</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:14.0pt;color:#1F4E79">But according to openstack wiki, the infiniband should be supported.</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><a href="https://wiki.openstack.org/wiki/Mellanox-OpenStack"><span style="font-size:14.0pt">https://wiki.openstack.org/wiki/Mellanox-OpenStack</span></a><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><a href="https://wiki.openstack.org/wiki/SR-IOV-Passthrough-For-Networking"><span style="font-size:14.0pt">https://wiki.openstack.org/wiki/SR-IOV-Passthrough-For-Networking</span></a><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><o:p> </o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:14.0pt;color:#1F4E79">so I don't what's wrong with my environment, can someone answer me ?</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><o:p> </o:p></p>
</div>
</div>
</div>
</body>
</html>