<div dir="ltr">+1<div><br></div><div>It's totally different between ovs and userspace ovs.</div><div>also, there is strong need to keep ovs even we have a userspace ovs in the same host<br><div class="gmail_extra"><br>
<br><div class="gmail_quote">On Fri, Jul 11, 2014 at 7:59 AM, Ian Wells <span dir="ltr"><<a href="mailto:ijw.ubuntu@cack.org.uk" target="_blank">ijw.ubuntu@cack.org.uk</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div class="">On 10 July 2014 08:19, Czesnowicz, Przemyslaw <span dir="ltr"><<a href="mailto:przemyslaw.czesnowicz@intel.com" target="_blank">przemyslaw.czesnowicz@intel.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div link="blue" vlink="purple" lang="EN-IE">
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Hi,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Thanks for Your answers.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Yep using binding:vif_details makes more sense. We would like to reuse VIF_TYPE_OVS and modify the nova to use the userspace vhost when ‘use_dpdk’ flag is present.</span></p>
</div></div></blockquote><div><br></div></div><div>I admit it's a bit of a pedantic point, but connecting to OVS and connecting to userspace OVS would seem to be drastically different (neither type will work with the wrong switch) so using a different binding type would seem to be rather more appropriate than if(this flag is set) { do something completely different; }.<br>
<br></div><div class=""><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div link="blue" vlink="purple" lang="EN-IE"><div><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">What we are missing is how to inform the ml2 plugin/mechanism drivers when to put that ‘use_dpdk’ flag into vif_details.</span></p>
</div></div></blockquote><div><br></div></div><div>You might want to refer to the mail I sent yesterday evening about getting Nova to tell Neutron what binding types it supports. I'm not sure it's the answer to your problem but it might well simplify it.<br>
<br></div><div><div class="h5"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div link="blue" vlink="purple" lang="EN-IE"><div><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">On the node ovs_neutron_agent could look up datapath_type in ovsdb, but how can we provide that info to the plugin?
<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Currently there is no mechanism to get node specific info into the ml2 plugin (or at least we don’t see any).<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Any ideas on how this could be implemented?<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Regards<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Przemek<u></u><u></u></span></p>
<div>
<div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"" lang="EN-US">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"" lang="EN-US"> Irena Berezovsky [<a href="mailto:irenab@mellanox.com" target="_blank">mailto:irenab@mellanox.com</a>]
<br>
<b>Sent:</b> Thursday, July 10, 2014 8:08 AM<br>
<b>To:</b> OpenStack Development Mailing List (not for usage questions); Czesnowicz, Przemyslaw<br>
<b>Cc:</b> Mooney, Sean K<br>
<b>Subject:</b> RE: [openstack-dev] [Neutron][ML2] Support dpdk ovs with ml2 plugin<u></u><u></u></span></p>
</div>
</div><div><div>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">Hi,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">For passing information from neutron to nova VIF Driver, you should use binding:vif_details dictionary. You may not require new VIF_TYPE, but
can leverage the existing VIF_TYPE_OVS, and add ‘use_dpdk’ in vif_details dictionary. This will require some rework of the existing libvirt vif_driver VIF_TYPE_OVS.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">Binding:profile is considered as input dictionary that is used to pass information required for port binding on Server side. You may use binding:profile
to pass in a dpdk ovs request, so it will be taken into port binding consideration by ML2 plugin.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">I am not sure regarding new vnic_type, since it will require port owner to pass in the requested type. Is it your intention? Should the port owner
be aware of dpdk ovs usage? <u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">There is also VM scheduling consideration that if certain vnic_type is requested, VM should be scheduled on the node that can satisfy the request.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">Regards,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US">Irena<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d" lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"" lang="EN-US">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"" lang="EN-US"> loy wolfe [</span><a href="mailto:loywolfe@gmail.com" target="_blank"><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"" lang="EN-US">mailto:loywolfe@gmail.com</span></a><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"" lang="EN-US">]
<br>
<b>Sent:</b> Thursday, July 10, 2014 6:00 AM<br>
<b>To:</b> OpenStack Development Mailing List (not for usage questions)<br>
<b>Cc:</b> Mooney, Sean K<br>
<b>Subject:</b> Re: [openstack-dev] [Neutron][ML2] Support dpdk ovs with ml2 plugin<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US">i think both a new vnic_type and a new vif_type should be added. now vnic has three types: normal, direct, macvtap, then we need a new type of "uservhost". <u></u><u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">as for vif_type, now we have </span><span style="font-size:9.5pt;font-family:"Arial","sans-serif"" lang="EN-US">VIF_TYPE_OVS, VIF_TYPE_QBH/QBG, VIF_HW_VEB, so we need a new VIF_TYPE_USEROVS</span><span lang="EN-US"><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt;font-family:"Arial","sans-serif"" lang="EN-US">I don't think it's a good idea to directly reuse ovs agent, for we have to consider use cases that ovs and userovs co-exists. Now it's a little painful to fork
and write a new agent, but it will be easier when ML2 agent BP is merged in the future. (</span><a href="https://etherpad.openstack.org/p/modular-l2-agent-outline" target="_blank"><span style="font-family:"Arial","sans-serif"" lang="EN-US">https://etherpad.openstack.org/p/modular-l2-agent-outline</span></a><span style="font-size:9.5pt;font-family:"Arial","sans-serif"" lang="EN-US">)</span><span lang="EN-US"><u></u><u></u></span></p>
</div>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span lang="EN-US"><u></u> <u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US">On Wed, Jul 9, 2014 at 11:08 PM, Czesnowicz, Przemyslaw <</span><a href="mailto:przemyslaw.czesnowicz@intel.com" target="_blank"><span lang="EN-US">przemyslaw.czesnowicz@intel.com</span></a><span lang="EN-US">> wrote:<u></u><u></u></span></p>
<div>
<div>
<p class="MsoNormal">Hi<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">We (Intel Openstack team) would like to add support for dpdk based userspace openvswitch using mech_openvswitch and mech_odl from ML2 plugin.<u></u><u></u></p>
<p class="MsoNormal">The dpdk enabled ovs comes in two flavours one is netdev incorporated into vanilla ovs the other is a fork of ovs with a dpdk datapath (<a href="https://github.com/01org/dpdk-ovs" target="_blank">https://github.com/01org/dpdk-ovs</a>
).<u></u><u></u></p>
<p class="MsoNormal">Both flavours use userspace vhost mechanism to connect the VMs to the switch.<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">Our initial approach was to extend ovs vif bindings in nova and add a config parameter to specify when userspace vhost should be used.<u></u><u></u></p>
<p class="MsoNormal"><span lang="PL">Spec :
</span><a href="https://review.openstack.org/95805" target="_blank"><span lang="PL">https://review.openstack.org/95805</span></a><span lang="PL"><u></u><u></u></span></p>
<p class="MsoNormal"><span lang="PL">Code:
</span><a href="https://review.openstack.org/100256" target="_blank"><span lang="PL">https://review.openstack.org/100256</span></a><span lang="PL"><u></u><u></u></span></p>
<p class="MsoNormal"><span lang="PL"> <u></u><u></u></span></p>
<p class="MsoNormal">Nova devs rejected this approach saying that Neutron should pass all necessary information to nova to select vif bindings.<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">Currently we are looking for a way to pass information from Neutron to Nova that dpdk enabled ovs is being used while still being able to use mech_openvswitch and ovs_neutron_agent
or mech_odl.<u></u><u></u></p>
<p class="MsoNormal">
<u></u><u></u></p>
<p class="MsoNormal">We thought of two possible solutions:<u></u><u></u></p>
<p>1.<span style="font-size:7.0pt"> </span>Use binding_profile to provide node specific info to nova.
<u></u><u></u></p>
<p>Agent rpc api would be extended to allow agents to send node profile to neutron plugin.<u></u><u></u></p>
<p>That info would be stored in db and passed to nova when binding on this specific host is requested.<u></u><u></u></p>
<p>This could be used to support our use case or pass other info to nova (i.e name of integration bridge)<u></u><u></u></p>
<p> <u></u><u></u></p>
<p>2.<span style="font-size:7.0pt"> </span>Let mech_openvswitch and mech_odl detect what binding type to use.<u></u><u></u></p>
<p>When asked for port binding mech_openvswitch and mech_odl would call the agent or odl to check what bindings to use (VIF_TYPE_OVS or VIF_TYPE_DPDKVHOST)<u></u><u></u></p>
<p> <u></u><u></u></p>
<p class="MsoNormal">So, what would be the best way to support our usecase, is it one of the above ?
<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">Best regards<u></u><u></u></p>
<p class="MsoNormal">Przemek<u></u><u></u></p>
</div>
<p>--------------------------------------------------------------<br>
Intel Shannon Limited<br>
Registered in Ireland<br>
Registered Office: Collinstown Industrial Park, Leixlip, County Kildare<br>
Registered Number: 308263<br>
Business address: Dromore House, East Park, Shannon, Co. Clare<u></u><u></u></p>
<p>This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all
copies.<u></u><u></u></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span lang="EN-US"><br>
_______________________________________________<br>
OpenStack-dev mailing list<br>
</span><a href="mailto:OpenStack-dev@lists.openstack.org" target="_blank"><span lang="EN-US">OpenStack-dev@lists.openstack.org</span></a><span lang="EN-US"><br>
</span><a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank"><span lang="EN-US">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</span></a><span lang="EN-US"><u></u><u></u></span></p>
</div>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
</div>
</div></div></div><div><div>
<p>--------------------------------------------------------------<br>
Intel Shannon Limited<br>
Registered in Ireland<br>
Registered Office: Collinstown Industrial Park, Leixlip, County Kildare<br>
Registered Number: 308263<br>
Business address: Dromore House, East Park, Shannon, Co. Clare</p>
<p>This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies.</p>
<p></p></div></div></div>
<br>_______________________________________________<br>
OpenStack-dev mailing list<br>
<a href="mailto:OpenStack-dev@lists.openstack.org" target="_blank">OpenStack-dev@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
<br></blockquote></div></div></div><br></div></div>
<br>_______________________________________________<br>
OpenStack-dev mailing list<br>
<a href="mailto:OpenStack-dev@lists.openstack.org">OpenStack-dev@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
<br></blockquote></div><br></div></div></div>