<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:#1F497D;}
span.EmailStyle18
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal" style="margin-bottom:12.0pt">Hi<o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt">qemu version was 2.0.0 does not support mapping hugepage as shared.<br>
as a result the dpdk implementation of vhost-user cannot function with this version.<br>
Similarly libvirt 1.2.2 has no knowledge of vhost-user.<o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt">If you are on fedora 21 then the virt-preview repo packages the required Libvirt and qemu.<o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt">On Ubuntu the kilo cloud archive also packages version that meet the minimum versions.<o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt">Looking at the log I would agree that this error is probably related to manually installing Libvirt and
<br>
not adding the appropriate libvirtd configuration options.<o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt">Devstack does not have native support for installing a vhost-user compatible Libvirt or qemu.<br>
when using our networking-ovs-dpdk plugin we ask you to enable the virt-prevew or cloud archive<br>
Before stacking so that when devestack install Libvirt/qemu it get compatible versions.
<br>
for centos as we have been unable to find an equivalent we explicitly install Libvirt/qemu.<o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt">In general we don’t provide support for installing the required version Libvirt/qemu in<br>
the networking-ovs-dpdk devstack plugin.<o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt">What os are you currently using? ubuntu?
<br>
in your case enabling the kilo cloud archive, uinstalling Libvirt/qemu and then restacking<br>
should provide the appropriate packages.<o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt">In liberty we use that standard neutron openvswich agent binary and set the agent type to DPDK OVS Agent to enable<br>
the ovsdpdk ml2 driver to manage the node. In mitaka the standard ovs neutron agent and standard openvswitch ml2 drivers will be used instead.<o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt"><o:p> </o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt">To confirm if ovs-dpdk is running you can use the following command<o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt;text-indent:36.0pt">sudo service ovs-dpdk status<o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt">this will check if ovs-dpdk is running by reading the pid files and checking if the ovsdb and ovs-vswitchd
<br>
process are running and tail the last 20ish lines of the vswitchd log file.<o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt">note this is not a systemd service so the systemd equivalent command will not work.<o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt"><o:p> </o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt">Alternative you can user ps and grep<o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt;text-indent:36.0pt">ps aux | grep ovs<o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt"><o:p> </o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt">regards<o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt">sean.<o:p></o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Prathyusha Guduri [mailto:prathyushaconnects@gmail.com]
<br>
<b>Sent:</b> Monday, November 23, 2015 9:16 AM<br>
<b>To:</b> OpenStack Development Mailing List (not for usage questions)<br>
<b>Subject:</b> Re: [openstack-dev] [networking-ovs-dpdk]<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Hi Sean,<o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Thanks for your help before. It would be great if you look into another issue too.
<o:p></o:p></p>
</div>
<p class="MsoNormal">Am able to run stack.sh successfully and all services are up. But,
<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">libvirt version was 1.2.2 and qemu version was 2.0.0<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">To satisfy the minimum requirement of qemu- version >=2.1 and libvirt-version >= 1.2.10
<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">I manually installed qemu and libvirt from respective sources.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Now<br>
$ kvm --version<br>
/usr/bin/kvm: line 42: /tmp/qemu.orig: Permission denied<br>
QEMU emulator version 2.1.3, Copyright (c) 2003-2008 Fabrice Bellard<br>
<br>
$ virsh --version<br>
1.2.10<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">So basic requirement is satisfied.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Before creating an instance ran the below command,<br>
$ nova flavor-key m1.tiny set "hw:mem_page_size=large"<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Now created an instance <br>
$ nova boot --flavor m1.tiny --image cirros-0.3.4-x86_64-uec --nic net-id=445e2dc5-221b-48ea-aea4-d04dee12fc7f --security-group default demo-instance1<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">It gives the ERROR :<br>
<br>
2015-11-23 13:19:59.654 ERROR nova.virt.libvirt.host [req-2d9d060d-1934-4e9e-af1c-010e177bea11 None None]
<span style="color:red">Connection to libvirt failed:</span> error from service: CheckAuthorization: Did not receive a reply. Possible causes include: the remote application did not send a reply, the message bus security policy blocked the reply, the reply
timeout expired, or the network connection was broken.<br>
2015-11-23 13:19:59.654 TRACE nova.virt.libvirt.host Traceback (most recent call last):<br>
2015-11-23 13:19:59.654 TRACE nova.virt.libvirt.host File "/opt/stack/nova/nova/virt/libvirt/host.py", line 527, in get_connection<br>
2015-11-23 13:19:59.654 TRACE nova.virt.libvirt.host conn = self._get_connection()<br>
2015-11-23 13:19:59.654 TRACE nova.virt.libvirt.host File "/opt/stack/nova/nova/virt/libvirt/host.py", line 514, in _get_connection<br>
2015-11-23 13:19:59.654 TRACE nova.virt.libvirt.host wrapped_conn = self._get_new_connection()<br>
2015-11-23 13:19:59.654 TRACE nova.virt.libvirt.host File "/opt/stack/nova/nova/virt/libvirt/host.py", line 466, in _get_new_connection<br>
2015-11-23 13:19:59.654 TRACE nova.virt.libvirt.host wrapped_conn = self._connect(self._uri, self._read_only)<br>
2015-11-23 13:19:59.654 TRACE nova.virt.libvirt.host File "/opt/stack/nova/nova/virt/libvirt/host.py", line 320, in _connect<br>
2015-11-23 13:19:59.654 TRACE nova.virt.libvirt.host libvirt.openAuth, uri, auth, flags)<br>
2015-11-23 13:19:59.654 TRACE nova.virt.libvirt.host File "/usr/local/lib/python2.7/dist-packages/eventlet/tpool.py", line 141, in proxy_call<br>
2015-11-23 13:19:59.654 TRACE nova.virt.libvirt.host rv = execute(f, *args, **kwargs)<br>
2015-11-23 13:19:59.654 TRACE nova.virt.libvirt.host File "/usr/local/lib/python2.7/dist-packages/eventlet/tpool.py", line 122, in execute<br>
2015-11-23 13:19:59.654 TRACE nova.virt.libvirt.host six.reraise(c, e, tb)<br>
2015-11-23 13:19:59.654 TRACE nova.virt.libvirt.host File "/usr/local/lib/python2.7/dist-packages/eventlet/tpool.py", line 80, in tworker<br>
2015-11-23 13:19:59.654 TRACE nova.virt.libvirt.host rv = meth(*args, **kwargs)<br>
2015-11-23 13:19:59.654 TRACE nova.virt.libvirt.host File "/usr/local/lib/python2.7/dist-packages/libvirt.py", line 105, in openAuth<br>
2015-11-23 13:19:59.654 TRACE nova.virt.libvirt.host if ret is None:raise libvirtError('virConnectOpenAuth() failed')<br>
2015-11-23 13:19:59.654 TRACE nova.virt.libvirt.host libvirtError: error from service: CheckAuthorization: Did not receive a reply. Possible causes include: the remote application did not send a reply, the message bus security policy blocked the reply, the
reply timeout expired, or the network connection was broken.<br>
2015-11-23 13:19:59.654 TRACE nova.virt.libvirt.host <br>
Traceback (most recent call last):<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">I suspect this is because, I manually installed libvirt and qemu. My doubt is why devstack is not installing a correct version when it is supposed to. why a version less than min requirement is being installed???
<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Now that because am installing manually, there might be a problem with groups - devstack creates some group and installs but manual installation doesn't bother about that groups.
<br>
Can you please suggest a way on how do avoid that???<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Also, I just want to make sure that the agent running is neutron-openvswitch only. No ovsdpdk agent running.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">$ ps -Al | grep neutron<br>
0 S 1000 8882 8859 3 80 0 - 49946 ep_pol pts/34 00:02:24 neutron-openvsw<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">But <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">$ neutron agent-list<br>
3385a430-5738-43cb-b853-059add5ab602 | DPDK OVS Agent | ubuntu-Precision-Tower-5810 | :-) | True | neutron-openvswitch-agent<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">So this implies that dpdk agent is running right??? I remember reading in launchpad bugs that ovsdpdk agent is removed and that now openvswitch takes care of everything. Just wanted to confirm that my setup
has ovs-dpdk running.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Regards,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Prathyusha<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On Wed, Nov 18, 2015 at 7:23 PM, James Page <<a href="mailto:james.page@ubuntu.com" target="_blank">james.page@ubuntu.com</a>> wrote:<o:p></o:p></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<div>
<p class="MsoNormal">Hi Sean<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On Wed, Nov 18, 2015 at 12:30 PM, Mooney, Sean K <<a href="mailto:sean.k.mooney@intel.com" target="_blank">sean.k.mooney@intel.com</a>> wrote:<o:p></o:p></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Hi james</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Yes we are planning on testing the packaged release to see if it is compatible with our ml2 driver
and the </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Changes we are submitting upstream. If it is we will add a use binary flag to our devstack plugin to
skip the </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Compilation step and use that instead on 15.10 or 14.04 cloud-archive:liberty </span><o:p></o:p></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Excellent.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span><o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">As part of your packaging did ye fix pciutils to correctly report the unused drivers when an interface
is bound</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">The dpdk driver? Also does it support both igb_uio and/or vfio-pci drivers for dpdk interface?</span><o:p></o:p></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Re pcituils, we've not done any work in that area - can you give an example of what you would expect?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">The dpdk package supports both driver types in /etc/dpdk/interfaces - when you declare an adapter for use, you get to specify the module you want to use as well; we're relying the in-tree kernel drivers (uio-pci-generic and vfio-pci) right
now.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Anyway yes I hope to check it out and seeing what ye have done. When ovs-dpdk starts getting packaged
in more operating systems</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">We will probably swap our default to the binary install though we will keep the source install option
as it allows us to work on new features</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Before they are packaged and to have better performance.</span><o:p></o:p></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">That sounds sensible; re 'better performance' - yeah we do have to baseline the optimizations at compile time right now (ssse3 only right now) , but I really hope that does change so that we can move to a runtime CPU feature detection model,
allowing the best possible performance through the packages we have in Ubuntu (or any other distribution for that matter).<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
__________________________________________________________________________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" target="_blank">
OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><o:p></o:p></p>
</blockquote>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</body>
</html>