<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<div class="moz-cite-prefix">Upgrade OVS to version >= 1.11. <br>
<br>
I don't know it will work with neutron or not, but OVS 1.10 (and
1.4, and any version <1.11) is just not production ready. <br>
<br>
Way to reproduce problem:<br>
<br>
hping3 --flood --rand-source ANY_FLOATING_IP.<br>
<br>
It kills any hosts with older OVS up to the level 'connection
timeout'. <br>
<br>
On 11.01.2014 21:12, Alejandro Comisario wrote:<br>
</div>
<blockquote
cite="mid:CAMrG31yx9f4q8vShPGbSVPoMA17ZJYhU6FxGcjyxtFzZjFiMdQ@mail.gmail.com"
type="cite">
<div dir="ltr">
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)">Well, its
been a long time since we use nova with KVM, we got over the
many thousand vms, and still, something doesnt feel right.</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)">We are using
ubuntu 12.04 kernel 3.2.0-[40-48], tuned sysctl with lots of
parameters, and everything ... works, you can say, quite well.</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)"><br>
</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)">
But here's the deal, we have an special networking scenario
that is, EVERYTHING IS APIS, everything is throughput, no
bandwidth.</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)">
Every 2x1Gb bonded compute node, doesnt get over the [200Mb/s
- 400Mb/s] but its handling hundreds of thousands requests per
minute to the vms.</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)">
<br>
</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)">And once in a
while, gives you the sensation that everything goes to hell,
timeouts from aplications over there, response times from apis
going from 10ms to 200ms over there, 20ms delays happening
between the vm ETH0 and the VNET interface, etc.</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)">So, since its
a massive scenario to tune, we never kinda, nailedon WHERE TO
give this 1, 2 or 3 final buffer/ring/affinity tune to make
everything work from the compute side.</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)"><br>
</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)">
I know its a little awkward, but im craving, and jaunting for
community real life examples regarding "HIGH THROUGHPUT"
tuning with KVM scenarios, dark linux or if someone can help
me go through configurations that might sound weird /
unnecesary / incorrect.</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)"><br>
</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)">
For those who are wondering, well ... i dont know what you
have, lets start with this.</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)"><br>
</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)">
COMPUTE NODES (99% of them, different vendors, but ...)</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)">* 128/256 GB
of ram</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)">
* 2 hexacores with HT enabled</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)">* 2x1Gb
bonded interfaces (want to know the more than 20 models we are
using, just ask for it)</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)">* Multi queue
interfaces, pined via irq to different cores</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)">
* ubuntu 12.04 kernel 3.2.0-[40-48]</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)">* Linux
bridges, no VLAN, no open-vswitch</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)">
<br>
</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)">I want to try
to keep the networking appliances ( TOR's, AGGR, CORES ) as
out of the picture as possible.</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)">im thinking
"i hope this thread gets great, in time"</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)">
<br>
</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)">So, ready to
learn as much as i can.</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)">
Thank you openstack community, as allways.</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)"><br>
</div>
<div class="gmail_default" style="font-family:'courier
new',monospace;font-size:small;color:rgb(0,0,0)">
alejandrito</div>
<div><br>
</div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
OpenStack-operators mailing list
<a class="moz-txt-link-abbreviated" href="mailto:OpenStack-operators@lists.openstack.org">OpenStack-operators@lists.openstack.org</a>
<a class="moz-txt-link-freetext" href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a>
</pre>
</blockquote>
<br>
</body>
</html>