<html>
  <head>
    <meta content="text/html; charset=ISO-8859-1"
      http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    <div class="moz-cite-prefix">Upgrade OVS to version >= 1.11. <br>
      <br>
      I don't know it will work with neutron or not, but OVS 1.10 (and
      1.4, and any version <1.11) is just not production ready. <br>
      <br>
      Way to reproduce problem:<br>
      <br>
      hping3 --flood --rand-source ANY_FLOATING_IP.<br>
      <br>
      It kills any hosts with older OVS up to the level 'connection
      timeout'. <br>
      <br>
      On 11.01.2014 21:12, Alejandro Comisario wrote:<br>
    </div>
    <blockquote
cite="mid:CAMrG31yx9f4q8vShPGbSVPoMA17ZJYhU6FxGcjyxtFzZjFiMdQ@mail.gmail.com"
      type="cite">
      <div dir="ltr">
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)">Well, its
          been a long time since we use nova with KVM, we got over the
          many thousand vms, and still, something doesnt feel right.</div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)">We are using
          ubuntu 12.04 kernel 3.2.0-[40-48], tuned sysctl with lots of
          parameters, and everything ... works, you can say, quite well.</div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)"><br>
        </div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)">
          But here's the deal, we have an special networking scenario
          that is, EVERYTHING IS APIS, everything is throughput, no
          bandwidth.</div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)">
          Every 2x1Gb bonded compute node, doesnt get over the [200Mb/s
          - 400Mb/s] but its handling hundreds of thousands requests per
          minute to the vms.</div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)">
          <br>
        </div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)">And once in a
          while, gives you the sensation that everything goes to hell,
          timeouts from aplications over there, response times from apis
          going from 10ms to 200ms over there, 20ms delays happening
          between the vm ETH0 and the VNET interface, etc.</div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)">So, since its
          a massive scenario to tune, we never kinda, nailedon WHERE TO
          give this 1, 2 or 3 final buffer/ring/affinity tune to make
          everything work from the compute side.</div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)"><br>
        </div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)">
          I know its a little awkward, but im craving, and jaunting for
          community real life examples regarding "HIGH THROUGHPUT"
          tuning with KVM scenarios, dark linux or if someone can help
          me go through configurations that might sound weird /
          unnecesary / incorrect.</div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)"><br>
        </div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)">
          For those who are wondering, well ... i dont know what you
          have, lets start with this.</div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)"><br>
        </div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)">
          COMPUTE NODES (99% of them, different vendors, but ...)</div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)">* 128/256 GB
          of ram</div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)">
          * 2 hexacores with HT enabled</div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)">* 2x1Gb
          bonded interfaces (want to know the more than 20 models we are
          using, just ask for it)</div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)">* Multi queue
          interfaces, pined via irq to different cores</div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)">
          * ubuntu 12.04 kernel 3.2.0-[40-48]</div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)">* Linux
          bridges,  no VLAN, no open-vswitch</div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)">
          <br>
        </div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)">I want to try
          to keep the networking appliances ( TOR's, AGGR, CORES ) as
          out of the picture as possible.</div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)">im thinking
          "i hope this thread gets great, in time"</div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)">
          <br>
        </div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)">So, ready to
          learn as much as i can.</div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)">
          Thank you openstack community, as allways.</div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)"><br>
        </div>
        <div class="gmail_default" style="font-family:'courier
          new',monospace;font-size:small;color:rgb(0,0,0)">
          alejandrito</div>
        <div><br>
        </div>
      </div>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <br>
      <pre wrap="">_______________________________________________
OpenStack-operators mailing list
<a class="moz-txt-link-abbreviated" href="mailto:OpenStack-operators@lists.openstack.org">OpenStack-operators@lists.openstack.org</a>
<a class="moz-txt-link-freetext" href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a>
</pre>
    </blockquote>
    <br>
  </body>
</html>