<html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body dir="auto">Did you change the mtu on neutron config?<br><br><div id="AppleMailSignature">Sent from my iPad</div><div><br>On Dec 18, 2017, at 5:38 PM, Manuel Sopena Ballesteros <<a href="mailto:manuel.sb@garvan.org.au">manuel.sb@garvan.org.au</a>> wrote:<br><br></div><blockquote type="cite"><div>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoPlainText, li.MsoPlainText, div.MsoPlainText
{mso-style-priority:99;
mso-style-link:"Plain Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
span.EmailStyle17
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.PlainTextChar
{mso-style-name:"Plain Text Char";
mso-style-priority:99;
mso-style-link:"Plain Text";
font-family:"Calibri","sans-serif";}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:911308253;
mso-list-type:hybrid;
mso-list-template-ids:-506968804 67698689 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;}
@list l0:level1
{mso-level-number-format:bullet;
mso-level-text:\F0B7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Symbol;}
@list l0:level2
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Courier New";}
@list l0:level3
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Wingdings;}
@list l0:level4
{mso-level-number-format:bullet;
mso-level-text:\F0B7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Symbol;}
@list l0:level5
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Courier New";}
@list l0:level6
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Wingdings;}
@list l0:level7
{mso-level-number-format:bullet;
mso-level-text:\F0B7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Symbol;}
@list l0:level8
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Courier New";}
@list l0:level9
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Wingdings;}
@list l1
{mso-list-id:1008481263;
mso-list-type:hybrid;
mso-list-template-ids:649787984 67698689 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;}
@list l1:level1
{mso-level-number-format:bullet;
mso-level-text:\F0B7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Symbol;}
@list l1:level2
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Courier New";}
@list l1:level3
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Wingdings;}
@list l1:level4
{mso-level-number-format:bullet;
mso-level-text:\F0B7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Symbol;}
@list l1:level5
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Courier New";}
@list l1:level6
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Wingdings;}
@list l1:level7
{mso-level-number-format:bullet;
mso-level-text:\F0B7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Symbol;}
@list l1:level8
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Courier New";}
@list l1:level9
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Wingdings;}
@list l2
{mso-list-id:1147012979;
mso-list-type:hybrid;
mso-list-template-ids:36473926 67698689 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;}
@list l2:level1
{mso-level-number-format:bullet;
mso-level-text:\F0B7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Symbol;}
@list l2:level2
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Courier New";}
@list l2:level3
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Wingdings;}
@list l2:level4
{mso-level-number-format:bullet;
mso-level-text:\F0B7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Symbol;}
@list l2:level5
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Courier New";}
@list l2:level6
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Wingdings;}
@list l2:level7
{mso-level-number-format:bullet;
mso-level-text:\F0B7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Symbol;}
@list l2:level8
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Courier New";}
@list l2:level9
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Wingdings;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div class="WordSection1">
<p class="MsoPlainText">Dear Openstack community,<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Openstack environment:<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">2 compute nodes each has:<o:p></o:p></p>
<p class="MsoPlainText" style="margin-left:.5in;text-indent:-.25in;mso-list:l0 level1 lfo3">
<!--[if !supportLists]--><span style="font-family:Symbol"><span style="mso-list:Ignore">·<span style="font:7.0pt "Times New Roman"">
</span></span></span><!--[endif]-->1x AMD Opteron(tm) Processor 6282 SE (56 cpus)<o:p></o:p></p>
<p class="MsoPlainText" style="margin-left:.5in;text-indent:-.25in;mso-list:l0 level1 lfo3">
<!--[if !supportLists]--><span style="font-family:Symbol"><span style="mso-list:Ignore">·<span style="font:7.0pt "Times New Roman"">
</span></span></span><!--[endif]-->512GB RAM<o:p></o:p></p>
<p class="MsoPlainText" style="margin-left:.5in;text-indent:-.25in;mso-list:l0 level1 lfo3">
<!--[if !supportLists]--><span style="font-family:Symbol"><span style="mso-list:Ignore">·<span style="font:7.0pt "Times New Roman"">
</span></span></span><!--[endif]-->1x dual port 25Gbps Mellanox connect-4 XOR bond<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Physical network:<o:p></o:p></p>
<p class="MsoPlainText" style="margin-left:.5in;text-indent:-.25in;mso-list:l1 level1 lfo1">
<!--[if !supportLists]--><span style="font-family:Symbol"><span style="mso-list:Ignore">·<span style="font:7.0pt "Times New Roman"">
</span></span></span><!--[endif]-->Compute nodes connected through a mellanox 2700 switch (100Gbps)<o:p></o:p></p>
<p class="MsoPlainText" style="margin-left:.5in;text-indent:-.25in;mso-list:l1 level1 lfo1">
<!--[if !supportLists]--><span style="font-family:Symbol"><span style="mso-list:Ignore">·<span style="font:7.0pt "Times New Roman"">
</span></span></span><!--[endif]-->MTU 9000<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Openstack network:<o:p></o:p></p>
<p class="MsoPlainText" style="margin-left:.5in;text-indent:-.25in;mso-list:l2 level1 lfo2">
<!--[if !supportLists]--><span style="font-family:Symbol"><span style="mso-list:Ignore">·<span style="font:7.0pt "Times New Roman"">
</span></span></span><!--[endif]-->OVS + VxLan<o:p></o:p></p>
<p class="MsoPlainText" style="margin-left:.5in;text-indent:-.25in;mso-list:l2 level1 lfo2">
<!--[if !supportLists]--><span style="font-family:Symbol"><span style="mso-list:Ignore">·<span style="font:7.0pt "Times New Roman"">
</span></span></span><!--[endif]-->Vxlan offloading setup on physical nics<o:p></o:p></p>
<p class="MsoPlainText" style="margin-left:.5in;text-indent:-.25in;mso-list:l2 level1 lfo2">
<!--[if !supportLists]--><span style="font-family:Symbol"><span style="mso-list:Ignore">·<span style="font:7.0pt "Times New Roman"">
</span></span></span><!--[endif]-->MTU on vms 8950<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><i><u>Compute nodes nics:<o:p></o:p></u></i></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><span style="font-family:Consolas">[root@hercules-23 ~]# ip a<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">…<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">6: p2p1: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP>
<b><span style="color:red">mtu 9000</span></b><span style="color:red"> </span>qdisc mq master bond0 state UP qlen 1000<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas"> link/ether 7c:fe:90:12:23:c4 brd ff:ff:ff:ff:ff:ff<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">7: p2p2: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP>
<b><span style="color:red">mtu 9000</span></b><span style="color:red"> </span>qdisc mq master bond0 state UP qlen 1000<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas"> link/ether 7c:fe:90:12:23:c4 brd ff:ff:ff:ff:ff:ff<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">8: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP>
<b><span style="color:red">mtu 9000</span></b><span style="color:red"> </span>qdisc noqueue state UP qlen 1000<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas"> link/ether 7c:fe:90:12:23:c4 brd ff:ff:ff:ff:ff:ff<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas"> inet 10.0.32.23/16 brd 10.0.255.255 scope global bond0<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas"> valid_lft forever preferred_lft forever<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas"> inet6 fe80::3826:9daa:ef1b:43b0/64 scope link<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas"> valid_lft forever preferred_lft forever<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">…<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoPlainText"><i><u>VM nics:<o:p></o:p></u></i></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><span style="font-family:Consolas">[centos@centos2 ~]$ ip a<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">…<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP>
<b><span style="color:red">mtu 8950</span></b><span style="color:red"> </span>qdisc pfifo_fast state UP qlen 1000<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas"> link/ether fa:16:3e:a3:d4:85 brd ff:ff:ff:ff:ff:ff<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas"> inet 192.168.1.116/24 brd 192.168.1.255 scope global dynamic eth0<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas"> valid_lft 57885sec preferred_lft 57885sec<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas"> inet6 fe80::f816:3eff:fea3:d485/64 scope link<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas"> valid_lft forever preferred_lft forever<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoPlainText"><i><u>host to host bandwidth using muttcp (1 thread):<o:p></o:p></u></i></p>
<p class="MsoPlainText"><span style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">[root@hercules-22 ~]# nuttcp -l65536 -fparse 10.0.32.23<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">megabytes=19844.1759 real_seconds=10.00
<b><span style="color:red">rate_Mbps=16643.4189</span></b><span style="color:red">
</span>tx_cpu=61 rx_cpu=99 retrans=0 rtt_ms=0.28<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoPlainText"><i><u>VMTP Output:<o:p></o:p></u></i></p>
<p class="MsoPlainText"><i><u><o:p><span style="text-decoration:none"> </span></o:p></u></i></p>
<p class="MsoPlainText"><span style="font-family:Consolas">==================<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">Total Scenarios: 29<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">Passed Scenarios: 17 [100.00%]<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">Failed Scenarios: 0 [0.00%]<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">Skipped Scenarios: 12<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">+----------+-------------------------------------------------------+-------------------+----------------------------------------------------------------------------------+<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| Scenario | Scenario Name | Functional Status | Data |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">+----------+-------------------------------------------------------+-------------------+----------------------------------------------------------------------------------+<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 1.1 | Same Network, Fixed IP, Intra-node, TCP | PASSED | {'tp_kbps': '7613130', 'rtt_ms': '0.463333'} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 1.2 | Same Network, Fixed IP, Intra-node, UDP | PASSED | {128: {'tp_kbps': 59954, 'loss_rate': 0.02}, 1024: {'tp_kbps': 444264, |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| | | | 'loss_rate': 0.05}, 8192: {'tp_kbps': 2877674, 'loss_rate': 0.0}} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 1.3 | Same Network, Fixed IP, Intra-node, ICMP | PASSED | {'rtt avg/min/max/stddev msec': {'391-byte': '0.376/0.285/0.439/0.047', |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| | | | '64-byte': '0.617/0.361/1.513/0.388', '1500-byte': '0.369/0.322/0.452/0.048'}} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 1.4 | Same Network, Fixed IP, Intra-node, Multicast | SKIPPED | {} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 2.1 | Same Network, Fixed IP, Inter-node, TCP | PASSED | {'tp_kbps': '6864266', 'rtt_ms': '0.653333'} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 2.2 | Same Network, Fixed IP, Inter-node, UDP | PASSED | {128: {'tp_kbps': 80955, 'loss_rate': 0.46}, 1024: {'tp_kbps': 166186, |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| | | | 'loss_rate': 36.2}, 8192: {'tp_kbps': 2189389, 'loss_rate': 0.05}} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 2.3 | Same Network, Fixed IP, Inter-node, ICMP | PASSED | {'rtt avg/min/max/stddev msec': {'391-byte': '0.484/0.315/0.561/0.068', |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| | | | '64-byte': '0.719/0.421/2.714/0.666', '1500-byte': '0.465/0.358/0.553/0.055'}} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 2.4 | Same Network, Fixed IP, Inter-node, Multicast | SKIPPED | {} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 3.1 | Different Network, Fixed IP, Intra-node, TCP | PASSED | {'tp_kbps': '5207719', 'rtt_ms': '0.896667'} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 3.2 | Different Network, Fixed IP, Intra-node, UDP | PASSED | {128: {'tp_kbps': 76569, 'loss_rate': 0.9}, 1024: {'tp_kbps': 571847, |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| | | | 'loss_rate': 2.75}, 8192: {'tp_kbps': 1855166, 'loss_rate': 0.0}} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 3.3 | Different Network, Fixed IP, Intra-node, ICMP | PASSED | {'rtt avg/min/max/stddev msec': {'391-byte': '0.859/0.658/1.103/0.133', |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| | | | '64-byte': '0.976/0.576/1.946/0.361', '1500-byte': '0.824/0.644/1.082/0.136'}} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 3.4 | Different Network, Fixed IP, Intra-node, Multicast | SKIPPED | {} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 4.1 | Different Network, Fixed IP, Inter-node, TCP | PASSED | {'tp_kbps': '6730928', 'rtt_ms': '1.37667'} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 4.2 | Different Network, Fixed IP, Inter-node, UDP | PASSED | {128: {'tp_kbps': 31131, 'loss_rate': 4.84}, 1024: {'tp_kbps': 579859, |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| | | | 'loss_rate': 4.35}, 8192: {'tp_kbps': 1601092, 'loss_rate': 0.18}} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 4.3 | Different Network, Fixed IP, Inter-node, ICMP | PASSED | {'rtt avg/min/max/stddev msec': {'391-byte': '0.915/0.740/1.138/0.144', |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| | | | '64-byte': '1.134/0.713/2.210/0.539', '1500-byte': '0.980/0.719/1.188/0.131'}} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 4.4 | Different Network, Fixed IP, Inter-node, Multicast | SKIPPED | {} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 5.1 | Different Network, Floating IP, Intra-node, TCP | PASSED | {'tp_kbps': '5406554', 'rtt_ms': '0.836667'} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 5.2 | Different Network, Floating IP, Intra-node, UDP | PASSED | {128: {'tp_kbps': 71084, 'loss_rate': 4.26}, 1024: {'tp_kbps': 507900, |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| | | | 'loss_rate': 15.96}, 8192: {'tp_kbps': 2011414, 'loss_rate': 3.72}} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 5.3 | Different Network, Floating IP, Intra-node, ICMP | PASSED | {'rtt avg/min/max/stddev msec': {'391-byte': '0.902/0.760/1.007/0.073', |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| | | | '64-byte': '0.875/0.661/0.967/0.104', '1500-byte': '0.889/0.754/0.988/0.082'}} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 5.4 | Different Network, Floating IP, Intra-node, Multicast | SKIPPED | {} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 6.1 | Different Network, Floating IP, Inter-node, TCP | PASSED | {'tp_kbps': '6770995', 'rtt_ms': '0.973333'} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 6.2 | Different Network, Floating IP, Inter-node, UDP | PASSED | {128: {'tp_kbps': 81812, 'loss_rate': 2.25}, 1024: {'tp_kbps': 617485, |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| | | | 'loss_rate': 3.27}, 8192: {'tp_kbps': 1295351, 'loss_rate': 0.02}} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 6.3 | Different Network, Floating IP, Inter-node, ICMP | PASSED | {'rtt avg/min/max/stddev msec': {'391-byte': '1.028/0.920/1.254/0.105', |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| | | | '64-byte': '1.043/0.807/1.227/0.137', '1500-byte': '0.988/0.759/1.194/0.146'}} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 6.4 | Different Network, Floating IP, Inter-node, Multicast | SKIPPED | {} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 7.1 | Native Throughput, TCP | SKIPPED | {} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 7.2 | Native Throughput, UDP | SKIPPED | {} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 7.3 | Native Throughput, ICMP | SKIPPED | {} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 7.4 | Native Throughput, Multicast | SKIPPED | {} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 8.1 | VM to Host Uploading | SKIPPED | {} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">| 8.2 | VM to Host Downloading | SKIPPED | {} |<o:p></o:p></span></p>
<p class="MsoPlainText"><span style="font-family:Consolas">+----------+-------------------------------------------------------+-------------------+----------------------------------------------------------------------------------+<o:p></o:p></span></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">My concern is about east-west bandwidth:<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Inter-host and intra-subnet (vmtp Scenario 2.1): I am getting ~6.8Gbps which I found quite poor compared to 16.0 Gbps I am getting from the hosts<o:p></o:p></p>
<p class="MsoPlainText">intra-host and intra-subnet (vmtp Scenario 1.1): In this example traffic remains inside the compute node and no tunneling is required. I am getting ~7.6Gbps which I found quite poor compared to 16.0 Gbps I am getting from the hosts<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">NOTE: I am not running anything except these tests on the machines so cpu usage is quite low.
<o:p></o:p></p>
<p class="MsoPlainText">NOTE2: I know vmtp uses <o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">I would like to understand what is stopping my vms to get full network bandwidth. Is this related with an OVS configuration? ML2? Other part of neutron? Something else?<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Thank you very much<o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
<p class="MsoPlainText">Manuel Sopena Ballesteros | Big data Engineer<o:p></o:p></p>
<p class="MsoPlainText">Garvan Institute of Medical Research <o:p></o:p></p>
<p class="MsoPlainText">The Kinghorn Cancer Centre, 370 Victoria Street, Darlinghurst, NSW 2010<o:p></o:p></p>
<p class="MsoPlainText">T: + 61 (0)2 9355 5760 | F: +61 (0)2 9295 8507 | E: <a href="mailto:manuel.sb@garvan.org.au">manuel.sb@garvan.org.au</a><o:p></o:p></p>
<p class="MsoPlainText"><o:p> </o:p></p>
</div>
<div style="font-size:8pt; font-family: Arial">NOTICE</div>
<div style="font-size:8pt; font-family: Arial">Please consider the environment before printing this email. This message and any attachments are intended for the addressee named and may contain legally privileged/confidential/copyright information. If you are
not the intended recipient, you should not read, use, disclose, copy or distribute this communication. If you have received this message in error please notify us at once by return email and then delete both messages. We accept no liability for the distribution
of viruses or similar in electronic communications. This notice should not be removed.
</div>
</div></blockquote><blockquote type="cite"><div><span>_______________________________________________</span><br><span>Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a></span><br><span>Post to : <a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a></span><br><span>Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a></span><br></div></blockquote></body></html>