<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; color: rgb(0, 0, 0); font-size: 14px; font-family: Calibri, sans-serif;"><div><div><div>I have just had to tweak our grizzly network node the biggest impacts were seem from doing changing root wrap to only use sudo – not the python wrapper (its super slow) and upgrading openvswitch to 1.11</div><div><br></div><div>This smoke ping shows the latency to one of our instances from europe before and after the openvswitch upgrade : <a href="http://d.pr/i/36v0">http://d.pr/i/36v0</a></div><div><br></div><div>And this graph shows the load avg on our network node, the first drop is from disabling root wrap the second is after the OVS upgrade : <a href="http://d.pr/i/xhFc">http://d.pr/i/xhFc</a></div><div><br></div><div>I would suggest you do the same, and just make sure all MTU’s are correct.</div><div><br></div><div><div><div>-- </div><div>Geraint Jones</div></div><div>Director of Systems & Infrastructure</div><div>Koding </div><div><a href="https://koding.com">https://koding.com</a></div><div>geraint@koding.com</div><div>M (NZ) +64 22 123 4626</div><div>M (US) +1 415 316 8027</div></div></div></div><div><br></div><span id="OLK_SRC_BODY_SECTION"><div style="font-family:Calibri; font-size:11pt; text-align:left; color:black; BORDER-BOTTOM: medium none; BORDER-LEFT: medium none; PADDING-BOTTOM: 0in; PADDING-LEFT: 0in; PADDING-RIGHT: 0in; BORDER-TOP: #b5c4df 1pt solid; BORDER-RIGHT: medium none; PADDING-TOP: 3pt"><span style="font-weight:bold">From: </span> Martinx - ジェームズ <<a href="mailto:thiagocmartinsc@gmail.com">thiagocmartinsc@gmail.com</a>><br><span style="font-weight:bold">Date: </span> Tuesday, 22 October 2013 9:00 am<br><span style="font-weight:bold">To: </span> Rick Jones <<a href="mailto:rick.jones2@hp.com">rick.jones2@hp.com</a>><br><span style="font-weight:bold">Cc: </span> "<a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a>" <<a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a>><br><span style="font-weight:bold">Subject: </span> Re: [Openstack] Very slow connectivity from within tenant network - GRE<br></div><div><br></div><div dir="ltr">Hi Rick!<div><br></div><div>Back with Grizzly, I faced that problem and I was able to detect it, at the Network Node with tcpdump and fix it by running "ip link set mtu 1454 dev eth0" within the Instance.</div><div><br></div><div>Not this time... This is another problem... ;-/</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On 22 October 2013 13:25, Rick Jones <span dir="ltr"><<a href="mailto:rick.jones2@hp.com" target="_blank">rick.jones2@hp.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="HOEnZb"><div class="h5">On 10/22/2013 01:32 AM, Martinx - ジェームズ wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Stackers,<br><br>
I'm trying to put my Havana into production and I'm facing a very<br>
strange problem.<br><br>
The Internet connectivity from tenant's subnet is very, very slow. It is<br>
useless in fact... I can not even use "apt-get update" from a Instance.<br><br>
The following command works (apt update from the tenant namespace):<br><br>
---<br>
root@net-node-1:~# ip netns exec qrouter-XXXXXXXXX aptitude update<br>
---<br><br>
But not from the tenant subnet...<br><br>
I'm following this topology:<br><br><a href="http://docs.openstack.org/trunk/install-guide/install/apt/content/section_use-cases-tenant-router.html" target="_blank">http://docs.openstack.org/<u></u>trunk/install-guide/install/<u></u>apt/content/section_use-cases-<u></u>tenant-router.html</a><br><br>
Already tried to change MTUs (via DHCP agent)... Nothing had fixed this<br>
weird issue.<br><br>
Any thoughts?!<br><br>
Right now, my "aptitude safe-upgrade" will take 2 days to download<br>
60MB... During this network outages, even the SSH session stops<br>
responding for a few seconds...<br><br>
Everything else seems to be working as expected, as for example, DHCP,<br>
Floating IPs, Security Groups...<br><br>
Sometimes, even the first ssh connection to the Instance Floating IP,<br>
have a lag.<br></blockquote><br></div></div>
It is but a guess, but I wonder if, even with changing MTUs (to what values?) you may still be experiencing a PathMTU+ICMP blackhole problem accessing nodes on the Internet. Can you access something that is a bit "closer" but still outside your stack so you have a shot at looking at netstat statistics on the sender and/or get packet traces on the sender?<br><br>
You could still try taking packet traces at the instance or perhaps the namespace and try to discern packet losses at the receiving side, though it can be a bit more difficult.<span class="HOEnZb"><font color="#888888"><br><br>
rick jones<br><br></font></span></blockquote></div><br></div>
_______________________________________________
Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a>
Post to : <a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a>
Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a>
</span></body></html>