<div dir="ltr">Hi Martinx,<div><br></div><div>We have another solution for this issue.</div><div><br></div><div>Changing MTU of each instances is very feeling heavy for me. If you are OK for lowering the performance, </div>
<div>you can avoid this issue by disabling 'pmtud' of OVS.</div><div><br></div><div> % <span style="background-color:transparent;font-family:Consolas,'Liberation Mono',Courier,monospace;font-size:12px;color:rgb(0,0,0)">sudo ovs-vsctl set interface gre-2 type=gre options:remote_ip=<remote_host_ip> options:pmtud=false</span></div>
<div><span style="background-color:transparent;font-family:Consolas,'Liberation Mono',Courier,monospace;font-size:12px;color:rgb(0,0,0)"><br></span></div><div><font color="#000000" face="Consolas, Liberation Mono, Courier, monospace"><span style="font-size:12px">You need to execute this command on each nodes (network nodes, compute nodes).</span></font></div>
<div><span style="background-color:transparent;font-family:Consolas,'Liberation Mono',Courier,monospace;font-size:12px;color:rgb(0,0,0)"><br></span></div><div><font color="#000000" face="Consolas, Liberation Mono, Courier, monospace"><span style="font-size:12px">This operation raise lower the performance because fragmentation will be occured.</span></font></div>
<div><font color="#000000" face="Consolas, Liberation Mono, Courier, monospace"><span style="font-size:12px">But you do not need to change MTU of each instances.</span></font></div><div><font color="#000000" face="Consolas, Liberation Mono, Courier, monospace"><span style="font-size:12px"><br>
</span></font></div><div><font color="#000000" face="Consolas, Liberation Mono, Courier, monospace"><span style="font-size:12px">and you avoid a problem when you restart neutron with this patch.</span></font></div><div><font color="#000000" face="Consolas, Liberation Mono, Courier, monospace"><span style="font-size:12px"><br>
</span></font></div><div><pre style="font-family:Consolas,'Liberation Mono',Courier,monospace;font-size:13px;line-height:19px;margin-top:15px;margin-bottom:15px;background-color:rgb(248,248,248);border:1px solid rgb(221,221,221);overflow:auto;padding:6px 10px;border-top-left-radius:3px;border-top-right-radius:3px;border-bottom-right-radius:3px;border-bottom-left-radius:3px;color:rgb(0,0,0)">
% diff -u /usr/lib/python2.7/dist-packages/quantum/agent/linux/<a href="http://ovs_lib.py.org">ovs_lib.py.org</a> /usr/lib/python2.7/dist-packages/quantum/agent/linux/ovs_lib.py
--- /usr/lib/python2.7/dist-packages/quantum/agent/linux/<a href="http://ovs_lib.py.org">ovs_lib.py.org</a> 2013-05-27 12:11:28.503356553 +0900
+++ /usr/lib/python2.7/dist-packages/quantum/agent/linux/ovs_lib.py 2013-05-27 12:03:22.626967070 +0900
@@ -167,6 +167,7 @@
self.set_db_attribute("Interface", port_name, "options:in_key", "flow")
self.set_db_attribute("Interface", port_name, "options:out_key",
"flow")
+ self.set_db_attribute("Interface", port_name, "options:pmtud", "false")
return self.get_port_ofport(port_name)
def add_patch_port(self, local_name, remote_name):</pre></div><div><br></div><div><span style="background-color:transparent;font-family:Consolas,'Liberation Mono',Courier,monospace;font-size:12px;color:rgb(0,0,0)">Thanks from Sunny Tokyo.</span></div>
<div><span style="background-color:transparent;font-family:Consolas,'Liberation Mono',Courier,monospace;font-size:12px;color:rgb(0,0,0)"><br></span></div><div><span style="background-color:transparent;font-family:Consolas,'Liberation Mono',Courier,monospace;font-size:12px;color:rgb(0,0,0)">Tomokazu HIRAI @jedipunkz</span></div>
</div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/8/5 Martinx - $B%8%'!<%`%:(B <span dir="ltr"><<a href="mailto:thiagocmartinsc@gmail.com" target="_blank">thiagocmartinsc@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr"><div>Good to know!</div><div><br></div>"<span style="font-family:arial,sans-serif;font-size:12.800000190734863px">ip link set mtu 1454 dev eth0" from within the Instance fixed my problem!</span><div>
<span style="font-family:arial,sans-serif;font-size:12.800000190734863px"><br></span></div><div><span style="font-family:arial,sans-serif;font-size:12.800000190734863px">Thank you!</span><br></div><div><span style="font-family:arial,sans-serif;font-size:12.800000190734863px"><br>
</span></div><div><span style="font-family:arial,sans-serif;font-size:12.800000190734863px">Best,</span></div><div><span style="font-family:arial,sans-serif;font-size:12.800000190734863px">Thiago</span></div></div><div class="HOEnZb">
<div class="h5"><div class="gmail_extra">
<br><br><div class="gmail_quote">On 5 August 2013 03:55, Ashok Kumaran <span dir="ltr"><<a href="mailto:ashokkumaran.b@gmail.com" target="_blank">ashokkumaran.b@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Martin,<div><br></div><div>There was a discussion happened on this topic already.</div><div><br></div><div>Either set the MTU value in the instance to 1454 (cirros$ sudo ip link set mtu 1454 dev eth0)</div>
<div>
<br></div><div>or</div><div><br></div><div>Increase the mtu to 1546 on the interfaces on the network node and the computes nodes that have the GRE tunnel endpoint IPs.<br></div><div><br></div><div>Best,</div><div>Ashok</div>
<div><br></div></div><div class="gmail_extra"><br><br><div class="gmail_quote"><div><div>On Mon, Aug 5, 2013 at 12:02 PM, Martinx - $B%8%'!<%`%:(B <span dir="ltr"><<a href="mailto:thiagocmartinsc@gmail.com" target="_blank">thiagocmartinsc@gmail.com</a>></span> wrote:<br>
</div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div><div dir="ltr">Guys,<div><br></div><div>I followed this guide: <a href="https://github.com/mseknibilel/OpenStack-Grizzly-Install-Guide/blob/OVS_MultiNode/OpenStack_Grizzly_Install_Guide.rst" target="_blank">https://github.com/mseknibilel/OpenStack-Grizzly-Install-Guide/blob/OVS_MultiNode/OpenStack_Grizzly_Install_Guide.rst</a> to build my latest cloud (PoC) and, from within my Instances, I'm facing some connectivity issues, like this:</div>
<div><br></div><div>---</div><div>Instance ip config</div><div>---</div><div><div>ubuntu@ubu-1:~$ ip r</div><div>default via 10.100.1.1 dev eth0 metric 100 </div><div><a href="http://10.100.1.0/24" target="_blank">10.100.1.0/24</a> dev eth0 proto kernel scope link src 10.100.1.5 </div>
</div><div>---</div><div><br></div><div>---</div><div>Test #1 - ping google - okay...</div><div>---</div><div><div>root@ubu-1:~# ping -c 1 <a href="http://google.com" target="_blank">google.com</a></div><div>PING <a href="http://google.com" target="_blank">google.com</a> (74.125.234.110) 56(84) bytes of data.</div>
<div>64 bytes from <a href="http://gru03s08-in-f14.1e100.net" target="_blank">gru03s08-in-f14.1e100.net</a> (74.125.234.110): icmp_req=1 ttl=57 time=75.7 ms</div></div><div>---</div><div><br></div><div>---</div><div>Test #2 - install ruby gem "bundler" - not okay...</div>
<div>---</div><div><div>root@ubu-1:~# gem install bundler</div><div>ERROR: While executing gem ... (Gem::RemoteFetcher::FetchError)</div><div> too many connection resets (<a href="http://production.cf.rubygems.org/gems/bundler-1.3.5.gem" target="_blank">http://production.cf.rubygems.org/gems/bundler-1.3.5.gem</a>)</div>
</div><div>---</div><div><br></div><div>Also, I can ping rubygems server, look:</div><div><br></div><div>---</div><div>root@cir-1:~# ping <a href="http://production.cf.rubygems.org" target="_blank">production.cf.rubygems.org</a></div>
<div>
PING <a href="http://d2chzxaqi4y7f8.cloudfront.net" target="_blank">d2chzxaqi4y7f8.cloudfront.net</a> <a href="tel:%2854.230.58.161" value="+915423058161" target="_blank">(54.230.58.161</a>) 56(84) bytes of data.</div><div>
64 bytes from <a href="http://server-54-230-58-161.gru1.r.cloudfront.net" target="_blank">server-54-230-58-161.gru1.r.cloudfront.net</a> <a href="tel:%2854.230.58.161" value="+915423058161" target="_blank">(54.230.58.161</a>): icmp_req=1 ttl=56 time=5.09 ms</div>
<div>---</div><div><br></div><div>And I can telnet it too!</div><div><br></div><div>---</div><div><div><div>root@cir-1:~# telnet <a href="http://production.cf.rubygems.org" target="_blank">production.cf.rubygems.org</a> 80</div>
<div>Trying <a href="tel:54.230.58.161" value="+915423058161" target="_blank">54.230.58.161</a>...</div>
<div>Connected to <a href="http://d2chzxaqi4y7f8.cloudfront.net" target="_blank">d2chzxaqi4y7f8.cloudfront.net</a>.</div><div>Escape character is '^]'.</div><div>^]quit</div></div><div>---<br></div></div><div><br>
</div><div>But "gem install bundler" always fails...</div>
<div><br></div><div>From within ubu-1's gateway, the "network node" with l3 agent + namespaces, "gem install bundler" works as expected...</div><div><br></div><div>Weird thing is, I can run "apt-get update / upgrade" without any issues on "ubu-1" instance... Everything is just opened to the Internet...</div>
<div><br></div><div>All tenants have this weird problem... I tried different setups but, can't figure it out by myself... I appreciate any help!</div><div><br></div><div>I'm running tcpdump at the network node, while trying to run "gem install bundler" from within "ubu-1" instance:</div>
<div><br></div><div>---</div><div><div>root@network:~# ip netns exec qrouter-475257b2-836c-43a1-98a8-8f29ae1ce1b5 tcpdump -i qr-7a44c1d0-7e</div></div><div>---</div><div><br></div><div>Output:</div><div>---</div><div><div>
02:27:42.279268 IP 10.100.1.5 > <a href="http://server-54-230-58-171.gru1.r.cloudfront.net" target="_blank">server-54-230-58-171.gru1.r.cloudfront.net</a>: ICMP 10.100.1.5 unreachable - need to frag (mtu 1454), length 556</div>
</div>
<div>
<br></div><div>more on paste bin:</div><div><br></div><div><a href="http://paste.openstack.org/show/43153/" target="_blank">http://paste.openstack.org/show/43153/</a><br></div><div>---</div><div><br></div><div>From within network node (ubu-1 instance gateway), gem install it works...</div>
<div><br></div><div>---</div><div><div>root@network:~# gem install bundler</div><div>Fetching: bundler-1.3.5.gem (100%)</div><div>Successfully installed bundler-1.3.5</div><div>1 gem installed</div><div>Installing ri documentation for bundler-1.3.5...</div>
<div>Installing RDoc documentation for bundler-1.3.5...</div></div><div>---</div><div><br></div><div>Any thoughts?! Apparently, the package didn't goes back to the Instance... But I don't know how to fix it... =P</div>
<div><br></div><div>I tried a lots of variants of this setup (playing with quantum networks, routers and Floating IPs) but, no success... I can't run "gem install bundler" form within any Instance... But I can navigate, use apt-get update and etc... :-/</div>
<div><br></div><div>NOTE: I noted that the rubygems is hosted at the AWS + CloudFront, and, the IP of it keep changing... It differs a bit from this mail and pastebin that I posted.</div><div><br></div><div>NOTE 2: The ubu-1 have no Floating IP attached to it, I'm trying to run "gem install bundler" from VNC console after changing "ubuntu" user password... Everything here is based on Ubuntu 12.04.2 + Grizzly from UCA, including Instances (ubu-1) and servers (network, controller, node, etc)...</div>
<div><br></div><div>Tks!</div><div>Thiago</div></div>
<br></div></div>_______________________________________________<br>
Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
Post to : <a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a><br>
Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
<br></blockquote></div><span><font color="#888888"><br><br clear="all"><div><br></div>-- <br><div>Regds,</div>
<div> </div>
<div>Ashok ,</div>
<div>Delivery Consultant,</div>
<div>HP.</div>
</font></span></div>
</blockquote></div><br></div>
</div></div><br>_______________________________________________<br>
Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
Post to : <a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a><br>
Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
<br></blockquote></div><br></div>