<div dir="ltr"><div><div><div>Yes, it's in multi_host=true. In nova.conf and in the database multi_host is set to True. 10.5.5.32 isn't the gateway, instead is the private network.<br><br></div>LoL<br><br></div>Out of nothing my instances can now reach metadata. But when I login and ping <a href="http://www.google.com">www.google.com</a> VM can resolv name but there is no answer back, all packets are lost. And I've attached a floating IP for two vms, on different node, and they dont even ping back in the same node.<br>
<br></div>This is so confused! I'll do some tcpdump to check what is happening!<br><div><br><div><div><br><br></div></div></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, Dec 19, 2012 at 2:05 PM, Vishvananda Ishaya <span dir="ltr"><<a href="mailto:vishvananda@gmail.com" target="_blank">vishvananda@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word">Are you sure your network has multi_host = True? It seems like it isn't, since the gateway listed by the guest is 10.5.5.32<div>
<br></div><div>In multi_host mode each node should be getting an ip from the fixed range and the guest should be using that as the gateway.<br><div><div><br></div><div><div>Vish</div><div><div class="h5"><div><br><blockquote type="cite">
<div dir="ltr"><br><div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, Dec 19, 2012 at 1:13 PM, Vishvananda Ishaya <span dir="ltr"><<a href="mailto:vishvananda@gmail.com" target="_blank">vishvananda@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div style="word-wrap:break-word">There should be a redirect in iptables from <a href="http://169.254.169.254/" target="_blank">169.254.169.254:80</a> to $my_ip:8775 (where nova-api-metadata is running)<div>
<br></div><div>So:</div><div><br></div><div>a) can you</div><div><br></div><div> curl $my_ip:8775 (should 404)</div></div></blockquote><div>CloudController and Nodes awnser in the same way:<br>1.0<br>2007-01-19<br>2007-03-01<br>
2007-08-29<br>2007-10-10<br>2007-12-15<br>2008-02-01<br>2008-09-01<br>2009-04-04<br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div style="word-wrap:break-word"><div><br></div><div>b) if you do</div><div><br></div><div> sudo iptables -t nat -L -n v</div><div><br></div><div>do you see the forward rule? Is it getting hit properly?</div></div></blockquote>
<div><br></div><div>there is the correct rule, but they never got hit<br>controller<br> 0 0 DNAT tcp -- * * <a href="http://0.0.0.0/0" target="_blank">0.0.0.0/0</a> 169.254.169.254 tcp dpt:80 to:<a href="http://200.131.6.250:8775/" target="_blank">200.131.6.250:8775</a><br>
<br>nodes<br> 0 0 DNAT tcp -- * * <a href="http://0.0.0.0/0" target="_blank">0.0.0.0/0</a> 169.254.169.254 tcp dpt:80 to:<a href="http://200.131.6.248:8775/" target="_blank">200.131.6.248:8775</a><br>
0 0 DNAT tcp -- * * <a href="http://0.0.0.0/0" target="_blank">0.0.0.0/0</a> 169.254.169.254 tcp dpt:80 to:<a href="http://200.131.6.249:8775/" target="_blank">200.131.6.249:8775</a><br>
<br></div><div> <br></div><div>Thanks for appearing Vish! I was wishing your help!<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex">
<div style="word-wrap:break-word">
<div><br></div><div>Vish</div><div> </div><div><div><div><div><div>On Dec 19, 2012, at 6:39 AM, Gui Maluf <<a href="mailto:guimalufb@gmail.com" target="_blank">guimalufb@gmail.com</a>> wrote:</div><br></div>
</div><blockquote type="cite"><div><div><div dir="ltr"><div>My set up is a <a href="http://docs.openstack.org/trunk/openstack-compute/admin/content/existing-ha-networking-options.html" target="_blank">nova-network-ha</a>, so each of my nodes run a nova-{api-metadata,network,compute,volume}, my controller runs all of this plus the rest of things it should run.<br>
</div><div>Each of my nodes are the gateway for it's own instances. They all have the same net config, ip_forwarding. <br><br>The main issue is that I can't telnet the nodes on port 80 that should redirect to metadatas server. metadata IP is set correctly to eth0, but 80 port is not open.<br>
</div><div>My doubt is, should I create a endpoint for each node api-metadata service? should I install apache on nodes?<br><br><div>I really don't know what to do anymore. This only happen
on nodes, on cloudcontroller all instance run smoothly. they get the
floatip, metadata service, etc.<br><br>Thanks in advance!<br clear="all"></div><br></div><div></div><div>
</div><div><br></div>
<div>I will put the max of info I can here.<br><br>root@oxala:~# nova-manage service list <br>
Binary Host Zone Status State Updated_At<br>nova-compute xango nova enabled :-) 2012-12-18 20:34:21<br>nova-network xango nova enabled :-) 2012-12-18 20:34:20<br>
nova-compute oxossi nova enabled :-) 2012-12-18 20:34:15<br>nova-network oxossi nova enabled :-) 2012-12-18 20:34:20<br>
nova-volume oxossi nova enabled :-) 2012-12-18 20:34:18<br>nova-volume xango nova enabled :-) 2012-12-18 20:34:19<br>
nova-consoleauth oxala nova enabled :-) 2012-12-18 20:34:24<br>nova-scheduler oxala nova enabled :-) 2012-12-18 20:34:25<br>
nova-cert oxala nova enabled :-) 2012-12-18 20:34:25<br>nova-volume oxala nova enabled :-) 2012-12-18 20:34:25<br>
nova-network oxala nova enabled :-) 2012-12-18 20:34:17<br>nova-compute oxala nova enabled :-) 2012-12-18 20:34:10<br>
<br></div><div><b>controller nova.conf</b><br>#NETWORK<br>--allow_same_net_traffic=true<br>--network_manager=nova.network.manager.FlatDHCPManager<br>--firewall_driver=nova.virt.libvirt.firewall.IptablesFirewallDriver<br>
--public_interface=eth0<br>
--flat_interface=eth1<br>--flat_network_bridge=br100<br>--fixed_range=<a href="http://10.5.5.32/27" target="_blank">10.5.5.32/27</a><br>--network_size=32<br>--flat_network_dhcp_start=10.5.5.33<br>--my_ip=200.131.6.250<br>
--multi_host=True<br>
#--enabled_apis=ec2,osapi_compute,osapi_volume,metadata <br>--dhcpbridge_flagfile=/etc/nova/nova.conf<br>--dhcpbridge=/usr/bin/nova-dhcpbridge<br>--force_dhcp_release<br>--ec2_private_dns_show<br>--routing_source_ip=$my_ip<br>
</div><div><br><div><b>nodes nova.conf</b><br></div><div>{same network configs}<br></div><div>--my_ip=200.131.6.248<br>--multi_host=True<br>--enabled_apis=ec2,osapi_compute,osapi_volume,metadata <br>--routing_source_ip=$my_ip<br>
</div><br></div><b>controller iptables -L -vn && </b><b>iptables -L -vn</b> <b>-t nat</b><br><a href="http://paste.openstack.org/show/mkWZTYI6cKHR4qUWbOUz/" target="_blank">http://paste.openstack.org/show/mkWZTYI6cKHR4qUWbOUz/</a><br>
<div><b>node</b> <b>iptables -L -vn && </b><b>iptables -L -vn</b> <b>-t nat<br></b><a href="http://paste.openstack.org/show/28384/" target="_blank">http://paste.openstack.org/show/28384/</a><b><br></b><b><br></b><br>
<div><b>controller ip a</b><br>
<a href="http://paste.openstack.org/show/W2vrVtost2EP2u62iZwp/" target="_blank">http://paste.openstack.org/show/W2vrVtost2EP2u62iZwp/</a><br>root@oxala:~# route<br>Tabela de Roteamento IP do Kernel<br>Destino Roteador MáscaraGen. Opções Métrica Ref Uso Iface<br>
default 200.131.6.129 0.0.0.0 UG 100 0 0 eth0<br>10.5.5.32 * 255.255.255.224 U 0 0 0 br100<br>200.131.6.128 * 255.255.255.128 U 0 0 0 eth0<br>
</div><br><b><b>node ip a</b><br></b><a href="http://paste.openstack.org/show/S44TL3sznIztNCO3s8p2/" target="_blank">http://paste.openstack.org/show/S44TL3sznIztNCO3s8p2/</a><b><br></b>root@oxossi:~# route<br>Tabela de Roteamento IP do Kernel<br>
Destino Roteador MáscaraGen. Opções Métrica Ref Uso Iface<br>default 200.131.6.129 0.0.0.0 UG 100 0 0 eth0<br>10.5.5.32 * 255.255.255.224 U 0 0 0 br100<br>
200.131.6.128 * 255.255.255.128 U 0 0 0 eth0<br><b><br><br></b></div><div><b>And finnaly the error throw out by the vm when running on Nodes.<br><br></b></div><div><pre>ci-info: lo : 1 127.0.0.1 255.0.0.0 .
ci-info: eth0 : 1 10.5.5.53 255.255.255.224 fa:16:3e:69:cb:d2
ci-info: route-0: 0.0.0.0 10.5.5.35 0.0.0.0 eth0 UG
ci-info: route-1: 10.5.5.32 0.0.0.0 255.255.255.224 eth0 U
cloud-init start running: Tue, 18 Dec 2012 20:34:09 +0000. up 4.02 seconds
2012-12-18 20:34:15,967 - util.py[WARNING]: '<a href="http://169.254.169.254/2009-04-04/meta-data/instance-id" target="_blank">http://169.254.169.254/2009-04-04/meta-data/instance-id</a>' failed [6/120s]: url error [[Errno 113] No route to host]</pre>
<br></div><br>-- <br><font face="Arial, Helvetica, sans-serif"><b>guilherme</b> \n<br>\<font>t</font> <b>maluf</b><br></font>
</div></div></div>
_______________________________________________<br>Mailing list: <a href="https://launchpad.net/~openstack" target="_blank">https://launchpad.net/~openstack</a><br>Post to : <a href="mailto:openstack@lists.launchpad.net" target="_blank">openstack@lists.launchpad.net</a><br>
Unsubscribe : <a href="https://launchpad.net/~openstack" target="_blank">https://launchpad.net/~openstack</a><br>More help : <a href="https://help.launchpad.net/ListHelp" target="_blank">https://help.launchpad.net/ListHelp</a><br>
</blockquote></div><br></div></div></blockquote></div><br><br clear="all"><br>-- <br><font face="Arial, Helvetica, sans-serif"><b>guilherme</b> \n<br>\<font>t</font> <b>maluf</b><br></font>
</div></div>
</blockquote></div><br></div></div></div></div></div></div></blockquote></div><br><br clear="all"><br>-- <br><font face="Arial, Helvetica, sans-serif"><b>guilherme</b> \n<br>\<font>t</font> <b>maluf</b><br></font>
</div>