<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><br><div><div>Il giorno 19/lug/2012, alle ore 00:52, Steven Dake ha scritto:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div>On 07/18/2012 06:51 AM, Alessandro Tagliapietra wrote:<br><blockquote type="cite">Hi Steve,<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">the problem is not that it's not listening on the correct interface, as lsof shows<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">corosync 1485 root    9u  IPv4              14890      0t0       UDP 226.94.1.1:5405 <br></blockquote><blockquote type="cite">corosync 1485 root   10u  IPv4              14891      0t0       UDP server1:5404 <br></blockquote><blockquote type="cite">corosync 1485 root   11u  IPv4              14892      0t0       UDP server1:5405<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">where server1 is 10.8.0.1, which is correct because it's the eth1 address.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">The problem is that for some reason, the packets it sends to eth1 has as source ip the ip of eth0, which is the public internet connected interface, so like:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">15:44:34.135411 IP 5.9.x.x.5404 > 226.94.1.1.5405: UDP, length 82<br></blockquote><blockquote type="cite">15:44:34.238762 IP 5.9.x.x.5404 > 226.94.1.1.5405: UDP, length 82<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">which is wrong. my ip r is this:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">default via 5.9.x.x dev eth0  metric 100 <br></blockquote><blockquote type="cite">5.9.x.x/27 via 5.9.x.x dev eth0 <br></blockquote><blockquote type="cite">5.9.x.x/27 dev eth0  proto kernel  scope link  src 5.9.x.x <br></blockquote><blockquote type="cite">10.0.0.0/16 dev eth2  proto kernel  scope link  src 10.0.0.1 <br></blockquote><blockquote type="cite">10.8.0.0/16 dev eth1  proto kernel  scope link  src 10.8.0.1 <br></blockquote><blockquote type="cite">192.168.122.0/24 dev virbr0  proto kernel  scope link  src 192.168.122.1<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">As you can see packets to eth1 should have 10.8.0.1 as source, not eth0 ip.<br></blockquote><blockquote type="cite"><br></blockquote><br>Odd - Are you using udpu mode?  Which version?  Can you subscribe to the<br>corosync list and we can follow-up there?<br><br></div></blockquote><div><br></div><div>When starting this discussion i was using ubuntu 12.04 repositories so <span style="color: rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: left; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255); display: inline !important; float: none; ">1.4.2, today i've installed 2.0.1, i've added corosync mailing list in cc. I have to specify that this problem happens only when i've installed nova network on both nodes (i'm using multi-host).</span></div><div><span style="color: rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: left; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255); display: inline !important; float: none; ">Let me paste some configs:</span></div><div><span style="color: rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: left; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255); display: inline !important; float: none; "><br></span></div><div><span style="color: rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: left; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255); display: inline !important; float: none; ">nova.conf: </span><a href="http://pastie.org/private/c5tcutro6tp0s1te5yq">http://pastie.org/private/c5tcutro6tp0s1te5yq</a> (i've tried with flat_interface eth1 and eth2)</div><div>ifconfig: <a href="http://pastie.org/private/7li8gwodr0ulgbafsi4edw">http://pastie.org/private/7li8gwodr0ulgbafsi4edw</a></div><div>corosync.conf: <a href="http://pastie.org/private/cjrtqx9bspgmff7rlye6ew">http://pastie.org/private/cjrtqx9bspgmff7rlye6ew</a> (tried with 10.8.0.0 also as bindnetaddr)</div><div>ip r: <a href="http://pastie.org/private/ckqhy0vqoiwzewuj17v7g">http://pastie.org/private/ckqhy0vqoiwzewuj17v7g</a></div><div>iptables-save: <a href="http://pastie.org/private/yvypgi5ovs2rtcingrq5iw">http://pastie.org/private/yvypgi5ovs2rtcingrq5iw</a> (all generated by nova-network)</div><div><br></div><div>If you need any other things just ask.</div><div><br></div><div>Btw, i'm going to try with udpu now.</div><div><br></div><div>Regards</div><br><blockquote type="cite"><div><a href="http://lists.corosync.org/mailman/listinfo/discuss">http://lists.corosync.org/mailman/listinfo/discuss</a><br><br>thanks<br>-steve<br><br><blockquote type="cite">Regards<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Il giorno 18/lug/2012, alle ore 15:18, Steven Dake ha scritto:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><blockquote type="cite">On 07/18/2012 03:50 AM, Alessandro Tagliapietra wrote:<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">Hello,<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">i've 2 machines, running ubuntu 12.04, i've installed corosync +<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">pacemaker and it was working fine.<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">Corosync is using eth1 with 10.8.0.1 and 10.8.0.2 as ip of the hosts,<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">i've got keystone, glance, nova api-cert-scheduler, mysql, rabbitmq<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">working in HA with pacemaker.<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">The problem comes after installing nova-network and nova-compute, i've<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">used this nova.conf:<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">http://pastie.org/private/ddwva8kvaypqrxk7rifvba<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">and after nova-compute started and hosts rebooted i can't get to work<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">corosync,<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">the problem seems that when hosts send packets in eth1 to multicast<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">address, the source ip is the public one, not the 10.8.0.x one. After<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">disabling nova-network on boot everything works.<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">I've also tried to create a virtual eth2 device and set flat_interface<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">to eth2, but it seems that still nova-network break the configuration as<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">corosync still uses public ip for private lan.<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">Any idea?<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">Corosync goes to great pains to route packets across the interface<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">identified in the corosync.conf file.  If you are using a subnet<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">definition ie:<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">bindnetaddr: 10.8.0.0, it may be that the interface's netmask is causing<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">a rebind to the new interface when nova network starts.<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">One way to force binding to a specific interface when your network is<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">not configured in a typical fashion is to identify the bindnetaddr exactly:<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">ie: bindnetaddr: 10.8.0.1<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">Regards<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite">-steve<br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">Best Regards<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">-- <br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">Alessandro Tagliapietra | VISup srl<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">piazza 4 novembre 7<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">20124 Milano<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">http://www.visup.it<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">_______________________________________________<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">Mailing list: https://launchpad.net/~openstack<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">Post to     : openstack@lists.launchpad.net<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">Unsubscribe : https://launchpad.net/~openstack<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite">More help   : https://help.launchpad.net/ListHelp<br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><blockquote type="cite"><br></blockquote></blockquote><blockquote type="cite"><br></blockquote><br><br></div></blockquote></div><br>-- <br>Alessandro Tagliapietra | VISup srl<br>piazza 4 novembre 7<br>20124 Milano<br><br><div><div><a href="http://www.visup.it">http://www.visup.it</a></div></div></body></html>