<html>
<head>
<style><!--
.hmmessage P
{
margin:0px;
padding:0px
}
body.hmmessage
{
font-size: 12pt;
font-family:Calibri
}
--></style></head>
<body class='hmmessage'><div dir='ltr'><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; font-size: 14px; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif; color: rgb(75, 75, 75); background-color: rgb(255, 255, 255);">Dear All,</p><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; font-size: 14px; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif; color: rgb(75, 75, 75); background-color: rgb(255, 255, 255);"><br></p><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; font-size: 14px; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif; color: rgb(75, 75, 75); background-color: rgb(255, 255, 255);">My problem is that my VMs on different compute nodes are not communicating with each other (no ICMP/TCP/UDP connectivity). VMs on the same compute node can reach each other. The arp packets is flooded across the data path network but no reply is generated from the destination VM.</p><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; font-size: 14px; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif; color: rgb(75, 75, 75); background-color: rgb(255, 255, 255);"><br></p><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; font-size: 14px; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif; color: rgb(75, 75, 75); background-color: rgb(255, 255, 255);">I have a multi-node openstack havana deployment as follows:</p><ol style="list-style-position: initial; list-style-image: initial; margin-left: 30px; margin-bottom: 1em; padding-right: 0px; padding-left: 0px; color: rgb(75, 75, 75); font-family: Arial; font-size: 14px; line-height: 21px; background-color: rgb(255, 255, 255);"><li style="margin: 0px 0px 7px; padding: 0px; border: none; line-height: 18px;"><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif;">Controller (eth1=172.17.25.x) & (eth2 = no ip with promiscuous mode on for data traffic)</p></li><li style="margin: 0px 0px 7px; padding: 0px; border: none; line-height: 18px;"><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif;">Compute (eth1=172.17.25.x) & (eth2 = no ip with promiscuous mode on for data traffic)</p></li><li style="margin: 0px 0px 7px; padding: 0px; border: none; line-height: 18px;"><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif;">Compute (eth1=172.17.25.x) & (eth2 = no ip with promiscuous mode on for data traffic)</p></li><li style="margin: 0px 0px 7px; padding: 0px; border: none; line-height: 18px;"><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif;">Compute (eth1=172.17.25.x) & (eth2 = no ip with promiscuous mode on for data traffic)</p></li></ol><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; font-size: 14px; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif; color: rgb(75, 75, 75); background-color: rgb(255, 255, 255);"><br></p><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; font-size: 14px; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif; color: rgb(75, 75, 75); background-color: rgb(255, 255, 255);">I have configured two networks:</p><ol style="list-style-position: initial; list-style-image: initial; margin-left: 30px; margin-bottom: 1em; padding-right: 0px; padding-left: 0px; color: rgb(75, 75, 75); font-family: Arial; font-size: 14px; line-height: 21px; background-color: rgb(255, 255, 255);"><li style="margin: 0px 0px 7px; padding: 0px; border: none; line-height: 18px;"><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif;">External (172.17.25.x)</p></li><li style="margin: 0px 0px 7px; padding: 0px; border: none; line-height: 18px;"><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif;">Internal (192.168.1.x)</p></li></ol><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; font-size: 14px; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif; color: rgb(75, 75, 75); background-color: rgb(255, 255, 255);"><br></p><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; font-size: 14px; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif; color: rgb(75, 75, 75); background-color: rgb(255, 255, 255);">I have a router which connects these two networks:</p><ol style="list-style-position: initial; list-style-image: initial; margin-left: 30px; margin-bottom: 1em; padding-right: 0px; padding-left: 0px; color: rgb(75, 75, 75); font-family: Arial; font-size: 14px; line-height: 21px; background-color: rgb(255, 255, 255);"><li style="margin: 0px 0px 7px; padding: 0px; border: none; line-height: 18px;"><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif;">Port 1 on external network with ip=172.17.25.x</p></li><li style="margin: 0px 0px 7px; padding: 0px; border: none; line-height: 18px;"><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif;">Port 2 on internal network with ip=192.168.1.1</p></li></ol><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; font-size: 14px; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif; color: rgb(75, 75, 75); background-color: rgb(255, 255, 255);"><br></p><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; font-size: 14px; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif; color: rgb(75, 75, 75); background-color: rgb(255, 255, 255);">I have multiple virtual machines running on all the 3 compute nodes on 192.168.1.x network.</p><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; font-size: 14px; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif; color: rgb(75, 75, 75); background-color: rgb(255, 255, 255);">Here is what i have done so far to debug the issue: 1. I have verified the bridging information on control and compute nodes</p><ol style="list-style-position: initial; list-style-image: initial; margin-left: 30px; margin-bottom: 1em; padding-right: 0px; padding-left: 0px; color: rgb(75, 75, 75); font-family: Arial; font-size: 14px; line-height: 21px; background-color: rgb(255, 255, 255);"><li style="margin: 0px 0px 7px; padding: 0px; border: none; line-height: 18px;"><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif;">Packets leave the eth2 interface of the source VM's compute node and enter into the eth2 interface of the destination VM's compute node.</p></li><li style="margin: 0px 0px 7px; padding: 0px; border: none; line-height: 18px;"><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif;">The packets are being received by the br-compute and the vlans are also being translated</p></li><li style="margin: 0px 0px 7px; padding: 0px; border: none; line-height: 18px;"><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif;">br-int is not receiving the packets from br-compute and thus VM doesnt reply to the ARP packet.</p></li><li style="margin: 0px 0px 7px; padding: 0px; border: none; line-height: 18px;"><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif;">I have also dumped flows and checked the rules on the bridges and found 1 rule on br-compute which is translating the vlans but no rule on the br-int to re-translate the vlans back. I have added the rule myself but of no avail.</p></li><li style="margin: 0px 0px 7px; padding: 0px; border: none; line-height: 18px;"><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif;">Both the VMs are on the same vlan & physical switch is configured to allow all VLAN traffic on all interfaces</p></li></ol><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; font-size: 14px; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif; color: rgb(75, 75, 75); background-color: rgb(255, 255, 255);"><br></p><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; font-size: 14px; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif; color: rgb(75, 75, 75); background-color: rgb(255, 255, 255);">Compute Bridging info:</p><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; font-size: 14px; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif; color: rgb(75, 75, 75); background-color: rgb(255, 255, 255);">--> br-int = vm taps + int-br-compute</p><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; font-size: 14px; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif; color: rgb(75, 75, 75); background-color: rgb(255, 255, 255);">--> br-compute = eth2 + phy-br-compute</p><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; font-size: 14px; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif; color: rgb(75, 75, 75); background-color: rgb(255, 255, 255);"><br></p><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; font-size: 14px; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif; color: rgb(75, 75, 75); background-color: rgb(255, 255, 255);">If anyone can help me out with this then that would be great. Thanks.</p><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; font-size: 14px; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif; color: rgb(75, 75, 75); background-color: rgb(255, 255, 255);"><br></p><p style="margin-bottom: 14px; padding-right: 5px; padding-bottom: 5px; border: none; font-size: 14px; line-height: 1.4; font-family: 'Helvetica Neue', Arial, Helvetica, sans-serif; color: rgb(75, 75, 75); background-color: rgb(255, 255, 255);">Moiz Arif</p> </div></body>
</html>