<html><head><meta http-equiv="Content-Type" content="text/html charset=windows-1252"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;">OK<div>can you show us:</div><div>• The fixed IP you are trying to reach. From the compute node it is running on, are you able to ping it?</div><div>• $iptables -L -nv -t nat</div><div>• What is the floating IP ; does it appear on the iptables’ output command?</div><div>• If you run $ip addr sh | grep $IP do you see the floating IP? (assuming you are using a multi_host mode, is that the case?)</div><div><br></div><div>Regards,</div><div>Razique</div><div><br><div><div>On Oct 28, 2013, at 1:59, Narayanan, Krishnaprasad <<a href="mailto:narayana@uni-mainz.de">narayana@uni-mainz.de</a>> wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite">
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0cm;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
span.EmailStyle19
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle20
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle21
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1"><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Hi Razique,<o:p></o:p></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">They are located on different compute nodes and allow incoming connections. The VMs that I referred have a fixed IP address. I could see the eth0 interface
and it has the fixed IP address.<o:p></o:p></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Thanks,<o:p></o:p></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Krishnaprasad<o:p></o:p></span></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm"><p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Razique Mahroua [<a href="mailto:razique.mahroua@gmail.com">mailto:razique.mahroua@gmail.com</a>]
<br>
<b>Sent:</b> Sonntag, 27. Oktober 2013 21:11<br>
<b>To:</b> Narayanan, Krishnaprasad<br>
<b>Subject:</b> Re: [Openstack] VMs unable to communicate between each other using their floating IPs<o:p></o:p></span></p>
</div>
</div><p class="MsoNormal"><o:p> </o:p></p><p class="MsoNormal">Are all located on the same compute node? <o:p></o:p></p>
<div><p class="MsoNormal">And all the instances allow incoming connection?<o:p></o:p></p>
</div>
<div><p class="MsoNormal"><o:p> </o:p></p>
</div>
<div><p class="MsoNormal">Finally make sure the instance you cannot reach have a private IP assigned (not through the dash but check the logs to make sure the instance has indeed an interface up ; usually eth0)<o:p></o:p></p>
</div>
<div><p class="MsoNormal"><o:p> </o:p></p>
</div>
<div><p class="MsoNormal">- Razique<o:p></o:p></p>
</div>
<div><p class="MsoNormal"><o:p> </o:p></p>
<div>
<div><p class="MsoNormal">On Oct 27, 2013, at 9:48, Narayanan, Krishnaprasad <<a href="mailto:narayana@uni-mainz.de">narayana@uni-mainz.de</a>> wrote:<o:p></o:p></p>
</div><p class="MsoNormal"><br>
<br>
<o:p></o:p></p>
<div><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">I could see a strange behavior. I restarted the nova-compute and nova-network. I was able to reach certain floating IPs and few was not. Can I know the reason
behind this and some pointers to get rid of this problem?</span><o:p></o:p></p><p class="MsoNormal"> <o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm"><p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Razique Mahroua [<a href="mailto:razique.mahroua@gmail.com">mailto:razique.mahroua@gmail.com</a>]
<br>
<b>Sent:</b> Sonntag, 27. Oktober 2013 17:26<br>
<b>To:</b> Narayanan, Krishnaprasad<br>
<b>Cc:</b> Oleg Gelbukh; <a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a><br>
<b>Subject:</b> Re: [Openstack] VMs unable to communicate between each other using their floating IPs</span><o:p></o:p></p>
</div>
</div><p class="MsoNormal"> <o:p></o:p></p><p class="MsoNormal">I think that restarting the nova-network and nova-compute services would be sufficient :)<o:p></o:p></p>
<div><p class="MsoNormal"> <o:p></o:p></p>
<div>
<div><p class="MsoNormal">On Oct 27, 2013, at 9:14, Narayanan, Krishnaprasad <<a href="mailto:narayana@uni-mainz.de">narayana@uni-mainz.de</a>> wrote:<o:p></o:p></p>
</div><p class="MsoNormal"><br>
<br>
<br>
<o:p></o:p></p>
<div><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Hi,</span><o:p></o:p></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Thanks for your response. I don’t see this setting in my nova.conf. Will it be possible for you to describe the complete command of recreating the floating
IPs with –interface flag?</span><o:p></o:p></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Regards,</span><o:p></o:p></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Krishnaprasad</span><o:p></o:p></p><p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Oleg Gelbukh [<a href="mailto:ogelbukh@mirantis.com">mailto:ogelbukh@mirantis.com</a>]
<br>
<b>Sent:</b> Sonntag, 27. Oktober 2013 16:40<br>
<b>To:</b> Narayanan, Krishnaprasad<br>
<b>Cc:</b> <a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a><br>
<b>Subject:</b> Re: [Openstack] VMs unable to communicate between each other using their floating IPs</span><o:p></o:p></p><p class="MsoNormal"> <o:p></o:p></p>
<div><p class="MsoNormal">Narayan,<o:p></o:p></p>
<div><p class="MsoNormal"> <o:p></o:p></p>
</div>
<div><p class="MsoNormal">Are you using multi-host? Is 'public_interface' in your nova.conf set?<o:p></o:p></p>
</div>
<div><p class="MsoNormal"> <o:p></o:p></p>
</div>
<div><p class="MsoNormal">Recently we've had similar situation with a customer. Turned out that traffic going from VM's fixed IP to floating IP of another VM on the same physical host never gets to public interface and thus never SNATed, and response never gets
back.<o:p></o:p></p>
</div>
<div><p class="MsoNormal"> <o:p></o:p></p>
</div>
<div><p class="MsoNormal">We fixed it by unsetting 'public_interface' and re-creating floating IPs with --interface=<public_interface> flag. It ensures that all packets from VMs are source-translated, and also that floating IPs are assigned to correct interface.<o:p></o:p></p>
</div>
<div><p class="MsoNormal"> <o:p></o:p></p>
</div>
<div><p class="MsoNormal">Hope that helps.<o:p></o:p></p>
</div>
<div><p class="MsoNormal"> <o:p></o:p></p>
</div>
<div><p class="MsoNormal">--<o:p></o:p></p>
</div>
<div><p class="MsoNormal">Best regards,<br>
Oleg Gelbukh<o:p></o:p></p>
</div>
<div><p class="MsoNormal">Mirantis Labs<o:p></o:p></p>
</div>
</div>
<div><p class="MsoNormal" style="margin-bottom:12.0pt"> <o:p></o:p></p>
<div><p class="MsoNormal">On Fri, Oct 25, 2013 at 11:41 PM, Narayanan, Krishnaprasad <<a href="mailto:narayana@uni-mainz.de" target="_blank">narayana@uni-mainz.de</a>> wrote:<o:p></o:p></p>
<div>
<div><p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="DE">Hi all,</span><o:p></o:p></p><p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="DE"> </span><o:p></o:p></p><p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Im my OpenStack setup, i am using nova-network to manage the networks. I could see that the VMs are unable to communicate between each other via their floating IPs.<o:p></o:p></p><p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p><p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Can I know what is the reason and how to get rid of the problem?<o:p></o:p></p><p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p><p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Thanks,<o:p></o:p></p><p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Krishnaprasad<o:p></o:p></p>
</div>
</div><p class="MsoNormal" style="margin-bottom:12.0pt"><br>
_______________________________________________<br>
Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
Post to : <a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a><br>
Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><o:p></o:p></p>
</div><p class="MsoNormal"> <o:p></o:p></p>
</div>
</div><p class="MsoNormal">_______________________________________________<br>
Mailing list: <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack">
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
Post to : <a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a><br>
Unsubscribe : <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack">
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><o:p></o:p></p>
</div><p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
</div><p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</div>
</blockquote></div><br></div></body></html>