I've raised <a href="https://bugs.launchpad.net/nova/+bug/967166">https://bugs.launchpad.net/nova/+bug/967166</a> to track this issue.<div><br></div><div>Kev</div><div><br><div class="gmail_quote">On 28 March 2012 14:16, Kevin Jackson <span dir="ltr"><<a href="mailto:kevin@linuxservices.co.uk">kevin@linuxservices.co.uk</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">It does appear that the database is updated (see a reply a few moments ago) at the correct point... an explanation of what the tool is/isn't doing will go a long way in helping me work out what I should be using the tools for / configuration.<div>
To an end user - it appears to take anywhere between a few minutes and 10 mins before an instance is accessible - but looking at what is happening the instance is ready within seconds - so something is amiss with the supplied tools.</div>
<div><br></div><div>Cheers,</div><div><br></div><div>Kev<div><div class="h5"><br><br><div class="gmail_quote">On 28 March 2012 14:11, Kiall Mac Innes <span dir="ltr"><<a href="mailto:kiall@managedit.ie" target="_blank">kiall@managedit.ie</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><stab in the dark><div>Have you kept an eye on the mysql table itself, rather than relying on the cli tools / dashboard that may very well cache the data?<br clear="all">
</stab in the dark><br><br>Thanks,<br>Kiall<br>
<br><br><div class="gmail_quote"><div><div>On Wed, Mar 28, 2012 at 1:58 PM, Kevin Jackson <span dir="ltr"><<a href="mailto:kevin@linuxservices.co.uk" target="_blank">kevin@linuxservices.co.uk</a>></span> wrote:<br>
</div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div>
Cheers Phil,<div>It's not that I can't get to the instances - I'd assume it was an ARP issue at that point - its the fact that Nova hasn't notified me that it has assigned an IP address: see my additional note where I guessed an IP address it would've assigned and I could access it... but management tools were still blissfully unaware.</div>
<div>I used to have a working Diablo set up with pretty much this same set up (this is under Essex RC1 / Ubuntu 12.04) and never had an issue.</div><div><br></div><div>This just looks like it has assigned the IP to the instance, but hasn't notified the management underbelly of MySQL so any client tools interrogating the instance doesn't see that nova has done this work already.</div>
<div><br></div><div>Kev<div><div><br><br><div class="gmail_quote">On 28 March 2012 13:04, Day, Phil <span dir="ltr"><<a href="mailto:philip.day@hp.com" target="_blank">philip.day@hp.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="EN-GB" link="blue" vlink="purple"><div><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Are you sure that its Nova that is taking the time to associate the IP, and not an ARP issue in your network ?<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"> I’ve seen this behaviour when quickly reusing floating IP addresses – Nova does the assignment and sends out an unsolicited ARP response (assuming you have the “send_arp_for_ha” flag set) – this is in network/linux_net.bind_floating_ip(). However sometimes an unsolicited APR response can get dropped in the network, ad so if the switch doesn’t see this message and it already has a previous ARP mapping in its cache then it will continue to try and send traffic to the previous user of that address until the cache times out. <u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Note that some network failover systems send multiple requests to get more certainty around this (for example I’ve seen a VPN solution use 6 messages).<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">There are a couple of things you could try:<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p style="margin-left:54.0pt"><u></u><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><span>-<span style="font:7.0pt "Times New Roman""> </span></span></span><u></u><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Add a flag to be able to increase the number of arp_responses sent<u></u><u></u></span></p>
<p style="margin-left:54.0pt"><u></u><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><span>-<span style="font:7.0pt "Times New Roman""> </span></span></span><u></u><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Change the allocation of floating_ips so that instead of picking the first free one in the DB you pick the one which has been unused for the longest time (reduces the risk of reusing an address before the switch times out the entry in its cache).<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Phil<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> openstack-bounces+philip.day=<a href="mailto:hp.com@lists.launchpad.net" target="_blank">hp.com@lists.launchpad.net</a> [mailto:<a href="mailto:openstack-bounces%2Bphilip.day" target="_blank">openstack-bounces+philip.day</a>=<a href="mailto:hp.com@lists.launchpad.net" target="_blank">hp.com@lists.launchpad.net</a>] <b>On Behalf Of </b>Kevin Jackson<br>
<b>Sent:</b> 28 March 2012 12:49<br><b>To:</b> <a href="mailto:openstack@lists.launchpad.net" target="_blank">openstack@lists.launchpad.net</a><br><b>Subject:</b> [Openstack] Auto Assigned Floating IPs take a long time to associate<u></u><u></u></span></p>
<div><div><p class="MsoNormal"><u></u> <u></u></p><p class="MsoNormal">Hi all,<u></u><u></u></p><div><p class="MsoNormal">I've got the following set in my nova.conf:<u></u><u></u></p></div><div><p class="MsoNormal">
<u></u> <u></u></p></div><div><p class="MsoNormal">--auto_assign_floating_ip<u></u><u></u></p></div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">and I fire up an instance.<u></u><u></u></p>
</div><div><p class="MsoNormal">Everything works, a private IP is assigned... the instance is running... but it can take an inordinate amount of time (anywhere upwards of 2 mins, sometimes a lot longer) to associate a floating IP automatically.<u></u><u></u></p>
</div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">Anybody else experienced this? Any clues on what I can do to troubleshoot this? What is the condition when a Floating IP is assigned? I've seen it assign Floating IPs very quickly when it is still Booting, not Active, say.<u></u><u></u></p>
</div><div><p class="MsoNormal">Is it dependent on anything within the Instance itself?<u></u><u></u></p></div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">Cheers,<u></u><u></u></p></div><div>
<p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">Kev<u></u><u></u></p></div><div><p class="MsoNormal">-- <br>Kevin Jackson<br>@itarchitectkev<u></u><u></u></p></div></div></div></div></div></blockquote>
</div><br><br clear="all"><div><br></div></div></div><span><font color="#888888">-- <br>Kevin Jackson<br>@itarchitectkev<br>
</font></span></div>
<br></div></div>_______________________________________________<br>
Mailing list: <a href="https://launchpad.net/~openstack" target="_blank">https://launchpad.net/~openstack</a><br>
Post to : <a href="mailto:openstack@lists.launchpad.net" target="_blank">openstack@lists.launchpad.net</a><br>
Unsubscribe : <a href="https://launchpad.net/~openstack" target="_blank">https://launchpad.net/~openstack</a><br>
More help : <a href="https://help.launchpad.net/ListHelp" target="_blank">https://help.launchpad.net/ListHelp</a><br>
<br></blockquote></div><br></div>
</blockquote></div><br><br clear="all"><div><br></div></div></div><span class="HOEnZb"><font color="#888888">-- <br>Kevin Jackson<br>@itarchitectkev<br>
</font></span></div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br>Kevin Jackson<br>@itarchitectkev<br>
</div>