<div dir="ltr">I did nothing besides a Compute Node reboot... Everything is back to normal now, few hours after restarting it...<div><br></div><div>It is easily to reproduce this, every time I reboot a Compute Node, some instances doesn't get its IP... Need to wait hours to get it back to normal, without any intervention...</div>
<div><br></div><div>Unfortunately, Havana have a LOT of network problems, I believe that all of its problems is related to "Per-Tenant Router with Private Networks" topology, it is almost useless (it is definitely not production-ready (this topology)), I mean, I'm using it here but, I'm "living on the edge" with Havana... One more problematic step, my cloud is dead...</div>
<div><br></div><div>Nothing unusual appeared at the Network Node DHCP log during this outage. I can enable the DEBUG and restart the Compute Node again, to see if I catch something but, it will interfere with my running tenants...</div>
<div><br></div><div>Tks!</div><div>Thiago</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On 18 November 2013 16:50, Razique Mahroua <span dir="ltr"><<a href="mailto:razique.mahroua@gmail.com" target="_blank">razique.mahroua@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">now, that's interesting, you didn't even restarted a service?<br>
Did you found something into the dhcp-agent logs?<br>
<div class="im"><br>
On 18 Nov 2013, at 10:46, Martinx - ジェームズ wrote:<br>
<br>
> Thank you Razique!<br>
><br>
> Out of nothing, all instances gets its IP automatically again, without even<br>
> restarting it... Have no idea about what had happened.<br>
><br>
> But, this is very weird, every time I restart a compute node, those network<br>
> problems appear... No idea about the source of this problem...<br>
><br>
> Tks again!<br>
><br>
> Best,<br>
> Thiago<br>
><br>
><br>
> On 18 November 2013 16:36, Razique Mahroua <<a href="mailto:razique.mahroua@gmail.com">razique.mahroua@gmail.com</a>>wrote:<br>
><br>
>> Check the dhcp-agent logs especially when you force a dhcp renew on these<br>
>> instances.<br>
>> Meanwhile, use tcpdump with:<br>
>> tcpdump -i ROUTER-INTERFACE -vvv -s 1500 '((port 67 or port 68) and<br>
>> (udp[8:1] = 0x1))'<br>
>><br>
>> if you want to check the DHCP paquets for a particular instance, get its<br>
>> mac and:<br>
>> tcpdump -i ROUTER-INTERFACE -vvv -s 1500 '((port 67 or port 68) and<br>
>> (udp[38:4] = 0xMAC-ADDR))'<br>
>><br>
>> Razique<br>
>><br>
>> On 18 Nov 2013, at 10:10, Martinx - ジェームズ wrote:<br>
>><br>
>> Okay... I'm calm... :-P<br>
>><br>
>> This is the second time I'm seeing this with Havana.<br>
>><br>
>> Compute Node reboots, lots of Instances doesn't get its IP anymore, look:<br>
</div>>> ------------------------------<br>
<div><div class="h5">>><br>
>> cloud-init start-local running: Mon, 18 Nov 2013 16:34:06 +0000. up 18.19<br>
>> seconds<br>
>> no instance data found in start-local<br>
>> cloud-init-nonet waiting 120 seconds for a network device.<br>
>> cloud-init-nonet gave up waiting for a network device.<br>
>> ci-info: lo : 1 127.0.0.1 255.0.0.0 .<br>
>> ci-info: eth0 : 1 . . fa:16:3e:a2:71:74<br>
>> route_info failed<br>
>> Waiting for network configuration...<br>
>> Waiting up to 60 more seconds for network configuration...<br>
>> Booting system without full network configuration...<br>
>><br>
>> New Instances that I launch right now, get its IP normally.<br>
>><br>
>> The only way to put the website online again now is: take a snapshot of a<br>
>> Instance without IP, launch a new instance based on that image, voialá!<br>
>> Instance gets its IP again... But this is non-viable.<br>
>><br>
>> I appreciate any help!<br>
>><br>
>> Tks!<br>
>> Thiago<br>
>><br>
>> On 18 November 2013 15:35, Razique Mahroua razique.mahroua@gmail.comwrote:<br>
>><br>
>> Hey Martin :)<br>
>> On 18 Nov 2013, at 8:40, Martinx - ジェームズ wrote:<br>
>><br>
>> Guys,<br>
>><br>
>> My Havana (Ubuntu based) Compute Node was restarted and lots of Instances<br>
>> does not get an IP anymore.<br>
>><br>
>> Tips?!<br>
>><br>
>> Stay clam<br>
>><br>
>> It is ramdom, I mean, some instances of this same compute node are<br>
>><br>
>> normal,<br>
>><br>
>> while others have no IP.<br>
>><br>
>> Are you reffering to the private IPs pool or the public. When you say<br>
>> "don't have", you mean they don't get allocated or the instances (DHCP? )<br>
>> don't retrieve it?<br>
>><br>
>> I really need help here because my client's web site is completely off<br>
>><br>
>> line<br>
>><br>
>> now...<br>
>><br>
>> I'm using Per-Tenant router with private networks + VXLAN.<br>
>><br>
>> Tks!<br>
>> Thiago<br>
</div></div>>> ------------------------------<br>
<div class="HOEnZb"><div class="h5">>><br>
>> Mailing list:<br>
>><br>
>> <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
>><br>
>> Post to : <a href="mailto:openstack@lists.openstack.org">openstack@lists.openstack.org</a><br>
>> Unsubscribe :<br>
>><br>
>> <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack</a><br>
>><br>
>><br>
</div></div></blockquote></div><br></div>