<div dir="ltr"><div><div><div>Hi All,<br></div>i have the same problem with Grizzly, Ubuntu 12.04 and Dnsmasq 2.59<br></div>"killall dnsmasq && service quantum-dhcp-agent restart" fixes the problem <span id="result_box" class="" lang="en"><span class="">temporarily</span></span><br>
</div><div></div><br><div>Best Regards,<br></div><div>Marco<br></div><div><br><div><div><br></div></div></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/5/22 Thomas Kärgel <span dir="ltr"><<a href="mailto:kaergel@b1-systems.de" target="_blank">kaergel@b1-systems.de</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi Johanna,<br>
<br>
sure, I'll report my results, but this can take a while. The last time<br>
this issue occurred on my environment is May 10th. It occurs quite<br>
sporadic and i don't know how to manually reproduce this issue yet (i<br>
have to be very careful with my experiments since the environment is<br>
running productive already). Maybe you should also give dnsmasq 2.66 a<br>
try, because you wrote that you can manually reproduce this behavior.<br>
<br>
<br>
Best Regards,<br>
Thomas<br>
<br>
<br>
Am 20.05.2013 12:25, schrieb Heinonen, Johanna (NSN - FI/Espoo):<br>
<div class="HOEnZb"><div class="h5">> Hi,<br>
><br>
> You are right. Manually doing kill -HUP <PID> has just the effect you mentioned. In the syslog you can see<br>
><br>
> May 20 13:09:41 grizzly-236 dnsmasq[6170]: cleared cache<br>
> May 20 13:09:41 grizzly-236 dnsmasq-dhcp[6170]: read /var/lib/quantum/dhcp/d5879bbb-ada6-4323-a7b1-87b5db244513/host<br>
> May 20 13:09:41 grizzly-236 dnsmasq-dhcp[6170]: read /var/lib/quantum/dhcp/d5879bbb-ada6-4323-a7b1-87b5db244513/opts<br>
><br>
><br>
> But the problem stays. Only 'service quantum-dhcp-agent restart' fixes the problem.<br>
> If you try the newer version of the qnsmasq, I'd be interested to hear the results.<br>
><br>
> BR<br>
> Johanna<br>
><br>
><br>
><br>
> -----Original Message-----<br>
> From: ext Thomas Kärgel [mailto:<a href="mailto:kaergel@b1-systems.de">kaergel@b1-systems.de</a>]<br>
> Sent: Monday, May 20, 2013 11:37 AM<br>
> To: Heinonen, Johanna (NSN - FI/Espoo)<br>
> Cc: <a href="mailto:openstack@lists.launchpad.net">openstack@lists.launchpad.net</a><br>
> Subject: Re: [Openstack] DHCP problem in grizzly<br>
><br>
> Hi,<br>
><br>
> thx for the interesting info, Johanna: dnsmasq version is also 2.59 on<br>
> my environment. Can you can confirm that manually sigHUPing all running<br>
> dnsmasq processes has no effect?<br>
> (dnsmasq claims to have reread the configs in syslog, but still refuses<br>
> to deliver the new addresses.)<br>
> Maybe updating dnsmasq to a more recent release would solve our problem.<br>
> Current stable is 2.66. I'll give it a try when i get back to office<br>
> tomorrow.<br>
><br>
> Best regards<br>
><br>
> Thomas<br>
><br>
><br>
> Am 20.05.2013 10:21, schrieb Heinonen, Johanna (NSN - FI/Espoo):<br>
>> Hi Thomas,<br>
>><br>
>> I am using Ubuntu12.04 and the dnsmasq version is 2.59<br>
>><br>
>> BR<br>
>> Johanna<br>
>><br>
>><br>
>> -----Original Message-----<br>
>> From: Openstack [mailto:<a href="mailto:openstack-bounces%2Bjohanna.heinonen">openstack-bounces+johanna.heinonen</a>=<a href="mailto:nsn.com@lists.launchpad.net">nsn.com@lists.launchpad.net</a>] On Behalf Of ext Thomas Kärgel<br>
>> Sent: Monday, May 20, 2013 10:09 AM<br>
>> To: <a href="mailto:openstack@lists.launchpad.net">openstack@lists.launchpad.net</a><br>
>> Subject: Re: [Openstack] DHCP problem in grizzly<br>
>><br>
>> Hi Johanna,<br>
>><br>
>> I'm facing the same behavior on a Folsom-installation on SLES11SP2. I<br>
>> noticed that new hosts have correct entries in the dnsmasq config-files.<br>
>> The dnsmasq processes get a HUP signal by DHCP-Agent, but simply refuse<br>
>> to deliver the new address. Instead dnsmasq logs claim "no address<br>
>> available". Exactly like in your description.<br>
>> What distrubtion and exact dnsmasq-versions are in use on your environment?<br>
>> I assume dnsmasq is not rereading its configs correctly on signal HUP.<br>
>> dnsmasq logs claim it has reread configs, but it still does not deliver<br>
>> the new adresses in host-file.<br>
>> Manually trying to sigHUP dnsmasq had no effect. The only way to get out<br>
>> of this state seems to be restarting DHCP-agent.<br>
>><br>
>> Best regards<br>
>> Thomas<br>
>><br>
>> Am 20.05.2013 08:51, schrieb Heinonen, Johanna (NSN - FI/Espoo):<br>
>>> Hi,<br>
>>><br>
>>> I have installed grizzly with quantum and ovs-plugin. It seems that<br>
>>> grizzly allocates the third address of each subnet for dhcp. (In folsom<br>
>>> it was the second address). This means that the VMs will get addresses<br>
>>> .2, .4, .5, .<br>
>>><br>
>>> In my setup the first VM always boots fine and gets the address x.x.x.2.<br>
>>> This can be seen in the syslog:<br>
>>><br>
>>> May 20 08:29:23 grizzly-236 dnsmasq-dhcp[2190]:<br>
>>> DHCPDISCOVER(tapdbcef145-f5) 10.0.2.15 fa:16:3e:2d:0d:e0<br>
>>> May 20 08:29:23 grizzly-236 dnsmasq-dhcp[2190]:<br>
>>> DHCPOFFER(tapdbcef145-f5) 10.20.30.2 fa:16:3e:2d:0d:e0<br>
>>> May 20 08:29:23 grizzly-236 dnsmasq-dhcp[2190]:<br>
>>> DHCPREQUEST(tapdbcef145-f5) 10.20.30.2 fa:16:3e:2d:0d:e0<br>
>>> May 20 08:29:23 grizzly-236 dnsmasq-dhcp[2190]: DHCPACK(tapdbcef145-f5)<br>
>>> 10.20.30.2 fa:16:3e:2d:0d:e0 10-20-30-2<br>
>>><br>
>>> The problem comes when I start the second VM. Nova shows that the<br>
>>> x.x.x.4 is allocated<br>
>>><br>
>>> root@grizzly-236:~# nova list<br>
>>> +--------------------------------------+----------+--------+------------------------+<br>
>>> | ID | Name | Status |<br>
>>> Networks |<br>
>>> +--------------------------------------+----------+--------+------------------------+<br>
>>> | c112ccbb-5039-4d05-b414-b53a1eafa2d8 | q-test | ACTIVE |<br>
>>> tenant1-net=10.20.30.2 |<br>
>>> | 4f26975c-995d-403d-88b0-e7bbf189baad | q-test-2 | ACTIVE |<br>
>>> tenant1-net=10.20.30.4 |<br>
>>> +--------------------------------------+----------+--------+------------------------+<br>
>>><br>
>>> But from syslog I see that the answer to the DHCPDISCOVER is "no address<br>
>>> available"<br>
>>><br>
>>> May 20 08:33:34 grizzly-236 dnsmasq-dhcp[2190]:<br>
>>> DHCPDISCOVER(tapdbcef145-f5) 10.0.2.15 fa:16:3e:fc:1f:9a no address<br>
>>> available<br>
>>> May 20 08:33:52 grizzly-236 dnsmasq-dhcp[2190]:<br>
>>> DHCPDISCOVER(tapdbcef145-f5) 10.0.2.15 fa:16:3e:fc:1f:9a no address<br>
>>> available<br>
>>><br>
>>> When I restart the quantum-dhcp-server the problem disappears. This can<br>
>>> be seen from the syslog:<br>
>>><br>
>>> May 20 09:01:40 grizzly-236 dnsmasq[7235]: started, version 2.59<br>
>>> cachesize 150<br>
>>> May 20 09:01:40 grizzly-236 dnsmasq[7235]: compile time options: IPv6<br>
>>> GNU-getopt DBus i18n DHCP TFTP conntrack IDN<br>
>>> May 20 09:01:40 grizzly-236 dnsmasq[7235]: warning: no upstream servers<br>
>>> configured<br>
>>> May 20 09:01:40 grizzly-236 dnsmasq-dhcp[7235]: DHCP, static leases only<br>
>>> on 10.20.30.0, lease time 2m<br>
>>> May 20 09:01:40 grizzly-236 dnsmasq[7235]: cleared cache<br>
>>> May 20 09:01:40 grizzly-236 dnsmasq-dhcp[7235]: read<br>
>>> /var/lib/quantum/dhcp/e6f27330-be41-478c-b4d2-49ed4ce0af00/host<br>
>>> May 20 09:01:40 grizzly-236 dnsmasq-dhcp[7235]: read<br>
>>> /var/lib/quantum/dhcp/e6f27330-be41-478c-b4d2-49ed4ce0af00/opts<br>
>>> May 20 09:02:19 grizzly-236 dnsmasq-dhcp[7235]:<br>
>>> DHCPREQUEST(tapdbcef145-f5) 10.20.30.2 fa:16:3e:2d:0d:e0<br>
>>> May 20 09:02:19 grizzly-236 dnsmasq-dhcp[7235]: DHCPNAK(tapdbcef145-f5)<br>
>>> 10.20.30.2 fa:16:3e:2d:0d:e0 lease not found<br>
>>> May 20 09:02:19 grizzly-236 dnsmasq-dhcp[7235]:<br>
>>> DHCPDISCOVER(tapdbcef145-f5) fa:16:3e:2d:0d:e0<br>
>>> May 20 09:02:19 grizzly-236 dnsmasq-dhcp[7235]:<br>
>>> DHCPOFFER(tapdbcef145-f5) 10.20.30.2 fa:16:3e:2d:0d:e0<br>
>>> May 20 09:02:19 grizzly-236 dnsmasq-dhcp[7235]:<br>
>>> DHCPREQUEST(tapdbcef145-f5) 10.20.30.2 fa:16:3e:2d:0d:e0<br>
>>> May 20 09:02:19 grizzly-236 dnsmasq-dhcp[7235]: DHCPACK(tapdbcef145-f5)<br>
>>> 10.20.30.2 fa:16:3e:2d:0d:e0 10-20-30-2<br>
>>><br>
>>> *May 20 09:03:39 grizzly-236 dnsmasq-dhcp[7235]:<br>
>>> DHCPDISCOVER(tapdbcef145-f5) fa:16:3e:fc:1f:9a*<br>
>>> *May 20 09:03:39 grizzly-236 dnsmasq-dhcp[7235]:<br>
>>> DHCPOFFER(tapdbcef145-f5) 10.20.30.4 fa:16:3e:fc:1f:9a*<br>
>>> *May 20 09:03:39 grizzly-236 dnsmasq-dhcp[7235]:<br>
>>> DHCPREQUEST(tapdbcef145-f5) 10.20.30.4 fa:16:3e:fc:1f:9a*<br>
>>> *May 20 09:03:39 grizzly-236 dnsmasq-dhcp[7235]: DHCPACK(tapdbcef145-f5)<br>
>>> 10.20.30.4 fa:16:3e:fc:1f:9a 10-20-30-4*<br>
>>><br>
>>><br>
>>> What could be the problem? Have you seen similar behavior? If yes, how<br>
>>> did you fix this?<br>
>>><br>
>>> Best regards,<br>
>>> Johanna<br>
>>><br>
>>><br>
>>><br>
>>> _______________________________________________<br>
>>> Mailing list: <a href="https://launchpad.net/~openstack" target="_blank">https://launchpad.net/~openstack</a><br>
>>> Post to : <a href="mailto:openstack@lists.launchpad.net">openstack@lists.launchpad.net</a><br>
>>> Unsubscribe : <a href="https://launchpad.net/~openstack" target="_blank">https://launchpad.net/~openstack</a><br>
>>> More help : <a href="https://help.launchpad.net/ListHelp" target="_blank">https://help.launchpad.net/ListHelp</a><br>
>>><br>
>><br>
>><br>
><br>
><br>
<br>
<br>
--<br>
Thomas Kärgel<br>
Linux Consultant<br>
Mail: <a href="mailto:kaergel@b1-systems.de">kaergel@b1-systems.de</a><br>
B1 Systems GmbH<br>
Osterfeldstraße 7 / 85088 Vohburg / <a href="http://www.b1-systems.de" target="_blank">http://www.b1-systems.de</a><br>
GF: Ralph Dehner / Unternehmenssitz: Vohburg / AG: Ingolstadt,HRB 3537<br>
<br>
</div></div><br>_______________________________________________<br>
Mailing list: <a href="https://launchpad.net/~openstack" target="_blank">https://launchpad.net/~openstack</a><br>
Post to : <a href="mailto:openstack@lists.launchpad.net">openstack@lists.launchpad.net</a><br>
Unsubscribe : <a href="https://launchpad.net/~openstack" target="_blank">https://launchpad.net/~openstack</a><br>
More help : <a href="https://help.launchpad.net/ListHelp" target="_blank">https://help.launchpad.net/ListHelp</a><br>
<br></blockquote></div><br><br clear="all"><br>-- <br>Marco Colombo
</div>