<div dir="ltr"><div><div><div>Neil, much thanks !!!<br><br></div>Any idea if i can go and only run apt-get --only-upgrade install <packagename>  or that will be too crazy?<br><br></div>Cheers,<br></div>Dani<br><div><div><div><div><br></div></div></div></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Jul 1, 2015 at 9:23 AM, Neil Jerram <span dir="ltr"><<a href="mailto:Neil.Jerram@metaswitch.com" target="_blank">Neil.Jerram@metaswitch.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Well, the bug discussion seems to point specifically to this dnsmasq fix:<br>
<br>
<a href="http://thekelleys.org.uk/gitweb/?p=dnsmasq.git;a=commit;h=9380ba70d67db6b69f817d8e318de5ba1e990b12" rel="noreferrer" target="_blank">http://thekelleys.org.uk/gitweb/?p=dnsmasq.git;a=commit;h=9380ba70d67db6b69f817d8e318de5ba1e990b12</a><br>
<br>
        Neil<span class=""><br>
<br>
<br>
On 01/07/15 07:34, Daniel Comnea wrote:<br>
</span><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span class="">
Hi,<br>
<br>
sorry for no feedback, i've been doing more and more test and after<br>
enabled the dnsmasq log i found the error which i'm not longer sure if<br>
is related to having duplicated entries<br>
<br>
dnsmasq-dhcp[21231]: 0 DHCPRELEASE(tap8ecf66b6-72) 192.168.111.24<br>
fa:16:3e:72:04:82 unknown lease<br>
<br>
Looking around it seems i'm hitting this bug [1] but not clear from the<br>
description what was the problem on dnsmasp 2.59 (which comes wiht Fuel 5.1)<br>
<br>
Any ideas?<br>
<br>
Cheers,<br>
Dani<br>
<br>
[1] <a href="https://bugs.launchpad.net/neutron/+bug/1271344" rel="noreferrer" target="_blank">https://bugs.launchpad.net/neutron/+bug/1271344</a><br>
<br>
On Wed, Jun 10, 2015 at 7:13 AM, Daniel Comnea <<a href="mailto:comnea.dani@gmail.com" target="_blank">comnea.dani@gmail.com</a><br></span><span class="">
<mailto:<a href="mailto:comnea.dani@gmail.com" target="_blank">comnea.dani@gmail.com</a>>> wrote:<br>
<br>
    Thanks a bunch Kevin!<br>
<br>
    I'll try this patch and report back.<br>
<br>
    Dani<br>
<br>
<br>
    On Tue, Jun 9, 2015 at 2:50 AM, Kevin Benton <<a href="mailto:blak111@gmail.com" target="_blank">blak111@gmail.com</a><br></span><div><div class="h5">
    <mailto:<a href="mailto:blak111@gmail.com" target="_blank">blak111@gmail.com</a>>> wrote:<br>
<br>
        Hi Daniel,<br>
<br>
        I'm concerned that we are encountered out-of-order port events<br>
        on the DHCP agent side so the delete message is processed before<br>
        the create message. Would you be willing to apply a small patch<br>
        to your dhcp agent to see if it fixes the issue?<br>
<br>
        If it does fix the issue, you should see occasional warnings in<br>
        the DHCP agent log that show "Received message for port that was<br>
        already deleted". If it doesn't fix the issue, we may be losing<br>
        the delete event entirely. If that's the case, it would be great<br>
        if you can enable debuging on the agent and upload a log of a<br>
        run when it happens.<br>
<br>
        Cheers,<br>
        Kevin Benton<br>
<br>
        Here is the patch:<br>
<br>
        diff --git a/neutron/agent/dhcp_agent.py<br>
        b/neutron/agent/dhcp_agent.py<br>
        index 71c9709..9b9b637 100644<br>
        --- a/neutron/agent/dhcp_agent.py<br>
        +++ b/neutron/agent/dhcp_agent.py<br>
        @@ -71,6 +71,7 @@ class DhcpAgent(manager.Manager):<br>
                  self.needs_resync = False<br>
                  self.conf = cfg.CONF<br>
                  self.cache = NetworkCache()<br>
        +        self.deleted_ports = set()<br>
                  self.root_helper = config.get_root_helper(self.conf)<br>
                  self.dhcp_driver_cls =<br>
        importutils.import_class(self.conf.dhcp_driver)<br>
                  ctx = context.get_admin_context_without_session()<br>
        @@ -151,6 +152,7 @@ class DhcpAgent(manager.Manager):<br>
                  LOG.info(_('Synchronizing state'))<br>
                  pool = eventlet.GreenPool(cfg.CONF.num_sync_threads)<br>
                  known_network_ids = set(self.cache.get_network_ids())<br>
        +        self.deleted_ports = set()<br>
<br>
                  try:<br>
                      active_networks =<br>
        self.plugin_rpc.get_active_networks_info()<br>
        @@ -302,6 +304,10 @@ class DhcpAgent(manager.Manager):<br>
              @utils.synchronized('dhcp-agent')<br>
              def port_update_end(self, context, payload):<br>
                  """Handle the port.update.end notification event."""<br>
        +        if payload['port']['id'] in self.deleted_ports:<br>
        +            LOG.warning(_("Received message for port that was "<br>
        +                          "already deleted: %s"),<br>
        payload['port']['id'])<br>
        +            return<br>
                  updated_port = dhcp.DictModel(payload['port'])<br>
                  network =<br>
        self.cache.get_network_by_id(updated_port.network_id)<br>
                  if network:<br>
        @@ -315,6 +321,7 @@ class DhcpAgent(manager.Manager):<br>
              def port_delete_end(self, context, payload):<br>
                  """Handle the port.delete.end notification event."""<br>
                  port = self.cache.get_port_by_id(payload['port_id'])<br>
        +        self.deleted_ports.add(payload['port_id'])<br>
                  if port:<br>
                      network =<br>
        self.cache.get_network_by_id(port.network_id)<br>
                      self.cache.remove_port(port)<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
        On Mon, Jun 8, 2015 at 8:26 AM, Daniel Comnea<br></div></div><span class="">
        <<a href="mailto:comnea.dani@gmail.com" target="_blank">comnea.dani@gmail.com</a> <mailto:<a href="mailto:comnea.dani@gmail.com" target="_blank">comnea.dani@gmail.com</a>>> wrote:<br>
<br>
            Any help, ideas please?<br>
<br>
            Thx,<br>
            Dani<br>
<br>
            On Mon, Jun 8, 2015 at 9:25 AM, Daniel Comnea<br></span><span class="">
            <<a href="mailto:comnea.dani@gmail.com" target="_blank">comnea.dani@gmail.com</a> <mailto:<a href="mailto:comnea.dani@gmail.com" target="_blank">comnea.dani@gmail.com</a>>> wrote:<br>
<br>
                + Operators<br>
<br>
                Much thanks in advance,<br>
                Dani<br>
<br>
<br>
<br>
<br>
                On Sun, Jun 7, 2015 at 6:31 PM, Daniel Comnea<br></span>
                <<a href="mailto:comnea.dani@gmail.com" target="_blank">comnea.dani@gmail.com</a> <mailto:<a href="mailto:comnea.dani@gmail.com" target="_blank">comnea.dani@gmail.com</a>>><span class=""><br>
                wrote:<br>
<br>
                    Hi all,<br>
<br>
                    I'm running IceHouse (build using Fuel 5.1.1) on<br>
                    Ubuntu where dnsmask version 2.59-4.<br>
                    I have a very basic network layout where i have a<br>
                    private net which has 2 subnets<br>
<br>
                      2fb7de9d-d6df-481f-acca-2f7860cffa60 |<br>
                    private-net                                       |<br>
                    e79c3477-d3e5-471c-a728-8d881cf31bee<br></span>
                    <a href="http://192.168.110.0/24" rel="noreferrer" target="_blank">192.168.110.0/24</a> <<a href="http://192.168.110.0/24" rel="noreferrer" target="_blank">http://192.168.110.0/24</a>> |<br>
                    |<br>
                    |<br>
                                          |<br>
                    f48c3223-8507-455c-9c13-8b727ea5f441<br>
                    <a href="http://192.168.111.0/24" rel="noreferrer" target="_blank">192.168.111.0/24</a> <<a href="http://192.168.111.0/24" rel="noreferrer" target="_blank">http://192.168.111.0/24</a>> |<br>
<br><div><div class="h5">
                    and i'm creating VMs via HEAT.<br>
                    What is happening is that sometimes i get duplicated<br>
                    entries in [1] and because of that the VM which was<br>
                    spun up doesn't get an ip.<br>
                    The Dnsmask processes are running okay [2] and i<br>
                    can't see anything special/ wrong in it.<br>
<br>
                    Any idea why this is happening? Or are you aware of<br>
                    any bugs around this area? Do you see a problems<br>
                    with having 2 subnets mapped to 1 private-net?<br>
<br>
<br>
<br>
                    Thanks,<br>
                    Dani<br>
<br>
                    [1]<br>
                    /var/lib/neutron/dhcp/2fb7de9d-d6df-481f-acca-2f7860cffa60/addn_hosts<br>
<br>
                    [2]<br>
<br>
                    nobody    5664     1  0 Jun02 ?        00:00:08<br>
                    dnsmasq --no-hosts --no-resolv --strict-order<br>
                    --bind-interfaces --interface=tapc9164734-0c<br>
                    --except-interface=lo<br>
                    --pid-file=/var/lib/neutron/dhcp/2fb7de9d-d6df-481f-acca-2f7860cffa60/pid<br>
                    --dhcp-hostsfile=/var/lib/neutron/dhcp/2fb7de9d-d6df-481f-acca-2f7860cffa60/host<br>
                    --addn-hosts=/var/lib/neutron/dhcp/2fb7de9d-d6df-481f-acca-2f7860cffa60/addn_hosts<br>
                    --dhcp-optsfile=/var/lib/neutron/dhcp/2fb7de9d-d6df-481f-acca-2f7860cffa60/opts<br>
                    --leasefile-ro --dhcp-authoritative<br>
                    --dhcp-range=set:tag0,192.168.110.0,static,86400s<br>
                    --dhcp-range=set:tag1,192.168.111.0,static,86400s<br>
                    --dhcp-lease-max=512 --conf-file= --server=10.0.0.31<br>
                    --server=10.0.0.32 --domain=openstacklocal<br>
<br>
<br>
<br>
<br>
            _______________________________________________<br>
            OpenStack-operators mailing list<br>
            <a href="mailto:OpenStack-operators@lists.openstack.org" target="_blank">OpenStack-operators@lists.openstack.org</a><br></div></div>
            <mailto:<a href="mailto:OpenStack-operators@lists.openstack.org" target="_blank">OpenStack-operators@lists.openstack.org</a>><span class=""><br>
            <a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators</a><br>
<br>
<br>
<br>
<br>
        --<br>
        Kevin Benton<br>
<br>
<br>
<br>
<br>
<br></span><span class="">
__________________________________________________________________________<br>
OpenStack Development Mailing List (not for usage questions)<br>
Unsubscribe: <a href="http://OpenStack-dev-request@lists.openstack.org?subject:unsubscribe" rel="noreferrer" target="_blank">OpenStack-dev-request@lists.openstack.org?subject:unsubscribe</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" rel="noreferrer" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
<br>
</span></blockquote>
</blockquote></div><br></div>