<div dir="ltr">Yes, this matches that bug. Zane's comment on 2014-04-03 in that description is exactly the issue you are hitting.<div><br></div><div>Here is his comment:</div><div><br></div><div>"After discussion on IRC of another bug, it appears that depending on the Router (and by extension the gateway) is insufficient, and we need to depend instead on the RouterInterface that connects the Router to the internal Subnet.</div>
<div><br></div><div>This suggests that it's probably a mistake to have the RouterInterfaces take a Router argument, rather than the other way around; if Router took a list of Ports instead then depending on the Router would be sufficient."</div>
</div><div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, Aug 13, 2014 at 9:08 PM, McLellan, Steven <span dir="ltr"><<a href="mailto:steve.mclellan@hp.com" target="_blank">steve.mclellan@hp.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="EN-US" link="blue" vlink="purple">
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Thanks Kevin. Steve Baker pointed me at
<a href="https://bugs.launchpad.net/heat/+bug/1299259" target="_blank">https://bugs.launchpad.net/heat/+bug/1299259</a> which looks related.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">The only related field I see around floating ips is ‘router_id’ on FloatingIP, but it feels like that wouldn’t correct any dependencies on the RouterInterface.
I understand the error I’m getting, but I’m not sure if I’m doing something wrong or if it’s a bug.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> Kevin Benton [mailto:<a href="mailto:blak111@gmail.com" target="_blank">blak111@gmail.com</a>]
<br>
<b>Sent:</b> Wednesday, August 13, 2014 10:44 PM<br>
<b>To:</b> OpenStack Development Mailing List (not for usage questions)<br>
<b>Subject:</b> Re: [openstack-dev] [Heat] Occasional stack-delete failure with RouterInterface<u></u><u></u></span></p><div><div class="h5">
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">It looks like there may be a missing dependency. The floating IP association needs to depend on the router interface that attaches the router to the subnet where the floating IP maps to. You can't remove a router interface to a subnet if
there is a port on that subnet with a floating IP associated to it because it would prevent the floating IP from functioning. <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><u></u> <u></u></p>
<div>
<p class="MsoNormal">On Wed, Aug 13, 2014 at 8:30 PM, McLellan, Steven <<a href="mailto:steve.mclellan@hp.com" target="_blank">steve.mclellan@hp.com</a>> wrote:<u></u><u></u></p>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<p class="MsoNormal">Hello,<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">We’re occasionally (as in occasionally repeatable but not consistent) seeing failures deleting stacks containing a neutron RouterInterface. I’m not sure if it’s a bug or the template
is to blame. The error we get is:<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal" style="text-indent:.5in">
<span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white">Conflict: Router interface for subnet <id> on router <id> cannot be deleted, as it is required by one or more floating IPs.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white">The router id is provided to the heat template as an id; the subnet is a resource within
the template. An abridged example (minus server) is below (router interface towards the end). The logs (at INFO) for a SUCCESSFUL delete show the router interface being deleted first (straight after the server resource). I don’t have a lot of neutron expertise,
but it seems like there’s an implicit dependency that’s not being expressed properly – or perhaps the template is flawed? The failure doesn’t happen all the time, which makes me wonder if there’s a race going on.
</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white">Any ideas?</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white">Thanks,</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white">Steve</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white">2014-08-14 02:55:50.374 INFO heat.engine.resource [-] deleting RouterInterface "router-interface"
[685971ab-4c80-41a7-b64b-715a78b61267:subnet_id=4de89638-0e8b-4353-a847-0a3fceefe1f9] Stack "t1" [ba13d445-d43d-45c1-bc76-e2c5898ae5ad]
</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white">2014-08-14 02:55:50.491 INFO heat.engine.resource [-] deleting FloatingIPAssociation
"floating-ip-assoc" [92f10394-b524-4f8b-9383-e1f111d70d68:23540c60-9b05-47ad-b93b-b3b24f86ab37] Stack "t1" [ba13d445-d43d-45c1-bc76-e2c5898ae5ad]</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white">2014-08-14 02:55:51.124 INFO heat.engine.resource [-] deleting Port "port-on-subnet"
[23540c60-9b05-47ad-b93b-b3b24f86ab37] Stack "t1" [ba13d445-d43d-45c1-bc76-e2c5898ae5ad]
</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white">2014-08-14 02:55:51.163 INFO heat.engine.resource [-] deleting FloatingIP "floating-ip"
[92f10394-b524-4f8b-9383-e1f111d70d68] Stack "t1" [ba13d445-d43d-45c1-bc76-e2c5898ae5ad]
</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white">2014-08-14 02:55:52.278 INFO heat.engine.resource [-] deleting Subnet "subnet" [4de89638-0e8b-4353-a847-0a3fceefe1f9]
Stack "t1" [ba13d445-d43d-45c1-bc76-e2c5898ae5ad]
</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white">2014-08-14 02:55:52.428 INFO heat.engine.resource [-] deleting SecurityGroup "secgroup"
[e7ec7fbb-6134-41dc-a98e-c0d4104b270f] Stack "t1" [ba13d445-d43d-45c1-bc76-e2c5898ae5ad]
</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white"> floating-ip:</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white"> properties: {floating_network_id: a60900f8-bdc9-40ef-b0ab-a41d20e0c660}</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white"> type: OS::Neutron::FloatingIP</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white"> floating-ip-assoc:</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white"> properties:</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white"> floatingip_id: {get_resource: floating-ip}</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white"> port_id: {get_resource: port-on-subnet}</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white"> type: OS::Neutron::FloatingIPAssociation</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white"> port-on-subnet:</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white"> properties:</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white"> fixed_ips:</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white"> - subnet_id: {get_resource: subnet}</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white"> network_id: {get_resource: net}</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white"> security_groups:</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white"> - default</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white"> type: OS::Neutron::Port</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white"> net:</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white"> properties: {name: mynet}</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:black;background:white"> type: OS::Neutron::Net</span><u></u><u></u></p>
<p class="MsoNormal"> router-interface:<u></u><u></u></p>
<p class="MsoNormal"> properties:<u></u><u></u></p>
<p class="MsoNormal"> router_id: 108eea7b-b846-40df-9f0d-c53c926b7608<u></u><u></u></p>
<p class="MsoNormal"> subnet_id: {get_resource: subnet}<u></u><u></u></p>
<p class="MsoNormal"> type: OS::Neutron::RouterInterface<u></u><u></u></p>
<p class="MsoNormal"> subnet:<u></u><u></u></p>
<p class="MsoNormal"> properties:<u></u><u></u></p>
<p class="MsoNormal"> cidr:
<a href="http://10.0.29.0/24" target="_blank">10.0.29.0/24</a><u></u><u></u></p>
<p class="MsoNormal"> dns_nameservers: [8.8.8.8]<u></u><u></u></p>
<p class="MsoNormal"> ip_version: 4<u></u><u></u></p>
<p class="MsoNormal"> network_id: {get_resource: net}<u></u><u></u></p>
<p class="MsoNormal"> type: OS::Neutron::Subnet<u></u><u></u></p>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
_______________________________________________<br>
OpenStack-dev mailing list<br>
<a href="mailto:OpenStack-dev@lists.openstack.org" target="_blank">OpenStack-dev@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><u></u><u></u></p>
</blockquote>
</div>
<p class="MsoNormal"><br>
<br clear="all">
<u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<p class="MsoNormal">-- <u></u><u></u></p>
<div>
<p class="MsoNormal">Kevin Benton<u></u><u></u></p>
</div>
</div>
</div></div></div>
</div>
<br>_______________________________________________<br>
OpenStack-dev mailing list<br>
<a href="mailto:OpenStack-dev@lists.openstack.org">OpenStack-dev@lists.openstack.org</a><br>
<a href="http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev" target="_blank">http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div>Kevin Benton</div>
</div>