<div dir="ltr"><br><div class="gmail_quote"><div dir="ltr"><div><div><div>Hi,<br><br></div>It will be very helpful if any developers involved in Neutron can throw some light about cases when a router's internal interface can be deleted after being added. Please refer to the issue below.<br>
<br></div>Thanks,<br></div>Balu<br><div><div><div><div><br><br><div class="gmail_quote">---------- Forwarded message ----------<br>From: <b class="gmail_sendername">Balamurugan V G</b> <span dir="ltr"><<a href="mailto:balamuruganvg@gmail.com" target="_blank">balamuruganvg@gmail.com</a>></span><br>
Date: Tue, Oct 22, 2013 at 7:51 AM<br>Subject: [OpenStack:Networking] Router Internal interface goes down sometimes<br>To: <a href="mailto:openstack@lists.openstack.org" target="_blank">openstack@lists.openstack.org</a><br>
<br><br><div dir="ltr">
Hi,<br><div class="gmail_extra"><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_quote">
<div dir="ltr"><div><br></div><div>I have a Grizzly 2013.1.3 4 nodes setup(Controller, Network, Compute1, Compute2) on Ubuntu 12.04 LTS.<br>
</div><div><br></div>
I launch an instance which is attached to two networks(subnets) as shown in the diagram linked below. The subnets are in turn attached to two separate routers. Some times I see that the internal interface on one of the router remains DOWN (shown as red dot in the diagram below). Can someone help me with why this is happening. As said this only happens once in a while making the deployment unreliable.<br>
<div><div><img src="https://mail.google.com/mail/u/0/" alt=""><br>
<br><a href="https://dl.dropboxusercontent.com/u/5145369/OpenStack/NetworkTopology_RouterInternalPortIssue.png" target="_blank">https://dl.dropboxusercontent.com/u/5145369/OpenStack/NetworkTopology_RouterInternalPortIssue.png</a> (Topology Diagram)<br>
</div></div></div></div></div></blockquote><div><br></div><div> Please note that the provisioning of the networks, routers, instances are automated and happen successively with no delay between operations. <br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div dir="ltr"><div class="gmail_quote"><div dir="ltr"><div><div>
<br></div><div>When i look at the logs, the tap interfaces corresponding to the port which is DOWN is removed soon after its added. The ones highlighted in green correspond the internal interface which is good and the ones in yellow correspond to the problem port.<br>
<br>
<p class="MsoNormal">/var/log/syslog</p></div></div></div></div></div></blockquote><div><br> 8bc4ac6b - Interface which is fine<br> 09d96215 - Interface which is DOWN </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div dir="ltr"><div class="gmail_quote"><div dir="ltr"><div><div>
<p class="MsoNormal"> </p>
<p class="MsoNormal">Oct 21 10:07:13 openstack-blr-network ovs-vsctl:
00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl -- --may-exist add-port br-int
qr-<span style="background:none repeat scroll 0% 0% lime">8bc4ac6b</span>-90 -- set
Interface qr-8bc4ac6b-90 type=internal -- set Interface qr-8bc4ac6b-90
external-ids:iface-id=8bc4ac6b-9027-4eee-9e1e-7af7b9a9c0df -- set Interface
qr-8bc4ac6b-90 external-ids:iface-status=active -- set Interface qr-8bc4ac6b-90
external-ids:attached-mac=fa:16:3e:02:3c:1e</p>
<p class="MsoNormal">Oct 21 10:07:13 openstack-blr-network kernel: [<span> </span>401.933281] device qr-8bc4ac6b-90 entered promiscuous
mode</p>
<p class="MsoNormal">Oct 21 10:07:15 openstack-blr-network ovs-vsctl:
00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl --timeout=2 set Port qr-<span style="background:none repeat scroll 0% 0% lime">8bc4ac6b</span>-90 tag=5</p>
<p class="MsoNormal">Oct 21 10:07:20 openstack-blr-network kernel: [<span> </span>408.144038] qg-f1b0e315-df: no IPv6 routers
present</p>
<p class="MsoNormal">Oct 21 10:07:20 openstack-blr-network ovs-vsctl:
00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl -- --may-exist add-port br-int
qr-<span style="background:none repeat scroll 0% 0% yellow">09d96215</span>-c4 --
set Interface qr-09d96215-c4 type=internal -- set Interface qr-09d96215-c4
external-ids:iface-id=09d96215-c4e8-40a1-afc0-9c3904474b73 -- set Interface
qr-09d96215-c4 external-ids:iface-status=active -- set Interface qr-09d96215-c4
external-ids:attached-mac=fa:16:3e:56:9d:29</p>
<p class="MsoNormal">Oct 21 10:07:20 openstack-blr-network kernel: [<span> </span>408.329781] device qr-<span style="background:none repeat scroll 0% 0% yellow">09d96215</span>-c4 entered promiscuous mode</p>
<p class="MsoNormal">Oct 21 10:07:20 openstack-blr-network kernel: [<span> </span>408.640042] tap5507f5e7-ea: no IPv6 routers
present</p>
<p class="MsoNormal">Oct 21 10:07:21 openstack-blr-network ovs-vsctl:
00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl --timeout=2 set Port qr-<span style="background:none repeat scroll 0% 0% yellow">09d96215</span>-c4 tag=4</p>
<p class="MsoNormal">Oct 21 10:07:22 openstack-blr-network kernel: [<span> </span>410.280038] tap44bede85-d8: no IPv6 routers
present</p>
<p class="MsoNormal">Oct 21 10:07:24 openstack-blr-network ovs-vsctl:
00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl -- --may-exist add-port br-ex
qg-4414a87a-f1 -- set Interface qg-4414a87a-f1 type=internal -- set Interface
qg-4414a87a-f1 external-ids:iface-id=4414a87a-f166-426c-93ab-b51d9e8253c1 --
set Interface qg-4414a87a-f1 external-ids:iface-status=active -- set Interface
qg-4414a87a-f1 external-ids:attached-mac=fa:16:3e:94:c0:dd</p>
<p class="MsoNormal">Oct 21 10:07:24 openstack-blr-network kernel: [<span> </span>412.883270] device qg-4414a87a-f1 entered
promiscuous mode</p>
<p class="MsoNormal">Oct 21 10:07:25 openstack-blr-network kernel: [<span> </span>413.296045] qr-<span style="background:none repeat scroll 0% 0% lime">8bc4ac6b</span>-90: no IPv6 routers present</p>
<p class="MsoNormal">Oct 21 10:07:29 openstack-blr-network ovs-vsctl:
00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl --timeout=2 -- --if-exists
del-port br-int qr-<span style="background:none repeat scroll 0% 0% yellow">09d96215</span>-c4</p>
<p class="MsoNormal">Oct 21 10:07:29 openstack-blr-network kernel: [<span> </span>417.399603] device qr-<span style="background:none repeat scroll 0% 0% yellow">09d96215</span>-c4 left promiscuous mode</p>
<p class="MsoNormal">Oct 21 10:07:35 openstack-blr-network kernel: [<span> </span>423.800021] qg-4414a87a-f1: no IPv6 routers
present</p>
<p class="MsoNormal">Oct 21 10:07:45 openstack-blr-network dnsmasq-dhcp[3861]:
DHCPREQUEST(tap3faa7b42-37) 192.168.2.2 fa:16:3e:81:7a:58</p>
<p class="MsoNormal">Oct 21 10:07:45 openstack-blr-network dnsmasq-dhcp[3861]:
DHCPACK(tap3faa7b42-37) 192.168.2.2 fa:16:3e:81:7a:58 host-192-168-2-2</p>
<p class="MsoNormal">Oct 21 10:08:16 openstack-blr-network ovs-vsctl:
00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl -- --may-exist add-port br-ex
qg-4f64cb40-a6 -- set Interface qg-4f64cb40-a6 type=internal -- set Interface
qg-4f64cb40-a6 external-ids:iface-id=4f64cb40-a63a-47cc-935d-950e99212304 --
set Interface qg-4f64cb40-a6 external-ids:iface-status=active -- set Interface
qg-4f64cb40-a6 external-ids:attached-mac=fa:16:3e:4d:44:75</p>
<p class="MsoNormal">Oct 21 10:08:16 openstack-blr-network kernel: [ <span> </span>464.342581] device qg-4f64cb40-a6 entered
promiscuous mode</p>
<p class="MsoNormal">Oct 21 10:08:17 openstack-blr-network ovs-vsctl:
00001|vsctl|INFO|Called as /usr/bin/ovs-vsctl -- --may-exist add-port br-int
tapacf9db3a-2c -- set Interface tapacf9db3a-2c type=internal -- set Interface
tapacf9db3a-2c external-ids:iface-id=acf9db3a-2cae-45d8-97c2-02dde4ddeded --
set Interface tapacf9db3a-2c external-ids:iface-status=active -- set Interface
tapacf9db3a-2c external-ids:attached-mac=fa:16:3e:1b:f7:f5</p>
<p class="MsoNormal">Oct 21 10:08:17 openstack-blr-network kernel: [<span> </span>465.064522] device tapacf9db3a-2c entered
promiscuous mode</p>
<p class="MsoNormal"> </p>
<p class="MsoNormal"> </p>
<p class="MsoNormal"> <br></p>
<p class="MsoNormal"> </p>
<p class="MsoNormal">/var/log/quantum/openvswitch-agent.log</p>
<p class="MsoNormal"> <br></p></div></div></div></div></div></blockquote><div> 8bc4ac6b-9027-4eee-9e1e-7af7b9a9c0df - Port which is fine<br> 09d96215-c4e8-40a1-afc0-9c3904474b73 - Port which is DOWN <br></div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_quote"><div dir="ltr"><div><div>
<p class="MsoNormal"> </p>
<p class="MsoNormal">2013-10-21 10:07:11<span>
</span>INFO [quantum.agent.securitygroups_rpc] Refresh firewall rules</p>
<p class="MsoNormal">2013-10-21 10:07:11<span>
</span>INFO [quantum.agent.securitygroups_rpc] Preparing filters for devices
set([u'44bede85-d873-493b-a9a3-79a5d7f55174',
u'5507f5e7-ea9f-42b6-96eb-6d1984619c27'])</p>
<p class="MsoNormal">2013-10-21 10:07:11<span>
</span>INFO [quantum.plugins.openvswitch.agent.ovs_quantum_agent] Port
44bede85-d873-493b-a9a3-79a5d7f55174 added</p>
<p class="MsoNormal">2013-10-21 10:07:11<span>
</span>INFO [quantum.plugins.openvswitch.agent.ovs_quantum_agent] Port
44bede85-d873-493b-a9a3-79a5d7f55174 updated. Details: {u'admin_state_up':
True, u'network_id': u'c5c34bc4-f995-412d-923f-678d62f49361',
u'segmentation_id': 10, u'physical_network': u'physnet1', u'device':
u'44bede85-d873-493b-a9a3-79a5d7f55174', u'port_id':
u'44bede85-d873-493b-a9a3-79a5d7f55174', u'network_type': u'vlan'}</p>
<p class="MsoNormal">2013-10-21 10:07:11<span>
</span>INFO [quantum.plugins.openvswitch.agent.ovs_quantum_agent] Assigning 4
as local vlan for net-id=c5c34bc4-f995-412d-923f-678d62f49361</p>
<p class="MsoNormal">2013-10-21 10:07:12<span>
</span>INFO [quantum.plugins.openvswitch.agent.ovs_quantum_agent] Port
5507f5e7-ea9f-42b6-96eb-6d1984619c27 added</p>
<p class="MsoNormal">2013-10-21 10:07:12<span>
</span>INFO [quantum.plugins.openvswitch.agent.ovs_quantum_agent] Port
5507f5e7-ea9f-42b6-96eb-6d1984619c27 updated. Details: {u'admin_state_up':
True, u'network_id': u'956f3bfc-9cc2-4af6-8328-f5a359551671', u'segmentation_id':
11, u'physical_network': u'physnet1', u'device':
u'5507f5e7-ea9f-42b6-96eb-6d1984619c27', u'port_id':
u'5507f5e7-ea9f-42b6-96eb-6d1984619c27', u'network_type': u'vlan'}</p>
<p class="MsoNormal">2013-10-21 10:07:12<span>
</span>INFO [quantum.plugins.openvswitch.agent.ovs_quantum_agent] Assigning 5
as local vlan for net-id=956f3bfc-9cc2-4af6-8328-f5a359551671</p>
<p class="MsoNormal">2013-10-21 10:07:15<span>
</span>INFO [quantum.agent.securitygroups_rpc] Preparing filters for devices
set([u'<span style="background:none repeat scroll 0% 0% lime">8bc4ac6b-9027-4eee-9e1e-7af7b9a9c0df</span>'])</p>
<p class="MsoNormal">2013-10-21 10:07:15<span>
</span>INFO [quantum.plugins.openvswitch.agent.ovs_quantum_agent] Port <span style="background:none repeat scroll 0% 0% lime">8bc4ac6b-9027-4eee-9e1e-7af7b9a9c0df</span>
added</p>
<p class="MsoNormal">2013-10-21 10:07:15<span>
</span>INFO [quantum.plugins.openvswitch.agent.ovs_quantum_agent] Port <span style="background:none repeat scroll 0% 0% lime">8bc4ac6b-9027-4eee-9e1e-7af7b9a9c0df</span>
updated. Details: {u'admin_state_up': True, u'network_id': u'956f3bfc-9cc2-4af6-8328-f5a359551671',
u'segmentation_id': 11, u'physical_network': u'physnet1', u'device':
u'8bc4ac6b-9027-4eee-9e1e-7af7b9a9c0df', u'port_id':
u'8bc4ac6b-9027-4eee-9e1e-7af7b9a9c0df', u'network_type': u'vlan'}</p>
<p class="MsoNormal">2013-10-21 10:07:21<span>
</span>INFO [quantum.agent.securitygroups_rpc] Preparing filters for devices
set([u'<span style="background:none repeat scroll 0% 0% yellow">09d96215-c4e8-40a1-afc0-9c3904474b73</span>'])</p>
<p class="MsoNormal">2013-10-21 10:07:21<span>
</span>INFO [quantum.plugins.openvswitch.agent.ovs_quantum_agent] Port <span style="background:none repeat scroll 0% 0% yellow">09d96215-c4e8-40a1-afc0-9c3904474b73</span>
added</p>
<p class="MsoNormal">2013-10-21 10:07:21<span>
</span>INFO [quantum.plugins.openvswitch.agent.ovs_quantum_agent] Port <span style="background:none repeat scroll 0% 0% yellow">09d96215-c4e8-40a1-afc0-9c3904474b73</span>
updated. Details: {u'admin_state_up': True, u'network_id':
u'c5c34bc4-f995-412d-923f-678d62f49361', u'segmentation_id': 10,
u'physical_network': u'physnet1', u'device':
u'09d96215-c4e8-40a1-afc0-9c3904474b73', u'port_id':
u'09d96215-c4e8-40a1-afc0-9c3904474b73', u'network_type': u'vlan'}</p>
<p class="MsoNormal">2013-10-21 10:07:29<span>
</span>INFO [quantum.agent.securitygroups_rpc] Remove device filter for set([u'<span style="background:none repeat scroll 0% 0% yellow">09d96215-c4e8-40a1-afc0-9c3904474b73</span>'])</p>
<p class="MsoNormal">2013-10-21 10:07:29<span>
</span>INFO [quantum.plugins.openvswitch.agent.ovs_quantum_agent] Attachment <span style="background:none repeat scroll 0% 0% yellow">09d96215-c4e8-40a1-afc0-9c3904474b73</span>
removed</p>
<p class="MsoNormal">2013-10-21 10:07:29<span>
</span>INFO [quantum.plugins.openvswitch.agent.ovs_quantum_agent] Port <span style="background:none repeat scroll 0% 0% yellow">09d96215-c4e8-40a1-afc0-9c3904474b73</span>
updated.</p>
<p class="MsoNormal">2013-10-21 10:08:16<span>
</span>INFO [quantum.agent.securitygroups_rpc] Security group member updated
[u'7a952c14-45a6-4f5f-b8f1-551c3cfbb8ba']</p>
<p class="MsoNormal">2013-10-21 10:08:16<span>
</span>INFO [quantum.agent.securitygroups_rpc] Security group member updated
[u'7a952c14-45a6-4f5f-b8f1-551c3cfbb8ba']</p>
<p class="MsoNormal">2013-10-21 10:08:16<span>
</span>INFO [quantum.agent.securitygroups_rpc] Provider rule updated</p>
<p class="MsoNormal">2013-10-21 10:08:16<span>
</span>INFO [quantum.agent.securitygroups_rpc] Refresh firewall rules</p>
<p class="MsoNormal">2013-10-21 10:08:17<span>
</span>INFO [quantum.agent.securitygroups_rpc] Preparing filters for devices
set([u'acf9db3a-2cae-45d8-97c2-02dde4ddeded'])</p>
<p class="MsoNormal">2013-10-21 10:08:17<span>
</span>INFO [quantum.plugins.openvswitch.agent.ovs_quantum_agent] Port
acf9db3a-2cae-45d8-97c2-02dde4ddeded added</p>
<p class="MsoNormal">2013-10-21 10:08:17<span>
</span>INFO [quantum.plugins.openvswitch.agent.ovs_quantum_agent] Port
acf9db3a-2cae-45d8-97c2-02dde4ddeded updated. Details: {u'admin_state_up':
True, u'network_id': u'5da5b3cd-81e0-45e0-95d6-4f29954bd4b1', u'segmentation_id':
13, u'physical_network': u'physnet1', u'device':
u'acf9db3a-2cae-45d8-97c2-02dde4ddeded', u'port_id':
u'acf9db3a-2cae-45d8-97c2-02dde4ddeded', u'network_type': u'vlan'}</p>
<p class="MsoNormal">2013-10-21 10:08:17<span>
</span>INFO [quantum.plugins.openvswitch.agent.ovs_quantum_agent] Assigning 6
as local vlan for net-id=5da5b3cd-81e0-45e0-95d6-4f29954bd4b1</p>
<p class="MsoNormal">2013-10-21 10:08:18<span>
</span>INFO [quantum.agent.securitygroups_rpc] Provider rule updated</p>
<p class="MsoNormal">2013-10-21 10:08:18<span>
</span>INFO [quantum.agent.securitygroups_rpc] Refresh firewall rules</p>
<p class="MsoNormal">2013-10-21 10:08:19<span>
</span>INFO [quantum.agent.securitygroups_rpc] Preparing filters for devices
set([u'3cc5f73d-eaff-49b4-9ce9-f482476557e8'])</p>
<p class="MsoNormal">2013-10-21 10:08:19<span>
</span>INFO [quantum.plugins.openvswitch.agent.ovs_quantum_agent] Port
3cc5f73d-eaff-49b4-9ce9-f482476557e8 added</p>
<p class="MsoNormal">2013-10-21 10:08:19 <span> </span>INFO
[quantum.plugins.openvswitch.agent.ovs_quantum_agent] Port
3cc5f73d-eaff-49b4-9ce9-f482476557e8 updated. Details: {u'admin_state_up':
True, u'network_id': u'1c37a512-1394-40f9-ab26-867d5347ff63', u'segmentation_id':
12, u'physical_network': u'physnet1', u'device':
u'3cc5f73d-eaff-49b4-9ce9-f482476557e8', u'port_id':
u'3cc5f73d-eaff-49b4-9ce9-f482476557e8', u'network_type': u'vlan'}</p>
<p class="MsoNormal">2013-10-21 10:08:19<span>
</span>INFO [quantum.plugins.openvswitch.agent.ovs_quantum_agent] Assigning 7
as local vlan for net-id=1c37a512-1394-40f9-ab26-867d5347ff63</p>
<p class="MsoNormal">2013-10-21 10:08:23<span>
</span>INFO [quantum.agent.securitygroups_rpc] Preparing filters for devices
set([u'62d43349-b25c-45fb-ac67-e756d889451e'])</p>
<p class="MsoNormal">2013-10-21 10:08:23<span>
</span>INFO [quantum.plugins.openvswitch.agent.ovs_quantum_agent] Port
62d43349-b25c-45fb-ac67-e756d889451e added</p>
<br><br><br></div><div>I would like to know why one port is deleted soon after being added. Any help will be greatly appreciated.<br><br></div><div>Regards,<br>Balu<br></div></div></div>
</div><br></div>
</blockquote></div><br></div></div>
</div><br></div></div></div></div></div>
</div><br></div>