<div dir="ltr"><div dir="ltr"><div dir="ltr">Hi Lucas,<div><br></div><div>I have checked, currently there is only one router.</div><div><br></div><div>root@network:/etc/neutron# ovn-nbctl lr-list<br>9f6111a9-3231-4f60-8199-78780760fe34 (neutron-ff36ce12-78fc-4ac9-9ae9-5a18ec1002bd)<br></div><div><br></div><div>with two ports.</div><div><br></div><div>root@network:/etc/neutron# ovn-nbctl lrp-list 9f6111a9-3231-4f60-8199-78780760fe34<br>a33dc21f-dcd7-4714-8003-9e21bc283d03 (lrp-52409f01-b140-4729-90b4-409c7c9b3f4b)<br>76dd76a7-1c64-4686-aeac-44ae63677404 (lrp-b12c1aa0-0857-494c-92a0-ee54cc7e01cc)<br></div><div><br></div><div>One port showing no output.</div><div><br></div><div>root@network:/etc/neutron# ovn-nbctl lrp-get-gateway-chassis a33dc21f-dcd7-4714-8003-9e21bc283d03<br>root@network:/etc/neutron#</div><div><br></div><div>Other port showing gateway chassis.</div><div><br></div>root@network:/etc/neutron# ovn-nbctl lrp-get-gateway-chassis 76dd76a7-1c64-4686-aeac-44ae63677404<br><div>lrp-b12c1aa0-0857-494c-92a0-ee54cc7e01cc_731e842a-3a69-4044-87e9-32b7517d4f07 1</div><div><br></div><div>This is the current active gateway chassis. </div><div><br></div><div>root@network:/etc/neutron# ovn-nbctl list gateway_chassis<br>_uuid : 4e23ff9b-9588-46aa-9ed1-69fea503a729<br>chassis_name : "731e842a-3a69-4044-87e9-32b7517d4f07"<br>external_ids : {}<br>name : lrp-b12c1aa0-0857-494c-92a0-ee54cc7e01cc_731e842a-3a69-4044-87e9-32b7517d4f07<br>options : {}<br>priority : 1<br></div><div><br></div><div>This chassis fdfae005-7473-486a-b331-8a54c53c1279 is the one that I have removed from gateway chassis and I don't see any port scheduled on it. I have tried to reboot the chassis but when the chassis comes back, the uplink port start showing traffic in tcpdump.</div><div><br></div><div>- Ammad</div></div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Mar 16, 2021 at 3:21 PM Lucas Alvares Gomes <<a href="mailto:lucasagomes@gmail.com">lucasagomes@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Hi Ammad,<br>
<br>
<br>
On Tue, Mar 16, 2021 at 9:15 AM Ammad Syed <<a href="mailto:syedammad83@gmail.com" target="_blank">syedammad83@gmail.com</a>> wrote:<br>
><br>
> Hi,<br>
><br>
> I have four compute nodes in my lab setup. Initially all the four compute nodes were acting as gateway chassis with priority 1, 2, 3 and 4.<br>
><br>
> Then I have specifically marked two node as a gateway chassis with below command on compute nodes.<br>
><br>
> ovs-vsctl set open . external-ids:ovn-cms-options="enable-chassis-as-gw"<br>
><br>
> The command ovn-nbctl list gateway_chassis start showing two chassis. I have checked via tcpdump, the public traffic started flowing from both nodes. Look like its doing round robin to send packets.<br>
><br>
> Then I tried to remove one chassis from gateway and used below command.<br>
><br>
> ovs-vsctl remove open . external-ids ovn-cms-options=enable-chassis-as-gw<br>
><br>
> The ovn-nbctl list gateway_chassis started showing one gateway chassis but I can see from tcpdump that public traffic still flows from both gateway chassis.<br>
><br>
> Below is the current status of chassis.<br>
><br>
> root@network:/etc/neutron# ovn-sbctl list chassis<br>
> _uuid : 532bb9d0-6667-462c-9631-0cb5360bd4dc<br>
> encaps : [358c4a59-0bca-459c-958c-524eb8c385ce]<br>
> external_ids : {datapath-type=system, iface-types="erspan,geneve,gre,internal,ip6erspan,ip6gre,lisp,patch,stt,system,tap,vxlan", is-interconn="false", "neutron:liveness_check_at"="2021-03-16T08:52:41.361302+00:00", "neutron:metadata_liveness_check_at"="2021-03-16T08:52:41.364928+00:00", "neutron:ovn-metadata-id"="2ac66785-d0c7-43ee-8c78-5fd6ed6ccc73", "neutron:ovn-metadata-sb-cfg"="6157", ovn-bridge-mappings="ext-net1:br-ext", ovn-chassis-mac-mappings="", ovn-cms-options=""}<br>
> hostname : virtual-hv2<br>
> name : "fdfae005-7473-486a-b331-8a54c53c1279"<br>
> nb_cfg : 6157<br>
> transport_zones : []<br>
> vtep_logical_switches: []<br>
><br>
> _uuid : a99ab389-96a5-4a58-a301-34618868450a<br>
> encaps : [6e7490ce-3c58-4a1c-999d-ff1638c66feb]<br>
> external_ids : {datapath-type=system, iface-types="erspan,geneve,gre,internal,ip6erspan,ip6gre,lisp,patch,stt,system,tap,vxlan", is-interconn="false", neutron-metadata-proxy-networks="dc917847-f70f-4de0-9865-3e9594c65ef1", "neutron:liveness_check_at"="2021-03-16T08:52:41.368768+00:00", "neutron:metadata_liveness_check_at"="2021-03-16T08:52:41.372045+00:00", "neutron:ovn-metadata-id"="3441fc3c-ca43-4360-8210-8c9ebe4fc13d", "neutron:ovn-metadata-sb-cfg"="6157", ovn-bridge-mappings="ext-net1:br-ext", ovn-chassis-mac-mappings="", ovn-cms-options=""}<br>
> hostname : kvm10-a1-khi01<br>
> name : "87504098-4474-40fc-9576-ac449c1c4448"<br>
> nb_cfg : 6157<br>
> transport_zones : []<br>
> vtep_logical_switches: []<br>
><br>
> _uuid : b9bdfe12-fe27-4580-baee-159f871c442b<br>
> encaps : [52a8f523-9740-4333-a4a4-69bf5e27117c]<br>
> external_ids : {datapath-type=system, iface-types="erspan,geneve,gre,internal,ip6erspan,ip6gre,lisp,patch,stt,system,tap,vxlan", is-interconn="false", neutron-metadata-proxy-networks="dc917847-f70f-4de0-9865-3e9594c65ef1", "neutron:liveness_check_at"="2021-03-16T08:52:41.326719+00:00", "neutron:metadata_liveness_check_at"="2021-03-16T08:52:41.342214+00:00", "neutron:ovn-metadata-id"="2a751610-97a8-4688-a719-df3616f4f770", "neutron:ovn-metadata-sb-cfg"="6157", ovn-bridge-mappings="ext-net1:br-ext", ovn-chassis-mac-mappings="", ovn-cms-options=""}<br>
> hostname : kvm12-a1-khi01<br>
> name : "82630e57-668e-4f67-a3fb-a173f4da432a"<br>
> nb_cfg : 6157<br>
> transport_zones : []<br>
> vtep_logical_switches: []<br>
><br>
> _uuid : 669d1ae3-7a5d-4ec3-869d-ca6240f9ae2c<br>
> encaps : [ac8022b3-1ea5-45c7-a7e8-74db7b627df4]<br>
> external_ids : {datapath-type=system, iface-types="erspan,geneve,gre,internal,ip6erspan,ip6gre,lisp,patch,stt,system,tap,vxlan", is-interconn="false", "neutron:liveness_check_at"="2021-03-16T08:52:41.347144+00:00", "neutron:metadata_liveness_check_at"="2021-03-16T08:52:41.352021+00:00", "neutron:ovn-metadata-id"="2d5ce6fd-6a9f-4356-9406-6ca91601af43", "neutron:ovn-metadata-sb-cfg"="6157", ovn-bridge-mappings="ext-net1:br-ext", ovn-chassis-mac-mappings="", ovn-cms-options=enable-chassis-as-gw}<br>
> hostname : virtual-hv1<br>
> name : "731e842a-3a69-4044-87e9-32b7517d4f07"<br>
> nb_cfg : 6157<br>
> transport_zones : []<br>
> vtep_logical_switches: []<br>
><br>
> Need help how can I permanently remove a gateway chassis that it should stop serving public traffic ? also is it something to do with priority ?<br>
><br>
<br>
Is it possible that we still have router ports scheduled onto that chassis ?<br>
<br>
You list your routers, router_ports and which gateway chassis the port<br>
is scheduled on with the following commands:<br>
<br>
# List your routers<br>
$ ovn-nbctl lr-list<br>
<br>
# List the router ports in that router<br>
$ ovn-nbctl lrp-list <router id><br>
<br>
# List which gateway chassis (if any) that router port is scheduled<br>
on. Here you will see the priority, the highest is where the port<br>
should be located<br>
$ ovn-nbctl lrp-get-gateway-chassis <router port id><br>
<br>
If that's the case, I think the OVN driver is not automatically<br>
accounting for rescheduling these ports when a gateway chassis is<br>
removed/added. We need to discuss whether this is something we want to<br>
have automatically like this or not because it can cause data<br>
disruption.<br>
<br>
Alternatively we could have a "rescheduling" script that could be run<br>
by operators when they want to add/remove a gateway chassis so they<br>
can plan before moving the ports from one chassis to another (again<br>
potentially causing disruptions).<br>
<br>
Hope that helps,<br>
Lucas<br>
<br>
> - Ammad<br>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature">Regards,<div><br></div><div><br></div><div>Syed Ammad Ali</div></div>