<div>                Here's what I get when I create a 4th subnet:<br><br>$ openstack network segment create --physical-network physnet_bo-az3 --network-type vlan --segment 1115 --network trust trust-az4<br>+------------------+--------------------------------------+<br>| Field            | Value                                |<br>+------------------+--------------------------------------+<br>| description      |                                      |<br>| id               | 92355e6d-3406-4b29-a956-1b05c4c9a33e |<br>| name             | private-provider-trust-az4           |<br>| network_id       | ac30a487-bccc-c3de-93eb-c422ad9f3ce5 |<br>| network_type     | vlan                                 |<br>| physical_network | physnet_bo-az3                       |<br>| segmentation_id  | 1115                                 |<br>+------------------+--------------------------------------+<br> <br>$ openstack subnet create --no-dhcp --network private-provider-trust --network-segment private-provider-trust-az4 --ip-version 4 --allocation-pool start=10.52.172.14,end=10.52.172.235 --subnet-range 10.52.172.0/22 --dns-nameserver 10.10.10.10 --gateway 10.52.172.1 private-provider-trust-az4-subnet<br>+----------------------+------------------------------------------------------+<br>| Field                | Value                                                |<br>+----------------------+------------------------------------------------------+<br>| allocation_pools     | 10.52.172.10-10.52.172.245                           |<br>| cidr                 | 10.52.172.0/22                                       |<br>| created_at           | 2022-03-31T19:26:48Z                                 |<br>| description          |                                                      |<br>| dns_nameservers      | 10.10.10.10                                           |<br>| dns_publish_fixed_ip | None                                                 |<br>| enable_dhcp          | False                                                |<br>| gateway_ip           | 10.52.172.1                                          |<br>| host_routes          | destination='10.52.160.0/22', gateway='10.52.172.1' |<br>|                      | destination='10.52.164.0/22', gateway='10.52.172.1' |<br>|                      | destination='10.52.168.0/22', gateway='10.52.172.1' |<br>| id                   | 04a15cdd-d22b-4e58-8bbd-8b956d8c10ba                 |<br>| ip_version           | 4                                                    |<br>| ipv6_address_mode    | None                                                 |<br>| ipv6_ra_mode         | None                                                 |<br>| name                 | private-provider-trust-az4-subnet                    |<br>| network_id           | ac30a487-bccc-4ac5-93eb-c422ad9f3ce5                 |<br>| prefix_length        | None                                                 |<br>| project_id           | 561e8d2236634ece81ffa22203e80dc7                     |<br>| revision_number      | 0                                                    |<br>| segment_id           | 92355e6d-a5de-4b29-a956-1b05c4c9a33e                 |<br>| service_types        |                                                      |<br>| subnetpool_id        | None                                                 |<br>| tags                 |                                                      |<br>| updated_at           | 2022-03-31T19:26:48Z                                 |<br>+----------------------+------------------------------------------------------+<br><br>If I create the 4th subnet without specifying a gateway, then the routes are not created. It looks like this may be what changed from Queens to Train:<br><br>$ openstack subnet create --no-dhcp --network private-provider-trust --network-segment private-provider-trust-az4 --ip-version 4 --allocation-pool start=10.52.172.10,end=10.52.172.245 --subnet-range 10.52.172.0/22 --dns-nameserver 10.10.10.10 private-provider-trust-az4-subnet<br>+----------------------+--------------------------------------+<br>| Field                | Value                                |<br>+----------------------+--------------------------------------+<br>| allocation_pools     | 10.52.172.10-10.52.172.245           |<br>| cidr                 | 10.52.172.0/22                       |<br>| created_at           | 2022-03-31T20:00:44Z                 |<br>| description          |                                      |<br>| dns_nameservers      | 10.10.10.10                           |<br>| dns_publish_fixed_ip | None                                 |<br>| enable_dhcp          | False                                |<br>| gateway_ip           | 10.52.172.1                          |<br>| host_routes          |                                      |<br>| id                   | 11757c89-2057-4c7c-9730-9b7d976e361e |<br>| ip_version           | 4                                    |<br>| ipv6_address_mode    | None                                 |<br>| ipv6_ra_mode         | None                                 |<br>| name                 | private-provider-trust-az4-subnet    |<br>| network_id           | ac30a487-bccc-4ac5-93eb-c422ad9f3ce5 |<br>| prefix_length        | None                                 |<br>| project_id           | 561e8d2236634ece81ffa22203e80dc7     |<br>| revision_number      | 0                                    |<br>| segment_id           | 92355e6d-a5de-4b29-a956-1b05c4c9a33e |<br>| service_types        |                                      |<br>| subnetpool_id        | None                                 |<br>| tags                 |                                      |<br>| updated_at           | 2022-03-31T20:00:44Z                 |<br>+----------------------+--------------------------------------+            </div>            <div class="yahoo_quoted" style="margin:10px 0px 0px 0.8ex;border-left:1px solid #ccc;padding-left:1ex;">                        <div style="font-family:'Helvetica Neue', Helvetica, Arial, sans-serif;font-size:13px;color:#26282a;">                                <div>                    On Wednesday, March 30, 2022, 09:01:23 PM EDT, Brian Haley <haleyb.dev@gmail.com> wrote:                </div>                <div><br></div>                <div><br></div>                <div><div dir="ltr">Hi,<br clear="none"><br clear="none">On 3/30/22 15:27, Albert Braden wrote:<br clear="none">> The command that we use to create subnets looks like this:<br clear="none">> <br clear="none">> openstack subnet create --no-dhcp --network trust --network-segment <br clear="none">> trust-az1-seg --ip-version 4 --allocation-pool <br clear="none">> start=10.52.160.14,end=10.52.160.235 --subnet-range 10.52.160.0/24 <br clear="none">> --dns-nameserver 10.10.10.10 --gateway 10.52.160.1 trust-az1<br clear="none"><br clear="none">Since you're not specifying --host-route there should be none, can you <br clear="none">paste the created object returned from this call since for me <br clear="none">host_routes is blank (see below).<br clear="none"><br clear="none">> My co-workers tell me that we also specified "--gateway" when we created <br clear="none">> our Queens subnets, but this did not cause static routes to be created. <br clear="none">> Did the handling of "--gateway" change from Queens to Train?<br clear="none"><br clear="none">I don't believe so, and --gateway will default to the first IP in the <br clear="none">subnet if not given so isn't required.<br clear="none"><br clear="none">-Brian<br clear="none"><br clear="none"><br clear="none">$ openstack subnet create --subnet-pool <br clear="none">f5e3f133-a932-4adc-9592-0b525aec278f --network private private-subnet-2<br clear="none">+----------------------+---------------------------+<br clear="none">| Field                | Value                     |<br clear="none">+----------------------+---------------------------+<br clear="none">| allocation_pools     | 10.0.0.66-10.0.0.126      |<br clear="none">| cidr                 | 10.0.0.64/26              |<br clear="none">| created_at           | 2022-03-30T17:38:40Z      |<br clear="none">| description          |                           |<br clear="none">| dns_nameservers      |                           |<br clear="none">| dns_publish_fixed_ip | None                      |<br clear="none">| enable_dhcp          | True                      |<br clear="none">| gateway_ip           | 10.0.0.65                 |<br clear="none">| host_routes          |                           |<br clear="none">| id                   | ce09a038-b918-4208-9a3d-c8c259ae7433 |<br clear="none">| ip_version           | 4                         |<br clear="none">| ipv6_address_mode    | None                      |<br clear="none">| ipv6_ra_mode         | None                      |<br clear="none">| name                 | private-subnet-2          |<br clear="none">| network_id           | baf6c62d-4cec-464e-a768-253074df8879 |<br clear="none">| project_id           | 657e6d647c0446438c1f06da70d79bed |<br clear="none">| revision_number      | 0                         | <br clear="none">         | segment_id           | None                      | <br clear="none"><br clear="none">| service_types        |                           |<br clear="none">| subnetpool_id        | f5e3f133-a932-4adc-9592-0b525aec278f |<br clear="none">| tags                 |                           |<br clear="none">| updated_at           | 2022-03-30T17:38:40Z      |<div class="yqt9525970245" id="yqtfd81258"><br clear="none">+----------------------+---------------------------+<br clear="none"><br clear="none">> On Wednesday, March 30, 2022, 01:45:52 PM EDT, Brian Haley <br clear="none">> <<a shape="rect" ymailto="mailto:haleyb.dev@gmail.com" href="mailto:haleyb.dev@gmail.com">haleyb.dev@gmail.com</a>> wrote:<br clear="none">> <br clear="none">> <br clear="none">> Hi Albert,<br clear="none">> <br clear="none">> On 3/29/22 17:04, Albert Braden wrote:<br clear="none">>  > After upgrading our kolla-ansible clusters from Queens to Train, we <br clear="none">> are seeing static routes when we create subnets. We didn’t see this in <br clear="none">> Queens. For example, in our de6 region we have a network called “trust” <br clear="none">> with 3 subnets:<br clear="none">>  ><br clear="none">>  > Subnet                CIDR                                  Gateway<br clear="none">>  > trust-az1:            10.52.160.0/22  10.52.160.1<br clear="none">>  > trust-az2:            10.52.164.0/22  10.52.164.1<br clear="none">>  > trust-az3:            10.52.168.0/22  10.52.168.1<br clear="none">>  ><br clear="none">>  > Each of these subnets has 2 entries under “host_routes:” that point <br clear="none">> to the other two subnets. For example, subnet trust-az1 has these two <br clear="none">> routes:<br clear="none">>  ><br clear="none">>  > host_routes          | destination='10.52.164.0/22', <br clear="none">> gateway='10.52.160.1' |<br clear="none">>  > |                      | destination='10.52.168.0/22', <br clear="none">> gateway='10.52.160.1' |<br clear="none">>  ><br clear="none">>  > How can we prevent these host routes from being created in Train? Do <br clear="none">> we need to change something in our config?<br clear="none">> <br clear="none">> <br clear="none">>  From the neutron side of things, host_routes of a subnet is not<br clear="none">> automatically calculated and filled-in, they have to be manually added.<br clear="none">> So perhaps this is something kolla is doing? At least on my Yoga setup<br clear="none">> it is completely blank using 'openstack subnet create ...' even with<br clear="none">> multiple subnets on a network.<br clear="none">> <br clear="none">> How exactly are the subnets getting created?<br clear="none">> <br clear="none">> -Brian<br clear="none">> <br clear="none"><br clear="none"></div></div></div>            </div>                </div>