I have been banging my head on this issue for quite some time now. I am hoping that somebody can help me see what I have misconfigured.
Here is the situation.
I have tried setting up several openstack installs, and in none of them am I able to reach the internet from the instances running inside of openstack.
All of them are on Rocky Linux 9.5, running the dalmatian version of openstack, installed using packstack. (I have tried an all-in-one, with everything on a single node, and a cluster with the controller/networking on one node, and the compute running on separate nodes). I can get the cirros instances running on the backend network within openstack, and can ssh to them via the floating ip from the host without issues. The cirros instance can ping other cirros instances in the openstack controlled network (both on the backend network(subnet is in the 192.168.100.0/24 range, or on the external public network(subnet is in the 172.24.4.024 range)
Even trying the simplest configuration, where everything is all on a single node (compute/networking/controller/etc), Everything from instance creation to VM migration/etc all seems to work just fine.
However, the cirros instances cannot ping anything on the internet -- for example, I am unable to ping 8.8.8.8 or even the gateway that the host can reach (The host has an ip used to reach horizon on the 10.61.157.0/24 subnet on our internal lan)
I can ping all interfaces from the cirros interface through the backend_network (192.168.100.0/24) through the public interface (172.24.4.0/24), and can even ping the host ip address (10.61.157.59) . . .However, I can't ping anything beyond that (i.e. the 10.61.147.1 gateway does not ping from the cirros instance)
From the host commandline, it is able to reach everything external just fine (i.e. it can ping it's gateway 10.61.147.1 and 8.8.8.8 or anything else external)
Here is the ip addr output from the host:
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master ovs-system state UP group default qlen 1000
link/ether 00:1d:d8:b7:1e:df brd ff:ff:ff:ff:ff:ff
inet6 fe80::21d:d8ff:feb7:1edf/64 scope link
valid_lft forever preferred_lft forever
3: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
link/ether 56:d8:51:53:10:b0 brd ff:ff:ff:ff:ff:ff
4: br-int: <BROADCAST,MULTICAST> mtu 1442 qdisc noop state DOWN group default qlen 1000
link/ether 62:8c:b0:c2:3e:5a brd ff:ff:ff:ff:ff:ff
5: br-ex: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000
link/ether 00:1d:d8:b7:1e:df brd ff:ff:ff:ff:ff:ff
inet 10.61.157.59/24 brd 10.61.157.255 scope global br-ex
valid_lft forever preferred_lft forever
inet 172.24.4.1/24 brd 172.24.4.255 scope global br-ex
valid_lft forever preferred_lft forever
inet6 fe80::2446:29ff:fe58:6541/64 scope link
valid_lft forever preferred_lft forever
6: tapeffe7cc1-56: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1442 qdisc noqueue master ovs-system state UNKNOWN group default qlen 1000
link/ether fe:16:3e:e2:66:5d brd ff:ff:ff:ff:ff:ff
inet6 fe80::fc16:3eff:fee2:665d/64 scope link
valid_lft forever preferred_lft forever
7: tap65170f1f-e0@if2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master ovs-system state UP group default qlen 1000
link/ether 3a:26:09:cf:3d:4f brd ff:ff:ff:ff:ff:ff link-netns ovnmeta-65170f1f-e837-4b5e-a471-13e783e6b48e
inet6 fe80::3826:9ff:fecf:3d4f/64 scope link
valid_lft forever preferred_lft forever
And the output from the ovs-vsctl show command:
46294eda-8a39-4775-875d-ef6ec9929346
Manager "ptcp:6640:127.0.0.1"
is_connected: true
Bridge br-int
fail_mode: secure
datapath_type: system
Port tap65170f1f-e0
Interface tap65170f1f-e0
Port patch-br-int-to-provnet-371bdb7c-d2f3-4e70-aca9-1c4838c57e24
Interface patch-br-int-to-provnet-371bdb7c-d2f3-4e70-aca9-1c4838c57e24
type: patch
options: {peer=patch-provnet-371bdb7c-d2f3-4e70-aca9-1c4838c57e24-to-br-int}
Port tapeffe7cc1-56
Interface tapeffe7cc1-56
Port br-int
Interface br-int
type: internal
Bridge br-ex
fail_mode: standalone
Port patch-provnet-371bdb7c-d2f3-4e70-aca9-1c4838c57e24-to-br-int
Interface patch-provnet-371bdb7c-d2f3-4e70-aca9-1c4838c57e24-to-br-int
type: patch
options: {peer=patch-br-int-to-provnet-371bdb7c-d2f3-4e70-aca9-1c4838c57e24}
Port br-ex
Interface br-ex
type: internal
Port eth0
Interface eth0
ovs_version: "3.3.1"
Here is the info for the networks/subnets currently configured:
From "openstack network list --long"
+------------------------+-----------------+--------+------------------------+-------+--------+------------------------+--------------+-------------+--------------------+------+
| ID | Name | Status | Project | State | Shared | Subnets | Network Type | Router Type | Availability Zones | Tags |
+------------------------+-----------------+--------+------------------------+-------+--------+------------------------+--------------+-------------+--------------------+------+
| 65170f1f-e837-4b5e-a47 | backend_network | ACTIVE | c5f408c4daed4fb2afefa4 | UP | False | b1e5aef4-77da-4b0b-9b9 | geneve | Internal | | |
| 1-13e783e6b48e | | | 4fa039fe26 | | | 4-5aaf395484e0 | | | | |
| b8e7a305-65f0-44ea-93a | public | ACTIVE | c5f408c4daed4fb2afefa4 | UP | False | 6cff8f70-9dc8-4f17-b78 | flat | External | | |
| a-cc6ec741d408 | | | 4fa039fe26 | | | 0-32cf2aedb017 | | | | |
| c0c67da4-22bf-4dd2-b4c | private | ACTIVE | 2967b1fe70794fa88cbb3d | UP | False | caed16ae-22ff-427a-a37 | geneve | Internal | | |
| 2-2edcb41ffb97 | | | e7227cec77 | | | 0-6b891755bfa7 | | | | |
+------------------------+-----------------+--------+------------------------+-------+--------+------------------------+--------------+-------------+--------------------+------+
From "openstack subnet list --long"
+---------------+---------------+---------------+---------------+---------------+-------+--------------+------------------+-------------+------------+---------------+---------------+------+
| ID | Name | Network | Subnet | Project | DHCP | Name Servers | Allocation Pools | Host Routes | IP Version | Gateway | Service Types | Tags |
+---------------+---------------+---------------+---------------+---------------+-------+--------------+------------------+-------------+------------+---------------+---------------+------+
| 6cff8f70-9dc8 | public_subnet | b8e7a305-65f0 | 172.24.4.0/24 | c5f408c4daed4 | False | | 172.24.4.2-172.2 | | 4 | 172.24.4.1 | | |
| -4f17-b780-32 | | -44ea-93aa- | | fb2afefa44fa0 | | | 4.4.254 | | | | | |
| cf2aedb017 | | cc6ec741d408 | | 39fe26 | | | | | | | | |
| b1e5aef4-77da | backend_subne | 65170f1f-e837 | 192.168.100.0 | c5f408c4daed4 | True | | 192.168.100.100- | | 4 | 192.168.100.1 | | |
| -4b0b-9b94-5a | t | -4b5e-a471-13 | /24 | fb2afefa44fa0 | | | 192.168.100.250 | | | | | |
| af395484e0 | | e783e6b48e | | 39fe26 | | | | | | | | |
| caed16ae-22ff | private_subne | c0c67da4-22bf | 10.0.0.0/24 | 2967b1fe70794 | True | | 10.0.0.2-10.0.0. | | 4 | 10.0.0.1 | | |
| -427a-a370-6b | t | -4dd2-b4c2-2e | | fa88cbb3de722 | | | 254 | | | | | |
| 891755bfa7 | | dcb41ffb97 | | 7cec77 | | | | | | | | |
+---------------+---------------+---------------+---------------+---------------+-------+--------------+------------------+-------------+------------+---------------+---------------+------+
From "openstack floating ip list"
+------------------------------------+---------------------+------------------+------------------------------------+------------------------------------+----------------------------------+
| ID | Floating IP Address | Fixed IP Address | Port | Floating Network | Project |
+------------------------------------+---------------------+------------------+------------------------------------+------------------------------------+----------------------------------+
| 61d98a1c-f19a-451f-9353-6cb8305a0c | 172.24.4.175 | 192.168.100.128 | effe7cc1-566d-4574-b4e3-d9f440b776 | b8e7a305-65f0-44ea-93aa- | c5f408c4daed4fb2afefa44fa039fe26 |
| 2f | | | 5e | cc6ec741d408 | |
+------------------------------------+---------------------+------------------+------------------------------------+------------------------------------+----------------------------------+
From "openstack server list"
+--------------------------------------+-------+--------+-----------------------------------------------+--------------------------+---------+
| ID | Name | Status | Networks | Image | Flavor |
+--------------------------------------+-------+--------+-----------------------------------------------+--------------------------+---------+
| e42372d2-946d-4c90-bf2d-1e36cda80e2f | test3 | ACTIVE | backend_network=172.24.4.175, 192.168.100.128 | N/A (booted from volume) | m1.tiny |
+--------------------------------------+-------+--------+-----------------------------------------------+--------------------------+---------+
Any assistance in helping me figure out what I am missing to get external access would be greatly appreciated.
Thank you!