[Openstack-operators] Manual router setup
James Denton
james.denton at rackspace.com
Thu Mar 24 00:57:28 UTC 2016
Hi Christopher,
Routers work under Liberty and LinuxBridge just fine, in my experience, so don’t be too quick to give up on them. I promise you’ll have a tougher go at it, at this point, using another virtual machine as a router.
Some tips:
1. Use the ‘ip’ command rather than ‘ifconfig’. Output of ‘ip addr’ would be more helpful here.
2. Use ‘brctl show’ to see the virtual bridges and their members. That output would be helpful here as well.
You have an IP configured on interface enp3s0, and I can’t tell what you have set as the physical interface mappings in the ML2/LinuxBridge agent config. On older email I see this:
>> physical_interface_mappings | public:enp3s0
If that’s still the case, you’re going to have a hard time. The LinuxBridge agent expects to put the enp3s0 interface into the respective brq-* bridge that corresponds to the public (flat) network. Once the interface is in the bridge, you may lose connectivity to/from any address on that interface. At that point, your host will be unable to communicate with the router's gateway interface also in the bridge, and probably any external host. In this configuration, you may consider moving the IP from enp3s0 to the brq-* bridge temporarily. That should work. Give it a try and let me know.
James
From: Christopher Hull <chrishull42 at gmail.com<mailto:chrishull42 at gmail.com>>
Date: Wednesday, March 23, 2016 at 7:21 PM
To: Dan Sneddon <dsneddon at redhat.com<mailto:dsneddon at redhat.com>>
Cc: openstack-operators <openstack-operators at lists.openstack.org<mailto:openstack-operators at lists.openstack.org>>
Subject: Re: [Openstack-operators] Manual router setup
Conclusion. Neutron routers under Liberty (Linux Bridge) don't work. Please prove me wrong..... Moving on to manual router creation.
1: How can I assign a fixed IP to an instance?
2: If I add routes will they get used? I probably have to create a Port for every route (as Floating IPs do ).
------ Session: Trying to create a working router for the 15th time. :-) ----
[root at maersk src]# ifconfig
enp3s0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet 172.22.10.99 netmask 255.255.255.0 broadcast 172.22.10.255
inet6 2602:306:31fd:1020:ae9e:17ff:feec:5d95 prefixlen 64 scopeid 0x0<global>
inet6 fe80::ae9e:17ff:feec:5d95 prefixlen 64 scopeid 0x20<link>
ether ac:9e:17:ec:5d:95 txqueuelen 1000 (Ethernet)
RX packets 238 bytes 16020 (15.6 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 60 bytes 6650 (6.4 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
lo: flags=73<UP,LOOPBACK,RUNNING> mtu 65536
inet 127.0.0.1 netmask 255.0.0.0
inet6 ::1 prefixlen 128 scopeid 0x10<host>
loop txqueuelen 0 (Local Loopback)
RX packets 4985 bytes 1060267 (1.0 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 4985 bytes 1060267 (1.0 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
virbr0: flags=4099<UP,BROADCAST,MULTICAST> mtu 1500
inet 192.168.122.1 netmask 255.255.255.0 broadcast 192.168.122.255
ether 52:54:00:33:94:b3 txqueuelen 0 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
[root at maersk src]# source admin-openrc.sh
[root at maersk src]# clear
[root at maersk src]# neutron net-create public --shared --provider:physical_network public \
> --provider:network_type flat
Created a new network:
+---------------------------+--------------------------------------+
| Field | Value |
+---------------------------+--------------------------------------+
| admin_state_up | True |
| id | 9ee73442-5a86-48c0-84da-8f650937fd08 |
| mtu | 0 |
| name | public |
| port_security_enabled | True |
| provider:network_type | flat |
| provider:physical_network | public |
| provider:segmentation_id | |
| router:external | False |
| shared | True |
| status | ACTIVE |
| subnets | |
| tenant_id | fdf3f98a9b0c4e9e94603d8a84ea41a8 |
+---------------------------+--------------------------------------+
[root at maersk src]# neutron subnet-create public 172.22.10.0/24<http://172.22.10.0/24> --name public \
> --allocation-pool start=172.22.10.10,end=172.22.10.90 \
> --dns-nameserver 172.22.10.254 --gateway 172.22.10.254 --enable_dhcp False
Created a new subnet:
+-------------------+--------------------------------------------------+
| Field | Value |
+-------------------+--------------------------------------------------+
| allocation_pools | {"start": "172.22.10.10", "end": "172.22.10.90"} |
| cidr | 172.22.10.0/24<http://172.22.10.0/24> |
| dns_nameservers | 172.22.10.254 |
| enable_dhcp | False |
| gateway_ip | 172.22.10.254 |
| host_routes | |
| id | 28683bfe-2410-4f9b-b805-ec3c7aee009a |
| ip_version | 4 |
| ipv6_address_mode | |
| ipv6_ra_mode | |
| name | public |
| network_id | 9ee73442-5a86-48c0-84da-8f650937fd08 |
| subnetpool_id | |
| tenant_id | fdf3f98a9b0c4e9e94603d8a84ea41a8 |
+-------------------+--------------------------------------------------+
[root at maersk src]# ifconfig
enp3s0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet 172.22.10.99 netmask 255.255.255.0 broadcast 172.22.10.255
inet6 2602:306:31fd:1020:ae9e:17ff:feec:5d95 prefixlen 64 scopeid 0x0<global>
inet6 fe80::ae9e:17ff:feec:5d95 prefixlen 64 scopeid 0x20<link>
ether ac:9e:17:ec:5d:95 txqueuelen 1000 (Ethernet)
RX packets 5032 bytes 373870 (365.1 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 2602 bytes 3154215 (3.0 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
lo: flags=73<UP,LOOPBACK,RUNNING> mtu 65536
inet 127.0.0.1 netmask 255.0.0.0
inet6 ::1 prefixlen 128 scopeid 0x10<host>
loop txqueuelen 0 (Local Loopback)
RX packets 46701 bytes 12008341 (11.4 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 46701 bytes 12008341 (11.4 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
virbr0: flags=4099<UP,BROADCAST,MULTICAST> mtu 1500
inet 192.168.122.1 netmask 255.255.255.0 broadcast 192.168.122.255
ether 52:54:00:33:94:b3 txqueuelen 0 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
[root at maersk src]# neutron net-list
+--------------------------------------+--------+-----------------------------------------------------+
| id | name | subnets |
+--------------------------------------+--------+-----------------------------------------------------+
| 9ee73442-5a86-48c0-84da-8f650937fd08 | public | 28683bfe-2410-4f9b-b805-ec3c7aee009a 172.22.10.0/24<http://172.22.10.0/24> |
+--------------------------------------+--------+-----------------------------------------------------+
[root at maersk src]# source demo-openrc.sh
[root at maersk src]# neutron net-create private
Created a new network:
+-----------------------+--------------------------------------+
| Field | Value |
+-----------------------+--------------------------------------+
| admin_state_up | True |
| id | 573956a6-1378-4100-83c2-db5c3bf9a95c |
| mtu | 0 |
| name | private |
| port_security_enabled | True |
| router:external | False |
| shared | False |
| status | ACTIVE |
| subnets | |
| tenant_id | 7813be77b1de4196b1c6b77006afa21c |
+-----------------------+--------------------------------------+
[root at maersk src]# neutron subnet-create private 192.168.10.0/24<http://192.168.10.0/24> \
> --name private --dns-nameserver 172.22.10.254 --gateway 192.168.10.1
Created a new subnet:
+-------------------+----------------------------------------------------+
| Field | Value |
+-------------------+----------------------------------------------------+
| allocation_pools | {"start": "192.168.10.2", "end": "192.168.10.254"} |
| cidr | 192.168.10.0/24<http://192.168.10.0/24> |
| dns_nameservers | 172.22.10.254 |
| enable_dhcp | True |
| gateway_ip | 192.168.10.1 |
| host_routes | |
| id | 83f4f5e5-13b6-41f2-af07-b96d86847e2b |
| ip_version | 4 |
| ipv6_address_mode | |
| ipv6_ra_mode | |
| name | private |
| network_id | 573956a6-1378-4100-83c2-db5c3bf9a95c |
| subnetpool_id | |
| tenant_id | 7813be77b1de4196b1c6b77006afa21c |
+-------------------+----------------------------------------------------+
[root at maersk src]# ifconfig
brq573956a6-13: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1450
inet6 fe80::6469:36ff:fecc:a4d8 prefixlen 64 scopeid 0x20<link>
ether da:88:38:4a:06:e1 txqueuelen 0 (Ethernet)
RX packets 4 bytes 264 (264.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 7 bytes 578 (578.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
enp3s0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet 172.22.10.99 netmask 255.255.255.0 broadcast 172.22.10.255
inet6 2602:306:31fd:1020:ae9e:17ff:feec:5d95 prefixlen 64 scopeid 0x0<global>
inet6 fe80::ae9e:17ff:feec:5d95 prefixlen 64 scopeid 0x20<link>
ether ac:9e:17:ec:5d:95 txqueuelen 1000 (Ethernet)
RX packets 5310 bytes 393373 (384.1 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 2661 bytes 3165497 (3.0 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
lo: flags=73<UP,LOOPBACK,RUNNING> mtu 65536
inet 127.0.0.1 netmask 255.0.0.0
inet6 ::1 prefixlen 128 scopeid 0x10<host>
loop txqueuelen 0 (Local Loopback)
RX packets 50779 bytes 13259383 (12.6 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 50779 bytes 13259383 (12.6 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
tapbb0ceef0-e6: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1450
inet6 fe80::e816:29ff:fec8:9925 prefixlen 64 scopeid 0x20<link>
ether ea:16:29:c8:99:25 txqueuelen 1000 (Ethernet)
RX packets 7 bytes 578 (578.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 13 bytes 1066 (1.0 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
virbr0: flags=4099<UP,BROADCAST,MULTICAST> mtu 1500
inet 192.168.122.1 netmask 255.255.255.0 broadcast 192.168.122.255
ether 52:54:00:33:94:b3 txqueuelen 0 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
vxlan-92: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1450
inet6 fe80::d888:38ff:fe4a:6e1 prefixlen 64 scopeid 0x20<link>
ether da:88:38:4a:06:e1 txqueuelen 0 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 16 overruns 0 carrier 0 collisions 0
[root at maersk src]# source admin-openrc.sh
[root at maersk src]# neutron net-update public --router:external
Updated network: public
[root at maersk src]# source demo-openrc.sh
[root at maersk src]# neutron router-create router
Created a new router:
+-----------------------+--------------------------------------+
| Field | Value |
+-----------------------+--------------------------------------+
| admin_state_up | True |
| external_gateway_info | |
| id | ff6a61f5-f497-43a1-b245-64ec8e87b488 |
| name | router |
| routes | |
| status | ACTIVE |
| tenant_id | 7813be77b1de4196b1c6b77006afa21c |
+-----------------------+--------------------------------------+
[root at maersk src]# neutron router-interface-add router private
Multiple router matches found for name 'router', use an ID to be more specific.
[root at maersk src]# neutron router-list
+--------------------------------------+--------+-----------------------+
| id | name | external_gateway_info |
+--------------------------------------+--------+-----------------------+
| 5939b796-cae6-4d72-8d34-66e20afb95aa | router | null |
| ff6a61f5-f497-43a1-b245-64ec8e87b488 | router | null |
+--------------------------------------+--------+-----------------------+
[root at maersk src]# neutron router-delete 5939b796-cae6-4d72-8d34-66e20afb95aa
Deleted router: 5939b796-cae6-4d72-8d34-66e20afb95aa
[root at maersk src]# neutron router-delete ff6a61f5-f497-43a1-b245-64ec8e87b488
Deleted router: ff6a61f5-f497-43a1-b245-64ec8e87b488
[root at maersk src]# neutron router-create router
Created a new router:
+-----------------------+--------------------------------------+
| Field | Value |
+-----------------------+--------------------------------------+
| admin_state_up | True |
| external_gateway_info | |
| id | a1be1dbd-1a94-4a8c-8093-45a7af89140c |
| name | router |
| routes | |
| status | ACTIVE |
| tenant_id | 7813be77b1de4196b1c6b77006afa21c |
+-----------------------+--------------------------------------+
[root at maersk src]# neutron router-interface-add router private
Added interface 74c0d2df-3944-43d7-8be9-2ef0d9242edc to router router.
[root at maersk src]# neutron router-gateway-set router public
Set gateway for router router
[root at maersk src]# source admin-openrc.sh
[root at maersk src]# ip netns
qrouter-a1be1dbd-1a94-4a8c-8093-45a7af89140c (id: 1)
qdhcp-573956a6-1378-4100-83c2-db5c3bf9a95c (id: 0)
[root at maersk src]# neutron router-port-list router
+--------------------------------------+------+-------------------+-------------------------------------------------------------------------------------+
| id | name | mac_address | fixed_ips |
+--------------------------------------+------+-------------------+-------------------------------------------------------------------------------------+
| 21c8decf-e4c8-4467-9266-ca5cfb9c7c20 | | fa:16:3e:d6:29:b4 | {"subnet_id": "28683bfe-2410-4f9b-b805-ec3c7aee009a", "ip_address": "172.22.10.10"} |
| 74c0d2df-3944-43d7-8be9-2ef0d9242edc | | fa:16:3e:7b:d6:0f | {"subnet_id": "83f4f5e5-13b6-41f2-af07-b96d86847e2b", "ip_address": "192.168.10.1"} |
+--------------------------------------+------+-------------------+-------------------------------------------------------------------------------------+
[root at maersk src]# ping 172.22.10.10
PING 172.22.10.10 (172.22.10.10) 56(84) bytes of data.
From 172.22.10.99 icmp_seq=1 Destination Host Unreachable
From 172.22.10.99 icmp_seq=2 Destination Host Unreachable
From 172.22.10.99 icmp_seq=3 Destination Host Unreachable
From 172.22.10.99 icmp_seq=4 Destination Host Unreachable
From 172.22.10.99 icmp_seq=5 Destination Host Unreachable
From 172.22.10.99 icmp_seq=6 Destination Host Unreachable
From 172.22.10.99 icmp_seq=7 Destination Host Unreachable
From 172.22.10.99 icmp_seq=8 Destination Host Unreachable
^C
--- 172.22.10.10 ping statistics ---
8 packets transmitted, 0 received, +8 errors, 100% packet loss, time 7000ms
pipe 4
[root at maersk src]# ifconfig
brq573956a6-13: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1450
inet6 fe80::6469:36ff:fecc:a4d8 prefixlen 64 scopeid 0x20<link>
ether 72:65:0b:f7:66:9c txqueuelen 0 (Ethernet)
RX packets 6 bytes 348 (348.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 8 bytes 648 (648.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
enp3s0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet 172.22.10.99 netmask 255.255.255.0 broadcast 172.22.10.255
inet6 2602:306:31fd:1020:ae9e:17ff:feec:5d95 prefixlen 64 scopeid 0x0<global>
inet6 fe80::ae9e:17ff:feec:5d95 prefixlen 64 scopeid 0x20<link>
ether ac:9e:17:ec:5d:95 txqueuelen 1000 (Ethernet)
RX packets 6360 bytes 464736 (453.8 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 2867 bytes 3196849 (3.0 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
lo: flags=73<UP,LOOPBACK,RUNNING> mtu 65536
inet 127.0.0.1 netmask 255.0.0.0
inet6 ::1 prefixlen 128 scopeid 0x10<host>
loop txqueuelen 0 (Local Loopback)
RX packets 65582 bytes 17827940 (17.0 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 65582 bytes 17827940 (17.0 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
tap74c0d2df-39: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1450
inet6 fe80::7065:bff:fef7:669c prefixlen 64 scopeid 0x20<link>
ether 72:65:0b:f7:66:9c txqueuelen 1000 (Ethernet)
RX packets 10 bytes 864 (864.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 8 bytes 648 (648.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
tapbb0ceef0-e6: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1450
inet6 fe80::e816:29ff:fec8:9925 prefixlen 64 scopeid 0x20<link>
ether ea:16:29:c8:99:25 txqueuelen 1000 (Ethernet)
RX packets 8 bytes 648 (648.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 16 bytes 1248 (1.2 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
virbr0: flags=4099<UP,BROADCAST,MULTICAST> mtu 1500
inet 192.168.122.1 netmask 255.255.255.0 broadcast 192.168.122.255
ether 52:54:00:33:94:b3 txqueuelen 0 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
vxlan-92: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1450
inet6 fe80::d888:38ff:fe4a:6e1 prefixlen 64 scopeid 0x20<link>
ether da:88:38:4a:06:e1 txqueuelen 0 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 19 overruns 0 carrier 0 collisions 0
- Christopher T. Hull
I am presently seeking a new career opportunity Please see career page
http://chrishull.com/career
333 Orchard Ave, Sunnyvale CA. 94085
(415) 385 4865
chrishull42 at gmail.com<mailto:chrishull42 at gmail.com>
http://chrishull.com
On Wed, Mar 23, 2016 at 4:34 PM, Dan Sneddon <dsneddon at redhat.com<mailto:dsneddon at redhat.com>> wrote:
On 03/23/2016 04:06 PM, Christopher Hull wrote:
> Hmmm. Well I'm not using OpenVSwitch. Just LinuxBridge. My CentOS
> 7 install sees emp3s0 where eth0 would usually appear. But this may
> need to be changed to br-ex? The IP address no longer apperas at
> enp3s0, so perhaps that's the issue.
>
> When I make changes, I tear down all the networks and rebuild them
> according to instructions. I do this after restarting the machine. I
> wonder if the database needs to be updated as well.
>
> su -s /bin/sh -c "neutron-db-manage --config-file
> /etc/neutron/neutron.conf \
> --config-file /etc/neutron/plugins/ml2/ml2_conf.ini upgrade head" neutron
> systemctl stop neutron-server.service \
> neutron-linuxbridge-agent.service neutron-dhcp-agent.service \
> neutron-metadata-agent.service
> systemctl stop neutron-l3-agent.service
> and restart.
>
> Thanks for the help. Yes. It's a bit confusing. Why are router and
> instance ports different? It is for this reason that I figured I could
> just create my own instance/router. But why should I have to? Do
> routers not work unless you use OpenVSwitch? The Liberty install
> instructions (unlike Kilo) don't seem to require installing OpenVSwitch.
>
> linux_bridge_agent.ini
> inux_bridge | physical_interface_mappings | public:enp3s0
>
> Perhaps br-ex? Or whereever I see my static IP when doing an
> ifconfig :-) Was enp3s0 when CentOS was first installed, but I think
> thats changed somehow.
>
> +----------------------------+-----------------------------+--------------------------------------------------------------+
> | linuxbridge_agent: Section | Key |
> Value |
> +----------------------------+-----------------------------+--------------------------------------------------------------+
> | linux_bridge | physical_interface_mappings |
> public:enp3s0 |
> | vxlan | l2_population |
> True |
> | vxlan | local_ip |
> 172.22.10.99 |
> | vxlan | enable_vxlan |
> True |
> | agent | prevent_arp_spoofing |
> True |
> | securitygroup | firewall_driver |
> neutron.agent.linux.iptables_firewall.IptablesFirewallDriver |
> | securitygroup | enable_security_group |
> True |
> +----------------------------+-----------------------------+--------------------------------------------------------------+
>
>
>
> - Christopher T. Hull
> I am presently seeking a new career opportunity Please see career page
> http://chrishull.com/career
> 333 Orchard Ave, Sunnyvale CA. 94085
> (415) 385 4865<tel:%28415%29%20385%204865> <tel:%28415%29%20385%204865>
> chrishull42 at gmail.com<mailto:chrishull42 at gmail.com> <mailto:chrishull42 at gmail.com<mailto:chrishull42 at gmail.com>>
> http://chrishull.com
>
>
>
> On Wed, Mar 23, 2016 at 3:34 PM, Dan Sneddon <dsneddon at redhat.com<mailto:dsneddon at redhat.com>
> <mailto:dsneddon at redhat.com<mailto:dsneddon at redhat.com>>> wrote:
>
> On 03/23/2016 03:05 PM, Christopher Hull wrote:
> > Hi Keven / all;
> >
> > Re: Getting a Neutron Router to work. (set external_network_bridge =
> > blank). Apologies if this got sent twice.
> >
> > Nope, not quite there yet re getting the damn router to work
> (week 3 on
> > this issue).
> >
> > The Liberty install instructions indeed say to set...
> > external_network_bridge =
> >
> > I'm so desperate that I thought the blank space after the = might be
> > the issue. No. Then I noticed these instructions in
> l3_agent.ini itself.
> > -----
> > # When external_network_bridge is set, each L3 agent can be
> associated
> > # with no more than one external network. This value should be set to
> > the UUID
> > # of that external network. To allow L3 agent support multiple
> external
> > # networks, both the external_network_bridge and
> > gateway_external_network_id
> > # must be left empty.
> > # gateway_external_network_id =
> > ----
> >
> > 1: Should gateway_external_network_id = be unoommented?
> > 2: Should I reupdate the database after these changes?
> > su -s /bin/sh -c "neutron-db-manage --config-file
> > /etc/neutron/neutron.conf \
> > --config-file /etc/neutron/plugins/ml2/ml2_conf.ini upgrade
> head" neutron
> >
> > 3: Should external_network_bridge in fact be set to the UUID of the
> > public network?
> >
> > 4. All instances Ports work just fine on public and private network.
> > WHAT is the difference between a Neutron router northbound port
> and an
> > instance port on the public net.
> >
> > Services restarted after config change (just removed space after =
> > actually just in case sloppy Python coding was involved here). In
> > fact, I rebooted the box just to be sure.
> >
> > Making my own instance based router is looking better and better all
> > the time. If Neutron Routers really work, maybe UFO's exist too.
> > :-) j/k
> >
> >
> > Seriously. Thank you for your help. Hope to help the community
> > soon too myself. Trying to get my Gerrit account up and running but
> > the OpenStack.org site won't allow me to sign the Contrib agreement
> > with out getting a server error.
> >
> >
> > ==== Config Details ======
> > Issue Neutron Router Northbound Port won't Ping, is Down
> >
> > [root at maersk src]# ./pluto.py show -p /etc neutron rootwrap.conf
> > ml2_conf.ini l3_agent.ini linuxbridge_agent.ini dhcp_agent.ini
> >
> +-----------------------+------------------------------------+-------------------------------------------------+
> > | neutron: Section | Key |
> > Value |
> >
> +-----------------------+------------------------------------+-------------------------------------------------+
> > | DEFAULT | verbose |
> > True |
> > | DEFAULT | nova_url |
> > http://controller:8774/v2 |
> > | DEFAULT | notify_nova_on_port_data_changes |
> > True |
> > | DEFAULT | notify_nova_on_port_status_changes |
> > True |
> > | DEFAULT | auth_strategy |
> > keystone |
> > | DEFAULT | rpc_backend |
> > rabbit |
> > | DEFAULT | allow_overlapping_ips |
> > True |
> > | DEFAULT | service_plugins |
> > router |
> > | DEFAULT | core_plugin |
> > ml2 |
> > | keystone_authtoken | password |
> > mk4968small23buggidntpass |
> > | keystone_authtoken | username |
> > neutron |
> > | keystone_authtoken | project_name |
> > service |
> > | keystone_authtoken | user_domain_id |
> > default |
> > | keystone_authtoken | project_domain_id |
> > default |
> > | keystone_authtoken | auth_plugin |
> > password |
> > | keystone_authtoken | auth_url |
> > http://controller:35357 |
> > | keystone_authtoken | auth_uri |
> > http://controller:5000 |
> > | database | connection |
> > mysql://neutron:sleestack191@controller/neutron |
> > | nova | password |
> > mk4968small23buggidntpass |
> > | nova | username |
> > nova |
> > | nova | project_name |
> > service |
> > | nova | region_name |
> > RegionOne |
> > | nova | user_domain_id |
> > default |
> > | nova | project_domain_id |
> > default |
> > | nova | auth_plugin |
> > password |
> > | nova | auth_url |
> > http://controller:35357 |
> > | oslo_concurrency | lock_path |
> > /var/lib/neutron/tmp |
> > | oslo_messaging_rabbit | rabbit_password |
> > open.g00dke232 |
> > | oslo_messaging_rabbit | rabbit_userid |
> > openstack |
> > | oslo_messaging_rabbit | rabbit_host |
> > controller |
> >
> +-----------------------+------------------------------------+-------------------------------------------------+
> >
> +-------------------+---------------------+--------------------------------------------------------------+
> > | rootwrap: Section | Key |
> > Value |
> >
> +-------------------+---------------------+--------------------------------------------------------------+
> > | DEFAULT | filters_path |
> > /etc/cinder/rootwrap.d,/usr/share/cinder/rootwrap |
> > | DEFAULT | exec_dirs |
> > /sbin,/usr/sbin,/bin,/usr/bin,/usr/local/bin,/usr/local/sbin |
> > | DEFAULT | use_syslog |
> > False |
> > | DEFAULT | syslog_log_facility |
> > syslog |
> > | DEFAULT | syslog_log_level |
> > ERROR |
> >
> +-------------------+---------------------+--------------------------------------------------------------+
> >
> +-------------------+----------------------+--------------------------+
> > | ml2_conf: Section | Key | Value
> |
> >
> +-------------------+----------------------+--------------------------+
> > | ml2 | extension_drivers | port_security
> |
> > | ml2 | mechanism_drivers |
> linuxbridge,l2population |
> > | ml2 | tenant_network_types | vxlan
> |
> > | ml2 | type_drivers | flat,vlan,vxlan
> |
> > | ml2_type_flat | flat_networks | public
> |
> > | ml2_type_vxlan | vni_ranges | 1:1000
> |
> > | securitygroup | enable_ipset | True
> |
> >
> +-------------------+----------------------+--------------------------+
> >
> +-------------------+--------------------------+-----------------------------------------------------+
> > | l3_agent: Section | Key |
> > Value |
> >
> +-------------------+--------------------------+-----------------------------------------------------+
> > | DEFAULT | external_network_bridge
> > | |
> > | DEFAULT | verbose |
> > True |
> > | DEFAULT | interface_driver |
> > neutron.agent.linux.interface.BridgeInterfaceDriver |
> >
> +-------------------+--------------------------+-----------------------------------------------------+
> >
> +----------------------------+-----------------------------+--------------------------------------------------------------+
> > | linuxbridge_agent: Section | Key |
> > Value |
> >
> +----------------------------+-----------------------------+--------------------------------------------------------------+
> > | linux_bridge | physical_interface_mappings |
> > public:enp3s0 |
> > | vxlan | l2_population |
> > True |
> > | vxlan | local_ip |
> > 172.22.10.99 |
> > | vxlan | enable_vxlan |
> > True |
> > | agent | prevent_arp_spoofing |
> > True |
> > | securitygroup | firewall_driver |
> > neutron.agent.linux.iptables_firewall.IptablesFirewallDriver |
> > | securitygroup | enable_security_group |
> > True |
> >
> +----------------------------+-----------------------------+--------------------------------------------------------------+
> >
> +---------------------+--------------------------+-----------------------------------------------------+
> > | dhcp_agent: Section | Key |
> > Value |
> >
> +---------------------+--------------------------+-----------------------------------------------------+
> > | DEFAULT | dnsmasq_config_file |
> > /etc/neutron/dnsmasq-neutron.conf |
> > | DEFAULT | verbose |
> > True |
> > | DEFAULT | enable_isolated_metadata |
> > True |
> > | DEFAULT | dhcp_driver |
> > neutron.agent.linux.dhcp.Dnsmasq |
> > | DEFAULT | interface_driver |
> > neutron.agent.linux.interface.BridgeInterfaceDriver |
> >
> +---------------------+--------------------------+-----------------------------------------------------+
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > - Christopher T. Hull
> > I am presently seeking a new career opportunity Please see
> career page
> > http://chrishull.com/career
> > 333 Orchard Ave, Sunnyvale CA. 94085
> > (415) 385 4865<tel:%28415%29%20385%204865> <tel:%28415%29%20385%204865>
> > chrishull42 at gmail.com<mailto:chrishull42 at gmail.com> <mailto:chrishull42 at gmail.com<mailto:chrishull42 at gmail.com>>
> <mailto:chrishull42 at gmail.com<mailto:chrishull42 at gmail.com> <mailto:chrishull42 at gmail.com<mailto:chrishull42 at gmail.com>>>
> > http://chrishull.com
> >
> >
> >
> > On Wed, Mar 23, 2016 at 8:50 AM, <chrishull42 at gmail.com<mailto:chrishull42 at gmail.com> <mailto:chrishull42 at gmail.com<mailto:chrishull42 at gmail.com>>
> > <mailto:chrishull42 at gmail.com<mailto:chrishull42 at gmail.com> <mailto:chrishull42 at gmail.com<mailto:chrishull42 at gmail.com>>>> wrote:
> >
> > Thanks. Will check that.
> > When I create an instance in the public or private nets they ping.
> > Why do router ports behave differently than instance ports? Only
> > the Northbound router port is down and won't ping. Will check
> > settings ASAP thanks
> >
> > Chris.
> >
> > Sent from my iPhone
> >
> > On Mar 23, 2016, at 7:52 AM, Kevin Benton <kevin at benton.pub<mailto:kevin at benton.pub>
> > <mailto:kevin at benton.pub<mailto:kevin at benton.pub> <mailto:kevin at benton.pub<mailto:kevin at benton.pub>>>> wrote:
> >
> >> Ok. The same settings should apply to Linux bridge.
> >>
> >> Make sure you have external_network_bridge defined in your L3
> >> agent as an empty value.
> >>
> >> Then your external network should be created with the provider
> >> type of 'flat' and the physical network corresponding to the one
> >> you have defined in your bridge mappings in the L2 agent that
> >> attaches to the bridge going to your external physical network.
> >>
> >> On Mar 23, 2016 7:25 AM, <chrishull42 at gmail.com<mailto:chrishull42 at gmail.com> <mailto:chrishull42 at gmail.com<mailto:chrishull42 at gmail.com>>
> >> <mailto:chrishull42 at gmail.com<mailto:chrishull42 at gmail.com> <mailto:chrishull42 at gmail.com<mailto:chrishull42 at gmail.com>>>> wrote:
> >>
> >> Kevin;
> >> Thank you Very much. I'll check. I did a manual Liberty
> >> install so I may have done something wrong. I am using
> >> LinuxBridge (not OpenVSwitch) if that helps. Will post
> >> results to list soon. Would like to be able to use floating
> >> IPs, a more convenient form of ipTables basically.
> >>
> >> Chris.
> >>
> >> Sent from my iPhone
> >>
> >> On Mar 23, 2016, at 7:16 AM, Kevin Benton <kevin at benton.pub<mailto:kevin at benton.pub>
> >> <mailto:kevin at benton.pub<mailto:kevin at benton.pub> <mailto:kevin at benton.pub<mailto:kevin at benton.pub>>>> wrote:
> >>
> >>> Do you have external_network_bridge set to an empty value in
> >>> the l3 agent config? If not, the l3 agent will use a legacy
> >>> mode of wiring up the port and it's status field may not be
> >>> ACTIVE.
> >>>
> >>> The routers are tested thousands of times in the gate every
> >>> day, so they work. It's just a matter of getting your
> >>> configuration correct.
> >>>
> >>> Yes, you can use a VM to route as well.
> >>>
> >>> On Mar 23, 2016 7:06 AM, <chrishull42 at gmail.com<mailto:chrishull42 at gmail.com> <mailto:chrishull42 at gmail.com<mailto:chrishull42 at gmail.com>>
> >>> <mailto:chrishull42 at gmail.com<mailto:chrishull42 at gmail.com> <mailto:chrishull42 at gmail.com<mailto:chrishull42 at gmail.com>>>> wrote:
> >>>
> >>> Hi all;
> >>> It appears that Liberty Neutron routers do not work.
> >>> The Northbound port is always Down.
> >>>
> >>> What I'd like to do is dedicate an instance (CentOS) to
> >>> routing between the Public net and other nets. Has
> >>> anyone done this. Setting up the router is trivial.
> >>> But I'm a little worried about interaction with Neutron
> >>> Ports. I need to assign fixed IPs so I can route from
> >>> the Internet to a server instance.
> >>>
> >>> Ideas?
> >>>
> >>> Thanks
> >>> - Chris.
> >>>
> >>> Sent from my iPhone
> >>> _______________________________________________
> >>> OpenStack-operators mailing list
> >>> OpenStack-operators at lists.openstack.org<mailto:OpenStack-operators at lists.openstack.org>
> <mailto:OpenStack-operators at lists.openstack.org<mailto:OpenStack-operators at lists.openstack.org>>
> >>> <mailto:OpenStack-operators at lists.openstack.org<mailto:OpenStack-operators at lists.openstack.org>
> <mailto:OpenStack-operators at lists.openstack.org<mailto:OpenStack-operators at lists.openstack.org>>>
> >>>
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
> >>>
> >
> >
> >
> > _______________________________________________
> > OpenStack-operators mailing list
> > OpenStack-operators at lists.openstack.org<mailto:OpenStack-operators at lists.openstack.org>
> <mailto:OpenStack-operators at lists.openstack.org<mailto:OpenStack-operators at lists.openstack.org>>
> > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
> >
>
> Definitely the external_network_bridge needs to be explicitly set to
> nothing. That's not the default. I've never had to change the default
> gateway_external_network_id when I set external_network_bridge to a
> blank value.
>
> Note that after making changes to external_network_bridge, I've have to
> delete and recreate the router/port/network that was created before
> that change.
>
> I assume that your bridge mappings are correct in
> /etc/neutron/plugins/openvswitch/ovs_neutron_plugin.ini:
>
> bridge_mappings =datacentre:br-ex # or whatever you have locally
>
> And that the physical_network of the external network matches the
> network name in the bridge_mappings that corresponds to the bridge
> containing the physical interface? Probably your instance ports
> wouldn't work if those things weren't correct, but those are also areas
> where I see failures similar to this.
>
> --
> Dan Sneddon | Principal OpenStack Engineer
> dsneddon at redhat.com<mailto:dsneddon at redhat.com> <mailto:dsneddon at redhat.com<mailto:dsneddon at redhat.com>> |
> redhat.com/openstack<http://redhat.com/openstack> <http://redhat.com/openstack>
> 650.254.4025<tel:650.254.4025> <tel:650.254.4025<tel:650.254.4025>> | dsneddon:irc @dxs:twitter
>
>
>
>
> _______________________________________________
> OpenStack-operators mailing list
> OpenStack-operators at lists.openstack.org<mailto:OpenStack-operators at lists.openstack.org>
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
>
I didn't mean to confuse you by assuming that you were running Open
vSwitch. You don't have to run Open vSwitch, and some things do work
differently when using Linux bridge.
If your IP address is no longer on enp3s0, then that might be an
indicator that you have a bridge subsuming enp3s0. In that case, I'm
pretty sure that the physical_interface_mapping should be
public:<bridge>. I spend a lot more time with OVS deployments, though.
--
Dan Sneddon | Principal OpenStack Engineer
dsneddon at redhat.com<mailto:dsneddon at redhat.com> | redhat.com/openstack<http://redhat.com/openstack>
650.254.4025<tel:650.254.4025> | dsneddon:irc @dxs:twitter
_______________________________________________
OpenStack-operators mailing list
OpenStack-operators at lists.openstack.org<mailto:OpenStack-operators at lists.openstack.org>
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack-operators/attachments/20160324/5393688c/attachment-0001.html>
More information about the OpenStack-operators
mailing list