[Openstack] Networking issues in DevStack
Daniel Watrous
dwmaillist at gmail.com
Thu Aug 28 23:01:56 UTC 2014
Hi,
I’ve been trying to get DevStack working to the point that I could use it
to explore CloudFoundry (
http://docs.cloudfoundry.org/deploying/openstack/validate_openstack.html).
I keep getting stuck with networking glitches. Sometimes it works, but most
of the time it doesn’t. Hopefully you can help. This is how I’m running
DevStack:
http://software.danielwatrous.com/openstack-development-using-devstack/
When I boot my server fresh, the networking interfaces are as shown in the
first block below. The second block below that shows what they look like
after running stack.sh and starting the first guest VM. The IP address
disappears for eth0, but I don’t lose any SSH connections that are
currently live against that interface. When I log in to the instance I
can't access the outside internet. I have tried iptables changes (sudo
iptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE). I have tried
updating /proc/sys/net/ipv4/ip_forward. I can ping the host, the gateway
and the main IP address, including the one that supposedly no longer exists.
Any help appreciated.
******************************************************
**** Fresh boot Ubuntu 14.04 LTS x64 *
**** Two network ports, DHCP obtained IP addresses *
**** Behind a proxy *
******************************************************
watrous at watrous-helion:~$ ifconfig
eth0 Link encap:Ethernet HWaddr 00:1e:c9:b2:40:b3
inet addr:16.85.145.3 Bcast:16.85.147.255 Mask:255.255.252.0
inet6 addr: fe80::21e:c9ff:feb2:40b3/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:277 errors:0 dropped:0 overruns:0 frame:0
TX packets:149 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:29446 (29.4 KB) TX bytes:24038 (24.0 KB)
eth1 Link encap:Ethernet HWaddr 00:1e:c9:b2:40:b5
inet addr:16.85.145.6 Bcast:16.85.147.255 Mask:255.255.252.0
inet6 addr: fe80::21e:c9ff:feb2:40b5/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:177 errors:0 dropped:0 overruns:0 frame:0
TX packets:10 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:15657 (15.6 KB) TX bytes:1372 (1.3 KB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:65536 Metric:1
RX packets:128 errors:0 dropped:0 overruns:0 frame:0
TX packets:128 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:7930 (7.9 KB) TX bytes:7930 (7.9 KB)
virbr0 Link encap:Ethernet HWaddr 66:0f:58:21:8d:7f
inet addr:192.168.122.1 Bcast:192.168.122.255 Mask:255.255.255.0
UP BROADCAST MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
watrous at watrous-helion:~$ ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group
default
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group
default qlen 1000
link/ether 00:1e:c9:b2:40:b3 brd ff:ff:ff:ff:ff:ff
inet 16.85.145.3/22 brd 16.85.147.255 scope global eth0
valid_lft forever preferred_lft forever
inet6 fe80::21e:c9ff:feb2:40b3/64 scope link
valid_lft forever preferred_lft forever
3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group
default qlen 1000
link/ether 00:1e:c9:b2:40:b5 brd ff:ff:ff:ff:ff:ff
inet 16.85.145.6/22 brd 16.85.147.255 scope global eth1
valid_lft forever preferred_lft forever
inet6 fe80::21e:c9ff:feb2:40b5/64 scope link
valid_lft forever preferred_lft forever
4: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state
DOWN group default
link/ether 66:0f:58:21:8d:7f brd ff:ff:ff:ff:ff:ff
inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0
valid_lft forever preferred_lft forever
watrous at watrous-helion:~$ ip route
default via 16.85.144.1 dev eth0
16.85.144.0/22 dev eth0 proto kernel scope link src 16.85.145.3
16.85.144.0/22 dev eth1 proto kernel scope link src 16.85.145.6
192.168.122.0/24 dev virbr0 proto kernel scope link src 192.168.122.1
watrous at watrous-helion:~$ sudo iptables -L
Chain INPUT (policy ACCEPT)
target prot opt source destination
Chain FORWARD (policy ACCEPT)
target prot opt source destination
Chain OUTPUT (policy ACCEPT)
target prot opt source destination
**************************************************
****** After stack.sh and create a new VM ******
**************************************************
watrous at watrous-helion:~$ ifconfig
br100 Link encap:Ethernet HWaddr 00:1e:c9:b2:40:b3
inet addr:10.11.12.1 Bcast:10.11.12.255 Mask:255.255.255.0
inet6 addr: fe80::60ab:b0ff:fe26:9fd/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:887 errors:0 dropped:23 overruns:0 frame:0
TX packets:23 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:292811 (292.8 KB) TX bytes:2367 (2.3 KB)
eth0 Link encap:Ethernet HWaddr 00:1e:c9:b2:40:b3
inet6 addr: fe80::21e:c9ff:feb2:40b3/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:669986 errors:0 dropped:4 overruns:0 frame:0
TX packets:588283 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:597137467 (597.1 MB) TX bytes:593935543 (593.9 MB)
eth1 Link encap:Ethernet HWaddr 00:1e:c9:b2:40:b5
inet addr:16.85.145.6 Bcast:16.85.147.255 Mask:255.255.252.0
inet6 addr: fe80::21e:c9ff:feb2:40b5/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:354520 errors:0 dropped:0 overruns:0 frame:0
TX packets:285578 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:313844137 (313.8 MB) TX bytes:307237034 (307.2 MB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:65536 Metric:1
RX packets:60309 errors:0 dropped:0 overruns:0 frame:0
TX packets:60309 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:20401825 (20.4 MB) TX bytes:20401825 (20.4 MB)
virbr0 Link encap:Ethernet HWaddr 66:0f:58:21:8d:7f
inet addr:192.168.122.1 Bcast:192.168.122.255 Mask:255.255.255.0
UP BROADCAST MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
vnet0 Link encap:Ethernet HWaddr fe:16:3e:f6:f9:b8
inet6 addr: fe80::fc16:3eff:fef6:f9b8/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:31 errors:0 dropped:0 overruns:0 frame:0
TX packets:188 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:500
RX bytes:3004 (3.0 KB) TX bytes:18215 (18.2 KB)
watrous at watrous-helion:~$ ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group
default
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet 169.254.169.254/32 scope link lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master br100
state UP group default qlen 1000
link/ether 00:1e:c9:b2:40:b3 brd ff:ff:ff:ff:ff:ff
inet6 fe80::21e:c9ff:feb2:40b3/64 scope link
valid_lft forever preferred_lft forever
3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group
default qlen 1000
link/ether 00:1e:c9:b2:40:b5 brd ff:ff:ff:ff:ff:ff
inet 16.85.145.6/22 brd 16.85.147.255 scope global eth1
valid_lft forever preferred_lft forever
inet6 fe80::21e:c9ff:feb2:40b5/64 scope link
valid_lft forever preferred_lft forever
4: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state
DOWN group default
link/ether 66:0f:58:21:8d:7f brd ff:ff:ff:ff:ff:ff
inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0
valid_lft forever preferred_lft forever
5: br100: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP
group default
link/ether 00:1e:c9:b2:40:b3 brd ff:ff:ff:ff:ff:ff
inet 10.11.12.1/24 brd 10.11.12.255 scope global br100
valid_lft forever preferred_lft forever
inet 16.85.145.3/22 brd 16.85.147.255 scope global br100
valid_lft forever preferred_lft forever
inet6 fe80::60ab:b0ff:fe26:9fd/64 scope link
valid_lft forever preferred_lft forever
6: vnet0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast
master br100 state UNKNOWN group default qlen 500
link/ether fe:16:3e:f6:f9:b8 brd ff:ff:ff:ff:ff:ff
inet6 fe80::fc16:3eff:fef6:f9b8/64 scope link
valid_lft forever preferred_lft forever
watrous at watrous-helion:~$ ip route
default via 16.85.144.1 dev eth1
10.11.12.0/24 dev br100 proto kernel scope link src 10.11.12.1
16.85.144.0/22 dev eth1 proto kernel scope link src 16.85.145.6
16.85.144.0/22 dev br100 proto kernel scope link src 16.85.145.3
192.168.122.0/24 dev virbr0 proto kernel scope link src 192.168.122.1
watrous at watrous-helion:~$ sudo iptables -L
Chain INPUT (policy ACCEPT)
target prot opt source destination
nova-compute-INPUT all -- anywhere anywhere
nova-network-INPUT all -- anywhere anywhere
nova-api-INPUT all -- anywhere anywhere
Chain FORWARD (policy ACCEPT)
target prot opt source destination
nova-filter-top all -- anywhere anywhere
nova-compute-FORWARD all -- anywhere anywhere
nova-network-FORWARD all -- anywhere anywhere
nova-api-FORWARD all -- anywhere anywhere
Chain OUTPUT (policy ACCEPT)
target prot opt source destination
nova-filter-top all -- anywhere anywhere
nova-compute-OUTPUT all -- anywhere anywhere
nova-network-OUTPUT all -- anywhere anywhere
nova-api-OUTPUT all -- anywhere anywhere
Chain nova-api-FORWARD (1 references)
target prot opt source destination
Chain nova-api-INPUT (1 references)
target prot opt source destination
ACCEPT tcp -- anywhere watrous-helion.americas.hpqcorp.net
tcp dpt:8775
Chain nova-api-OUTPUT (1 references)
target prot opt source destination
Chain nova-api-local (1 references)
target prot opt source destination
Chain nova-compute-FORWARD (1 references)
target prot opt source destination
ACCEPT all -- anywhere anywhere
ACCEPT all -- anywhere anywhere
ACCEPT udp -- 0.0.0.0 255.255.255.255 udp
spt:bootpc dpt:bootps
Chain nova-compute-INPUT (1 references)
target prot opt source destination
ACCEPT udp -- 0.0.0.0 255.255.255.255 udp
spt:bootpc dpt:bootps
Chain nova-compute-OUTPUT (1 references)
target prot opt source destination
Chain nova-compute-inst-2 (1 references)
target prot opt source destination
DROP all -- anywhere anywhere state INVALID
ACCEPT all -- anywhere anywhere state
RELATED,ESTABLISHED
nova-compute-provider all -- anywhere anywhere
ACCEPT udp -- 10.11.12.1 anywhere udp
spt:bootps dpt:bootpc
ACCEPT all -- 10.11.12.0/24 anywhere
nova-compute-sg-fallback all -- anywhere anywhere
Chain nova-compute-local (1 references)
target prot opt source destination
nova-compute-inst-2 all -- anywhere 10.11.12.3
Chain nova-compute-provider (1 references)
target prot opt source destination
Chain nova-compute-sg-fallback (1 references)
target prot opt source destination
DROP all -- anywhere anywhere
Chain nova-filter-top (2 references)
target prot opt source destination
nova-compute-local all -- anywhere anywhere
nova-network-local all -- anywhere anywhere
nova-api-local all -- anywhere anywhere
Chain nova-network-FORWARD (1 references)
target prot opt source destination
ACCEPT all -- anywhere anywhere
ACCEPT all -- anywhere anywhere
Chain nova-network-INPUT (1 references)
target prot opt source destination
ACCEPT udp -- anywhere anywhere udp dpt:bootps
ACCEPT tcp -- anywhere anywhere tcp dpt:bootps
ACCEPT udp -- anywhere anywhere udp dpt:domain
ACCEPT tcp -- anywhere anywhere tcp dpt:domain
Chain nova-network-OUTPUT (1 references)
target prot opt source destination
Chain nova-network-local (1 references)
target prot opt source destination
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20140828/169305eb/attachment.html>
More information about the Openstack
mailing list