[Openstack] [devstack] [Neutron] Multi host installation cannot ping VM from compute node
Mark Kirkwood
mark.kirkwood at catalyst.net.nz
Wed Nov 19 22:45:28 UTC 2014
Hi,
I have a small multi host devstack setup running from from 2 Ubuntu
14.04 hosts (themselves VMs):
- controller node (stack1) running everything except compute
- compute node (stack2) running compute only
If I amend the default security group to allow ping and start a VM:
stack1 $ neutron security-group-rule-create --protocol icmp
--direction ingress default
stack1 $ nova boot --image cirros-0.3.2-x86_64-uec --flavor 1 cirros0
stack1 $ nova list
+--------------------------------------+---------+--------+------------+-------------+------------------+
| ID | Name | Status | Task State |
Power State | Networks |
+--------------------------------------+---------+--------+------------+-------------+------------------+
| 2bebd3c2-0bab-41b7-b0dd-555b49fd147a | cirros0 | ACTIVE | - |
Running | private=10.0.0.2 |
+--------------------------------------+---------+--------+------------+-------------+------------------+
stack1 $ ping 10.0.0.2
PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data.
64 bytes from 10.0.0.2: icmp_seq=1 ttl=63 time=2.99 ms
But from the compute node:
stack2 $ ping 10.0.0.2
(hangs)
It looks like I'm missing a route or nat rule of some kind:
stack1 $ route
$ route
Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use
Iface
default 192.168.122.1 0.0.0.0 UG 0 0 0 eth0
10.0.0.0 172.24.4.2 255.255.255.0 UG 0 0 0
br-ex
172.24.4.0 * 255.255.255.0 U 0 0 0
br-ex
192.168.122.0 * 255.255.255.0 U 0 0 0 eth0
stack2 $ route
$ route
Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use
Iface
default 192.168.122.1 0.0.0.0 UG 0 0 0 eth0
192.168.122.0 * 255.255.255.0 U 0 0 0 eth0
My local.conf config for the two hosts are:
stack1 $ cat local.conf
[[local|localrc]]
ADMIN_PASSWORD=password
MYSQL_PASSWORD=password
RABBIT_PASSWORD=password
SERVICE_PASSWORD=password
SERVICE_TOKEN=tokentoken
ENABLED_SERVICES=rabbit,mysql,key
ENABLED_SERVICES+=,-n-net
ENABLED_SERVICES+=,n-api,n-crt,n-obj,n-cond,n-sch,n-novnc,n-cauth
ENABLED_SERVICES+=,neutron,q-svc,q-agt,q-dhcp,q-l3,q-meta
ENABLED_SERVICES+=,g-api,g-reg
ENABLED_SERVICES+=,cinder,c-api,c-vol,c-sch,c-bak
ENABLED_SERVICES+=,horizon
# Multi host stuff
MULTI_HOST=True
HOST_IP=192.168.122.31
stack2 $ cat local.conf
[[local|localrc]]
ADMIN_PASSWORD=password
MYSQL_PASSWORD=password
RABBIT_PASSWORD=password
SERVICE_PASSWORD=password
SERVICE_TOKEN=tokentoken
ENABLED_SERVICES=rabbit
ENABLED_SERVICES+=,n-cpu
ENABLED_SERVICES+=,neutron,q-agt
# Multi host stuff
MULTI_HOST=True
HOST_IP=192.168.122.32
DATABASE_TYPE=mysql
SERVICE_HOST=192.168.122.31
MYSQL_HOST=192.168.122.31
RABBIT_HOST=192.168.122.31
GLANCE_HOSTPORT=192.168.122.31:9292
Q_HOST=192.168.122.31
The interfaces and ovs setup for each host are:
stack1 $ ifconfig
br-ex Link encap:Ethernet HWaddr 46:c4:42:d3:44:4f
inet addr:172.24.4.1 Bcast:0.0.0.0 Mask:255.255.255.0
UP BROADCAST RUNNING MTU:1500 Metric:1
RX packets:18 errors:0 dropped:0 overruns:0 frame:0
TX packets:7 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:1280 (1.2 KB) TX bytes:550 (550.0 B)
br-int Link encap:Ethernet HWaddr 5e:c1:4f:ab:13:4e
inet6 addr: fe80::f8e7:1aff:fe6e:b38d/64 Scope:Link
UP BROADCAST RUNNING MTU:1500 Metric:1
RX packets:37 errors:0 dropped:0 overruns:0 frame:0
TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:3348 (3.3 KB) TX bytes:648 (648.0 B)
br-tun Link encap:Ethernet HWaddr f6:bf:2d:bc:ec:43
inet6 addr: fe80::f8a9:c6ff:fe7e:c1e6/64 Scope:Link
UP BROADCAST RUNNING MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:648 (648.0 B)
eth0 Link encap:Ethernet HWaddr 52:54:00:54:45:8a
inet addr:192.168.122.31 Bcast:192.168.122.255
Mask:255.255.255.0
inet6 addr: fe80::5054:ff:fe54:458a/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:15438 errors:0 dropped:379 overruns:0 frame:0
TX packets:21504 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:1890780 (1.8 MB) TX bytes:37703250 (37.7 MB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:65536 Metric:1
RX packets:47756 errors:0 dropped:0 overruns:0 frame:0
TX packets:47756 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:46111186 (46.1 MB) TX bytes:46111186 (46.1 MB)
stack1 $ sudo ovs-vsctl show
77c5a374-8c18-42fe-bf1c-b96e6655068b
Bridge br-int
fail_mode: secure
Port "tap2790ca1b-e6"
tag: 1
Interface "tap2790ca1b-e6"
type: internal
Port br-int
Interface br-int
type: internal
Port patch-tun
Interface patch-tun
type: patch
options: {peer=patch-int}
Port "qr-bdc3eb4c-c6"
tag: 1
Interface "qr-bdc3eb4c-c6"
type: internal
Bridge br-tun
Port patch-int
Interface patch-int
type: patch
options: {peer=patch-tun}
Port br-tun
Interface br-tun
type: internal
Port "vxlan-c0a87a20"
Interface "vxlan-c0a87a20"
type: vxlan
options: {df_default="true", in_key=flow,
local_ip="192.168.122.31", out_key=flow, remote_ip="192.168.122.32"}
Bridge br-ex
Port "qg-cb7143ae-dd"
Interface "qg-cb7143ae-dd"
type: internal
Port br-ex
Interface br-ex
type: internal
ovs_version: "2.0.2"
stack2 $ ifconfig
br-int Link encap:Ethernet HWaddr 7e:c2:ed:6f:43:44
inet6 addr: fe80::6c62:63ff:fe41:13dd/64 Scope:Link
UP BROADCAST RUNNING MTU:1500 Metric:1
RX packets:26 errors:0 dropped:0 overruns:0 frame:0
TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:2466 (2.4 KB) TX bytes:648 (648.0 B)
br-tun Link encap:Ethernet HWaddr 16:df:31:94:ea:4d
inet6 addr: fe80::ccca:a7ff:fee8:3a4e/64 Scope:Link
UP BROADCAST RUNNING MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:648 (648.0 B)
eth0 Link encap:Ethernet HWaddr 52:54:00:64:b7:40
inet addr:192.168.122.32 Bcast:192.168.122.255
Mask:255.255.255.0
inet6 addr: fe80::5054:ff:fe64:b740/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:11226 errors:0 dropped:263 overruns:0 frame:0
TX packets:10784 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:35496422 (35.4 MB) TX bytes:2089639 (2.0 MB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:65536 Metric:1
RX packets:758 errors:0 dropped:0 overruns:0 frame:0
TX packets:758 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:41256 (41.2 KB) TX bytes:41256 (41.2 KB)
qbr864f4c91-5f Link encap:Ethernet HWaddr b2:29:c2:2f:bb:23
inet6 addr: fe80::3c67:2dff:fe0d:2225/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:19 errors:0 dropped:0 overruns:0 frame:0
TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:1642 (1.6 KB) TX bytes:648 (648.0 B)
qvb864f4c91-5f Link encap:Ethernet HWaddr b2:29:c2:2f:bb:23
inet6 addr: fe80::b029:c2ff:fe2f:bb23/64 Scope:Link
UP BROADCAST RUNNING PROMISC MULTICAST MTU:1500 Metric:1
RX packets:24 errors:0 dropped:0 overruns:0 frame:0
TX packets:35 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:2448 (2.4 KB) TX bytes:3262 (3.2 KB)
qvo864f4c91-5f Link encap:Ethernet HWaddr 8a:d6:c5:cf:f8:5e
inet6 addr: fe80::88d6:c5ff:fecf:f85e/64 Scope:Link
UP BROADCAST RUNNING PROMISC MULTICAST MTU:1500 Metric:1
RX packets:35 errors:0 dropped:0 overruns:0 frame:0
TX packets:24 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:3262 (3.2 KB) TX bytes:2448 (2.4 KB)
tap864f4c91-5f Link encap:Ethernet HWaddr fe:16:3e:93:af:55
inet6 addr: fe80::fc16:3eff:fe93:af55/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:20 errors:0 dropped:0 overruns:0 frame:0
TX packets:28 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:500
RX bytes:2056 (2.0 KB) TX bytes:2776 (2.7 KB)
stack2 $ sudo ovs-vsctl show
77c5a374-8c18-42fe-bf1c-b96e6655068b
Bridge br-int
fail_mode: secure
Port br-int
Interface br-int
type: internal
Port patch-tun
Interface patch-tun
type: patch
options: {peer=patch-int}
Port "qvo864f4c91-5f"
tag: 1
Interface "qvo864f4c91-5f"
Bridge br-tun
Port "vxlan-c0a87a1f"
Interface "vxlan-c0a87a1f"
type: vxlan
options: {df_default="true", in_key=flow,
local_ip="192.168.122.32", out_key=flow, remote_ip="192.168.122.31"}
Port patch-int
Interface patch-int
type: patch
options: {peer=patch-tun}
Port br-tun
Interface br-tun
type: internal
ovs_version: "2.0.2"
Cheers
Mark
More information about the Openstack
mailing list