[Openstack] [devstack] [Neutron] Multi host installation cannot ping VM from compute node

Mark Kirkwood mark.kirkwood at catalyst.net.nz
Wed Nov 19 22:45:28 UTC 2014


Hi,

I have a small multi host devstack setup running from from 2 Ubuntu 
14.04 hosts (themselves VMs):
- controller node (stack1) running everything except compute
- compute node (stack2) running compute only

If I amend the default security group to allow ping and start a VM:

stack1 $ neutron security-group-rule-create --protocol icmp 
--direction ingress default
stack1 $ nova boot --image cirros-0.3.2-x86_64-uec --flavor 1 cirros0
stack1 $ nova list
+--------------------------------------+---------+--------+------------+-------------+------------------+
| ID                                   | Name    | Status | Task State | 
Power State | Networks         |
+--------------------------------------+---------+--------+------------+-------------+------------------+
| 2bebd3c2-0bab-41b7-b0dd-555b49fd147a | cirros0 | ACTIVE | -          | 
Running     | private=10.0.0.2 |
+--------------------------------------+---------+--------+------------+-------------+------------------+

stack1 $ ping 10.0.0.2
PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data.
64 bytes from 10.0.0.2: icmp_seq=1 ttl=63 time=2.99 ms


But from the compute node:

stack2 $ ping 10.0.0.2
(hangs)

It looks like I'm missing a route or nat rule of some kind:

stack1 $ route
$ route
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use 
Iface
default         192.168.122.1   0.0.0.0         UG    0      0        0 eth0
10.0.0.0        172.24.4.2      255.255.255.0   UG    0      0        0 
br-ex
172.24.4.0      *               255.255.255.0   U     0      0        0 
br-ex
192.168.122.0   *               255.255.255.0   U     0      0        0 eth0


stack2 $ route
$ route
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use 
Iface
default         192.168.122.1   0.0.0.0         UG    0      0        0 eth0
192.168.122.0   *               255.255.255.0   U     0      0        0 eth0


My local.conf config for the two hosts are:

stack1 $ cat local.conf
[[local|localrc]]
ADMIN_PASSWORD=password
MYSQL_PASSWORD=password
RABBIT_PASSWORD=password
SERVICE_PASSWORD=password
SERVICE_TOKEN=tokentoken
ENABLED_SERVICES=rabbit,mysql,key
ENABLED_SERVICES+=,-n-net
ENABLED_SERVICES+=,n-api,n-crt,n-obj,n-cond,n-sch,n-novnc,n-cauth
ENABLED_SERVICES+=,neutron,q-svc,q-agt,q-dhcp,q-l3,q-meta
ENABLED_SERVICES+=,g-api,g-reg
ENABLED_SERVICES+=,cinder,c-api,c-vol,c-sch,c-bak
ENABLED_SERVICES+=,horizon

# Multi host stuff
MULTI_HOST=True
HOST_IP=192.168.122.31


stack2 $ cat local.conf
[[local|localrc]]
ADMIN_PASSWORD=password
MYSQL_PASSWORD=password
RABBIT_PASSWORD=password
SERVICE_PASSWORD=password
SERVICE_TOKEN=tokentoken
ENABLED_SERVICES=rabbit
ENABLED_SERVICES+=,n-cpu
ENABLED_SERVICES+=,neutron,q-agt

# Multi host stuff
MULTI_HOST=True
HOST_IP=192.168.122.32
DATABASE_TYPE=mysql
SERVICE_HOST=192.168.122.31
MYSQL_HOST=192.168.122.31
RABBIT_HOST=192.168.122.31
GLANCE_HOSTPORT=192.168.122.31:9292
Q_HOST=192.168.122.31


The interfaces and ovs setup for each host are:

stack1 $ ifconfig
br-ex     Link encap:Ethernet  HWaddr 46:c4:42:d3:44:4f
           inet addr:172.24.4.1  Bcast:0.0.0.0  Mask:255.255.255.0
           UP BROADCAST RUNNING  MTU:1500  Metric:1
           RX packets:18 errors:0 dropped:0 overruns:0 frame:0
           TX packets:7 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:1280 (1.2 KB)  TX bytes:550 (550.0 B)

br-int    Link encap:Ethernet  HWaddr 5e:c1:4f:ab:13:4e
           inet6 addr: fe80::f8e7:1aff:fe6e:b38d/64 Scope:Link
           UP BROADCAST RUNNING  MTU:1500  Metric:1
           RX packets:37 errors:0 dropped:0 overruns:0 frame:0
           TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:3348 (3.3 KB)  TX bytes:648 (648.0 B)

br-tun    Link encap:Ethernet  HWaddr f6:bf:2d:bc:ec:43
           inet6 addr: fe80::f8a9:c6ff:fe7e:c1e6/64 Scope:Link
           UP BROADCAST RUNNING  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:0 (0.0 B)  TX bytes:648 (648.0 B)

eth0      Link encap:Ethernet  HWaddr 52:54:00:54:45:8a
           inet addr:192.168.122.31  Bcast:192.168.122.255 
Mask:255.255.255.0
           inet6 addr: fe80::5054:ff:fe54:458a/64 Scope:Link
           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
           RX packets:15438 errors:0 dropped:379 overruns:0 frame:0
           TX packets:21504 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:1000
           RX bytes:1890780 (1.8 MB)  TX bytes:37703250 (37.7 MB)

lo        Link encap:Local Loopback
           inet addr:127.0.0.1  Mask:255.0.0.0
           inet6 addr: ::1/128 Scope:Host
           UP LOOPBACK RUNNING  MTU:65536  Metric:1
           RX packets:47756 errors:0 dropped:0 overruns:0 frame:0
           TX packets:47756 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:46111186 (46.1 MB)  TX bytes:46111186 (46.1 MB)

stack1 $ sudo ovs-vsctl show
77c5a374-8c18-42fe-bf1c-b96e6655068b
     Bridge br-int
         fail_mode: secure
         Port "tap2790ca1b-e6"
             tag: 1
             Interface "tap2790ca1b-e6"
                 type: internal
         Port br-int
             Interface br-int
                 type: internal
         Port patch-tun
             Interface patch-tun
                 type: patch
                 options: {peer=patch-int}
         Port "qr-bdc3eb4c-c6"
             tag: 1
             Interface "qr-bdc3eb4c-c6"
                 type: internal
     Bridge br-tun
         Port patch-int
             Interface patch-int
                 type: patch
                 options: {peer=patch-tun}
         Port br-tun
             Interface br-tun
                 type: internal
         Port "vxlan-c0a87a20"
             Interface "vxlan-c0a87a20"
                 type: vxlan
                 options: {df_default="true", in_key=flow, 
local_ip="192.168.122.31", out_key=flow, remote_ip="192.168.122.32"}
     Bridge br-ex
         Port "qg-cb7143ae-dd"
             Interface "qg-cb7143ae-dd"
                 type: internal
         Port br-ex
             Interface br-ex
                 type: internal
     ovs_version: "2.0.2"


stack2 $ ifconfig
br-int    Link encap:Ethernet  HWaddr 7e:c2:ed:6f:43:44
           inet6 addr: fe80::6c62:63ff:fe41:13dd/64 Scope:Link
           UP BROADCAST RUNNING  MTU:1500  Metric:1
           RX packets:26 errors:0 dropped:0 overruns:0 frame:0
           TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:2466 (2.4 KB)  TX bytes:648 (648.0 B)

br-tun    Link encap:Ethernet  HWaddr 16:df:31:94:ea:4d
           inet6 addr: fe80::ccca:a7ff:fee8:3a4e/64 Scope:Link
           UP BROADCAST RUNNING  MTU:1500  Metric:1
           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
           TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:0 (0.0 B)  TX bytes:648 (648.0 B)

eth0      Link encap:Ethernet  HWaddr 52:54:00:64:b7:40
           inet addr:192.168.122.32  Bcast:192.168.122.255 
Mask:255.255.255.0
           inet6 addr: fe80::5054:ff:fe64:b740/64 Scope:Link
           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
           RX packets:11226 errors:0 dropped:263 overruns:0 frame:0
           TX packets:10784 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:1000
           RX bytes:35496422 (35.4 MB)  TX bytes:2089639 (2.0 MB)

lo        Link encap:Local Loopback
           inet addr:127.0.0.1  Mask:255.0.0.0
           inet6 addr: ::1/128 Scope:Host
           UP LOOPBACK RUNNING  MTU:65536  Metric:1
           RX packets:758 errors:0 dropped:0 overruns:0 frame:0
           TX packets:758 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:41256 (41.2 KB)  TX bytes:41256 (41.2 KB)

qbr864f4c91-5f Link encap:Ethernet  HWaddr b2:29:c2:2f:bb:23
           inet6 addr: fe80::3c67:2dff:fe0d:2225/64 Scope:Link
           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
           RX packets:19 errors:0 dropped:0 overruns:0 frame:0
           TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:0
           RX bytes:1642 (1.6 KB)  TX bytes:648 (648.0 B)

qvb864f4c91-5f Link encap:Ethernet  HWaddr b2:29:c2:2f:bb:23
           inet6 addr: fe80::b029:c2ff:fe2f:bb23/64 Scope:Link
           UP BROADCAST RUNNING PROMISC MULTICAST  MTU:1500  Metric:1
           RX packets:24 errors:0 dropped:0 overruns:0 frame:0
           TX packets:35 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:1000
           RX bytes:2448 (2.4 KB)  TX bytes:3262 (3.2 KB)

qvo864f4c91-5f Link encap:Ethernet  HWaddr 8a:d6:c5:cf:f8:5e
           inet6 addr: fe80::88d6:c5ff:fecf:f85e/64 Scope:Link
           UP BROADCAST RUNNING PROMISC MULTICAST  MTU:1500  Metric:1
           RX packets:35 errors:0 dropped:0 overruns:0 frame:0
           TX packets:24 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:1000
           RX bytes:3262 (3.2 KB)  TX bytes:2448 (2.4 KB)

tap864f4c91-5f Link encap:Ethernet  HWaddr fe:16:3e:93:af:55
           inet6 addr: fe80::fc16:3eff:fe93:af55/64 Scope:Link
           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
           RX packets:20 errors:0 dropped:0 overruns:0 frame:0
           TX packets:28 errors:0 dropped:0 overruns:0 carrier:0
           collisions:0 txqueuelen:500
           RX bytes:2056 (2.0 KB)  TX bytes:2776 (2.7 KB)

stack2 $ sudo ovs-vsctl show
77c5a374-8c18-42fe-bf1c-b96e6655068b
     Bridge br-int
         fail_mode: secure
         Port br-int
             Interface br-int
                 type: internal
         Port patch-tun
             Interface patch-tun
                 type: patch
                 options: {peer=patch-int}
         Port "qvo864f4c91-5f"
             tag: 1
             Interface "qvo864f4c91-5f"
     Bridge br-tun
         Port "vxlan-c0a87a1f"
             Interface "vxlan-c0a87a1f"
                 type: vxlan
                 options: {df_default="true", in_key=flow, 
local_ip="192.168.122.32", out_key=flow, remote_ip="192.168.122.31"}
         Port patch-int
             Interface patch-int
                 type: patch
                 options: {peer=patch-tun}
         Port br-tun
             Interface br-tun
                 type: internal
     ovs_version: "2.0.2"


Cheers

Mark




More information about the Openstack mailing list