[Openstack] Network problem in instances created in compute node
t22330033
t22330033 at gmail.com
Thu May 15 09:41:36 UTC 2014
I'm using devsatck on one controller node and one compute node. the
instance created in controller node can get IP address by DHCP without
problem but those in compute node always fail to get IP address. I tried to
trace the DHCP request and found it was not forwarded out of the compute
node. I think the problem could be the ovs settings but I don't know how to
solve it. here is what did to trace the problem
1. ovs-vsctl show
Manager "tcp:172.22.11.43:6640"
is_connected: true
Bridge br-int
Controller "tcp:172.22.11.43:6633"
is_connected: true
fail_mode: secure
Port "tap766671cd-d8"
tag: 1
Interface "tap766671cd-d8"
Port br-int
Interface br-int
type: internal
Port patch-tun
Interface patch-tun
type: patch
options: {peer=patch-int}
Port "vxlan-172.31.0.125"
Interface "vxlan-172.31.0.125"
type: vxlan
options: {key=flow, local_ip="172.22.11.43",
remote_ip="172.31.0.125"}
Bridge br-tun
Port patch-int
Interface patch-int
type: patch
options: {peer=patch-tun}
Port "vxlan-ac1f007d"
Interface "vxlan-ac1f007d"
type: vxlan
options: {in_key=flow, local_ip="172.22.11.43",
out_key=flow, remote_ip="172.31.0.125"}
Port br-tun
Interface br-tun
type: internal
ovs_version: "2.1.90"
2. capture packets of DHCP request in all ports of the two bridges. I found
the packet went through tap766671cd-d8 and
vxlan-172.31.0.125 in br-int but not patch-tun. according to
http://docs.openstack.org/trunk/openstack-ops/content/network_troubleshooting.html.
it should go to patch-tun and then patch-int in br-tun. obviously it does
not.
3. I tried to dump the flows of ovs and it seems the packet won't go
through br-tun with the flow setting. is this the root cause? if so, how do
I modify the flow setting by changing local.conf for stack.sh?
$ ovs-ofctl dump-flows br-int -O OpenFlow13
OFPST_FLOW reply (OF1.3) (xid=0x2):
cookie=0x0, duration=2294.917s, table=0, n_packets=9, n_bytes=1434,
send_flow_rem in_port=2,dl_src=fa:16:3e:d6:ee:31
actions=set_field:0x3e9->tun_id,goto_table:10
cookie=0x0, duration=2285.698s, table=0, n_packets=0, n_bytes=0,
send_flow_rem priority=8192,in_port=2 actions=drop
cookie=0x0, duration=2264.881s, table=0, n_packets=0, n_bytes=0,
send_flow_rem tun_id=0x3e9,in_port=3 actions=goto_table:20
cookie=0x0, duration=3133.421s, table=0, n_packets=0, n_bytes=0,
send_flow_rem dl_type=0x88cc actions=CONTROLLER:56
cookie=0x0, duration=2272.421s, table=10, n_packets=5, n_bytes=650,
send_flow_rem priority=8192,tun_id=0x3e9 actions=goto_table:20
cookie=0x0, duration=2262.715s, table=10, n_packets=4, n_bytes=784,
send_flow_rem
priority=16384,tun_id=0x3e9,dl_dst=01:00:00:00:00:00/01:00:00:00:00:00
actions=output:3,goto_table:20
cookie=0x0, duration=2267.424s, table=20, n_packets=0, n_bytes=0,
send_flow_rem priority=8192,tun_id=0x3e9 actions=drop
cookie=0x0, duration=2281.314s, table=20, n_packets=0, n_bytes=0,
send_flow_rem tun_id=0x3e9,dl_dst=fa:16:3e:d6:ee:31 actions=output:2
cookie=0x0, duration=2275.604s, table=20, n_packets=9, n_bytes=1434,
send_flow_rem
priority=16384,tun_id=0x3e9,dl_dst=01:00:00:00:00:00/01:00:00:00:00:00
actions=output:2
# ovs-ofctl dump-flows br-tun
NXST_FLOW reply (xid=0x4):
cookie=0x0, duration=3178.843s, table=0, n_packets=0, n_bytes=0,
idle_age=3178, priority=0 actions=drop
cookie=0x0, duration=3179.361s, table=0, n_packets=631, n_bytes=57421,
idle_age=1, priority=1,in_port=1 actions=resubmit(,1)
cookie=0x0, duration=3172.443s, table=0, n_packets=1270, n_bytes=92075,
idle_age=1, priority=1,in_port=2 actions=resubmit(,3)
cookie=0x0, duration=3178.327s, table=1, n_packets=0, n_bytes=0,
idle_age=3178, priority=1,dl_dst=00:00:00:00:00:00/01:00:00:00:00:00
actions=resubmit(,20)
cookie=0x0, duration=3177.807s, table=1, n_packets=631, n_bytes=57421,
idle_age=1, priority=1,dl_dst=01:00:00:00:00:00/01:00:00:00:00:00
actions=resubmit(,21)
cookie=0x0, duration=3177.288s, table=2, n_packets=0, n_bytes=0,
idle_age=3177, priority=0 actions=drop
cookie=0x0, duration=3176.746s, table=3, n_packets=1270, n_bytes=92075,
idle_age=1, priority=0 actions=drop
cookie=0x0, duration=2343.819s, table=3, n_packets=0, n_bytes=0,
idle_age=2343, priority=1,tun_id=0x3e9 actions=mod_vlan_vid:1,resubmit(,10)
cookie=0x0, duration=3176.235s, table=10, n_packets=0, n_bytes=0,
idle_age=3176, priority=1
actions=learn(table=20,hard_timeout=300,priority=1,NXM_OF_VLAN_TCI[0..11],NXM_OF_ETH_DST[]=NXM_OF_ETH_SRC[],load:0->NXM_OF_VLAN_TCI[],load:NXM_NX_TUN_ID[]->NXM_NX_TUN_ID[],output:NXM_OF_IN_PORT[]),output:1
cookie=0x0, duration=3175.720s, table=20, n_packets=0, n_bytes=0,
idle_age=3175, priority=0 actions=resubmit(,21)
cookie=0x0, duration=3175.199s, table=21, n_packets=631, n_bytes=57421,
idle_age=1, priority=0 actions=drop
cookie=0x0, duration=2345.304s, table=21, n_packets=0, n_bytes=0,
idle_age=2345, dl_vlan=1 actions=strip_vlan,set_tunnel:0x3e9,output:2
4. here is the local.conf I used for compute node
ENABLED_SERVICES=n-cpu,rabbit,neutron,q-agt,n-novnc
SERVICE_HOST=172.31.0.125
MYSQL_HOST=$SERVICE_HOST
RABBIT_HOST=$SERVICE_HOST
Q_HOST=$SERVICE_HOST
Q_PLUGIN=ml2
Q_ML2_TENANT_NETWORK_TYPE=vxlan
enable_service odl-compute
ODL_MGR_IP=172.22.11.43
VNCSERVER_PROXYCLIENT_ADDRESS=172.22.11.43
VNCSERVER_LISTEN=0.0.0.0
please let me know if there's any info I need provide, thanks.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstack.org/pipermail/openstack/attachments/20140515/311f571e/attachment.html>
More information about the Openstack
mailing list