[Openstack] MTU/Fragmentation/Retransmission Problem in Juno using RE

Eren Türkay erent at skyatlas.com
Wed Jan 21 13:55:07 UTC 2015


On 20-01-2015 15:37, Miguel Ángel Ajo wrote:
> Hi Eren, good luck, and keep us updated.

Hello,

Today I've installed Juno using official documentation with VXLAN
networking (Host OS is Ubuntu Server 14.04). I have exactly the same
issues with previous installation (GRE). qbr bridge, after tap,
reconstructs the packets. After disabling "bridge-nf-call-iptables" tap
problem is solved and packets go as-is. However, I hit MTU problem in
router namespace again.

I needed to lower the internal leg in router namespace to match VMs MTU
to get ICMP packets working. With this setting, ICMP packets are OK and
any length can be send across the network.

I set MTU of 1400 on both VM and internal leg in router namespace to be
on safe side. The suggested 1452 on the documentation did not work. I
guess it was not small enough for VXLAN overhead.

I tried to test iperf inside VM to router (iperf -c 10.0.0.1), but that
gave me the following kernel error:

-------
Jan 21 14:34:36 compute1vx kernel: [84156.767977] bnx2x:
[bnx2x_panic_dump:1138(em1)]end crash dump -----------------
Jan 21 14:34:41 compute1vx kernel: [84162.358183] bnx2x:
[bnx2x_clean_tx_queue:1260(em1)]timeout waiting for queue[1]:
txdata->tx_pkt_prod(518) != txdata->tx_pkt_cons(516)
Jan 21 14:34:43 compute1vx kernel: [84164.450504] bnx2x:
[bnx2x_clean_tx_queue:1260(em1)]timeout waiting for queue[2]:
txdata->tx_pkt_prod(1062) != txdata->tx_pkt_cons(1056)
Jan 21 14:34:45 compute1vx kernel: [84166.539991] bnx2x:
[bnx2x_clean_tx_queue:1260(em1)]timeout waiting for queue[5]:
txdata->tx_pkt_prod(255) != txdata->tx_pkt_cons(254)
Jan 21 14:34:47 compute1vx kernel: [84168.621634] bnx2x:
[bnx2x_clean_tx_queue:1260(em1)]timeout waiting for queue[1]:
txdata->tx_pkt_prod(518) != txdata->tx_pkt_cons(516)
--------

I needed to "rmmod bnx2x && modprobe bnx2x" to get the eth working
again. After this failure, I tested simple nc connection inside VM to
router and I hit retransmission issue again. Without any data sent (just
after nc 10.0.0.1 9999), I see the attached retransmission lines. It
seems that it cannot correctly complete three-way handshake?

As a side note, not related with the network issue, I got libvirt error
on Ubuntu Server 14.04 in compute node. The VM was stuck and I couldn't
kill it. The logs on compute note showed the following. The detailed
syslog is attached.

"BUG: soft lockup - CPU#9 stuck for 22s! [qemu-system-x86:8838]"

Searching the error, it was suggested to upgrade the kernel. It seems
that I am having serious issues on Ubuntu Server 14.04 with
3.13.0-44-generic. In other lab environment, we use Fuel deployment on
Ubuntu Server 12.04 LTS with GRE and we didn't have those problems
(retransmission, packet construction, etc). Although GRE has its
performance issues, we can get 1.8-2Gbit link between VMs to network
node on 10Gbit network. I should add that all the physical machines are
same within all environments.

I will try updating the kernel to "linux-image-3.16.0-29-generic", which
is latest in ubuntu repository.

Has anyone tried Juno on Ubuntu Server 14.04 with linux-image-3.16.0-29
(which is the default) or am I the only one having those problems? Any
Ubuntu folks here? Is it possible that ubuntu cloud repository has some
specific patches for openstack, ovs, or other related software?

I am attaching related configuration files used in VXLAN environment.

Regards,
Eren

-- 
System Administrator
https://skyatlas.com/
-------------- next part --------------
Jan 21 10:00:55 compute1 kernel: [674120.861261] CPU: 7 PID: 8835 Comm: qemu-system-x86 Tainted: G      D   I  3.13.0-32-generic #57-Ubuntu
Jan 21 10:00:55 compute1 kernel: [674120.861262] Hardware name: HP ProLiant BL460c G6, BIOS I24 10/01/2013
Jan 21 10:00:55 compute1 kernel: [674120.861264] task: ffff8805f0f147d0 ti: ffff8805d3220000 task.ti: ffff8805d3220000
Jan 21 10:00:55 compute1 kernel: [674120.861269] RIP: 0010:[<ffffffff81723c32>]  [<ffffffff81723c32>] _raw_spin_lock+0x32/0x50
Jan 21 10:00:55 compute1 kernel: [674120.861270] RSP: 0018:ffff8805d3221c28  EFLAGS: 00000202
Jan 21 10:00:55 compute1 kernel: [674120.861271] RAX: 000000000000782d RBX: ffff8805d3221bb0 RCX: 000000000000105a
Jan 21 10:00:55 compute1 kernel: [674120.861272] RDX: 000000000000105e RSI: 000000000000105e RDI: ffff8805bc5d0000
Jan 21 10:00:55 compute1 kernel: [674120.861273] RBP: ffff8805d3221c28 R08: 0000000000000007 R09: ffff8805d3221c50
Jan 21 10:00:55 compute1 kernel: [674120.861274] R10: ffff8800000001f8 R11: 80000005a412d966 R12: ffff8805fcccbf00
Jan 21 10:00:55 compute1 kernel: [674120.861275] R13: ffff8805d3221c58 R14: 0000000000000000 R15: 00000000000bbf2d
Jan 21 10:00:55 compute1 kernel: [674120.861277] FS:  00007f61a2786700(0000) GS:ffff880607c60000(0000) knlGS:0000000000000000
Jan 21 10:00:55 compute1 kernel: [674120.861278] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 21 10:00:55 compute1 kernel: [674120.861280] CR2: 00007f74a1a89620 CR3: 00000005f129c000 CR4: 00000000000027e0
Jan 21 10:00:55 compute1 kernel: [674120.861280] Stack:
Jan 21 10:00:55 compute1 kernel: [674120.861285]  ffff8805d3221c90 ffffffffa048f420 ffff8805d3221c4f 00000000000344be
Jan 21 10:00:55 compute1 kernel: [674120.861288]  01ff8805d3221c58 0000000100000000 00000000005a412d 00000000000bbf2d
Jan 21 10:00:55 compute1 kernel: [674120.861291]  ffff8805fcccbf00 00000000bbf2d028 0000000000000000 0000000000000000
Jan 21 10:00:55 compute1 kernel: [674120.861291] Call Trace:
Jan 21 10:00:55 compute1 kernel: [674120.861311]  [<ffffffffa048f420>] tdp_page_fault+0x140/0x1f0 [kvm]
Jan 21 10:00:55 compute1 kernel: [674120.861330]  [<ffffffffa048a604>] kvm_mmu_page_fault+0x24/0x100 [kvm]
Jan 21 10:00:55 compute1 kernel: [674120.861336]  [<ffffffffa05df634>] handle_ept_violation+0x94/0x160 [kvm_intel]
Jan 21 10:00:55 compute1 kernel: [674120.861343]  [<ffffffffa05e4b05>] vmx_handle_exit+0xb5/0x890 [kvm_intel]
Jan 21 10:00:55 compute1 kernel: [674120.861346]  [<ffffffff8109d98e>] ? __vtime_account_system+0x2e/0x40
Jan 21 10:00:55 compute1 kernel: [674120.861362]  [<ffffffffa047ebd5>] vcpu_enter_guest+0x795/0xcb0 [kvm]
Jan 21 10:00:55 compute1 kernel: [674120.861365]  [<ffffffff810aacc8>] ? finish_wait+0x58/0x70
Jan 21 10:00:55 compute1 kernel: [674120.861376]  [<ffffffffa046a4db>] ? kvm_vcpu_block+0x9b/0xb0 [kvm]
Jan 21 10:00:55 compute1 kernel: [674120.861379]  [<ffffffff810aaf00>] ? prepare_to_wait_event+0x100/0x100
Jan 21 10:00:55 compute1 kernel: [674120.861396]  [<ffffffffa04830d8>] kvm_arch_vcpu_ioctl_run+0x1e8/0x460 [kvm]
Jan 21 10:00:55 compute1 kernel: [674120.861408]  [<ffffffffa046d062>] kvm_vcpu_ioctl+0x2c2/0x5b0 [kvm]
Jan 21 10:00:55 compute1 kernel: [674120.861412]  [<ffffffff811cfd10>] do_vfs_ioctl+0x2e0/0x4c0
Jan 21 10:00:55 compute1 kernel: [674120.861414]  [<ffffffff8109ddf4>] ? vtime_account_user+0x54/0x60
Jan 21 10:00:55 compute1 kernel: [674120.861417]  [<ffffffff811cff71>] SyS_ioctl+0x81/0xa0
Jan 21 10:00:55 compute1 kernel: [674120.861421]  [<ffffffff8172c87f>] tracesys+0xe1/0xe6
Jan 21 10:00:55 compute1 kernel: [674120.861440] Code: 89 e5 b8 00 00 02 00 f0 0f c1 07 89 c2 c1 ea 10 66 39 c2 75 02 5d c3 83 e2 fe 0f b7 f2 b8 00 80 00 00 eb 0c 0f 1f 44 00 00 f3 90 <83> e8 01 74 0a 0f b7 0f 66 39 ca 75 f1 5d c3 66 66 66 90 66 66 
Jan 21 10:00:55 compute1 kernel: [674121.129488] Hardware name: HP ProLiant BL460c G6, BIOS I24 10/01/2013
Jan 21 10:00:55 compute1 kernel: [674121.134664] task: ffff8805f332dfc0 ti: ffff880bfa710000 task.ti: ffff880bfa710000
Jan 21 10:00:55 compute1 kernel: [674121.139827] RIP: 0010:[<ffffffff81723c32>]  [<ffffffff81723c32>] _raw_spin_lock+0x32/0x50
Jan 21 10:00:55 compute1 kernel: [674121.145004] RSP: 0018:ffff880bfa7118d0  EFLAGS: 00000216
Jan 21 10:00:55 compute1 kernel: [674121.150077] RAX: 000000000000062e RBX: 0000000000000001 RCX: 000000000000105a
Jan 21 10:00:55 compute1 kernel: [674121.155104] RDX: 0000000000001060 RSI: 0000000000001060 RDI: ffff8805bc5d0000
Jan 21 10:00:55 compute1 kernel: [674121.160010] RBP: ffff880bfa7118d0 R08: 0000000000000000 R09: 0000000000000000
Jan 21 10:00:55 compute1 kernel: [674121.164812] R10: 0000000000002ef0 R11: 0000000000000000 R12: ffff8805f332dfc0
Jan 21 10:00:55 compute1 kernel: [674121.169508] R13: ffffffffa0488380 R14: ffffffffa0485ffa R15: ffff880bfa7118b8
Jan 21 10:00:55 compute1 kernel: [674121.174104] FS:  0000000000000000(0000) GS:ffff880607c20000(0000) knlGS:0000000000000000
Jan 21 10:00:55 compute1 kernel: [674121.178649] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Jan 21 10:00:55 compute1 kernel: [674121.183090] CR2: 00007f617e029200 CR3: 00000005f129c000 CR4: 00000000000027e0
Jan 21 10:00:55 compute1 kernel: [674121.187464] Stack:
Jan 21 10:00:55 compute1 kernel: [674121.191718]  ffff880bfa711910 ffffffffa046b67e 00007f617e02a000 ffff8805bc5d2be8
Jan 21 10:00:55 compute1 kernel: [674121.196056]  ffff8805fad8ec80 00007f617e02a000 00007f617e029000 0000000000000000
Jan 21 10:00:55 compute1 kernel: [674121.200358]  ffff880bfa711948 ffffffff8119a2cb ffffea0016996100 ffff8805dc26c480
Jan 21 10:00:55 compute1 kernel: [674121.204649] Call Trace:
Jan 21 10:00:55 compute1 kernel: [674121.208846]  [<ffffffffa046b67e>] kvm_mmu_notifier_invalidate_range_start+0x3e/0x90 [kvm]
Jan 21 10:00:55 compute1 kernel: [674121.213144]  [<ffffffff8119a2cb>] __mmu_notifier_invalidate_range_start+0x5b/0x80
Jan 21 10:00:55 compute1 kernel: [674121.217462]  [<ffffffff81176d7e>] do_wp_page+0x6be/0x7c0
Jan 21 10:00:55 compute1 kernel: [674121.221765]  [<ffffffff81177cfa>] ? do_numa_page+0x14a/0x1b0
Jan 21 10:00:55 compute1 kernel: [674121.226071]  [<ffffffff81178f0c>] handle_mm_fault+0x65c/0xf00
Jan 21 10:00:55 compute1 kernel: [674121.230371]  [<ffffffff8109a6da>] ? try_to_wake_up+0x1fa/0x2c0
Jan 21 10:00:55 compute1 kernel: [674121.234620]  [<ffffffff81727be4>] __do_page_fault+0x184/0x560
Jan 21 10:00:55 compute1 kernel: [674121.238832]  [<ffffffff810aa818>] ? __wake_up_common+0x58/0x90
Jan 21 10:00:55 compute1 kernel: [674121.243006]  [<ffffffff810aaaa4>] ? __wake_up+0x44/0x50
Jan 21 10:00:55 compute1 kernel: [674121.247123]  [<ffffffffa046a570>] ? kvm_vcpu_kick+0x80/0xa0 [kvm]
Jan 21 10:00:55 compute1 kernel: [674121.251219]  [<ffffffffa049b7e2>] ? __apic_accept_irq+0x2a2/0x2b0 [kvm]
Jan 21 10:00:55 compute1 kernel: [674121.255311]  [<ffffffff81360ee0>] ? cpumask_next_and+0x30/0x50
Jan 21 10:00:55 compute1 kernel: [674121.259398]  [<ffffffff81727fda>] do_page_fault+0x1a/0x70
Jan 21 10:00:55 compute1 kernel: [674121.263438]  [<ffffffff81724448>] page_fault+0x28/0x30
Jan 21 10:00:55 compute1 kernel: [674121.267454]  [<ffffffff8136d290>] ? copy_user_generic_string+0x30/0x40
Jan 21 10:00:55 compute1 kernel: [674121.271496]  [<ffffffff81615049>] ? memcpy_toiovecend+0x59/0x90
Jan 21 10:00:55 compute1 kernel: [674121.275519]  [<ffffffff8152112e>] tun_do_read.isra.24+0x20e/0x4c0
Jan 21 10:00:55 compute1 kernel: [674121.279533]  [<ffffffff8109a800>] ? wake_up_state+0x20/0x20
Jan 21 10:00:55 compute1 kernel: [674121.283533]  [<ffffffff8152148d>] tun_recvmsg+0xad/0xd0
Jan 21 10:00:55 compute1 kernel: [674121.287512]  [<ffffffffa07b35ad>] handle_rx+0x39d/0x750 [vhost_net]
Jan 21 10:00:55 compute1 kernel: [674121.291507]  [<ffffffffa07b3975>] handle_rx_net+0x15/0x20 [vhost_net]
Jan 21 10:00:55 compute1 kernel: [674121.295510]  [<ffffffffa07a5db1>] vhost_worker+0x101/0x1f0 [vhost]
Jan 21 10:00:55 compute1 kernel: [674121.299507]  [<ffffffffa07a5cb0>] ? vhost_dev_reset_owner+0x30/0x30 [vhost]
Jan 21 10:00:55 compute1 kernel: [674121.303520]  [<ffffffff8108b3d2>] kthread+0xd2/0xf0
Jan 21 10:00:55 compute1 kernel: [674121.307510]  [<ffffffff8108b300>] ? kthread_create_on_node+0x1d0/0x1d0
Jan 21 10:00:55 compute1 kernel: [674121.311526]  [<ffffffff8172c5bc>] ret_from_fork+0x7c/0xb0
Jan 21 10:00:55 compute1 kernel: [674121.315545]  [<ffffffff8108b300>] ? kthread_create_on_node+0x1d0/0x1d0
Jan 21 10:00:55 compute1 kernel: [674121.319596] Code: 89 e5 b8 00 00 02 00 f0 0f c1 07 89 c2 c1 ea 10 66 39 c2 75 02 5d c3 83 e2 fe 0f b7 f2 b8 00 80 00 00 eb 0c 0f 1f 44 00 00 f3 90 <83> e8 01 74 0a 0f b7 0f 66 39 ca 75 f1 5d c3 66 66 66 90 66 66 
Jan 21 10:01:03 compute1 kernel: [674128.889650] BUG: soft lockup - CPU#9 stuck for 22s! [qemu-system-x86:8838]
Jan 21 10:01:03 compute1 kernel: [674128.893776] Modules linked in: vhost_net vhost macvtap macvlan joydev hid_lenovo_tpkbd xt_LOG ip_gre dummy nbd xt_multiport nfnetlink_queue nfnetlink_log bluetooth nf_conntrack_ipv6 nf_defrag_ipv6 xt_mac xt_physdev xt_set iptable_raw ip_set_hash_ip ip_set nfnetlink veth openvswitch gre ipt_MASQUERADE iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT xt_CHECKSUM iptable_mangle xt_tcpudp bridge stp llc ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_tables kvm_intel dm_multipath scsi_dh btrfs raid6_pq xor ufs qnx4 hfsplus hfs minix ntfs msdos jfs intel_powerclamp coretemp radeon kvm ttm crct10dif_pclmul drm_kms_helper gpio_ich crc32_pclmul drm i2c_algo_bit ghash_clmulni_intel aesni_intel serio_raw aes_x86_64 lrw gf128mul glue_helper ablk_helper hpilo lpc_ich hpwdt cryptd i7core_edac edac_core ipmi_si acpi_power_meter mac_hid lp parport mlx4_en vxlan ip_tunnel ptp pps_core xfs hid_generic bnx2x usbhid psmouse mdio hid hpsa mlx4_core libcrc32c [last unloaded: nbd]
Jan 21 10:01:03 compute1 kernel: [674128.935107] CPU: 9 PID: 8838 Comm: qemu-system-x86 Tainted: G      D   I  3.13.0-32-generic #57-Ubuntu
Jan 21 10:01:03 compute1 kernel: [674128.940047] Hardware name: HP ProLiant BL460c G6, BIOS I24 10/01/2013
Jan 21 10:01:03 compute1 kernel: [674128.944965] task: ffff8805d26aafe0 ti: ffff8805d3014000 task.ti: ffff8805d3014000
Jan 21 10:01:03 compute1 kernel: [674128.949904] RIP: 0010:[<ffffffff81723c37>]  [<ffffffff81723c37>] _raw_spin_lock+0x37/0x50
Jan 21 10:01:03 compute1 kernel: [674128.954874] RSP: 0018:ffff8805d3015c28  EFLAGS: 00000202
Jan 21 10:01:03 compute1 kernel: [674128.959805] RAX: 0000000000001049 RBX: ffff8805d3015bb0 RCX: 000000000000105a
Jan 21 10:01:03 compute1 kernel: [674128.964790] RDX: 0000000000001064 RSI: 0000000000001064 RDI: ffff8805bc5d0000
Jan 21 10:01:03 compute1 kernel: [674128.969754] RBP: ffff8805d3015c28 R08: 0000000000000007 R09: ffff8805d3015c50
Jan 21 10:01:03 compute1 kernel: [674128.974684] R10: ffff880000000178 R11: 80000005a991e966 R12: ffff8805f1433f00
Jan 21 10:01:03 compute1 kernel: [674128.979558] R13: ffff8805d3015c58 R14: 0000000000000000 R15: 00000000000b9f1e
Jan 21 10:01:03 compute1 kernel: [674128.984410] FS:  00007f61a1784700(0000) GS:ffff880607c80000(0000) knlGS:ffff88023fd80000
Jan 21 10:01:03 compute1 kernel: [674128.989299] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 21 10:01:03 compute1 kernel: [674128.994207] CR2: 00007fdee69ca55b CR3: 00000005f129c000 CR4: 00000000000027e0
Jan 21 10:01:03 compute1 kernel: [674128.999175] Stack:
Jan 21 10:01:03 compute1 kernel: [674129.004107]  ffff8805d3015c90 ffffffffa048f420 ffff8805d3015c4f 00000000000344be
Jan 21 10:01:03 compute1 kernel: [674129.009187]  01ff8805d3015c58 0000000100000000 00000000005a991e 00000000000b9f1e
Jan 21 10:01:03 compute1 kernel: [674129.014284]  ffff8805f1433f00 00000000b9f1e238 0000000000000000 0000000000000000
Jan 21 10:01:03 compute1 kernel: [674129.019401] Call Trace:
Jan 21 10:01:03 compute1 kernel: [674129.024492]  [<ffffffffa048f420>] tdp_page_fault+0x140/0x1f0 [kvm]
Jan 21 10:01:03 compute1 kernel: [674129.029650]  [<ffffffffa048a604>] kvm_mmu_page_fault+0x24/0x100 [kvm]
Jan 21 10:01:03 compute1 kernel: [674129.034796]  [<ffffffffa05df634>] handle_ept_violation+0x94/0x160 [kvm_intel]
Jan 21 10:01:03 compute1 kernel: [674129.039973]  [<ffffffffa05e4b05>] vmx_handle_exit+0xb5/0x890 [kvm_intel]
Jan 21 10:01:03 compute1 kernel: [674129.045166]  [<ffffffff8109d98e>] ? __vtime_account_system+0x2e/0x40
Jan 21 10:01:03 compute1 kernel: [674129.050376]  [<ffffffffa047ebd5>] vcpu_enter_guest+0x795/0xcb0 [kvm]
Jan 21 10:01:03 compute1 kernel: [674129.055567]  [<ffffffff810aacc8>] ? finish_wait+0x58/0x70
Jan 21 10:01:03 compute1 kernel: [674129.060760]  [<ffffffffa046a4db>] ? kvm_vcpu_block+0x9b/0xb0 [kvm]
Jan 21 10:01:03 compute1 kernel: [674129.065955]  [<ffffffff810aaf00>] ? prepare_to_wait_event+0x100/0x100
Jan 21 10:01:03 compute1 kernel: [674129.071179]  [<ffffffffa04830d8>] kvm_arch_vcpu_ioctl_run+0x1e8/0x460 [kvm]
Jan 21 10:01:03 compute1 kernel: [674129.076414]  [<ffffffffa046d062>] kvm_vcpu_ioctl+0x2c2/0x5b0 [kvm]
Jan 21 10:01:03 compute1 kernel: [674129.081638]  [<ffffffff810d8c01>] ? futex_wake+0x1b1/0x1d0
Jan 21 10:01:03 compute1 kernel: [674129.086856]  [<ffffffff811cfd10>] do_vfs_ioctl+0x2e0/0x4c0
Jan 21 10:01:03 compute1 kernel: [674129.092047]  [<ffffffff8109ddf4>] ? vtime_account_user+0x54/0x60
Jan 21 10:01:03 compute1 kernel: [674129.097225]  [<ffffffff811cff71>] SyS_ioctl+0x81/0xa0
Jan 21 10:01:03 compute1 kernel: [674129.102392]  [<ffffffff8172c87f>] tracesys+0xe1/0xe6
Jan 21 10:01:03 compute1 kernel: [674129.107526] Code: 02 00 f0 0f c1 07 89 c2 c1 ea 10 66 39 c2 75 02 5d c3 83 e2 fe 0f b7 f2 b8 00 80 00 00 eb 0c 0f 1f 44 00 00 f3 90 83 e8 01 74 0a <0f> b7 0f 66 39 ca 75 f1 5d c3 66 66 66 90 66 66 90 eb da 66 0f 
Jan 21 10:01:11 compute1 kernel: [674137.082177] BUG: soft lockup - CPU#23 stuck for 23s! [qemu-system-x86:8829]
Jan 21 10:01:11 compute1 kernel: [674137.087396] Modules linked in: vhost_net vhost macvtap macvlan joydev hid_lenovo_tpkbd xt_LOG ip_gre dummy nbd xt_multiport nfnetlink_queue nfnetlink_log bluetooth nf_conntrack_ipv6 nf_defrag_ipv6 xt_mac xt_physdev xt_set iptable_raw ip_set_hash_ip ip_set nfnetlink veth openvswitch gre ipt_MASQUERADE iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT xt_CHECKSUM iptable_mangle xt_tcpudp bridge stp llc ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_tables kvm_intel dm_multipath scsi_dh btrfs raid6_pq xor ufs qnx4 hfsplus hfs minix ntfs msdos jfs intel_powerclamp coretemp radeon kvm ttm crct10dif_pclmul drm_kms_helper gpio_ich crc32_pclmul drm i2c_algo_bit ghash_clmulni_intel aesni_intel serio_raw aes_x86_64 lrw gf128mul glue_helper ablk_helper hpilo lpc_ich hpwdt cryptd i7core_edac edac_core ipmi_si acpi_power_meter mac_hid lp parport mlx4_en vxlan ip_tunnel ptp pps_core xfs hid_generic bnx2x usbhid psmouse mdio hid hpsa mlx4_core libcrc32c [last unloaded: nbd]
Jan 21 10:01:11 compute1 kernel: [674137.135813] CPU: 23 PID: 8829 Comm: qemu-system-x86 Tainted: G      D   I  3.13.0-32-generic #57-Ubuntu
Jan 21 10:01:11 compute1 kernel: [674137.141085] Hardware name: HP ProLiant BL460c G6, BIOS I24 10/01/2013
Jan 21 10:01:11 compute1 kernel: [674137.146302] task: ffff880036bc17f0 ti: ffff8800da4f6000 task.ti: ffff8800da4f6000
Jan 21 10:01:11 compute1 kernel: [674137.151505] RIP: 0010:[<ffffffff81723c35>]  [<ffffffff81723c35>] _raw_spin_lock+0x35/0x50
Jan 21 10:01:11 compute1 kernel: [674137.156745] RSP: 0018:ffff8800da4f7d58  EFLAGS: 00000202
Jan 21 10:01:11 compute1 kernel: [674137.161923] RAX: 000000000000302c RBX: ffff880607d70160 RCX: 000000000000105a
Jan 21 10:01:11 compute1 kernel: [674137.167118] RDX: 0000000000001066 RSI: 0000000000001066 RDI: ffff8805bc5d0000
Jan 21 10:01:11 compute1 kernel: [674137.172293] RBP: ffff8800da4f7d58 R08: 0000000000000005 R09: 0000000000000000
Jan 21 10:01:11 compute1 kernel: [674137.177469] R10: 000000000017c000 R11: 0000000000000246 R12: ffffea0014a0c900
Jan 21 10:01:11 compute1 kernel: [674137.182647] R13: ffff8800da4f7d08 R14: 0000000000000000 R15: 0000000000000001
Jan 21 10:01:11 compute1 kernel: [674137.187841] FS:  00007f61b32b6980(0000) GS:ffff880607d60000(0000) knlGS:0000000000000000
Jan 21 10:01:11 compute1 kernel: [674137.193077] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 21 10:01:11 compute1 kernel: [674137.198273] CR2: 00007f5edc17b5e8 CR3: 00000005f129c000 CR4: 00000000000027e0
Jan 21 10:01:11 compute1 kernel: [674137.203479] Stack:
Jan 21 10:01:11 compute1 kernel: [674137.208613]  ffff8800da4f7d98 ffffffffa046b67e 00007f5edc19c000 ffff8805bc5d2be8
Jan 21 10:01:11 compute1 kernel: [674137.213849]  ffff8805fad8ec80 00007f5edc19c000 00007f5edc17c000 0000000000000000
Jan 21 10:01:11 compute1 kernel: [674137.219053]  ffff8800da4f7dd0 ffffffff8119a2cb ffff880bfa2e2b40 00007f5edc19c000
Jan 21 10:01:11 compute1 kernel: [674137.224265] Call Trace:
Jan 21 10:01:11 compute1 kernel: [674137.229432]  [<ffffffffa046b67e>] kvm_mmu_notifier_invalidate_range_start+0x3e/0x90 [kvm]
Jan 21 10:01:11 compute1 kernel: [674137.234689]  [<ffffffff8119a2cb>] __mmu_notifier_invalidate_range_start+0x5b/0x80
Jan 21 10:01:11 compute1 kernel: [674137.239947]  [<ffffffff8117755f>] zap_page_range+0x12f/0x150
Jan 21 10:01:11 compute1 kernel: [674137.245187]  [<ffffffff81727c64>] ? __do_page_fault+0x204/0x560
Jan 21 10:01:11 compute1 kernel: [674137.250417]  [<ffffffff8117400f>] SyS_madvise+0x3bf/0x850
Jan 21 10:01:11 compute1 kernel: [674137.255618]  [<ffffffff8111155c>] ? acct_account_cputime+0x1c/0x20
Jan 21 10:01:11 compute1 kernel: [674137.260823]  [<ffffffff8109ddf4>] ? vtime_account_user+0x54/0x60
Jan 21 10:01:11 compute1 kernel: [674137.266017]  [<ffffffff8172c87f>] tracesys+0xe1/0xe6
Jan 21 10:01:11 compute1 kernel: [674137.271178] Code: 00 00 02 00 f0 0f c1 07 89 c2 c1 ea 10 66 39 c2 75 02 5d c3 83 e2 fe 0f b7 f2 b8 00 80 00 00 eb 0c 0f 1f 44 00 00 f3 90 83 e8 01 <74> 0a 0f b7 0f 66 39 ca 75 f1 5d c3 66 66 66 90 66 66 90 eb da 
Jan 21 10:01:15 compute1 kernel: [674140.844255] BUG: soft lockup - CPU#5 stuck for 22s! [ksmd:213]
Jan 21 10:01:15 compute1 kernel: [674140.849710] Modules linked in: vhost_net vhost macvtap macvlan joydev hid_lenovo_tpkbd xt_LOG ip_gre dummy nbd xt_multiport nfnetlink_queue nfnetlink_log bluetooth nf_conntrack_ipv6 nf_defrag_ipv6 xt_mac xt_physdev xt_set iptable_raw ip_set_hash_ip ip_set nfnetlink veth openvswitch gre ipt_MASQUERADE iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT xt_CHECKSUM iptable_mangle xt_tcpudp bridge stp llc ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_tables kvm_intel dm_multipath scsi_dh btrfs raid6_pq xor ufs qnx4 hfsplus hfs minix ntfs msdos jfs intel_powerclamp coretemp radeon kvm ttm crct10dif_pclmul drm_kms_helper gpio_ich crc32_pclmul drm i2c_algo_bit ghash_clmulni_intel aesni_intel serio_raw aes_x86_64 lrw gf128mul glue_helper ablk_helper hpilo lpc_ich hpwdt cryptd i7core_edac edac_core ipmi_si acpi_power_meter mac_hid lp parport mlx4_en vxlan ip_tunnel ptp pps_core xfs hid_generic bnx2x usbhid psmouse mdio hid hpsa mlx4_core libcrc32c [last unloaded: nbd]
Jan 21 10:01:15 compute1 kernel: [674140.904399] CPU: 5 PID: 213 Comm: ksmd Tainted: G      D   I  3.13.0-32-generic #57-Ubuntu
Jan 21 10:01:15 compute1 kernel: [674140.910599] Hardware name: HP ProLiant BL460c G6, BIOS I24 10/01/2013
Jan 21 10:01:15 compute1 kernel: [674140.916719] task: ffff880bfbfd2fe0 ti: ffff880bfbfdc000 task.ti: ffff880bfbfdc000
Jan 21 10:01:15 compute1 kernel: [674140.922784] RIP: 0010:[<ffffffff81723c32>]  [<ffffffff81723c32>] _raw_spin_lock+0x32/0x50
Jan 21 10:01:15 compute1 kernel: [674140.928810] RSP: 0018:ffff880bfbfddd10  EFLAGS: 00000212
Jan 21 10:01:15 compute1 kernel: [674140.934713] RAX: 0000000000000450 RBX: ffff880bfbfddca0 RCX: 000000000000105a
Jan 21 10:01:15 compute1 kernel: [674140.940568] RDX: 0000000000001062 RSI: 0000000000001062 RDI: ffff8805bc5d0000
Jan 21 10:01:15 compute1 kernel: [674140.946322] RBP: ffff880bfbfddd10 R08: 8200000000000000 R09: a800598241000000
Jan 21 10:01:15 compute1 kernel: [674140.951981] R10: 57ff907dd5609040 R11: 0000000000046efc R12: ffffffff8101b7e9
Jan 21 10:01:15 compute1 kernel: [674140.957539] R13: ffff880bfbfddc88 R14: ffffffff8101b773 R15: ffff880bfbfddc78
Jan 21 10:01:15 compute1 kernel: [674140.963048] FS:  0000000000000000(0000) GS:ffff880607c40000(0000) knlGS:0000000000000000
Jan 21 10:01:15 compute1 kernel: [674140.968543] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Jan 21 10:01:15 compute1 kernel: [674140.974004] CR2: 00007fdee69ca55b CR3: 0000000001c0e000 CR4: 00000000000027e0
Jan 21 10:01:15 compute1 kernel: [674140.979462] Stack:
Jan 21 10:01:15 compute1 kernel: [674140.984829]  ffff880bfbfddd50 ffffffffa046b67e 00007f6176238000 ffff8805bc5d2be8
Jan 21 10:01:15 compute1 kernel: [674140.990311]  ffff8805fad8ec80 00007f6176238000 00007f6176237000 0000000000000000
Jan 21 10:01:15 compute1 kernel: [674140.995788]  ffff880bfbfddd88 ffffffff8119a2cb ffff8805f0740cc0 ffff8805dc26c480
Jan 21 10:01:15 compute1 kernel: [674141.001290] Call Trace:
Jan 21 10:01:15 compute1 kernel: [674141.006745]  [<ffffffffa046b67e>] kvm_mmu_notifier_invalidate_range_start+0x3e/0x90 [kvm]
Jan 21 10:01:15 compute1 kernel: [674141.012316]  [<ffffffff8119a2cb>] __mmu_notifier_invalidate_range_start+0x5b/0x80
Jan 21 10:01:15 compute1 kernel: [674141.017865]  [<ffffffff8119bff6>] try_to_merge_with_ksm_page+0x646/0x650
Jan 21 10:01:15 compute1 kernel: [674141.023378]  [<ffffffff81177a7f>] ? follow_page_mask+0x4ff/0x5b0
Jan 21 10:01:15 compute1 kernel: [674141.028850]  [<ffffffff8119c4a9>] ksm_do_scan+0x4a9/0xdb0
Jan 21 10:01:15 compute1 kernel: [674141.034270]  [<ffffffff8119ce2f>] ksm_scan_thread+0x7f/0x200
Jan 21 10:01:15 compute1 kernel: [674141.039632]  [<ffffffff810aaf00>] ? prepare_to_wait_event+0x100/0x100
Jan 21 10:01:15 compute1 kernel: [674141.045014]  [<ffffffff8119cdb0>] ? ksm_do_scan+0xdb0/0xdb0
Jan 21 10:01:15 compute1 kernel: [674141.050367]  [<ffffffff8108b3d2>] kthread+0xd2/0xf0
Jan 21 10:01:15 compute1 kernel: [674141.055659]  [<ffffffff8108b300>] ? kthread_create_on_node+0x1d0/0x1d0
Jan 21 10:01:15 compute1 kernel: [674141.060930]  [<ffffffff8172c5bc>] ret_from_fork+0x7c/0xb0
Jan 21 10:01:15 compute1 kernel: [674141.066159]  [<ffffffff8108b300>] ? kthread_create_on_node+0x1d0/0x1d0
Jan 21 10:01:15 compute1 kernel: [674141.071395] Code: 89 e5 b8 00 00 02 00 f0 0f c1 07 89 c2 c1 ea 10 66 39 c2 75 02 5d c3 83 e2 fe 0f b7 f2 b8 00 80 00 00 eb 0c 0f 1f 44 00 00 f3 90 <83> e8 01 74 0a 0f b7 0f 66 39 ca 75 f1 5d c3 66 66 66 90 66 66 
Jan 21 10:01:19 compute1 kernel: [674144.794437] BUG: soft lockup - CPU#1 stuck for 23s! [qemu-system-x86:8836]
Jan 21 10:01:19 compute1 kernel: [674144.799969] Modules linked in: vhost_net vhost macvtap macvlan joydev hid_lenovo_tpkbd xt_LOG ip_gre dummy nbd xt_multiport nfnetlink_queue nfnetlink_log bluetooth nf_conntrack_ipv6 nf_defrag_ipv6 xt_mac xt_physdev xt_set iptable_raw ip_set_hash_ip ip_set nfnetlink veth openvswitch gre ipt_MASQUERADE iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT xt_CHECKSUM iptable_mangle xt_tcpudp bridge stp llc ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_tables kvm_intel dm_multipath scsi_dh btrfs raid6_pq xor ufs qnx4 hfsplus hfs minix ntfs msdos jfs intel_powerclamp coretemp radeon kvm ttm crct10dif_pclmul drm_kms_helper gpio_ich crc32_pclmul drm i2c_algo_bit ghash_clmulni_intel aesni_intel serio_raw aes_x86_64 lrw gf128mul glue_helper ablk_helper hpilo lpc_ich hpwdt cryptd i7core_edac edac_core ipmi_si acpi_power_meter mac_hid lp parport mlx4_en vxlan ip_tunnel ptp pps_core xfs hid_generic bnx2x usbhid psmouse mdio hid hpsa mlx4_core libcrc32c [last unloaded: nbd]
Jan 21 10:01:19 compute1 kernel: [674144.852850] CPU: 1 PID: 8836 Comm: qemu-system-x86 Tainted: G      D   I  3.13.0-32-generic #57-Ubuntu
Jan 21 10:01:19 compute1 kernel: [674144.858659] Hardware name: HP ProLiant BL460c G6, BIOS I24 10/01/2013
Jan 21 10:01:19 compute1 kernel: [674144.864380] task: ffff8805f0f117f0 ti: ffff8805d3234000 task.ti: ffff8805d3234000
Jan 21 10:01:19 compute1 kernel: [674144.870042] RIP: 0010:[<ffffffff81723c32>]  [<ffffffff81723c32>] _raw_spin_lock+0x32/0x50
Jan 21 10:01:19 compute1 kernel: [674144.875668] RSP: 0018:ffff8805d3235c28  EFLAGS: 00000202
Jan 21 10:01:19 compute1 kernel: [674144.881163] RAX: 0000000000007095 RBX: ffff8805d3235bb0 RCX: 000000000000105a
Jan 21 10:01:19 compute1 kernel: [674144.886656] RDX: 000000000000105c RSI: 000000000000105c RDI: ffff8805bc5d0000
Jan 21 10:01:19 compute1 kernel: [674144.892109] RBP: ffff8805d3235c28 R08: 0000000000000007 R09: ffff8805d3235c50
Jan 21 10:01:19 compute1 kernel: [674144.897538] R10: ffff880000000190 R11: 80000000ccc02966 R12: ffff8805f1430000
Jan 21 10:01:19 compute1 kernel: [674144.902899] R13: ffff8805d3235c58 R14: 0000000000000000 R15: 00000000000ba402
Jan 21 10:01:19 compute1 kernel: [674144.908233] FS:  00007f61a1f85700(0000) GS:ffff880607c00000(0000) knlGS:ffff88023fd00000
Jan 21 10:01:19 compute1 kernel: [674144.913597] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 21 10:01:19 compute1 kernel: [674144.918954] CR2: 00007ff1679be000 CR3: 00000005f129c000 CR4: 00000000000027e0
Jan 21 10:01:19 compute1 kernel: [674144.924344] Stack:
Jan 21 10:01:19 compute1 kernel: [674144.929674]  ffff8805d3235c90 ffffffffa048f420 ffff8805d3235c4f 00000000000344be
Jan 21 10:01:19 compute1 kernel: [674144.935122]  01ff8805d3235c58 0000000100000000 00000000000ccc02 00000000000ba402
Jan 21 10:01:19 compute1 kernel: [674144.940672]  ffff8805f1430000 00000000ba402000 0000000000000000 0000000000000000
Jan 21 10:01:19 compute1 kernel: [674144.946043] Call Trace:
Jan 21 10:01:19 compute1 kernel: [674144.951360]  [<ffffffffa048f420>] tdp_page_fault+0x140/0x1f0 [kvm]
Jan 21 10:01:19 compute1 kernel: [674144.956707]  [<ffffffffa048a604>] kvm_mmu_page_fault+0x24/0x100 [kvm]
Jan 21 10:01:19 compute1 kernel: [674144.962007]  [<ffffffffa05df634>] handle_ept_violation+0x94/0x160 [kvm_intel]
Jan 21 10:01:19 compute1 kernel: [674144.967330]  [<ffffffffa05e4b05>] vmx_handle_exit+0xb5/0x890 [kvm_intel]
Jan 21 10:01:19 compute1 kernel: [674144.972628]  [<ffffffff8109d98e>] ? __vtime_account_system+0x2e/0x40
Jan 21 10:01:19 compute1 kernel: [674144.977896]  [<ffffffffa047ebd5>] vcpu_enter_guest+0x795/0xcb0 [kvm]
Jan 21 10:01:19 compute1 kernel: [674144.983109]  [<ffffffff810aacc8>] ? finish_wait+0x58/0x70
Jan 21 10:01:19 compute1 kernel: [674144.988429]  [<ffffffffa046a4db>] ? kvm_vcpu_block+0x9b/0xb0 [kvm]
Jan 21 10:01:19 compute1 kernel: [674144.993591]  [<ffffffff810aaf00>] ? prepare_to_wait_event+0x100/0x100
Jan 21 10:01:19 compute1 kernel: [674144.998772]  [<ffffffffa04830d8>] kvm_arch_vcpu_ioctl_run+0x1e8/0x460 [kvm]
Jan 21 10:01:19 compute1 kernel: [674145.003961]  [<ffffffffa046d062>] kvm_vcpu_ioctl+0x2c2/0x5b0 [kvm]
Jan 21 10:01:19 compute1 kernel: [674145.009293]  [<ffffffff811cfd10>] do_vfs_ioctl+0x2e0/0x4c0
Jan 21 10:01:19 compute1 kernel: [674145.014469]  [<ffffffff8109ddf4>] ? vtime_account_user+0x54/0x60
Jan 21 10:01:19 compute1 kernel: [674145.019655]  [<ffffffff811cff71>] SyS_ioctl+0x81/0xa0
Jan 21 10:01:19 compute1 kernel: [674145.024836]  [<ffffffff8172c87f>] tracesys+0xe1/0xe6
Jan 21 10:01:19 compute1 kernel: [674145.029991] Code: 89 e5 b8 00 00 02 00 f0 0f c1 07 89 c2 c1 ea 10 66 39 c2 75 02 5d c3 83 e2 fe 0f b7 f2 b8 00 80 00 00 eb 0c 0f 1f 44 00 00 f3 90 <83> e8 01 74 0a 0f b7 0f 66 39 ca 75 f1 5d c3 66 66 66 90 66 66 
-------------- next part --------------
[ml2]
# (ListOpt) List of network type driver entrypoints to be loaded from
# the neutron.ml2.type_drivers namespace.
#
# type_drivers = local,flat,vlan,gre,vxlan
# Example: type_drivers = flat,vlan,gre,vxlan
type_drivers = flat,vxlan
tenant_network_types = vxlan
mechanism_drivers = openvswitch

# (ListOpt) Ordered list of network_types to allocate as tenant
# networks. The default value 'local' is useful for single-box testing
# but provides no connectivity between hosts.
#
# tenant_network_types = local
# Example: tenant_network_types = vlan,gre,vxlan

# (ListOpt) Ordered list of networking mechanism driver entrypoints
# to be loaded from the neutron.ml2.mechanism_drivers namespace.
# mechanism_drivers =
# Example: mechanism_drivers = openvswitch,mlnx
# Example: mechanism_drivers = arista
# Example: mechanism_drivers = cisco,logger
# Example: mechanism_drivers = openvswitch,brocade
# Example: mechanism_drivers = linuxbridge,brocade

# (ListOpt) Ordered list of extension driver entrypoints
# to be loaded from the neutron.ml2.extension_drivers namespace.
# extension_drivers =
# Example: extension_drivers = anewextensiondriver

[ml2_type_flat]
# (ListOpt) List of physical_network names with which flat networks
# can be created. Use * to allow flat networks with arbitrary
# physical_network names.
#
# flat_networks =
# Example:flat_networks = physnet1,physnet2
# Example:flat_networks = *

[ml2_type_vlan]
# (ListOpt) List of <physical_network>[:<vlan_min>:<vlan_max>] tuples
# specifying physical_network names usable for VLAN provider and
# tenant networks, as well as ranges of VLAN tags on each
# physical_network available for allocation as tenant networks.
#
# network_vlan_ranges =
# Example: network_vlan_ranges = physnet1:1000:2999,physnet2

[ml2_type_gre]
# (ListOpt) Comma-separated list of <tun_min>:<tun_max> tuples enumerating ranges of GRE tunnel IDs that are available for tenant network allocation
# tunnel_id_ranges =

[ml2_type_vxlan]
# (ListOpt) Comma-separated list of <vni_min>:<vni_max> tuples enumerating
# ranges of VXLAN VNI IDs that are available for tenant network allocation.
#
vni_ranges = 65537:69999

# (StrOpt) Multicast group for the VXLAN interface. When configured, will
# enable sending all broadcast traffic to this multicast group. When left
# unconfigured, will disable multicast VXLAN mode.
#
# vxlan_group =
# Example: vxlan_group = 239.1.1.1

[securitygroup]
# Controls if neutron security group is enabled or not.
# It should be false when you use nova security group.
# enable_security_group = True

# Use ipset to speed-up the iptables security groups. Enabling ipset support
# requires that ipset is installed on L2 agent node.
# enable_ipset = True
enable_security_group = True
enable_ipset = True
firewall_driver = neutron.agent.linux.iptables_firewall.OVSHybridIptablesFirewallDriver

[agent]
tunnel_types = vxlan

[ovs]
local_ip = 10.20.0.161
-------------- next part --------------
tshark output on tap interface in compute node
----------------

  6  18.500971     10.0.0.4 -> 10.0.0.1     TCP 74 54222 > distinct [SYN] Seq=0 Win=14140 Len=0 MSS=1414 SACK_PERM=1 TSval=30845 TSecr=0 WS=64
  7  18.502365     10.0.0.1 -> 10.0.0.4     TCP 74 distinct > 54222 [SYN, ACK] Seq=0 Ack=1 Win=26960 Len=0 MSS=1360 SACK_PERM=1 TSval=21047784 TSecr=30845 WS=128
  8  18.502675     10.0.0.4 -> 10.0.0.1     TCP 66 54222 > distinct [ACK] Seq=1 Ack=1 Win=14144 Len=0 TSval=30845 TSecr=21047784
8   9  19.899301     10.0.0.1 -> 10.0.0.4     TCP 74 [TCP Retransmission] distinct > 54222 [SYN, ACK] Seq=0 Ack=1 Win=26960 Len=0 MSS=1360 SACK_PERM=1 TSval=21048134 TSecr=30845 WS=128
9  10  19.899622     10.0.0.4 -> 10.0.0.1     TCP 66 [TCP Dup ACK 8#1] 54222 > distinct [ACK] Seq=1 Ack=1 Win=14144 Len=0 TSval=31195 TSecr=21047784
10  11  21.899306     10.0.0.1 -> 10.0.0.4     TCP 74 [TCP Retransmission] distinct > 54222 [SYN, ACK] Seq=0 Ack=1 Win=26960 Len=0 MSS=1360 SACK_PERM=1 TSval=21048634 TSecr=30845 WS=128
11  12  21.899640     10.0.0.4 -> 10.0.0.1     TCP 66 [TCP Dup ACK 8#2] 54222 > distinct [ACK] Seq=1 Ack=1 Win=14144 Len=0 TSval=31695 TSecr=21047784
14  15  26.299286     10.0.0.1 -> 10.0.0.4     TCP 74 [TCP Retransmission] distinct > 54222 [SYN, ACK] Seq=0 Ack=1 Win=26960 Len=0 MSS=1360 SACK_PERM=1 TSval=21049734 TSecr=30845 WS=128
15  16  26.299613     10.0.0.4 -> 10.0.0.1     TCP 66 [TCP Dup ACK 8#3] 54222 > distinct [ACK] Seq=1 Ack=1 Win=14144 Len=0 TSval=32795 TSecr=21047784
16  17  34.299939     10.0.0.1 -> 10.0.0.4     TCP 74 [TCP Retransmission] distinct > 54222 [SYN, ACK] Seq=0 Ack=1 Win=26960 Len=0 MSS=1360 SACK_PERM=1 TSval=21051734 TSecr=30845 WS=128
17  18  34.300324     10.0.0.4 -> 10.0.0.1     TCP 66 [TCP Dup ACK 8#4] 54222 > distinct [ACK] Seq=1 Ack=1 Win=14144 Len=0 TSval=34795 TSecr=21047784


tshark output on qrxxx interface in network node in router namspace
-----------

 6  18.502436     10.0.0.4 -> 10.0.0.1     TCP 74 54222 > distinct [SYN] Seq=0 Win=14140 Len=0 MSS=1414 SACK_PERM=1 TSval=30845 TSecr=0 WS=64                                            [10/262]
  7  18.502484     10.0.0.1 -> 10.0.0.4     TCP 74 distinct > 54222 [SYN, ACK] Seq=0 Ack=1 Win=26960 Len=0 MSS=1360 SACK_PERM=1 TSval=21047784 TSecr=30845 WS=128
  8  18.503501     10.0.0.4 -> 10.0.0.1     TCP 66 54222 > distinct [ACK] Seq=1 Ack=1 Win=14144 Len=0 TSval=30845 TSecr=21047784
8   9  19.899822     10.0.0.1 -> 10.0.0.4     TCP 74 [TCP Retransmission] distinct > 54222 [SYN, ACK] Seq=0 Ack=1 Win=26960 Len=0 MSS=1360 SACK_PERM=1 TSval=21048134 TSecr=30845 WS=128
9  10  19.900437     10.0.0.4 -> 10.0.0.1     TCP 66 [TCP Dup ACK 8#1] 54222 > distinct [ACK] Seq=1 Ack=1 Win=14144 Len=0 TSval=31195 TSecr=21047784
10  11  21.899821     10.0.0.1 -> 10.0.0.4     TCP 74 [TCP Retransmission] distinct > 54222 [SYN, ACK] Seq=0 Ack=1 Win=26960 Len=0 MSS=1360 SACK_PERM=1 TSval=21048634 TSecr=30845 WS=128
 12  21.900467     10.0.0.4 -> 10.0.0.1     TCP 66 [TCP Dup ACK 8#2] 54222 > distinct [ACK] Seq=1 Ack=1 Win=14144 Len=0 TSval=31695 TSecr=21047784
14  15  26.299822     10.0.0.1 -> 10.0.0.4     TCP 74 [TCP Retransmission] distinct > 54222 [SYN, ACK] Seq=0 Ack=1 Win=26960 Len=0 MSS=1360 SACK_PERM=1 TSval=21049734 TSecr=30845 WS=128
15  16  26.300464     10.0.0.4 -> 10.0.0.1     TCP 66 [TCP Dup ACK 8#3] 54222 > distinct [ACK] Seq=1 Ack=1 Win=14144 Len=0 TSval=32795 TSecr=21047784
16  17  34.299820     10.0.0.1 -> 10.0.0.4     TCP 74 [TCP Retransmission] distinct > 54222 [SYN, ACK] Seq=0 Ack=1 Win=26960 Len=0 MSS=1360 SACK_PERM=1 TSval=21051734 TSecr=30845 WS=128
 18  34.301691     10.0.0.4 -> 10.0.0.1     TCP 66 [TCP Dup ACK 8#4] 54222 > distinct [ACK] Seq=1 Ack=1 Win=14144 Len=0 TSval=34795 TSecr=21047784

-------------- next part --------------
[ml2]
# (ListOpt) List of network type driver entrypoints to be loaded from
# the neutron.ml2.type_drivers namespace.
#
# type_drivers = local,flat,vlan,gre,vxlan
# Example: type_drivers = flat,vlan,gre,vxlan

type_drivers = flat,vxlan
tenant_network_types = vxlan
mechanism_drivers = openvswitch

# (ListOpt) Ordered list of network_types to allocate as tenant
# networks. The default value 'local' is useful for single-box testing
# but provides no connectivity between hosts.
#
# tenant_network_types = local
# Example: tenant_network_types = vlan,gre,vxlan

# (ListOpt) Ordered list of networking mechanism driver entrypoints
# to be loaded from the neutron.ml2.mechanism_drivers namespace.
# mechanism_drivers =
# Example: mechanism_drivers = openvswitch,mlnx
# Example: mechanism_drivers = arista
# Example: mechanism_drivers = cisco,logger
# Example: mechanism_drivers = openvswitch,brocade
# Example: mechanism_drivers = linuxbridge,brocade

# (ListOpt) Ordered list of extension driver entrypoints
# to be loaded from the neutron.ml2.extension_drivers namespace.
# extension_drivers =
# Example: extension_drivers = anewextensiondriver

[ml2_type_flat]
# (ListOpt) List of physical_network names with which flat networks
# can be created. Use * to allow flat networks with arbitrary
# physical_network names.
#
# flat_networks =
# Example:flat_networks = physnet1,physnet2
# Example:flat_networks = *
flat_networks = external

[ml2_type_vlan]
# (ListOpt) List of <physical_network>[:<vlan_min>:<vlan_max>] tuples
# specifying physical_network names usable for VLAN provider and
# tenant networks, as well as ranges of VLAN tags on each
# physical_network available for allocation as tenant networks.
#
# network_vlan_ranges =
# Example: network_vlan_ranges = physnet1:1000:2999,physnet2

[ml2_type_gre]
# (ListOpt) Comma-separated list of <tun_min>:<tun_max> tuples enumerating ranges of GRE tunnel IDs that are available for tenant network allocation
# tunnel_id_ranges =

[ml2_type_vxlan]
# (ListOpt) Comma-separated list of <vni_min>:<vni_max> tuples enumerating
# ranges of VXLAN VNI IDs that are available for tenant network allocation.
#
vni_ranges = 65537:69999

# (StrOpt) Multicast group for the VXLAN interface. When configured, will
# enable sending all broadcast traffic to this multicast group. When left
# unconfigured, will disable multicast VXLAN mode.
#
# vxlan_group =
# Example: vxlan_group = 239.1.1.1

[securitygroup]
# Controls if neutron security group is enabled or not.
# It should be false when you use nova security group.
# enable_security_group = True

# Use ipset to speed-up the iptables security groups. Enabling ipset support
# requires that ipset is installed on L2 agent node.
# enable_ipset = True

enable_security_group = True
enable_ipset = True
firewall_driver = neutron.agent.linux.iptables_firewall.OVSHybridIptablesFirewallDriver

[ovs]
local_ip = 10.20.0.162
bridge_mappings = external:br-ex
tunnel_type = vxlan
tunnel_bridge = br-tun
integration_bridge = br-int
tunnel_id_ranges = 65537:69999
tenant_network_type = vxlan
enable_tunneling = true

[agent]
tunnel_types = vxlan


More information about the Openstack mailing list