[Openstack] [rhos-list] system panic after starting OVS agent

Xin Zhao xzhao at bnl.gov
Tue Nov 5 21:43:23 UTC 2013


Add the general Openstack list, sorry for folks who are on both lists...

On 11/5/2013 2:42 PM, Xin Zhao wrote:
> Hello,
>
> On my grizzly quantum/OVS network node, after I start the 
> quantum-openvswitch-agent, the system log shows errors as below,
> and it repeats every second since then...  and the panic messages 
> continue on even after I stop all openstack daemons, only a system reboot
> can clear it out.
>
> Nov  5 14:13:58 cldnet01 kernel: qg-581539d2-ac: hw csum failure.
> Nov  5 14:13:58 cldnet01 kernel: Pid: 0, comm: swapper Not tainted 
> 2.6.32-358.123.2.openstack.el6.x86_64 #1
> Nov  5 14:13:58 cldnet01 kernel: Call Trace:
> Nov  5 14:13:58 cldnet01 kernel: <IRQ> [<ffffffff8144a252>] ? 
> netdev_rx_csum_fault+0x42/0x50
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffff81442cc0>] ? 
> __skb_checksum_complete_head+0x60/0x70
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffff81442ce1>] ? 
> __skb_checksum_complete+0x11/0x20
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffff814c8b7d>] ? 
> nf_ip_checksum+0x5d/0x130
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffffa01b4d31>] ? 
> udp_error+0xb1/0x1e0 [nf_conntrack]
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffffa01aec98>] ? 
> nf_conntrack_in+0x138/0xa00 [nf_conntrack]
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffffa00721bb>] ? 
> alloc_null_binding+0x5b/0xa0 [iptable_nat]
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffffa0072441>] ? 
> nf_nat_fn+0x91/0x260 [iptable_nat]
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffffa01cc721>] ? 
> ipv4_conntrack_in+0x21/0x30 [nf_conntrack_ipv4]
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffff81477459>] ? 
> nf_iterate+0x69/0xb0
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffff814819e9>] ? 
> ip_rcv_finish+0x199/0x440
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffff81481850>] ? 
> ip_rcv_finish+0x0/0x440
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffff81477614>] ? 
> nf_hook_slow+0x74/0x110
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffff81481850>] ? 
> ip_rcv_finish+0x0/0x440
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffff81481ef4>] ? 
> ip_rcv+0x264/0x350
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffffa024b503>] ? 
> ovs_netdev_frame_hook+0xb3/0x110 [openvswitch]
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffff81449e6b>] ? 
> __netif_receive_skb+0x4ab/0x750
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffff8144a1aa>] ? 
> process_backlog+0x9a/0x100
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffff8144f483>] ? 
> net_rx_action+0x103/0x2f0
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffff810770b1>] ? 
> __do_softirq+0xc1/0x1e0
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffff810e1bb0>] ? 
> handle_IRQ_event+0x60/0x170
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffff8100c1cc>] ? 
> call_softirq+0x1c/0x30
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffff8100de05>] ? 
> do_softirq+0x65/0xa0
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffff81076e95>] ? 
> irq_exit+0x85/0x90
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffff8151cd75>] ? do_IRQ+0x75/0xf0
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffff8100b9d3>] ? 
> ret_from_intr+0x0/0x11
> Nov  5 14:13:58 cldnet01 kernel: <EOI> [<ffffffff81014907>] ? 
> mwait_idle+0x77/0xd0
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffff8151931a>] ? 
> atomic_notifier_call_chain+0x1a/0x20
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffff81009fc6>] ? 
> cpu_idle+0xb6/0x110
> Nov  5 14:13:58 cldnet01 kernel: [<ffffffff8150cc00>] ? 
> start_secondary+0x2ac/0x2ef
>
> The only other message in the syslog that's related to CSUM is the 
> following:
> Nov  5 14:10:44 cldnet01 kernel: lo: Dropping TSO features since no 
> CSUM feature.
> Nov  5 14:10:44 cldnet01 kernel: lo: Disabled Privacy Extensions
> (this message appears after starting the l3-agent)
>
> The network host is RHEL6.4, kernel is 
> 2.6.32-358.123.2.openstack.el6.x86_64
>
> All the daemons appear to being running, an instance can start, but 
> network doesn't work for the instance.
>
> Any wisdom on what's going on?
>
> Thanks,
> Xin
>
>
>
>
> _______________________________________________
> rhos-list mailing list
> rhos-list at redhat.com
> https://www.redhat.com/mailman/listinfo/rhos-list





More information about the Openstack mailing list