[Bug 833236] New: getting kernel multiple warning each second under some network load
https://bugzilla.novell.com/show_bug.cgi?id=833236 https://bugzilla.novell.com/show_bug.cgi?id=833236#c0 Summary: getting kernel multiple warning each second under some network load Classification: openSUSE Product: openSUSE 12.3 Version: Final Platform: x86-64 OS/Version: openSUSE 12.3 Status: NEW Severity: Normal Priority: P5 - None Component: Kernel AssignedTo: kernel-maintainers@forge.provo.novell.com ReportedBy: matorola@gmail.com QAContact: qa-bugs@suse.de Found By: --- Blocker: --- User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:22.0) Gecko/20100101 Firefox/22.0 Hello! I have IBM System X3250 M4 server and getting like 42 warning each second from kernel. Updated to latest available via "zypper up" (with reboot to latest kernel), but it didn't helped. If there's almost no load on system, there's no kernel warnings, but as soon we start some kvm machines, there's a lot of kernel warnings. ithaqua:~ # cat /etc/SuSE-release openSUSE 12.3 (x86_64) VERSION = 12.3 CODENAME = Dartmouth ithaqua:~ # uname -a Linux ithaqua.nyarly.com 3.7.10-1.16-default #1 SMP Fri May 31 20:21:23 UTC 2013 (97c14ba) x86_64 x86_64 x86_64 GNU/Linux Aug 03 18:03:56 ithaqua.nyarly.com kernel: ------------[ cut here ]------------ Aug 03 18:03:56 ithaqua.nyarly.com kernel: WARNING: at /home/abuild/rpmbuild/BUILD/kernel-default-3.7.10/linux-3.7/net/core/dev.c:1941 skb_warn_bad_offload+0xb6/0xc1() Aug 03 18:03:56 ithaqua.nyarly.com kernel: Hardware name: IBM System X3250 M4 -[2583E4G]- Aug 03 18:03:56 ithaqua.nyarly.com kernel: e1000e: caps=(0x00000000700043a9, 0x0000000000000000) len=2464 data_len=0 gso_size=1460 gso_type=5 ip_summed=1 Aug 03 18:03:56 ithaqua.nyarly.com kernel: Modules linked in: dm_log_userspace fuse ufs qnx4 hfsplus hfs minix msdos jfs reiserfs vhost_net macvtap macvlan xfs xt_pkttype xt_physdev xt_TCPMSS xt_LOG xt_limit ebtable_nat ebtables xt_CHECKSUM iptable_mangle xt_tcpudp tun bridge stp llc ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 ip6table_raw ipt_REJECT iptable_raw xt_CT iptable_filter ip6table_mangle nf_conntrack_netbios_ns nf_conntrack_broadcast nf_conntrack_ipv4 nf_defrag_ipv4 ip_tables xt_conntrack nf_conntrack ip6table_filter ip6_tables x_tables nls_iso8859_1 nls_cp437 vfat fat dm_mirror dm_region_hash dm_log dm_mod acpi_cpufreq mperf coretemp ghash_clmulni_intel aesni_intel ablk_helper cryptd joydev lrw kvm_intel aes_x86_64 xts hid_logitech_dj kvm gf128mul cdc_ether iTCO_wdt iTCO_vendor_support usbhid sr_mod pcspkr usbnet Aug 03 18:03:56 ithaqua.nyarly.com kernel: i2c_i801 gpio_ich tpm_tis tpm cdrom tpm_bios e1000e sg shpchp lpc_ich mfd_core microcode pci_hotplug wmi button ipmi_devintf ipmi_si ipmi_msghandler autofs4 btrfs zlib_deflate libcrc32c raid456 async_raid6_recov async_pq raid6_pq async_xor xor async_memcpy async_tx raid10 raid0 raid1 crc32c_intel mgag200 ttm drm_kms_helper ehci_hcd drm i2c_algo_bit usbcore sysimgblt sysfillrect syscopyarea usb_common processor thermal_sys scsi_dh_rdac scsi_dh_hp_sw scsi_dh_emc scsi_dh_alua scsi_dh Aug 03 18:03:56 ithaqua.nyarly.com kernel: Pid: 3401, comm: vhost-3392 Tainted: G W 3.7.10-1.16-default #1 Aug 03 18:03:56 ithaqua.nyarly.com kernel: Call Trace: Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffff81004728>] dump_trace+0x78/0x2c0 Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffff8153b38e>] dump_stack+0x69/0x6f Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffff81043f69>] warn_slowpath_common+0x79/0xc0 Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffff81044065>] warn_slowpath_fmt+0x45/0x50 Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffff815446e7>] skb_warn_bad_offload+0xb6/0xc1 Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffff8144e746>] skb_gso_segment+0x206/0x280 Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffff81451ada>] dev_hard_start_xmit+0x9a/0x4a0 Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffff8146d16d>] sch_direct_xmit+0xfd/0x1d0 Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffff8145229e>] dev_queue_xmit+0x16e/0x410 Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffffa0571c42>] br_dev_queue_push_xmit+0x72/0xc0 [bridge] Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffffa0578973>] br_nf_post_routing+0x223/0x340 [bridge] Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffff8147a23d>] nf_iterate+0x8d/0xc0 Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffff8147a2de>] nf_hook_slow+0x6e/0x130 Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffffa0571f42>] br_forward_finish+0x42/0x50 [bridge] Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffffa05781f9>] br_nf_forward_finish+0xb9/0x180 [bridge] Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffffa0578d01>] br_nf_forward_ip+0x271/0x3a0 [bridge] Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffff8147a23d>] nf_iterate+0x8d/0xc0 Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffff8147a2de>] nf_hook_slow+0x6e/0x130 Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffffa0571fe0>] __br_forward+0x90/0xb0 [bridge] Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffffa0572e44>] br_handle_frame_finish+0x214/0x2b0 [bridge] Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffffa057852f>] br_nf_pre_routing_finish+0x14f/0x370 [bridge] Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffffa05793b9>] br_nf_pre_routing+0x399/0x620 [bridge] Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffff8147a23d>] nf_iterate+0x8d/0xc0 Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffff8147a2de>] nf_hook_slow+0x6e/0x130 Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffffa05730c0>] br_handle_frame+0x1e0/0x280 [bridge] Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffff81450415>] __netif_receive_skb+0x215/0x860 Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffff81450b01>] process_backlog+0xa1/0x180 Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffff814515e0>] net_rx_action+0x140/0x250 Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffff8104c39e>] __do_softirq+0xbe/0x1f0 Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffff8155061c>] call_softirq+0x1c/0x30 Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffff81004675>] do_softirq+0x75/0xb0 Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffff8144ff1e>] netif_rx_ni+0x1e/0x30 Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffffa0593a99>] tun_get_user+0x409/0x630 [tun] Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffffa0593ce7>] tun_sendmsg+0x27/0x30 [tun] Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffffa06b57e5>] handle_tx+0x235/0x570 [vhost_net] Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffffa06b27ad>] vhost_worker+0xed/0x190 [vhost_net] Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffff81066273>] kthread+0xb3/0xc0 Aug 03 18:03:56 ithaqua.nyarly.com kernel: [<ffffffff8154f17c>] ret_from_fork+0x7c/0xb0 Aug 03 18:03:56 ithaqua.nyarly.com kernel: ---[ end trace a29a5dcdaadb3731 ]--- bridge is br0 which consist of one eth1 interface (all other settings are defaults). Anything to try to solve this problem? /usr/lib/systemd/systemd-journald is getting full 1 core load per logging/storing this kernel warnings. Reproducible: Always -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=833236
https://bugzilla.novell.com/show_bug.cgi?id=833236#c
Jeff Mahoney
https://bugzilla.novell.com/show_bug.cgi?id=833236
https://bugzilla.novell.com/show_bug.cgi?id=833236#c
Alberto Planas Dominguez
https://bugzilla.novell.com/show_bug.cgi?id=833236
https://bugzilla.novell.com/show_bug.cgi?id=833236#c1
david chang
https://bugzilla.novell.com/show_bug.cgi?id=833236
https://bugzilla.novell.com/show_bug.cgi?id=833236#c2
Anatoly Pugachev
https://bugzilla.novell.com/show_bug.cgi?id=833236
https://bugzilla.novell.com/show_bug.cgi?id=833236#c3
--- Comment #3 from david chang
https://bugzilla.novell.com/show_bug.cgi?id=833236
https://bugzilla.novell.com/show_bug.cgi?id=833236#c4
--- Comment #4 from Anatoly Pugachev
https://bugzilla.novell.com/show_bug.cgi?id=833236
https://bugzilla.novell.com/show_bug.cgi?id=833236#c5
--- Comment #5 from david chang
https://bugzilla.novell.com/show_bug.cgi?id=833236
https://bugzilla.novell.com/show_bug.cgi?id=833236#c6
--- Comment #6 from Anatoly Pugachev
https://bugzilla.novell.com/show_bug.cgi?id=833236
https://bugzilla.novell.com/show_bug.cgi?id=833236#c7
--- Comment #7 from Anatoly Pugachev
https://bugzilla.novell.com/show_bug.cgi?id=833236
https://bugzilla.novell.com/show_bug.cgi?id=833236#c8
--- Comment #8 from david chang
https://bugzilla.novell.com/show_bug.cgi?id=833236
https://bugzilla.novell.com/show_bug.cgi?id=833236#c9
--- Comment #9 from Anatoly Pugachev
https://bugzilla.novell.com/show_bug.cgi?id=833236
https://bugzilla.novell.com/show_bug.cgi?id=833236#c10
--- Comment #10 from david chang
David,
rebooted the server yesterday (with intel_iommu=on and updated from kernel-default-3.7.10-1.16.1.x86_64 to kernel-default-3.7.10-1.24.1.x86_64). logs are still generated (eth1 gso off). Hope to make a test on eth0 within few days. Once again, sorry for the delay, preparing to next exam (2 exams passed).
No problem, thanks for your feedback. Would it be possible to disable TSO on both eth1 and br1? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=833236
https://bugzilla.novell.com/show_bug.cgi?id=833236#c11
--- Comment #11 from Anatoly Pugachev
https://bugzilla.novell.com/show_bug.cgi?id=833236
https://bugzilla.novell.com/show_bug.cgi?id=833236#c12
david chang
participants (1)
-
bugzilla_noreply@novell.com