[opensuse-kernel] Kernel:HEAD: Networking soft lockup !

Hi: I am getting this on current kernel:HEAD Aug 23 09:00:13 ex6 kernel: [45328.226501] BUG: soft lockup - CPU#6 stuck for 23s! [httpd2-event:15597] Aug 23 09:00:13 ex6 kernel: [45328.226552] Modules linked in: sg st sr_mod cdrom act_police cls_basic cls_flow cls_fw cls_u32 sch_tbf sch_prio sch_htb sch_hfsc sch_ingress sch_sfq bridge stp llc xt_statistic xt_CT xt_LOG xt_realm xt_connlimit xt_addrtype iptable_raw xt_c omment xt_recent ipt_ULOG ipt_REJECT ipt_REDIRECT ipt_NETMAP ipt_MASQUERADE ipt_ECN ipt_CLUSTERIP ipt_ah xt_set ip_set nf_nat_tftp nf_nat_snmp_basic nf_conntrack_snmp nf_nat_sip nf_nat_pptp nf_nat_proto_gre nf_nat_irc nf_nat_h323 nf_nat_ftp nf_nat_amanda ts_kmp xt_time x t_TCPMSS xt_sctp nf_conntrack_amanda xt_policy nf_conntrack_sane ip6t_REJECT nf_conntrack_tftp nf_conntrack_ipv6 nf_conntrack_sip ip6table_raw nf_conntrack_proto_udplite ip6table_mangle nf_conntrack_proto_sctp nf_conntrack_pptp nf_conntrack_proto_gre nf_conntrack_netlink nf_conntrack_netbios_ns nf_conntrack_broadcast nf_conntrack_irc nf_conntrack_h323 nf_conntrack_ftp xt_TPROXY nf_tproxy_core nf_defrag_ipv6 xt_tcpmss xt_pkttype xt_physdev xt_owner xt_NFQUEUE xt_NFLOG nfnetlink_ Aug 23 09:00:13 ex6 kernel: log xt_multiport xt_mark xt_mac xt_limit xt_length xt_iprange xt_helper xt_hashlimit xt_DSCP xt_dscp xt_dccp xt_conntrack xt_connmark xt_CLASSIFY xt_AUDIT xt_tcpudp xt_state iptable_nat nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_conntrack ipta ble_mangle nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables x_tables af_packet cachefiles fscache eeepc_wmi asus_wmi sparse_keymap acpi_cpufreq mperf rfkill pci_hotplug e1000e coretemp wmi kvm_intel i2c_i801 kvm mei pcspkr joydev ghash_clmulni_intel microcod e crc32c_intel edd aesni_intel ablk_helper cryptd aes_x86_64 autofs4 hid_generic usbhid i915 xhci_hcd drm_kms_helper drm ehci_hcd i2c_algo_bit usbcore usb_common video button scsi_dh_hp_sw scsi_dh_alua scsi_dh_emc scsi_dh_rdac scsi_dh fan processor thermal thermal_sys me garaid_sas Aug 23 09:00:13 ex6 kernel: [45328.226665] CPU 6 Aug 23 09:00:13 ex6 kernel: [45328.226669] Pid: 15597, comm: httpd2-event Not tainted 3.6.0-rc2-1-default #1 System manufacturer System Product Name/P8B WS Aug 23 09:00:13 ex6 kernel: [45328.226671] RIP: 0010:[<ffffffff81562be5>] [<ffffffff81562be5>] _raw_spin_lock_bh+0x25/0x30 Aug 23 09:00:13 ex6 kernel: [45328.226680] RSP: 0018:ffff88018fc79f08 EFLAGS: 00000297 Aug 23 09:00:13 ex6 kernel: [45328.226682] RAX: 0000000000000014 RBX: ffff880407ba4cc0 RCX: 0000000000000001 Aug 23 09:00:13 ex6 kernel: [45328.226684] RDX: 0000000000000015 RSI: 0000000000000000 RDI: ffff880194f4c090 Aug 23 09:00:13 ex6 kernel: [45328.226686] RBP: 0000000000000002 R08: ffff8804089938f0 R09: 0000000000003ced Aug 23 09:00:13 ex6 kernel: [45328.226687] R10: ffff88041e836800 R11: 0000000000000202 R12: ffff880407ba4d08 Aug 23 09:00:13 ex6 kernel: [45328.226689] R13: ffff880407ba4cc0 R14: 0000000000000292 R15: 0000293da5c4986a Aug 23 09:00:13 ex6 kernel: [45328.226691] FS: 00007fcd524e4700(0000) GS:ffff88041f380000(0000) knlGS:0000000000000000 Aug 23 09:00:13 ex6 kernel: [45328.226693] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b Aug 23 09:00:13 ex6 kernel: [45328.226695] CR2: 00007fcd51b59000 CR3: 0000000208ab4000 CR4: 00000000000407e0 Aug 23 09:00:13 ex6 kernel: [45328.226697] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Aug 23 09:00:13 ex6 kernel: [45328.226699] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Aug 23 09:00:13 ex6 kernel: [45328.226701] Process httpd2-event (pid: 15597, threadinfo ffff88018fc78000, task ffff880194f5a300) Aug 23 09:00:13 ex6 kernel: [45328.226702] Stack: Aug 23 09:00:13 ex6 kernel: [45328.226704] ffff880194f4c040 ffffffff8145d45d ffff880194f4c040 ffffffff814d120e Aug 23 09:00:13 ex6 kernel: [45328.226708] ffff880194f5a300 ffff8804067d2580 0000000000000001 00007fcd60c8eaa0 Aug 23 09:00:13 ex6 kernel: [45328.226712] 0004c7e9679f5fbf ffffffff8145ac14 00007fcd589c02e0 0000000100000000 Aug 23 09:00:13 ex6 kernel: [45328.226716] Call Trace: Aug 23 09:00:13 ex6 kernel: [45328.226725] [<ffffffff8145d45d>] lock_sock_nested+0xd/0x30 Aug 23 09:00:13 ex6 kernel: [45328.226732] [<ffffffff814d120e>] inet_shutdown+0x3e/0x130 Aug 23 09:00:13 ex6 kernel: [45328.226738] [<ffffffff8145ac14>] sys_shutdown+0x74/0x80 Aug 23 09:00:13 ex6 kernel: [45328.226746] [<ffffffff8156a47d>] system_call_fastpath+0x1a/0x1f Aug 23 09:00:13 ex6 kernel: [45328.226756] [<00007fcd5fc42477>] 0x7fcd5fc42476 Aug 23 09:00:13 ex6 kernel: [45328.226757] Code: c3 0f 1f 44 00 00 53 48 89 fb e8 67 88 ae ff b8 00 00 01 00 f0 0f c1 03 89 c2 c1 ea 10 66 39 c2 74 0e 0f 1f 40 00 f3 90 0f b7 03 <66> 39 d0 75 f6 5b c3 90 90 90 90 48 c7 c7 60 74 a5 81 e9 34 d9 Aug 23 09:00:24 ex6 cachefilesd[5919]: Refilling cull table Aug 23 09:00:24 ex6 cachefilesd[5919]: Scan complete Aug 23 09:00:41 ex6 kernel: [45356.199337] BUG: soft lockup - CPU#6 stuck for 23s! [httpd2-event:15597] ug 23 09:00:41 ex6 kernel: [45356.199502] CPU 6 Aug 23 09:00:41 ex6 kernel: [45356.199506] Pid: 15597, comm: httpd2-event Not tainted 3.6.0-rc2-1-default #1 System manufacturer System Product Name/P8B WS Aug 23 09:00:41 ex6 kernel: [45356.199508] RIP: 0010:[<ffffffff81562be5>] [<ffffffff81562be5>] _raw_spin_lock_bh+0x25/0x30 Aug 23 09:00:41 ex6 kernel: [45356.199517] RSP: 0018:ffff88018fc79f08 EFLAGS: 00000297 Aug 23 09:00:41 ex6 kernel: [45356.199519] RAX: 0000000000000014 RBX: ffff880407ba4cc0 RCX: 0000000000000001 Aug 23 09:00:41 ex6 kernel: [45356.199521] RDX: 0000000000000015 RSI: 0000000000000000 RDI: ffff880194f4c090 Aug 23 09:00:41 ex6 kernel: [45356.199522] RBP: 0000000000000002 R08: ffff8804089938f0 R09: 0000000000003ced Aug 23 09:00:41 ex6 kernel: [45356.199524] R10: ffff88041e836800 R11: 0000000000000202 R12: ffff880407ba4d08 Aug 23 09:00:41 ex6 kernel: [45356.199526] R13: ffff880407ba4cc0 R14: 0000000000000292 R15: 0000293da5c4986a Aug 23 09:00:41 ex6 kernel: [45356.199528] FS: 00007fcd524e4700(0000) GS:ffff88041f380000(0000) knlGS:0000000000000000 Aug 23 09:00:41 ex6 kernel: [45356.199530] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b Aug 23 09:00:41 ex6 kernel: [45356.199532] CR2: 00007fcd51b59000 CR3: 0000000208ab4000 CR4: 00000000000407e0 Aug 23 09:00:41 ex6 kernel: [45356.199534] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Aug 23 09:00:41 ex6 kernel: [45356.199536] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Aug 23 09:00:41 ex6 kernel: [45356.199538] Process httpd2-event (pid: 15597, threadinfo ffff88018fc78000, task ffff880194f5a300) Aug 23 09:00:41 ex6 kernel: [45356.199539] Stack: Aug 23 09:00:41 ex6 kernel: [45356.199541] ffff880194f4c040 ffffffff8145d45d ffff880194f4c040 ffffffff814d120e Aug 23 09:00:41 ex6 kernel: [45356.199545] ffff880194f5a300 ffff8804067d2580 0000000000000001 00007fcd60c8eaa0 Aug 23 09:00:41 ex6 kernel: [45356.199548] 0004c7e9679f5fbf ffffffff8145ac14 00007fcd589c02e0 0000000100000000 Aug 23 09:00:41 ex6 kernel: [45356.199552] Call Trace: Aug 23 09:00:41 ex6 kernel: [45356.199562] [<ffffffff8145d45d>] lock_sock_nested+0xd/0x30 Aug 23 09:00:41 ex6 kernel: [45356.199569] [<ffffffff814d120e>] inet_shutdown+0x3e/0x130 Aug 23 09:00:41 ex6 kernel: [45356.199576] [<ffffffff8145ac14>] sys_shutdown+0x74/0x80 Aug 23 09:00:41 ex6 kernel: [45356.199584] [<ffffffff8156a47d>] system_call_fastpath+0x1a/0x1f Aug 23 09:00:41 ex6 kernel: [45356.199593] [<00007fcd5fc42477>] 0x7fcd5fc42476 Aug 23 09:00:41 ex6 kernel: [45356.199594] Code: c3 0f 1f 44 00 00 53 48 89 fb e8 67 88 ae ff b8 00 00 01 00 f0 0f c1 03 89 c2 c1 ea 10 66 39 c2 74 0e 0f 1f 40 00 f3 90 0f b7 03 <66> 39 d0 75 f6 5b c3 90 90 90 90 48 c7 c7 60 74 a5 81 e9 34 d9 Aug 23 09:00:45 ex6 kernel: [45359.899733] INFO: rcu_sched self-detected stall on CPU { 7} (t=15000 jiffies) Aug 23 09:00:45 ex6 kernel: [45359.899742] sending NMI to all CPUs: Aug 23 09:00:45 ex6 kernel: [45359.899749] NMI backtrace for cpu 7 Aug 23 09:00:45 ex6 kernel: [45359.899751] CPU 7 Aug 23 09:00:45 ex6 kernel: [45359.899757] Pid: 0, comm: swapper/7 Not tainted 3.6.0-rc2-1-default #1 System manufacturer System Product Name/P8B WS Aug 23 09:00:45 ex6 kernel: [45359.899760] RIP: 0010:[<ffffffff812dc9a3>] [<ffffffff812dc9a3>] __bitmap_andnot+0x23/0x40 Aug 23 09:00:45 ex6 kernel: [45359.899770] RSP: 0018:ffff88041f3c3938 EFLAGS: 00000046 Aug 23 09:00:45 ex6 kernel: [45359.899773] RAX: 0000000000000000 RBX: ffff88041f3ccfe0 RCX: 0000000000000007 Aug 23 09:00:45 ex6 kernel: [45359.899775] RDX: ffff88041f20d020 RSI: ffff88041f3ccfe0 RDI: ffff88041f3ccfe0 Aug 23 09:00:45 ex6 kernel: [45359.899778] RBP: ffff88041f20d020 R08: 0000000000000000 R09: 0000000000000008 Aug 23 09:00:45 ex6 kernel: [45359.899780] R10: 0000000000000000 R11: 0000000000005815 R12: 000000000000d060 Aug 23 09:00:45 ex6 kernel: [45359.899783] R13: 0000000000080000 R14: 00000000000000ff R15: 0000000000000007 Aug 23 09:00:45 ex6 kernel: [45359.899786] FS: 0000000000000000(0000) GS:ffff88041f3c0000(0000) knlGS:0000000000000000 Aug 23 09:00:45 ex6 kernel: [45359.899789] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b Aug 23 09:00:45 ex6 kernel: [45359.899792] CR2: 00007fcd2c062ac0 CR3: 0000000001a0c000 CR4: 00000000000407e0 Aug 23 09:00:45 ex6 kernel: [45359.899794] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Aug 23 09:00:45 ex6 kernel: [45359.899797] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Aug 23 09:00:45 ex6 kernel: [45359.899800] Process swapper/7 (pid: 0, threadinfo ffff88040abc4000, task ffff88040abc2400) Aug 23 09:00:45 ex6 kernel: [45359.899802] Stack: Aug 23 09:00:45 ex6 kernel: [45359.899804] ffffffff8102a5a8 0000000081a2cec0 000000000000d020 0000000200000007 Aug 23 09:00:45 ex6 kernel: [45359.899810] 0000000000000082 ffff88041f3c39b0 0000000000002710 ffffffff81a2ce00 Aug 23 09:00:45 ex6 kernel: [45359.899815] ffff88040abc4000 0000000000000007 ffff88040abc4000 ffffffff81a2cec0 Aug 23 09:00:45 ex6 kernel: [45359.899821] Call Trace: Aug 23 09:00:45 ex6 kernel: [45359.899835] [<ffffffff8102a5a8>] __x2apic_send_IPI_mask+0x178/0x1a0 Aug 23 09:00:45 ex6 kernel: [45359.899844] [<ffffffff810260ff>] arch_trigger_all_cpu_backtrace+0x4f/0x90 Aug 23 09:00:45 ex6 kernel: [45359.899852] [<ffffffff810d6d20>] rcu_pending+0x210/0x560 Aug 23 09:00:45 ex6 kernel: [45359.899861] [<ffffffff810d78c0>] rcu_check_callbacks+0x90/0x110 Aug 23 09:00:45 ex6 kernel: [45359.899871] [<ffffffff8105467f>] update_process_times+0x3f/0x80 Aug 23 09:00:45 ex6 kernel: [45359.899879] [<ffffffff810971fb>] tick_sched_timer+0x6b/0xe0 Aug 23 09:00:45 ex6 kernel: [45359.899888] [<ffffffff810699a6>] __run_hrtimer+0x66/0x1d0 Aug 23 09:00:45 ex6 kernel: [45359.899896] [<ffffffff8106a299>] hrtimer_interrupt+0xe9/0x210 Aug 23 09:00:45 ex6 kernel: [45359.899902] [<ffffffff81024e93>] smp_apic_timer_interrupt+0x63/0xa0 Aug 23 09:00:45 ex6 kernel: [45359.899911] [<ffffffff8156b0fa>] apic_timer_interrupt+0x6a/0x70 Aug 23 09:00:45 ex6 kernel: [45359.899923] [<ffffffff814c2c7d>] tcp_slow_start+0x6d/0xa0 Aug 23 09:00:45 ex6 kernel: [45359.899930] [<ffffffff814b6260>] tcp_ack+0x560/0x11e0 Aug 23 09:00:45 ex6 kernel: [45359.899938] [<ffffffff814b715d>] tcp_rcv_established+0x27d/0x8e0 Aug 23 09:00:45 ex6 kernel: [45359.899946] [<ffffffff814c045e>] tcp_v4_do_rcv+0xde/0x340 Aug 23 09:00:45 ex6 kernel: [45359.899954] [<ffffffff814c173b>] tcp_v4_rcv+0x59b/0x850 Aug 23 09:00:45 ex6 kernel: [45359.899963] [<ffffffff8149e156>] ip_local_deliver_finish+0xd6/0x250 Aug 23 09:00:45 ex6 kernel: [45359.899971] [<ffffffff8146eb5e>] __netif_receive_skb+0x67e/0x7e0 Aug 23 09:00:45 ex6 kernel: [45359.899979] [<ffffffff8146ed61>] process_backlog+0xa1/0x180 Aug 23 09:00:45 ex6 kernel: [45359.899985] [<ffffffff8146f830>] net_rx_action+0x140/0x230 Aug 23 09:00:45 ex6 kernel: [45359.899993] [<ffffffff8104be2e>] __do_softirq+0xbe/0x1f0 Aug 23 09:00:45 ex6 kernel: [45359.900001] [<ffffffff8156b7ec>] call_softirq+0x1c/0x30 Aug 23 09:00:45 ex6 kernel: [45359.900008] [<ffffffff810045a5>] do_softirq+0x75/0xb0 Aug 23 09:00:45 ex6 kernel: [45359.900016] [<ffffffff8104c1e5>] irq_exit+0xa5/0xb0 Aug 23 09:00:45 ex6 kernel: [45359.900023] [<ffffffff8156b2ba>] call_function_single_interrupt+0x6a/0x70 Aug 23 09:00:45 ex6 kernel: [45359.900033] [<ffffffff813303cc>] intel_idle+0xec/0x160 Aug 23 09:00:45 ex6 kernel: [45359.900042] [<ffffffff8143566d>] cpuidle_idle_call+0x9d/0x240 Aug 23 09:00:45 ex6 kernel: [45359.900050] [<ffffffff8100b715>] cpu_idle+0x65/0xd0 Aug 23 09:00:45 ex6 kernel: [45359.900058] [<ffffffff81550547>] start_secondary+0x1fe/0x203 And repeats forever , machine needed a hard reset. -- To unsubscribe, e-mail: opensuse-kernel+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-kernel+owner@opensuse.org