Mailinglist Archive: opensuse-bugs (4060 mails)

< Previous Next >
[Bug 662317] DomU crashes under high load on OBS workers

https://bugzilla.novell.com/show_bug.cgi?id=662317

https://bugzilla.novell.com/show_bug.cgi?id=662317#c19


--- Comment #19 from Adrian Schröter <adrian@xxxxxxxxxx> 2011-01-10 19:43:48
UTC ---
Another system died in this way with the "soft lockup" message:

build23:~ # xm vcpu-list | grep build:14
build:14 122 0 3 -b- 16.9 0-7
build:14 122 1 - --p 3.2 0-7
build:14 122 2 2 --- 3129.8 0-7
build:14 122 3 1 r-- 3081.0 0-7
build:14 122 4 3 -b- 2.4 0-7
build:14 122 5 6 -b- 2.8 0-7
build:14 122 6 5 -b- 1.9 0-7
build:14 122 7 5 -b- 2.0 0-7


/usr/lib64/xen/bin/xenctx 122 1 -s /boot/System.map-2.6.37-xen
rip: ffffffff8000330a hypercall_page+0x30a
flags: 00001246 i z p
rsp: ffff88002d4eff08
rax: 0000000000000000 rcx: ffffffff8000330a rdx: 0000000000000000
rbx: 0000000000000000 rsi: 0000000000000001 rdi: 0000000000000002
rbp: 0000000000000001 r8: ffffffff8082d880 r9: 0000000000000000
r10: 0000000000007ff0 r11: 0000000000000246 r12: ffff88002d4ee000
r13: ffffffff8082d880 r14: ffff88002d4ee000 r15: 0000000000000000
cs: e033 ss: e02b ds: 002b es: 002b
fs: 0000 @ 00007fb9f26dd700
gs: 0000 @ ffff88002e195000/0000000000000000
Code (instr addr ffffffff8000330a)
cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 18 00 00 00 0f 05 <41> 5b 59 c3 cc
cc cc cc cc cc cc


Stack:
0000000000000000 ffff88002e217000 ffffffff80478f76 0000000000000000
ffffffff8000528e 0000000000000000 0000000000000000 0000000000000000
0000000000000000 0000000000000000 0000000000000000 0000000000000000
0000000000000000 0000000000000000 0000000000000000 0000000000000000

Call Trace:
[<ffffffff8000330a>] hypercall_page+0x30a <--
[<ffffffff80478f76>] play_dead+0x36
[<ffffffff8000528e>] cpu_idle+0x8e



build23:~ # /usr/lib64/xen/bin/xenctx 122 2 -s /boot/System.map-2.6.37-xen
rip: ffffffff804899c9 _raw_spin_lock+0xf9
flags: 00001247 i z p c
rsp: ffff88002e1aad40
rax: 0000000000000000 rcx: 000000000002aadd rdx: 00000000aaddaadc
rbx: ffff88002e18cdc0 rsi: ffff88002e1aad4c rdi: ffff88002e18cdc0
rbp: 0000000000000001 r8: ffff88002a8fc9e0 r9: 0000000000000000
r10: 0000000000000010 r11: 000000000000000d r12: 0000000000005020
r13: ffff88002e1aad4c r14: 0000000000000002 r15: 0000000000000002
cs: e033 ss: e02b ds: 0000 es: 0000
fs: 0000 @ 00007f8fd0351700
gs: 0000 @ ffff88002e1a7000/0000000000000000
Code (instr addr ffffffff804899c9)
01 0f a4 d1 10 66 39 ca 74 0b ff c8 74 07 f3 90 66 8b 13 eb f0 <85> c0 89 54 24
0c 0f 85 69 ff ff


Stack:
ffff88002a8fc800 aaddaadc2a8fc800 ffff88002e1b0dc0 ffff88002a8fc800
ffff88002e1aadd0 ffff88002e18cdc0 0000000000000000 ffffffff8003c3b7
ffffffff00000000 0000000300000000 00000000002d06e2 0000000000000000
000000000000000d 0000000000000100 ffff88002b6ddde0 ffff88002a8fc800

Call Trace:
[<ffffffff804899c9>] _raw_spin_lock+0xf9 <--
[<ffffffff8003c3b7>] try_to_wake_up+0x137
[<ffffffff800526a0>] del_timer+0xf0
[<ffffffff800519de>] call_timer_fn+0x3e
[<ffffffff800526a0>] del_timer+0xf0
[<ffffffff800531e0>] run_timer_softirq+0x160
[<ffffffff8004a83d>] __do_softirq+0xdd
[<ffffffff80007f1c>] call_softirq+0x1c
[<ffffffff800093f5>] do_softirq+0xa5
[<ffffffff8004aa9d>] irq_exit+0x8d
[<ffffffff802eea7a>] evtchn_do_upcall+0x26a
[<ffffffff80094470>] spin_unlock_irq+0x50
[<ffffffff80007a6e>] do_hypervisor_callback+0x1e


build23:~ # /usr/lib64/xen/bin/xenctx 122 3 -s /boot/System.map-2.6.37-xen
rip: ffffffff8007ac92 smp_call_function_many+0x1b2
flags: 00001202 i nz
rsp: ffff88002b5c3d50
rax: ffff88002e1bf7c0 rcx: 0000000000000008 rdx: 0000000000000008
rbx: ffff88002e1c3840 rsi: 0000000000000200 rdi: 0000000000000000
rbp: 0000000000000003 r8: ffff88002e1c38b0 r9: 0000000000000200
r10: 0000000000000008 r11: 00000000ffffffff r12: ffffffff8082d880
r13: ffffffff8082d880 r14: ffff88002e1c3870 r15: 0000000000000000
cs: e033 ss: e02b ds: 0000 es: 0000
fs: 0000 @ 00007fb9f26dd700
gs: 0000 @ ffff88002e1b9000/0000000000000000
Code (instr addr ffffffff8007ac92)
0f 84 d4 fe ff ff f6 43 20 01 0f 84 ca fe ff ff 0f 1f 00 f3 90 <f6> 43 20 01 75
f8 e9 ba fe ff ff


Stack:
ffff88002b5c3e60 01ffffff80486f28 ffff88002e1c2280 ffffffff80069170
0000000000000000 ffff88002e1c5e00 ffffffff80009cb0 0000000000000000
ffff88002e1c5e15 ffffffff8007ad2d 0044b82fa09b5a00 ffffffff8004992d
0044b82fa09b5a00 ffff88002b5c3e00 ffff88002e1c5e00 ffffffff80070528

Call Trace:
[<ffffffff8007ac92>] smp_call_function_many+0x1b2 <--
[<ffffffff80069170>] hrtimer_cancel+0x30
[<ffffffff80009cb0>] update_wallclock+0xe0
[<ffffffff8007ad2d>] smp_call_function+0x1d
[<ffffffff8004992d>] on_each_cpu+0x1d
[<ffffffff80070528>] do_settimeofday+0x128
[<ffffffff80009c9a>] update_wallclock+0xca
[<ffffffff8005f161>] process_one_work+0x141
[<ffffffff800603d7>] worker_thread+0x167
[<ffffffff80060270>] manage_workers+0x120
[<ffffffff80064b76>] kthread+0x96
[<ffffffff80007e24>] kernel_thread_helper+0x4
[<ffffffff80064ae0>] flush_kthread_worker+0xb0
[<ffffffff80007e20>] simd_coprocessor_error+0x30

--
Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are on the CC list for the bug.
< Previous Next >
References