[Bug 843520] New: qemu-kvm tdp_page_fault crash
https://bugzilla.novell.com/show_bug.cgi?id=843520 https://bugzilla.novell.com/show_bug.cgi?id=843520#c0 Summary: qemu-kvm tdp_page_fault crash Classification: openSUSE Product: openSUSE 12.3 Version: Final Platform: Other OS/Version: Other Status: NEW Severity: Major Priority: P5 - None Component: Kernel AssignedTo: kernel-maintainers@forge.provo.novell.com ReportedBy: aspiers@suse.com QAContact: qa-bugs@suse.de Found By: Development Blocker: --- Created an attachment (id=561050) --> (http://bugzilla.novell.com/attachment.cgi?id=561050) syslog extract showing beginning of crash I was running 4 KVM VMs on a recently patched 12.3 box, and one of those was running a KVM VM nested inside it (the host has "options kvm-intel nested=1"). These all ran happily for at least several hours if not days in some cases, but then suddenly the Xorg desktop vanished and was replaced with a kernel oops screen. After that the console was unresponsive (except for the mouse pointer still moving). I could ssh in but got a stream of messages from syslogd which the same errors seen in /var/log/messages, e.g. Message from syslogd@pacific at Oct 1 04:27:29 ... kernel:[483416.098144] BUG: soft lockup - CPU#5 stuck for 22s! [qemu-kvm:10478] -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=843520 https://bugzilla.novell.com/show_bug.cgi?id=843520#c1 --- Comment #1 from Jeff Mahoney <jeffm@suse.com> 2013-10-01 14:26:29 EDT --- BUG: unable to handle kernel paging request at ffff87ffffffffff IP: [<ffffffffa0430047>] __direct_map.isra.104+0xa7/0x230 [kvm] PGD 0 Oops: 0000 [#1] PREEMPT SMP Modules linked in: usb_storage md5 8021q garp 9p 9pnet_virtio virtio 9pnet virtio_ring btrfs zlib_deflate libcrc32c ufs qnx4 hfsplus msdos jfs xfs vhost_net macvtap macvlan fuse ip6table_filter af_packet ip6_tables ebtable_nat ebtables xt_CHECKSUM iptable_mangle ipt_MASQUERADE iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT xt_tcpudp iptable_filter ip_tables x_tables tun bridge stp llc openvswitch(O) nfsd lockd nfs_acl auth_rpcgss sunrpc reiserfs minix hfs vfat fat nls_utf8 loop acpi_cpufreq mperf coretemp crc32c_intel ghash_clmulni_intel aesni_intel ablk_helper cryptd lrw aes_x86_64 xts gf128mul snd_hda_codec_hdmi snd_hda_codec_realtek gspca_zc3xx gspca_main snd_hda_intel videodev iTCO_wdt kvm_intel iTCO_vendor_support kvm i2c_i801 sr_mod cdrom snd_usb_audio snd_hda_codec snd_hwdep lpc_ich serio_raw pcspkr microcode snd_usbmidi_lib snd_pcm_oss sg mei mfd_core e1000e ata_generic snd_rawmidi snd_pcm dcdbas snd_page_alloc shpchp container pciehp pci_hotplug snd_seq snd_timer snd_seq_device snd_mixer_oss snd soundcore autofs4 dm_mod linear raid456 async_raid6_recov async_pq raid6_pq async_xor xor async_memcpy async_tx raid10 raid0 raid1 ata_piix i915 drm_kms_helper drm i2c_algo_bit video button processor thermal_sys scsi_dh_emc scsi_dh_alua scsi_dh_rdac scsi_dh_hp_sw scsi_dh CPU 2 Pid: 10480, comm: qemu-kvm Tainted: G W O 3.7.10-58.gae46e8d-desktop #1 Dell Inc. OptiPlex 990/06D7TR RIP: 0010:[<ffffffffa0430047>] [<ffffffffa0430047>] __direct_map.isra.104+0xa7/0x230 [kvm] RSP: 0018:ffff8801ab3ddb98 EFLAGS: 00010293 RAX: 0000000000000004 RBX: 000ffffffffff000 RCX: 0000000000000027 RDX: 00000000530df000 RSI: 0000000000000000 RDI: 0000000000000003 RBP: ffff8801be7700c0 R08: ffff87ffffffffff R09: 00000000003e8f2f R10: ffff87ffffffffff R11: 00007fd080000000 R12: 0000000000000001 R13: ffff880000000000 R14: 0000000000000001 R15: 00000000000530df FS: 00007fd0beffd700(0000) GS:ffff88042dc40000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: ffff87ffffffffff CR3: 0000000109d73000 CR4: 00000000000427e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Process qemu-kvm (pid: 10480, threadinfo ffff8801ab3dc000, task ffff88018fb92300) Stack: ffffea000daf5248 ffffffffa04871e2 ffff88004cf53000 ffff8801be7700c0 00000000000530df ffff8801ab3ddc88 0000000000000000 0000000000000000 00000000003e8f2f 00ffffff00000000 ffff8803f53e4600 0000000000000001 Call Trace: [<ffffffffa04308f1>] tdp_page_fault+0x1f1/0x230 [kvm] [<ffffffffa0429ebc>] kvm_mmu_page_fault+0x2c/0x100 [kvm] [<ffffffffa0487517>] vmx_handle_exit+0xc7/0x790 [kvm_intel] [<ffffffffa0424cf1>] vcpu_enter_guest+0x581/0xbc0 [kvm] [<ffffffffa04258e0>] kvm_arch_vcpu_ioctl_run+0x1f0/0x510 [kvm] [<ffffffffa040d27f>] kvm_vcpu_ioctl+0x41f/0x5e0 [kvm] [<ffffffff8118060f>] do_vfs_ioctl+0x8f/0x530 [<ffffffff81180b50>] sys_ioctl+0xa0/0xc0 [<ffffffff8159efed>] system_call_fastpath+0x1a/0x1f [<00007fd0cc1ecf27>] 0x7fd0cc1ecf26 Code: 4c 03 44 24 68 8d 4c ff 0c 48 89 d6 48 d3 ee 81 e6 ff 01 00 00 41 39 c4 4d 8d 14 f0 89 74 24 7c 4c 89 54 24 70 0f 84 d9 00 00 00 <49> 8b 32 40 f6 c6 01 74 40 4c 8b 05 59 4a 03 00 49 89 f1 4d 21 RIP [<ffffffffa0430047>] __direct_map.isra.104+0xa7/0x230 [kvm] RSP <ffff8801ab3ddb98> CR2: ffff87ffffffffff ---[ end trace 0eccfcea7a7f539a ]--- -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=843520 https://bugzilla.novell.com/show_bug.cgi?id=843520#c2 Jeff Mahoney <jeffm@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |NEEDINFO CC| |jeffm@suse.com InfoProvider| |aspiers@suse.com AssignedTo|kernel-maintainers@forge.pr |agraf@suse.com |ovo.novell.com | --- Comment #2 from Jeff Mahoney <jeffm@suse.com> 2013-10-01 14:27:17 EDT --- Adam, the Oops is tainted W, which means there's a warning further up in the log. Can you capture that bit too? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=843520 https://bugzilla.novell.com/show_bug.cgi?id=843520#c3 Adam Spiers <aspiers@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEEDINFO |NEW InfoProvider|aspiers@suse.com | --- Comment #3 from Adam Spiers <aspiers@suse.com> 2013-10-03 17:03:11 UTC --- Best guess is this: 2013-09-29T17:49:32.890226+01:00 pacific kernel: [359094.973108] ------------[ cut here ]------------ 2013-09-29T17:49:32.890240+01:00 pacific kernel: [359094.973115] WARNING: at /home/abuild/rpmbuild/BUILD/kernel-desktop-3.7.10/linux-3.7/fs/inode.c:280 drop_nlink+0x34/0x40() 2013-09-29T17:49:32.890241+01:00 pacific kernel: [359094.973117] Hardware name: OptiPlex 990 2013-09-29T17:49:32.890242+01:00 pacific kernel: [359094.973118] Modules linked in: md5 8021q garp 9p 9pnet_virtio virtio 9pnet virtio_ring btrfs zlib_deflate libcrc32c ufs qnx4 hfsplus msdos jfs xfs vhost_net macvtap macvlan fuse ip6table_filter af_packet ip6_tables ebtable_nat ebtables xt_CHECKSUM iptable_mangle ipt_MASQUERADE iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT xt_tcpudp iptable_filter ip_tables x_tables tun bridge stp llc openvswitch(O) nfsd lockd nfs_acl auth_rpcgss sunrpc reiserfs minix hfs vfat fat nls_utf8 loop acpi_cpufreq mperf coretemp crc32c_intel ghash_clmulni_intel aesni_intel ablk_helper cryptd lrw aes_x86_64 xts gf128mul snd_hda_codec_hdmi snd_hda_codec_realtek gspca_zc3xx gspca_main snd_hda_intel videodev iTCO_wdt kvm_intel iTCO_vendor_support kvm i2c_i801 sr_mod cdrom snd_usb_audio snd_hda_codec snd_hwdep lpc_ich serio_raw pcspkr microcode snd_usbmidi_lib snd_pcm_oss sg mei mfd_core e1000e ata_generic snd_rawmidi snd_pcm dcdbas snd_page_alloc shpchp container pciehp pci_hotplug snd_seq snd_timer snd_seq_device snd_mixer_oss snd soundcore autofs4 dm_mod linear raid456 async_raid6_recov async_pq raid6_pq async_xor xor async_memcpy async_tx raid10 raid0 raid1 ata_piix i915 drm_kms_helper drm i2c_algo_bit video button processor thermal_sys scsi_dh_emc scsi_dh_alua scsi_dh_rdac scsi_dh_hp_sw scsi_dh 2013-09-29T17:49:32.890243+01:00 pacific kernel: [359094.973197] Pid: 19532, comm: mv Tainted: G O 3.7.10-58.gae46e8d-desktop #1 2013-09-29T17:49:32.890244+01:00 pacific kernel: [359094.973198] Call Trace: 2013-09-29T17:49:32.890245+01:00 pacific kernel: [359094.973207] [<ffffffff81004818>] dump_trace+0x88/0x300 2013-09-29T17:49:32.890249+01:00 pacific kernel: [359094.973212] [<ffffffff8158b463>] dump_stack+0x69/0x6f 2013-09-29T17:49:32.890250+01:00 pacific kernel: [359094.973217] [<ffffffff81045249>] warn_slowpath_common+0x79/0xc0 2013-09-29T17:49:32.890251+01:00 pacific kernel: [359094.973221] [<ffffffff81187ae4>] drop_nlink+0x34/0x40 2013-09-29T17:49:32.890252+01:00 pacific kernel: [359094.973228] [<ffffffffa072589e>] fuse_unlink+0xee/0x140 [fuse] 2013-09-29T17:49:32.890253+01:00 pacific kernel: [359094.973247] [<ffffffff8117a8af>] vfs_unlink+0x9f/0x110 2013-09-29T17:49:32.890253+01:00 pacific kernel: [359094.973252] [<ffffffff8117e42e>] do_unlinkat+0x18e/0x1d0 2013-09-29T17:49:32.890254+01:00 pacific kernel: [359094.973256] [<ffffffff8159efed>] system_call_fastpath+0x1a/0x1f 2013-09-29T17:49:32.890256+01:00 pacific kernel: [359094.973263] [<00007f21067f00ed>] 0x7f21067f00ec 2013-09-29T17:49:32.890257+01:00 pacific kernel: [359094.973265] ---[ end trace 0eccfcea7a7f52e7 ]--- 2013-09-29T17:51:22.001173+01:00 pacific kernel: [359203.772137] ------------[ cut here ]------------ 2013-09-29T17:51:22.001187+01:00 pacific kernel: [359203.772143] WARNING: at /home/abuild/rpmbuild/BUILD/kernel-desktop-3.7.10/linux-3.7/fs/inode.c:280 drop_nlink+0x34/0x40() 2013-09-29T17:51:22.001189+01:00 pacific kernel: [359203.772145] Hardware name: OptiPlex 990 2013-09-29T17:51:22.001200+01:00 pacific kernel: [359203.772145] Modules linked in: md5 8021q garp 9p 9pnet_virtio virtio 9pnet virtio_ring btrfs zlib_deflate libcrc32c ufs qnx4 hfsplus msdos jfs xfs vhost_net macvtap macvlan fuse ip6table_filter af_packet ip6_tables ebtable_nat ebtables xt_CHECKSUM iptable_mangle ipt_MASQUERADE iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT xt_tcpudp iptable_filter ip_tables x_tables tun bridge stp llc openvswitch(O) nfsd lockd nfs_acl auth_rpcgss sunrpc reiserfs minix hfs vfat fat nls_utf8 loop acpi_cpufreq mperf coretemp crc32c_intel ghash_clmulni_intel aesni_intel ablk_helper cryptd lrw aes_x86_64 xts gf128mul snd_hda_codec_hdmi snd_hda_codec_realtek gspca_zc3xx gspca_main snd_hda_intel videodev iTCO_wdt kvm_intel iTCO_vendor_support kvm i2c_i801 sr_mod cdrom snd_usb_audio snd_hda_codec snd_hwdep lpc_ich serio_raw pcspkr microcode snd_usbmidi_lib snd_pcm_oss sg mei mfd_core e1000e ata_generic snd_rawmidi snd_pcm dcdbas snd_page_alloc shpchp container pciehp pci_hotplug snd_seq snd_timer snd_seq_device snd_mixer_oss snd soundcore autofs4 dm_mod linear raid456 async_raid6_recov async_pq raid6_pq async_xor xor async_memcpy async_tx raid10 raid0 raid1 ata_piix i915 drm_kms_helper drm i2c_algo_bit video button processor thermal_sys scsi_dh_emc scsi_dh_alua scsi_dh_rdac scsi_dh_hp_sw scsi_dh 2013-09-29T17:51:22.001203+01:00 pacific kernel: [359203.772204] Pid: 19978, comm: mv Tainted: G W O 3.7.10-58.gae46e8d-desktop #1 2013-09-29T17:51:22.001204+01:00 pacific kernel: [359203.772205] Call Trace: 2013-09-29T17:51:22.001205+01:00 pacific kernel: [359203.772213] [<ffffffff81004818>] dump_trace+0x88/0x300 2013-09-29T17:51:22.001205+01:00 pacific kernel: [359203.772217] [<ffffffff8158b463>] dump_stack+0x69/0x6f 2013-09-29T17:51:22.001206+01:00 pacific kernel: [359203.772221] [<ffffffff81045249>] warn_slowpath_common+0x79/0xc0 2013-09-29T17:51:22.001207+01:00 pacific kernel: [359203.772224] [<ffffffff81187ae4>] drop_nlink+0x34/0x40 2013-09-29T17:51:22.001208+01:00 pacific kernel: [359203.772229] [<ffffffffa072589e>] fuse_unlink+0xee/0x140 [fuse] 2013-09-29T17:51:22.001209+01:00 pacific kernel: [359203.772245] [<ffffffff8117a8af>] vfs_unlink+0x9f/0x110 2013-09-29T17:51:22.001209+01:00 pacific kernel: [359203.772248] [<ffffffff8117e42e>] do_unlinkat+0x18e/0x1d0 2013-09-29T17:51:22.001210+01:00 pacific kernel: [359203.772251] [<ffffffff8159efed>] system_call_fastpath+0x1a/0x1f 2013-09-29T17:51:22.001211+01:00 pacific kernel: [359203.772256] [<00007f4dd23b30ed>] 0x7f4dd23b30ec 2013-09-29T17:51:22.001212+01:00 pacific kernel: [359203.772257] ---[ end trace 0eccfcea7a7f52e8 ]--- 2013-09-29T17:52:48.697228+01:00 pacific kernel: [359290.221055] ------------[ cut here ]------------ 2013-09-29T17:52:48.697248+01:00 pacific kernel: [359290.221066] WARNING: at /home/abuild/rpmbuild/BUILD/kernel-desktop-3.7.10/linux-3.7/fs/inode.c:280 drop_nlink+0x34/0x40() 2013-09-29T17:52:48.697251+01:00 pacific kernel: [359290.221068] Hardware name: OptiPlex 990 2013-09-29T17:52:48.697254+01:00 pacific kernel: [359290.221070] Modules linked in: md5 8021q garp 9p 9pnet_virtio virtio 9pnet virtio_ring btrfs zlib_deflate libcrc32c ufs qnx4 hfsplus msdos jfs xfs vhost_net macvtap macvlan fuse ip6table_filter af_packet ip6_tables ebtable_nat ebtables xt_CHECKSUM iptable_mangle ipt_MASQUERADE iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT xt_tcpudp iptable_filter ip_tables x_tables tun bridge stp llc openvswitch(O) nfsd lockd nfs_acl auth_rpcgss sunrpc reiserfs minix hfs vfat fat nls_utf8 loop acpi_cpufreq mperf coretemp crc32c_intel ghash_clmulni_intel aesni_intel ablk_helper cryptd lrw aes_x86_64 xts gf128mul snd_hda_codec_hdmi snd_hda_codec_realtek gspca_zc3xx gspca_main snd_hda_intel videodev iTCO_wdt kvm_intel iTCO_vendor_support kvm i2c_i801 sr_mod cdrom snd_usb_audio snd_hda_codec snd_hwdep lpc_ich serio_raw pcspkr microcode snd_usbmidi_lib snd_pcm_oss sg mei mfd_core e1000e ata_generic snd_rawmidi snd_pcm dcdbas snd_page_alloc shpchp container pciehp pci_hotplug snd_seq snd_timer snd_seq_device snd_mixer_oss snd soundcore autofs4 dm_mod linear raid456 async_raid6_recov async_pq raid6_pq async_xor xor async_memcpy async_tx raid10 raid0 raid1 ata_piix i915 drm_kms_helper drm i2c_algo_bit video button processor thermal_sys scsi_dh_emc scsi_dh_alua scsi_dh_rdac scsi_dh_hp_sw scsi_dh 2013-09-29T17:52:48.697258+01:00 pacific kernel: [359290.221180] Pid: 20205, comm: mv Tainted: G W O 3.7.10-58.gae46e8d-desktop #1 2013-09-29T17:52:48.697262+01:00 pacific kernel: [359290.221182] Call Trace: 2013-09-29T17:52:48.697263+01:00 pacific kernel: [359290.221195] [<ffffffff81004818>] dump_trace+0x88/0x300 2013-09-29T17:52:48.697265+01:00 pacific kernel: [359290.221202] [<ffffffff8158b463>] dump_stack+0x69/0x6f 2013-09-29T17:52:48.697266+01:00 pacific kernel: [359290.221210] [<ffffffff81045249>] warn_slowpath_common+0x79/0xc0 2013-09-29T17:52:48.697268+01:00 pacific kernel: [359290.221215] [<ffffffff81187ae4>] drop_nlink+0x34/0x40 2013-09-29T17:52:48.697269+01:00 pacific kernel: [359290.221224] [<ffffffffa072589e>] fuse_unlink+0xee/0x140 [fuse] 2013-09-29T17:52:48.697271+01:00 pacific kernel: [359290.221250] [<ffffffff8117a8af>] vfs_unlink+0x9f/0x110 2013-09-29T17:52:48.697272+01:00 pacific kernel: [359290.221256] [<ffffffff8117e42e>] do_unlinkat+0x18e/0x1d0 2013-09-29T17:52:48.697273+01:00 pacific kernel: [359290.221261] [<ffffffff8159efed>] system_call_fastpath+0x1a/0x1f 2013-09-29T17:52:48.697275+01:00 pacific kernel: [359290.221270] [<00007f2023af40ed>] 0x7f2023af40ec 2013-09-29T17:52:48.697276+01:00 pacific kernel: [359290.221272] ---[ end trace 0eccfcea7a7f52e9 ]---
From memory this might have been whilst accessing a MTP device (Nexus 4 phone) via FUSE and simple-mtpfs. Would that make sense? But even if so, it doesn't seem very likely that it was related to the Oops above ... but then I'm no kernel expert.
-- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
participants (1)
-
bugzilla_noreply＠novell.com