http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c2 Greg Kroah-Hartman changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |NEEDINFO Info Provider| |rschweikert@novell.com --- Comment #2 from Greg Kroah-Hartman 2009-12-20 16:32:55 UTC --- Can you reproduce this without the closed source, unmaintainable, nvidia driver loaded? -- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c4 --- Comment #4 from Robert Schweikert 2009-12-28 20:23:42 UTC --- Installed the nouveau driver and while I did not get an Ooops traceback the system dis lock up and I had to push the rest button. I was not actively using the machine when it locked up. Had a tar with b2 compression running when I left the machine. Will now move to the nv driver and see what happens. -- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c6 --- Comment #6 from Robert Schweikert 2010-01-04 17:17:15 UTC --- Triggered another ooops today, here is the info. [119013.061802] BUG: Bad page state in process tar pfn:1991b7 [119013.061830] BUG: unable to handle kernel NULL pointer dereference at 000000000000000a [119013.061842] IP: [<ffffffff8110f748>] bad_page+0xd8/0x160 [119013.061856] PGD 23bcc7067 PUD 2259a9067 PMD 0 [119013.061866] Oops: 0000 [#1] SMP [119013.061875] last sysfs file: /sys/devices/virtual/net/br0/statistics/collisions [119013.061885] CPU 0 [119013.061891] Modules linked in: nfs fscache nfsd lockd nfs_acl auth_rpcgss sunrpc snd_pcm_oss snd_mixer_oss snd_seq edd bridge stp llc fuse loop dm_mod snd_hda_codec_realtek snd_usb_audio snd_usb_lib snd_hda_intel snd_rawmidi kvm_intel ohci1394 snd_hda_codec uvcvideo kvm snd_seq_device videodev v4l1_compat v4l2_compat_ioctl32 snd_hwdep snd_pcm snd_timer ieee1394 pcspkr i2c_nforce2 sg forcedeth snd sr_mod snd_page_alloc cdrom floppy button xfs exportfs fan processor ide_pci_generic amd74xx ide_core ata_generic sym53c8xx aic7xxx scsi_transport_spi pata_jmicron pata_amd thermal thermal_sys sata_nv [last unloaded: preloadtrace] [119013.061983] Pid: 18519, comm: tar Not tainted 2.6.31.5-0.1-default #1 132-CK-NF79 [119013.061992] RIP: 0010:[<ffffffff8110f748>] [<ffffffff8110f748>] bad_page+0xd8/0x160 [119013.062003] RSP: 0018:ffff8802239517b8 EFLAGS: 00010206 [119013.062011] RAX: 0000000000000002 RBX: ffffea000597e008 RCX: 0000000000000000 [119013.062019] RDX: 004054d2d1c3c200 RSI: 0000000000000000 RDI: 0000000000000282 [119013.062027] RBP: ffff8802239517e8 R08: 00000000ffffffff R09: 0000000000000000 [119013.062036] R10: 0000000000000004 R11: 0000000000000000 R12: ffff88023fc50600 [119013.062044] R13: 0000000000000000 R14: 00000000000201da R15: ffff88000001ac00 [119013.062053] FS: 00007f70381f56f0(0000) GS:ffff880008e4a000(0000) knlGS:0000000000000000 [119013.062062] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [119013.062070] CR2: 000000000000000a CR3: 00000001faddd000 CR4: 00000000000026f0 [119013.062078] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [119013.062086] DR3: 0000000000000000 DR6: 00000000ffff4ff0 DR7: 0000000000000400 [119013.062095] Process tar (pid: 18519, threadinfo ffff880223950000, task ffff8801fada62c0) [119013.062103] Stack: [119013.062109] 0000000000000000 0000000100000020 ffff880223951808 0000000012482eda [119013.062116] <0> ffff8802239517f8 ffffea000597e008 ffff880223951848 ffffffff8110ffcb [119013.062127] <0> ffff88023c43b070 00000001991b3000 0000000000000000 0000000012482eda [119013.062143] Call Trace: [119013.062158] [<ffffffff8110ffcb>] prep_new_page+0x3b/0x190 [119013.062170] [<ffffffff811107cf>] get_page_from_freelist+0x35f/0x6e0 [119013.062182] [<ffffffff811111b5>] __alloc_pages_nodemask+0xe5/0x160 [119013.062194] [<ffffffff81146e7e>] alloc_pages_current+0x8e/0xe0 [119013.062206] [<ffffffff8110a075>] __page_cache_alloc+0x85/0x90 [119013.062218] [<ffffffff811161d9>] __do_page_cache_readahead+0xd9/0x1a0 [119013.062231] [<ffffffff811162cf>] ra_submit+0x2f/0x50 [119013.062241] [<ffffffff8111654d>] ondemand_readahead+0x11d/0x260 [119013.062253] [<ffffffff81116730>] page_cache_async_readahead+0xa0/0xc0 [119013.062265] [<ffffffff8110b351>] T.777+0x1f1/0x440 [119013.062276] [<ffffffff8110b666>] generic_file_aio_read+0xc6/0x1f0 [119013.062308] [<ffffffffa0141df5>] xfs_read+0x165/0x3c0 [xfs] [119013.062406] [<ffffffffa013c6de>] xfs_file_aio_read+0x6e/0x90 [xfs] [119013.062483] [<ffffffff8115a3c2>] do_sync_read+0x102/0x160 [119013.062495] [<ffffffff8115a8f5>] vfs_read+0xd5/0x1c0 [119013.062505] [<ffffffff8115b01b>] sys_read+0x5b/0xa0 [119013.062517] [<ffffffff8100c602>] system_call_fastpath+0x16/0x1b [119013.062530] [<00007f7037b64dc0>] 0x7f7037b64dc0 [119013.062538] Code: 81 c6 a0 04 00 00 48 0f af d0 31 c0 e8 ea 4d 44 00 48 8b 13 48 8b 73 20 48 89 d8 4c 8b 4b 18 44 8b 43 0c f7 c2 00 00 02 00 75 5d <8b> 48 08 41 83 c0 01 48 89 34 24 48 c7 c7 e8 a5 6e 81 48 89 de [119013.062598] RIP [<ffffffff8110f748>] bad_page+0xd8/0x160 [119013.062608] RSP <ffff8802239517b8> [119013.062615] CR2: 000000000000000a [119013.062623] ---[ end trace 2fe07d2505130e1c ]--- [313979.738114] tun: Universal TUN/TAP device driver, 1.6 [313979.738129] tun: (C) 1999-2004 Max Krasnyansky [313979.739463] tun0: Disabled Privacy Extensions [319575.899205] BUG: Bad page state in process applydeltarpm pfn:66e4a [319575.899235] BUG: unable to handle kernel NULL pointer dereference at 000000000000000a [319575.899247] IP: [<ffffffff8110f748>] bad_page+0xd8/0x160 [319575.899261] PGD 1b79dd067 PUD 15c18a067 PMD 0 [319575.899271] Oops: 0000 [#2] SMP [319575.899280] last sysfs file: /sys/devices/virtual/net/tun0/statistics/collisions [319575.899291] CPU 0 [319575.899297] Modules linked in: tun nfs fscache nfsd lockd nfs_acl auth_rpcgss sunrpc snd_pcm_oss snd_mixer_oss snd_seq edd bridge stp llc fuse loop dm_mod snd_hda_codec_realtek snd_usb_audio snd_usb_lib snd_hda_intel snd_rawmidi kvm_intel ohci1394 snd_hda_codec uvcvideo kvm snd_seq_device videodev v4l1_compat v4l2_compat_ioctl32 snd_hwdep snd_pcm snd_timer ieee1394 pcspkr i2c_nforce2 sg forcedeth snd sr_mod snd_page_alloc cdrom floppy button xfs exportfs fan processor ide_pci_generic amd74xx ide_core ata_generic sym53c8xx aic7xxx scsi_transport_spi pata_jmicron pata_amd thermal thermal_sys sata_nv [last unloaded: preloadtrace] [319575.899391] Pid: 13033, comm: applydeltarpm Tainted: G D 2.6.31.5-0.1-default #1 132-CK-NF79 [319575.899401] RIP: 0010:[<ffffffff8110f748>] [<ffffffff8110f748>] bad_page+0xd8/0x160 [319575.899412] RSP: 0018:ffff88015c0ed7b8 EFLAGS: 00010206 [319575.899420] RAX: 0000000000000002 RBX: ffffea0001682030 RCX: 0000000000000000 [319575.899428] RDX: 00200000358f8200 RSI: 000000000000017d RDI: 0000000000000282 [319575.899437] RBP: ffff88015c0ed7e8 R08: 00000000ffffffff R09: 0000000000000000 [319575.899445] R10: 0000000000000005 R11: 0000000000000000 R12: ffff88023fc50640 [319575.899453] R13: 0000000000000000 R14: 00000000000201da R15: ffff880000019600 [319575.899462] FS: 00007f68ab1726f0(0000) GS:ffff880008e4a000(0000) knlGS:0000000000000000 [319575.899471] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b [319575.899479] CR2: 000000000000000a CR3: 0000000198975000 CR4: 00000000000026f0 [319575.899487] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [319575.899495] DR3: 0000000000000000 DR6: 00000000ffff4ff0 DR7: 0000000000000400 [319575.899504] Process applydeltarpm (pid: 13033, threadinfo ffff88015c0ec000, task ffff88015c040780) [319575.899513] Stack: [319575.899518] ffffea000178c650 0000000000000080 ffff88015c0ed8b8 00000000387e8857 [319575.899526] <0> ffff88015c0ed858 ffffea0001682030 ffff88015c0ed848 ffffffff8110ffcb [319575.899537] <0> 0000000100000002 ffff88015c0ed950 ffffffffa0136f60 00000000387e8857 [319575.899552] Call Trace: [319575.899566] [<ffffffff8110ffcb>] prep_new_page+0x3b/0x190 [319575.899578] [<ffffffff811107cf>] get_page_from_freelist+0x35f/0x6e0 [319575.899590] [<ffffffff811111b5>] __alloc_pages_nodemask+0xe5/0x160 [319575.899602] [<ffffffff81146e7e>] alloc_pages_current+0x8e/0xe0 [319575.899615] [<ffffffff8110a075>] __page_cache_alloc+0x85/0x90 [319575.899626] [<ffffffff811161d9>] __do_page_cache_readahead+0xd9/0x1a0 [319575.899638] [<ffffffff811162cf>] ra_submit+0x2f/0x50 [319575.899649] [<ffffffff8111654d>] ondemand_readahead+0x11d/0x260 [319575.899661] [<ffffffff81116730>] page_cache_async_readahead+0xa0/0xc0 [319575.899673] [<ffffffff8110b351>] T.777+0x1f1/0x440 [319575.899685] [<ffffffff8110b666>] generic_file_aio_read+0xc6/0x1f0 [319575.899719] [<ffffffffa0141df5>] xfs_read+0x165/0x3c0 [xfs] [319575.899821] [<ffffffffa013c6de>] xfs_file_aio_read+0x6e/0x90 [xfs] [319575.899897] [<ffffffff8115a3c2>] do_sync_read+0x102/0x160 [319575.899909] [<ffffffff8115a8f5>] vfs_read+0xd5/0x1c0 [319575.899920] [<ffffffff8115b01b>] sys_read+0x5b/0xa0 [319575.899932] [<ffffffff8100c602>] system_call_fastpath+0x16/0x1b [319575.899945] [<00007f68aa8bbdc0>] 0x7f68aa8bbdc0 [319575.899953] Code: 81 c6 a0 04 00 00 48 0f af d0 31 c0 e8 ea 4d 44 00 48 8b 13 48 8b 73 20 48 89 d8 4c 8b 4b 18 44 8b 43 0c f7 c2 00 00 02 00 75 5d <8b> 48 08 41 83 c0 01 48 89 34 24 48 c7 c7 e8 a5 6e 81 48 89 de [319575.900013] RIP [<ffffffff8110f748>] bad_page+0xd8/0x160 [319575.900023] RSP <ffff88015c0ed7b8> [319575.900030] CR2: 000000000000000a [319575.900049] ---[ end trace 2fe07d2505130e1d ]--- Here is the terminal output: Message from syslogd@triumph at Jan 4 08:59:21 ... kernel:[319575.899271] Oops: 0000 [#2] SMP Message from syslogd@triumph at Jan 4 08:59:21 ... kernel:[319575.899280] last sysfs file: /sys/devices/virtual/net/tun0/statistics/collisions Message from syslogd@triumph at Jan 4 08:59:21 ... kernel:[319575.899513] Stack: Message from syslogd@triumph at Jan 4 08:59:21 ... kernel:[319575.899552] Call Trace: Message from syslogd@triumph at Jan 4 08:59:21 ... kernel:[319575.899953] Code: 81 c6 a0 04 00 00 48 0f af d0 31 c0 e8 ea 4d 44 00 48 8b 13 48 8b 73 20 48 89 d8 4c 8b 4b 18 44 8b 43 0c f7 c2 00 00 02 00 75 5d <8b> 48 08 41 83 c0 01 48 89 34 24 48 c7 c7 e8 a5 6e 81 48 89 de Message from syslogd@triumph at Jan 4 08:59:21 ... kernel:[319575.900030] CR2: 000000000000000a This occurred while I was ugrading packages using YaST. The oops was triggered while the latest kernel package was being installed. I am now running 2.6.31.8-0.1-default, will add to the report of more oops problems occur. -- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c8 --- Comment #8 from Robert Schweikert 2010-01-08 15:34:08 UTC --- processor : 3 vendor_id : GenuineIntel cpu family : 6 model : 15 model name : Intel(R) Core(TM)2 Quad CPU Q6700 @ 2.66GHz stepping : 11 cpu MHz : 2667.085 cache size : 4096 KB physical id : 0 siblings : 4 core id : 3 cpu cores : 4 apicid : 3 initial apicid : 3 fpu : yes fpu_exception : yes cpuid level : 10 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm lahf_lm tpr_shadow vnmi flexpriority bogomips : 5333.38 clflush size : 64 cache_alignment : 64 address sizes : 36 bits physical, 48 bits virtual power management: Couldn't find a memcheck package, found memtest86+? I can boot from the install CD and run the test, is that what you mean? -- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c10 --- Comment #10 from Robert Schweikert 2010-01-08 17:42:03 UTC --- no errors reported by memtest no errors encountered using xfs_check, xfs_repair -n did not produce anything either I have set up a bridge on the machine thus that I can run VM images and connect them to the net. The bridge is set up as br0 and eth1 is bound to the bridge while eth0 in the machine is not configured. -- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c12 --- Comment #12 from Robert Schweikert 2010-01-10 11:57:06 UTC --- And another oops, triggered by rsync. Jan 10 02:23:07 triumph kernel: [44203.804423] BUG: Bad page state in process rsync pfn:a024a Jan 10 02:23:07 triumph kernel: [44203.804478] BUG: unable to handle kernel NULL pointer dereference at 000000000000000a Jan 10 02:23:07 triumph kernel: [44203.804489] IP: [<ffffffff8110f608>] bad_page+0xd8/0x160 Jan 10 02:23:07 triumph kernel: [44203.804504] PGD 22e931067 PUD 22e8c0067 PMD 0 Jan 10 02:23:07 triumph kernel: [44203.804514] Oops: 0000 [#1] SMP Jan 10 02:23:07 triumph kernel: [44203.804522] last sysfs file: /sys/devices/system/cpu/cpu3/cache/index2/shared_cpu_map Jan 10 02:23:07 triumph kernel: [44203.804533] CPU 0 Jan 10 02:23:07 triumph kernel: [44203.804539] Modules linked in: nls_utf8 nfs fscache deflate zlib_deflate ctr twofish_x86_64 twofish_common camellia serpent blowfish cast5 des_generic cbc cryptd crypto_wq aes_x86_64 aes_generic xcbc rmd160 sha256_generic sha1_generic md5 hmac cryptomgr aead pcompress crypto_null crypto_blkcipher crypto_hash crypto_algapi nfsd lockd nfs_acl auth_rpcgss sunrpc af_key snd_pcm_oss snd_mixer_oss snd_seq edd bridge stp llc fuse loop dm_mod snd_hda_codec_realtek kvm_intel snd_hda_intel snd_hda_codec sr_mod uvcvideo videodev v4l1_compat v4l2_compat_ioctl32 snd_usb_audio snd_pcm snd_usb_lib snd_rawmidi snd_seq_device snd_hwdep ohci1394 sg i2c_nforce2 ieee1394 kvm snd_timer pcspkr cdrom snd floppy forcedeth snd_page_alloc button xfs exportfs fan processor ide_pci_generic amd74xx ide_core ata_generic sym53c8xx aic7xxx scsi_transport_spi pata_jmicron pata_amd thermal thermal_sys sata_nv [last unloaded: preloadtrace] Jan 10 02:23:07 triumph kernel: [44203.804668] Pid: 8555, comm: rsync Tainted: G B 2.6.31.8-0.1-default #1 132-CK-NF79 Jan 10 02:23:07 triumph kernel: [44203.804677] RIP: 0010:[<ffffffff8110f608>] [<ffffffff8110f608>] bad_page+0xd8/0x160 Jan 10 02:23:07 triumph kernel: [44203.804688] RSP: 0018:ffff88023c863818 EFLAGS: 00010206 Jan 10 02:23:07 triumph kernel: [44203.804696] RAX: 0000000000000002 RBX: ffffea0002308030 RCX: 0000000000000000 Jan 10 02:23:07 triumph kernel: [44203.804705] RDX: 00200000358f8200 RSI: 0000000000059f5e RDI: 0000000000000282 Jan 10 02:23:07 triumph kernel: [44203.804713] RBP: ffff88023c863848 R08: 00000000ffffffff R09: 0000000000000000 Jan 10 02:23:07 triumph kernel: [44203.804721] R10: 0000000000000005 R11: 0000000000000000 R12: ffff88023fc50640 Jan 10 02:23:07 triumph kernel: [44203.804730] R13: 0000000000000000 R14: 00000000000201da R15: ffff880000019600 Jan 10 02:23:07 triumph kernel: [44203.804739] FS: 00007f1df3e166f0(0000) GS:ffff880008e4a000(0000) knlGS:0000000000000000 Jan 10 02:23:07 triumph kernel: [44203.804748] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b Jan 10 02:23:07 triumph kernel: [44203.804756] CR2: 000000000000000a CR3: 000000023cca0000 CR4: 00000000000006f0 Jan 10 02:23:07 triumph kernel: [44203.804764] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Jan 10 02:23:07 triumph kernel: [44203.804773] DR3: 0000000000000000 DR6: 00000000ffff4ff0 DR7: 0000000000000400 Jan 10 02:23:07 triumph kernel: [44203.804781] Process rsync (pid: 8555, threadinfo ffff88023c862000, task ffff88023cd0e840) Jan 10 02:23:07 triumph kernel: [44203.804790] Stack: Jan 10 02:23:07 triumph kernel: [44203.804795] ffffea00023085d0 ffff880000019600 0000000000000002 00000000f3c4050e Jan 10 02:23:07 triumph kernel: [44203.804803] <0> ffff88023c8638a8 ffffea0002308030 ffff88023c8638a8 ffffffff8110fe8b Jan 10 02:23:07 triumph kernel: [44203.804814] <0> 0000000000000002 000000000000001f ffff88023c863898 00000000f3c4050e Jan 10 02:23:07 triumph kernel: [44203.804829] Call Trace: Jan 10 02:23:07 triumph kernel: [44203.804844] [<ffffffff8110fe8b>] prep_new_page+0x3b/0x190 Jan 10 02:23:07 triumph kernel: [44203.804856] [<ffffffff8111068f>] get_page_from_freelist+0x35f/0x6e0 Jan 10 02:23:07 triumph kernel: [44203.804868] [<ffffffff811110d5>] __alloc_pages_nodemask+0xe5/0x160 Jan 10 02:23:07 triumph kernel: [44203.804880] [<ffffffff81146d8e>] alloc_pages_current+0x8e/0xe0 Jan 10 02:23:07 triumph kernel: [44203.804893] [<ffffffff81109f35>] __page_cache_alloc+0x85/0x90 Jan 10 02:23:07 triumph kernel: [44203.804905] [<ffffffff811160f9>] __do_page_cache_readahead+0xd9/0x1a0 Jan 10 02:23:07 triumph kernel: [44203.804917] [<ffffffff811161ef>] ra_submit+0x2f/0x50 Jan 10 02:23:07 triumph kernel: [44203.804928] [<ffffffff8111646d>] ondemand_readahead+0x11d/0x260 Jan 10 02:23:07 triumph kernel: [44203.804940] [<ffffffff81116650>] page_cache_async_readahead+0xa0/0xc0 Jan 10 02:23:07 triumph kernel: [44203.804952] [<ffffffff8110b211>] T.778+0x1f1/0x440 Jan 10 02:23:07 triumph kernel: [44203.804963] [<ffffffff8110b526>] generic_file_aio_read+0xc6/0x1f0 Jan 10 02:23:07 triumph kernel: [44203.804990] [<ffffffffa0614a32>] nfs_file_read+0xe2/0x130 [nfs] Jan 10 02:23:07 triumph kernel: [44203.805018] [<ffffffff8115a2e2>] do_sync_read+0x102/0x160 Jan 10 02:23:07 triumph kernel: [44203.805030] [<ffffffff8115a815>] vfs_read+0xd5/0x1c0 Jan 10 02:23:07 triumph kernel: [44203.805041] [<ffffffff8115af3b>] sys_read+0x5b/0xa0 Jan 10 02:23:07 triumph kernel: [44203.805053] [<ffffffff8100c602>] system_call_fastpath+0x16/0x1b Jan 10 02:23:07 triumph kernel: [44203.805067] [<00007f1df3365dc0>] 0x7f1df3365dc0 Jan 10 02:23:07 triumph kernel: [44203.805075] Code: 81 c6 a0 04 00 00 48 0f af d0 31 c0 e8 aa 54 44 00 48 8b 13 48 8b 73 20 48 89 d8 4c 8b 4b 18 44 8b 43 0c f7 c2 00 00 02 00 75 5d <8b> 48 08 41 83 c0 01 48 89 34 24 48 c7 c7 d0 a7 6e 81 48 89 de Jan 10 02:23:07 triumph kernel: [44203.805133] RIP [<ffffffff8110f608>] bad_page+0xd8/0x160 Jan 10 02:23:07 triumph kernel: [44203.805143] RSP <ffff88023c863818> Jan 10 02:23:07 triumph kernel: [44203.805149] CR2: 000000000000000a Jan 10 02:23:07 triumph kernel: [44203.865407] ---[ end trace dcd9fd889047fb7e ]--- -- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c14 Jan Kara changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |jack@novell.com --- Comment #14 from Jan Kara 2010-01-11 19:29:38 UTC --- Guys, just one observation: The machine mostly dies as: Jan 10 02:23:07 triumph kernel: [44203.804423] BUG: Bad page state in process rsync pfn:<some number> Jan 10 02:23:07 triumph kernel: [44203.804478] BUG: unable to handle kernel NULL pointer dereference at 000000000000000a Jan 10 02:23:07 triumph kernel: [44203.804489] IP: [<ffffffff8110f608>] bad_page+0xd8/0x160 .. Note that this is actually a double fault. Page allocator has been allocating a new page, it was checking the page it got with check_new_page() which failed (my guess is because some page flag is set) so it called bad_page(). That function oopsed while printing information about the page. The only conceivable way how printk(KERN_ALERT "page:%p flags:%p count:%d mapcount:%d mapping:%p index:%lx\n", page, (void *)page->flags, page_count(page), page_mapcount(page), page->mapping, page->index); can oops is in page_count() which tries to follow page->first_page if some page flags are set. And page->first_page contains 0x2... So obviously struct page is corrupted and I don't think XFS is at fault. Rather something is corrupting free page structures... -- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c16 --- Comment #16 from Robert Schweikert 2010-03-18 20:33:25 UTC --- (In reply to comment #15)

Can you try to reproduce this with the -debug kernel? It has a bunch of memory corruption checks that may help us track it down.

I'm not seeing any changes in forcedeth or bridging that would address this.

I don't really have time right now to deal with a flacky system sorry. I'll try to switch the machine to 11.2 again when things calm down a bit. Will then try the debug kernel. -- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c18 --- Comment #18 from Robert Schweikert 2010-04-19 16:17:34 UTC --- Here is some more evidence that XFS is in play. When I had trouble with the machine I dumped (dd) the partition containing all data onto an external drive. Now when I try to restore the data in some directories I get read errors (not unexpected). When those read errors occur I get the following trace in the kernel log. Apr 19 12:05:14 triumph kernel: [ 4132.476952] XFS internal error XFS_WANT_CORRUPTED_GOTO at line 4653 of file /usr/src/packages/BUILD/kernel-desktop-2.6.31.12/linux-2.6.31/fs/xfs/xfs_bmap.c. Caller 0xffffffffa0529ef9 Apr 19 12:05:14 triumph kernel: [ 4132.476956] Pid: 14997, comm: cp Not tainted 2.6.31.12-0.2-desktop #1 Apr 19 12:05:14 triumph kernel: [ 4132.476958] Call Trace: Apr 19 12:05:14 triumph kernel: [ 4132.476963] [<ffffffff81011a19>] try_stack_unwind+0x189/0x1b0 Apr 19 12:05:14 triumph kernel: [ 4132.476968] [<ffffffff8101025d>] dump_trace+0xad/0x3a0 Apr 19 12:05:14 triumph kernel: [ 4132.476973] [<ffffffff81011524>] show_trace_log_lvl+0x64/0x90 Apr 19 12:05:14 triumph kernel: [ 4132.476978] [<ffffffff81011573>] show_trace+0x23/0x40 Apr 19 12:05:14 triumph kernel: [ 4132.476982] [<ffffffff81552b46>] dump_stack+0x81/0x9e Apr 19 12:05:14 triumph kernel: [ 4132.477003] [<ffffffffa0520b4a>] xfs_error_report+0x5a/0x70 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.477057] [<ffffffffa0503294>] xfs_bmap_read_extents+0x2d4/0x3b0 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.477125] [<ffffffffa0529ef9>] xfs_iread_extents+0x99/0x130 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.477198] [<ffffffffa050860e>] xfs_bmapi+0x1ce/0x1320 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.477270] [<ffffffffa052ea9b>] xfs_iomap+0x12b/0x300 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.477337] [<ffffffffa054b50e>] __xfs_get_blocks+0x8e/0x230 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.477443] [<ffffffffa054b725>] xfs_get_blocks+0x25/0x40 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.477534] [<ffffffff8117cf0b>] block_read_full_page+0x1ab/0x410 Apr 19 12:05:14 triumph kernel: [ 4132.477561] [<ffffffff81185e48>] do_mpage_readpage+0x408/0x700 Apr 19 12:05:14 triumph kernel: [ 4132.477581] [<ffffffff811862c3>] mpage_readpages+0xf3/0x150 Apr 19 12:05:14 triumph kernel: [ 4132.477600] [<ffffffffa054bf0b>] xfs_vm_readpages+0x2b/0x50 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.477672] [<ffffffff8110b203>] read_pages+0x43/0x110 Apr 19 12:05:14 triumph kernel: [ 4132.477699] [<ffffffff8110b6ab>] __do_page_cache_readahead+0x1bb/0x1f0 Apr 19 12:05:14 triumph kernel: [ 4132.477712] [<ffffffff8110b70f>] ra_submit+0x2f/0x50 Apr 19 12:05:14 triumph kernel: [ 4132.477716] [<ffffffff8110b95d>] ondemand_readahead+0x15d/0x310 Apr 19 12:05:14 triumph kernel: [ 4132.477722] [<ffffffff8110bbfd>] page_cache_sync_readahead+0x2d/0x50 Apr 19 12:05:14 triumph kernel: [ 4132.477731] [<ffffffff811001e6>] T.777+0x2b6/0x440 Apr 19 12:05:14 triumph kernel: [ 4132.477735] [<ffffffff81100436>] generic_file_aio_read+0xc6/0x1f0 Apr 19 12:05:14 triumph kernel: [ 4132.477755] [<ffffffffa0556515>] xfs_read+0x165/0x3c0 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.477845] [<ffffffffa0550d8e>] xfs_file_aio_read+0x6e/0x90 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.477946] [<ffffffff8114bea2>] do_sync_read+0x102/0x160 Apr 19 12:05:14 triumph kernel: [ 4132.477972] [<ffffffff8114c3d5>] vfs_read+0xd5/0x1c0 Apr 19 12:05:14 triumph kernel: [ 4132.477985] [<ffffffff8114cafb>] sys_read+0x5b/0xa0 Apr 19 12:05:14 triumph kernel: [ 4132.477990] [<ffffffff8100c682>] system_call_fastpath+0x16/0x1b Apr 19 12:05:14 triumph kernel: [ 4132.477997] [<00007fa7b6498a90>] 0x7fa7b6498a90 Apr 19 12:05:14 triumph kernel: [ 4132.478017] XFS internal error XFS_WANT_CORRUPTED_GOTO at line 4653 of file /usr/src/packages/BUILD/kernel-desktop-2.6.31.12/linux-2.6.31/fs/xfs/xfs_bmap.c. Caller 0xffffffffa0529ef9 Apr 19 12:05:14 triumph kernel: [ 4132.478021] Pid: 14997, comm: cp Not tainted 2.6.31.12-0.2-desktop #1 Apr 19 12:05:14 triumph kernel: [ 4132.478023] Call Trace: Apr 19 12:05:14 triumph kernel: [ 4132.478028] [<ffffffff81011a19>] try_stack_unwind+0x189/0x1b0 Apr 19 12:05:14 triumph kernel: [ 4132.478034] [<ffffffff8101025d>] dump_trace+0xad/0x3a0 Apr 19 12:05:14 triumph kernel: [ 4132.478043] [<ffffffff81011524>] show_trace_log_lvl+0x64/0x90 Apr 19 12:05:14 triumph kernel: [ 4132.478053] [<ffffffff81011573>] show_trace+0x23/0x40 Apr 19 12:05:14 triumph kernel: [ 4132.478064] [<ffffffff81552b46>] dump_stack+0x81/0x9e Apr 19 12:05:14 triumph kernel: [ 4132.478092] [<ffffffffa0520b4a>] xfs_error_report+0x5a/0x70 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.478159] [<ffffffffa0503294>] xfs_bmap_read_extents+0x2d4/0x3b0 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.478231] [<ffffffffa0529ef9>] xfs_iread_extents+0x99/0x130 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.478297] [<ffffffffa050860e>] xfs_bmapi+0x1ce/0x1320 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.478367] [<ffffffffa052ea9b>] xfs_iomap+0x12b/0x300 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.478434] [<ffffffffa054b50e>] __xfs_get_blocks+0x8e/0x230 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.478539] [<ffffffffa054b725>] xfs_get_blocks+0x25/0x40 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.478635] [<ffffffff81185bbe>] do_mpage_readpage+0x17e/0x700 Apr 19 12:05:14 triumph kernel: [ 4132.478663] [<ffffffff811862c3>] mpage_readpages+0xf3/0x150 Apr 19 12:05:14 triumph kernel: [ 4132.478689] [<ffffffffa054bf0b>] xfs_vm_readpages+0x2b/0x50 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.478762] [<ffffffff8110b203>] read_pages+0x43/0x110 Apr 19 12:05:14 triumph kernel: [ 4132.478788] [<ffffffff8110b6ab>] __do_page_cache_readahead+0x1bb/0x1f0 Apr 19 12:05:14 triumph kernel: [ 4132.478801] [<ffffffff8110b70f>] ra_submit+0x2f/0x50 Apr 19 12:05:14 triumph kernel: [ 4132.478812] [<ffffffff8110b95d>] ondemand_readahead+0x15d/0x310 Apr 19 12:05:14 triumph kernel: [ 4132.478825] [<ffffffff8110bbfd>] page_cache_sync_readahead+0x2d/0x50 Apr 19 12:05:14 triumph kernel: [ 4132.478837] [<ffffffff811001e6>] T.777+0x2b6/0x440 Apr 19 12:05:14 triumph kernel: [ 4132.478849] [<ffffffff81100436>] generic_file_aio_read+0xc6/0x1f0 Apr 19 12:05:14 triumph kernel: [ 4132.478884] [<ffffffffa0556515>] xfs_read+0x165/0x3c0 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.478974] [<ffffffffa0550d8e>] xfs_file_aio_read+0x6e/0x90 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.479070] [<ffffffff8114bea2>] do_sync_read+0x102/0x160 Apr 19 12:05:14 triumph kernel: [ 4132.479101] [<ffffffff8114c3d5>] vfs_read+0xd5/0x1c0 Apr 19 12:05:14 triumph kernel: [ 4132.479113] [<ffffffff8114cafb>] sys_read+0x5b/0xa0 Apr 19 12:05:14 triumph kernel: [ 4132.479132] [<ffffffff8100c682>] system_call_fastpath+0x16/0x1b Apr 19 12:05:14 triumph kernel: [ 4132.479145] [<00007fa7b6498a90>] 0x7fa7b6498a90 Apr 19 12:05:14 triumph kernel: [ 4132.479484] XFS internal error XFS_WANT_CORRUPTED_GOTO at line 4653 of file /usr/src/packages/BUILD/kernel-desktop-2.6.31.12/linux-2.6.31/fs/xfs/xfs_bmap.c. Caller 0xffffffffa0529ef9 Apr 19 12:05:14 triumph kernel: [ 4132.479515] Pid: 14997, comm: cp Not tainted 2.6.31.12-0.2-desktop #1 Apr 19 12:05:14 triumph kernel: [ 4132.479524] Call Trace: Apr 19 12:05:14 triumph kernel: [ 4132.479534] [<ffffffff81011a19>] try_stack_unwind+0x189/0x1b0 Apr 19 12:05:14 triumph kernel: [ 4132.479547] [<ffffffff8101025d>] dump_trace+0xad/0x3a0 Apr 19 12:05:14 triumph kernel: [ 4132.479566] [<ffffffff81011524>] show_trace_log_lvl+0x64/0x90 Apr 19 12:05:14 triumph kernel: [ 4132.479571] [<ffffffff81011573>] show_trace+0x23/0x40 Apr 19 12:05:14 triumph kernel: [ 4132.479577] [<ffffffff81552b46>] dump_stack+0x81/0x9e Apr 19 12:05:14 triumph kernel: [ 4132.479601] [<ffffffffa0520b4a>] xfs_error_report+0x5a/0x70 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.479654] [<ffffffffa0503294>] xfs_bmap_read_extents+0x2d4/0x3b0 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.479714] [<ffffffffa0529ef9>] xfs_iread_extents+0x99/0x130 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.479779] [<ffffffffa050860e>] xfs_bmapi+0x1ce/0x1320 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.479840] [<ffffffffa052ea9b>] xfs_iomap+0x12b/0x300 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.479908] [<ffffffffa054b50e>] __xfs_get_blocks+0x8e/0x230 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.480017] [<ffffffffa054b725>] xfs_get_blocks+0x25/0x40 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.480107] [<ffffffff8117cf0b>] block_read_full_page+0x1ab/0x410 Apr 19 12:05:14 triumph kernel: [ 4132.480142] [<ffffffff81185e48>] do_mpage_readpage+0x408/0x700 Apr 19 12:05:14 triumph kernel: [ 4132.480155] [<ffffffff811862c3>] mpage_readpages+0xf3/0x150 Apr 19 12:05:14 triumph kernel: [ 4132.480184] [<ffffffffa054bf0b>] xfs_vm_readpages+0x2b/0x50 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.480256] [<ffffffff8110b203>] read_pages+0x43/0x110 Apr 19 12:05:14 triumph kernel: [ 4132.480283] [<ffffffff8110b6ab>] __do_page_cache_readahead+0x1bb/0x1f0 Apr 19 12:05:14 triumph kernel: [ 4132.480302] [<ffffffff8110b70f>] ra_submit+0x2f/0x50 Apr 19 12:05:14 triumph kernel: [ 4132.480307] [<ffffffff8110b95d>] ondemand_readahead+0x15d/0x310 Apr 19 12:05:14 triumph kernel: [ 4132.480312] [<ffffffff8110bbfd>] page_cache_sync_readahead+0x2d/0x50 Apr 19 12:05:14 triumph kernel: [ 4132.480321] [<ffffffff811001e6>] T.777+0x2b6/0x440 Apr 19 12:05:14 triumph kernel: [ 4132.480325] [<ffffffff81100436>] generic_file_aio_read+0xc6/0x1f0 Apr 19 12:05:14 triumph kernel: [ 4132.480345] [<ffffffffa0556515>] xfs_read+0x165/0x3c0 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.480440] [<ffffffffa0550d8e>] xfs_file_aio_read+0x6e/0x90 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.480540] [<ffffffff8114bea2>] do_sync_read+0x102/0x160 Apr 19 12:05:14 triumph kernel: [ 4132.480567] [<ffffffff8114c3d5>] vfs_read+0xd5/0x1c0 Apr 19 12:05:14 triumph kernel: [ 4132.480578] [<ffffffff8114cafb>] sys_read+0x5b/0xa0 Apr 19 12:05:14 triumph kernel: [ 4132.480590] [<ffffffff8100c682>] system_call_fastpath+0x16/0x1b Apr 19 12:05:14 triumph kernel: [ 4132.480596] [<00007fa7b6498a90>] 0x7fa7b6498a90 Apr 19 12:05:14 triumph kernel: [ 4132.480617] XFS internal error XFS_WANT_CORRUPTED_GOTO at line 4653 of file /usr/src/packages/BUILD/kernel-desktop-2.6.31.12/linux-2.6.31/fs/xfs/xfs_bmap.c. Caller 0xffffffffa0529ef9 Apr 19 12:05:14 triumph kernel: [ 4132.480621] Pid: 14997, comm: cp Not tainted 2.6.31.12-0.2-desktop #1 Apr 19 12:05:14 triumph kernel: [ 4132.480623] Call Trace: Apr 19 12:05:14 triumph kernel: [ 4132.480628] [<ffffffff81011a19>] try_stack_unwind+0x189/0x1b0 Apr 19 12:05:14 triumph kernel: [ 4132.480638] [<ffffffff8101025d>] dump_trace+0xad/0x3a0 Apr 19 12:05:14 triumph kernel: [ 4132.480642] [<ffffffff81011524>] show_trace_log_lvl+0x64/0x90 Apr 19 12:05:14 triumph kernel: [ 4132.480647] [<ffffffff81011573>] show_trace+0x23/0x40 Apr 19 12:05:14 triumph kernel: [ 4132.480652] [<ffffffff81552b46>] dump_stack+0x81/0x9e Apr 19 12:05:14 triumph kernel: [ 4132.480671] [<ffffffffa0520b4a>] xfs_error_report+0x5a/0x70 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.480728] [<ffffffffa0503294>] xfs_bmap_read_extents+0x2d4/0x3b0 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.480789] [<ffffffffa0529ef9>] xfs_iread_extents+0x99/0x130 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.480856] [<ffffffffa050860e>] xfs_bmapi+0x1ce/0x1320 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.480917] [<ffffffffa052ea9b>] xfs_iomap+0x12b/0x300 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.480984] [<ffffffffa054b50e>] __xfs_get_blocks+0x8e/0x230 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.481096] [<ffffffffa054b725>] xfs_get_blocks+0x25/0x40 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.481198] [<ffffffff81185bbe>] do_mpage_readpage+0x17e/0x700 Apr 19 12:05:14 triumph kernel: [ 4132.481232] [<ffffffff811862c3>] mpage_readpages+0xf3/0x150 Apr 19 12:05:14 triumph kernel: [ 4132.481252] [<ffffffffa054bf0b>] xfs_vm_readpages+0x2b/0x50 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.481324] [<ffffffff8110b203>] read_pages+0x43/0x110 Apr 19 12:05:14 triumph kernel: [ 4132.481351] [<ffffffff8110b6ab>] __do_page_cache_readahead+0x1bb/0x1f0 Apr 19 12:05:14 triumph kernel: [ 4132.481368] [<ffffffff8110b70f>] ra_submit+0x2f/0x50 Apr 19 12:05:14 triumph kernel: [ 4132.481377] [<ffffffff8110b95d>] ondemand_readahead+0x15d/0x310 Apr 19 12:05:14 triumph kernel: [ 4132.481387] [<ffffffff8110bbfd>] page_cache_sync_readahead+0x2d/0x50 Apr 19 12:05:14 triumph kernel: [ 4132.481397] [<ffffffff811001e6>] T.777+0x2b6/0x440 Apr 19 12:05:14 triumph kernel: [ 4132.481409] [<ffffffff81100436>] generic_file_aio_read+0xc6/0x1f0 Apr 19 12:05:14 triumph kernel: [ 4132.481434] [<ffffffffa0556515>] xfs_read+0x165/0x3c0 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.481528] [<ffffffffa0550d8e>] xfs_file_aio_read+0x6e/0x90 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.481605] [<ffffffff8114bea2>] do_sync_read+0x102/0x160 Apr 19 12:05:14 triumph kernel: [ 4132.481638] [<ffffffff8114c3d5>] vfs_read+0xd5/0x1c0 Apr 19 12:05:14 triumph kernel: [ 4132.481643] [<ffffffff8114cafb>] sys_read+0x5b/0xa0 Apr 19 12:05:14 triumph kernel: [ 4132.481648] [<ffffffff8100c682>] system_call_fastpath+0x16/0x1b Apr 19 12:05:14 triumph kernel: [ 4132.481655] [<00007fa7b6498a90>] 0x7fa7b6498a90 Apr 19 12:05:14 triumph kernel: [ 4132.481672] XFS internal error XFS_WANT_CORRUPTED_GOTO at line 4653 of file /usr/src/packages/BUILD/kernel-desktop-2.6.31.12/linux-2.6.31/fs/xfs/xfs_bmap.c. Caller 0xffffffffa0529ef9 Apr 19 12:05:14 triumph kernel: [ 4132.481677] Pid: 14997, comm: cp Not tainted 2.6.31.12-0.2-desktop #1 Apr 19 12:05:14 triumph kernel: [ 4132.481679] Call Trace: Apr 19 12:05:14 triumph kernel: [ 4132.481684] [<ffffffff81011a19>] try_stack_unwind+0x189/0x1b0 Apr 19 12:05:14 triumph kernel: [ 4132.481688] [<ffffffff8101025d>] dump_trace+0xad/0x3a0 Apr 19 12:05:14 triumph kernel: [ 4132.481693] [<ffffffff81011524>] show_trace_log_lvl+0x64/0x90 Apr 19 12:05:14 triumph kernel: [ 4132.481698] [<ffffffff81011573>] show_trace+0x23/0x40 Apr 19 12:05:14 triumph kernel: [ 4132.481703] [<ffffffff81552b46>] dump_stack+0x81/0x9e Apr 19 12:05:14 triumph kernel: [ 4132.481723] [<ffffffffa0520b4a>] xfs_error_report+0x5a/0x70 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.481775] [<ffffffffa0503294>] xfs_bmap_read_extents+0x2d4/0x3b0 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.481836] [<ffffffffa0529ef9>] xfs_iread_extents+0x99/0x130 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.481900] [<ffffffffa050860e>] xfs_bmapi+0x1ce/0x1320 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.481961] [<ffffffffa052ea9b>] xfs_iomap+0x12b/0x300 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.482029] [<ffffffffa054b50e>] __xfs_get_blocks+0x8e/0x230 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.482147] [<ffffffffa054b725>] xfs_get_blocks+0x25/0x40 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.482244] [<ffffffff8117cf0b>] block_read_full_page+0x1ab/0x410 Apr 19 12:05:14 triumph kernel: [ 4132.482273] [<ffffffff81185e48>] do_mpage_readpage+0x408/0x700 Apr 19 12:05:14 triumph kernel: [ 4132.482288] [<ffffffff811862c3>] mpage_readpages+0xf3/0x150 Apr 19 12:05:14 triumph kernel: [ 4132.482307] [<ffffffffa054bf0b>] xfs_vm_readpages+0x2b/0x50 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.482379] [<ffffffff8110b203>] read_pages+0x43/0x110 Apr 19 12:05:14 triumph kernel: [ 4132.482406] [<ffffffff8110b6ab>] __do_page_cache_readahead+0x1bb/0x1f0 Apr 19 12:05:14 triumph kernel: [ 4132.482426] [<ffffffff8110b70f>] ra_submit+0x2f/0x50 Apr 19 12:05:14 triumph kernel: [ 4132.482431] [<ffffffff8110b95d>] ondemand_readahead+0x15d/0x310 Apr 19 12:05:14 triumph kernel: [ 4132.482436] [<ffffffff8110bbfd>] page_cache_sync_readahead+0x2d/0x50 Apr 19 12:05:14 triumph kernel: [ 4132.482445] [<ffffffff811001e6>] T.777+0x2b6/0x440 Apr 19 12:05:14 triumph kernel: [ 4132.482450] [<ffffffff81100436>] generic_file_aio_read+0xc6/0x1f0 Apr 19 12:05:14 triumph kernel: [ 4132.482469] [<ffffffffa0556515>] xfs_read+0x165/0x3c0 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.482559] [<ffffffffa0550d8e>] xfs_file_aio_read+0x6e/0x90 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.482656] [<ffffffff8114bea2>] do_sync_read+0x102/0x160 Apr 19 12:05:14 triumph kernel: [ 4132.482660] [<ffffffff8114c3d5>] vfs_read+0xd5/0x1c0 Apr 19 12:05:14 triumph kernel: [ 4132.482665] [<ffffffff8114cafb>] sys_read+0x5b/0xa0 Apr 19 12:05:14 triumph kernel: [ 4132.482673] [<ffffffff8100c682>] system_call_fastpath+0x16/0x1b Apr 19 12:05:14 triumph kernel: [ 4132.482679] [<00007fa7b6498a90>] 0x7fa7b6498a90 Apr 19 12:05:14 triumph kernel: [ 4132.482695] XFS internal error XFS_WANT_CORRUPTED_GOTO at line 4653 of file /usr/src/packages/BUILD/kernel-desktop-2.6.31.12/linux-2.6.31/fs/xfs/xfs_bmap.c. Caller 0xffffffffa0529ef9 Apr 19 12:05:14 triumph kernel: [ 4132.482699] Pid: 14997, comm: cp Not tainted 2.6.31.12-0.2-desktop #1 Apr 19 12:05:14 triumph kernel: [ 4132.482702] Call Trace: Apr 19 12:05:14 triumph kernel: [ 4132.482707] [<ffffffff81011a19>] try_stack_unwind+0x189/0x1b0 Apr 19 12:05:14 triumph kernel: [ 4132.482711] [<ffffffff8101025d>] dump_trace+0xad/0x3a0 Apr 19 12:05:14 triumph kernel: [ 4132.482716] [<ffffffff81011524>] show_trace_log_lvl+0x64/0x90 Apr 19 12:05:14 triumph kernel: [ 4132.482722] [<ffffffff81011573>] show_trace+0x23/0x40 Apr 19 12:05:14 triumph kernel: [ 4132.482726] [<ffffffff81552b46>] dump_stack+0x81/0x9e Apr 19 12:05:14 triumph kernel: [ 4132.482746] [<ffffffffa0520b4a>] xfs_error_report+0x5a/0x70 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.482804] [<ffffffffa0503294>] xfs_bmap_read_extents+0x2d4/0x3b0 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.482844] [<ffffffffa0529ef9>] xfs_iread_extents+0x99/0x130 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.482926] [<ffffffffa050860e>] xfs_bmapi+0x1ce/0x1320 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.482966] [<ffffffffa052ea9b>] xfs_iomap+0x12b/0x300 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.483052] [<ffffffffa054b50e>] __xfs_get_blocks+0x8e/0x230 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.483146] [<ffffffffa054b725>] xfs_get_blocks+0x25/0x40 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.483245] [<ffffffff8117cf0b>] block_read_full_page+0x1ab/0x410 Apr 19 12:05:14 triumph kernel: [ 4132.483273] [<ffffffff81185e48>] do_mpage_readpage+0x408/0x700 Apr 19 12:05:14 triumph kernel: [ 4132.483286] [<ffffffff81186199>] mpage_readpage+0x59/0x90 Apr 19 12:05:14 triumph kernel: [ 4132.483312] [<ffffffffa054bfe6>] xfs_vm_readpage+0x26/0x50 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.483379] [<ffffffff8110003c>] T.777+0x10c/0x440 Apr 19 12:05:14 triumph kernel: [ 4132.483385] [<ffffffff81100436>] generic_file_aio_read+0xc6/0x1f0 Apr 19 12:05:14 triumph kernel: [ 4132.483406] [<ffffffffa0556515>] xfs_read+0x165/0x3c0 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.483501] [<ffffffffa0550d8e>] xfs_file_aio_read+0x6e/0x90 [xfs] Apr 19 12:05:14 triumph kernel: [ 4132.483573] [<ffffffff8114bea2>] do_sync_read+0x102/0x160 Apr 19 12:05:14 triumph kernel: [ 4132.483608] [<ffffffff8114c3d5>] vfs_read+0xd5/0x1c0 Apr 19 12:05:14 triumph kernel: [ 4132.483612] [<ffffffff8114cafb>] sys_read+0x5b/0xa0 Apr 19 12:05:14 triumph kernel: [ 4132.483617] [<ffffffff8100c682>] system_call_fastpath+0x16/0x1b Apr 19 12:05:14 triumph kernel: [ 4132.483623] [<00007fa7b6498a90>] 0x7fa7b6498a90 Apr 19 12:11:20 triumph kernel: [ 4498.373460] XFS internal error XFS_WANT_CORRUPTED_GOTO at line 4617 of file /usr/src/packages/BUILD/kernel-desktop-2.6.31.12/linux-2.6.31/fs/xfs/xfs_bmap.c. Caller 0xffffffffa0529ef9 Apr 19 12:11:20 triumph kernel: [ 4498.373483] Pid: 14997, comm: cp Not tainted 2.6.31.12-0.2-desktop #1 Apr 19 12:11:20 triumph kernel: [ 4498.373492] Call Trace: Apr 19 12:11:20 triumph kernel: [ 4498.373511] [<ffffffff81011a19>] try_stack_unwind+0x189/0x1b0 Apr 19 12:11:20 triumph kernel: [ 4498.373524] [<ffffffff8101025d>] dump_trace+0xad/0x3a0 Apr 19 12:11:20 triumph kernel: [ 4498.373536] [<ffffffff81011524>] show_trace_log_lvl+0x64/0x90 Apr 19 12:11:20 triumph kernel: [ 4498.373548] [<ffffffff81011573>] show_trace+0x23/0x40 Apr 19 12:11:20 triumph kernel: [ 4498.373561] [<ffffffff81552b46>] dump_stack+0x81/0x9e Apr 19 12:11:20 triumph kernel: [ 4498.373593] [<ffffffffa0520b4a>] xfs_error_report+0x5a/0x70 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.373658] [<ffffffffa0503294>] xfs_bmap_read_extents+0x2d4/0x3b0 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.373705] [<ffffffffa0529ef9>] xfs_iread_extents+0x99/0x130 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.373909] [<ffffffffa050860e>] xfs_bmapi+0x1ce/0x1320 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.373956] [<ffffffffa052ea9b>] xfs_iomap+0x12b/0x300 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.374037] [<ffffffffa054b50e>] __xfs_get_blocks+0x8e/0x230 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.374128] [<ffffffffa054b725>] xfs_get_blocks+0x25/0x40 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.374204] [<ffffffff81185bbe>] do_mpage_readpage+0x17e/0x700 Apr 19 12:11:20 triumph kernel: [ 4498.374218] [<ffffffff811862c3>] mpage_readpages+0xf3/0x150 Apr 19 12:11:20 triumph kernel: [ 4498.374245] [<ffffffffa054bf0b>] xfs_vm_readpages+0x2b/0x50 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.374314] [<ffffffff8110b203>] read_pages+0x43/0x110 Apr 19 12:11:20 triumph kernel: [ 4498.374347] [<ffffffff8110b6ab>] __do_page_cache_readahead+0x1bb/0x1f0 Apr 19 12:11:20 triumph kernel: [ 4498.374360] [<ffffffff8110b70f>] ra_submit+0x2f/0x50 Apr 19 12:11:20 triumph kernel: [ 4498.374372] [<ffffffff8110b95d>] ondemand_readahead+0x15d/0x310 Apr 19 12:11:20 triumph kernel: [ 4498.374384] [<ffffffff8110bbfd>] page_cache_sync_readahead+0x2d/0x50 Apr 19 12:11:20 triumph kernel: [ 4498.374397] [<ffffffff811001e6>] T.777+0x2b6/0x440 Apr 19 12:11:20 triumph kernel: [ 4498.374409] [<ffffffff81100436>] generic_file_aio_read+0xc6/0x1f0 Apr 19 12:11:20 triumph kernel: [ 4498.374436] [<ffffffffa0556515>] xfs_read+0x165/0x3c0 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.374533] [<ffffffffa0550d8e>] xfs_file_aio_read+0x6e/0x90 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.374612] [<ffffffff8114bea2>] do_sync_read+0x102/0x160 Apr 19 12:11:20 triumph kernel: [ 4498.374625] [<ffffffff8114c3d5>] vfs_read+0xd5/0x1c0 Apr 19 12:11:20 triumph kernel: [ 4498.374636] [<ffffffff8114cafb>] sys_read+0x5b/0xa0 Apr 19 12:11:20 triumph kernel: [ 4498.374648] [<ffffffff8100c682>] system_call_fastpath+0x16/0x1b Apr 19 12:11:20 triumph kernel: [ 4498.374669] [<00007fa7b6498a90>] 0x7fa7b6498a90 Apr 19 12:11:20 triumph kernel: [ 4498.374692] XFS internal error XFS_WANT_CORRUPTED_GOTO at line 4617 of file /usr/src/packages/BUILD/kernel-desktop-2.6.31.12/linux-2.6.31/fs/xfs/xfs_bmap.c. Caller 0xffffffffa0529ef9 Apr 19 12:11:20 triumph kernel: [ 4498.374708] Pid: 14997, comm: cp Not tainted 2.6.31.12-0.2-desktop #1 Apr 19 12:11:20 triumph kernel: [ 4498.374717] Call Trace: Apr 19 12:11:20 triumph kernel: [ 4498.374727] [<ffffffff81011a19>] try_stack_unwind+0x189/0x1b0 Apr 19 12:11:20 triumph kernel: [ 4498.374739] [<ffffffff8101025d>] dump_trace+0xad/0x3a0 Apr 19 12:11:20 triumph kernel: [ 4498.374750] [<ffffffff81011524>] show_trace_log_lvl+0x64/0x90 Apr 19 12:11:20 triumph kernel: [ 4498.374762] [<ffffffff81011573>] show_trace+0x23/0x40 Apr 19 12:11:20 triumph kernel: [ 4498.374774] [<ffffffff81552b46>] dump_stack+0x81/0x9e Apr 19 12:11:20 triumph kernel: [ 4498.374800] [<ffffffffa0520b4a>] xfs_error_report+0x5a/0x70 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.374859] [<ffffffffa0503294>] xfs_bmap_read_extents+0x2d4/0x3b0 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.374905] [<ffffffffa0529ef9>] xfs_iread_extents+0x99/0x130 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.374972] [<ffffffffa050860e>] xfs_bmapi+0x1ce/0x1320 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.375030] [<ffffffffa052ea9b>] xfs_iomap+0x12b/0x300 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.375101] [<ffffffffa054b50e>] __xfs_get_blocks+0x8e/0x230 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.375190] [<ffffffffa054b725>] xfs_get_blocks+0x25/0x40 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.375265] [<ffffffff8117cf0b>] block_read_full_page+0x1ab/0x410 Apr 19 12:11:20 triumph kernel: [ 4498.375278] [<ffffffff81185e48>] do_mpage_readpage+0x408/0x700 Apr 19 12:11:20 triumph kernel: [ 4498.375291] [<ffffffff811862c3>] mpage_readpages+0xf3/0x150 Apr 19 12:11:20 triumph kernel: [ 4498.375318] [<ffffffffa054bf0b>] xfs_vm_readpages+0x2b/0x50 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.375393] [<ffffffff8110b203>] read_pages+0x43/0x110 Apr 19 12:11:20 triumph kernel: [ 4498.375406] [<ffffffff8110b6ab>] __do_page_cache_readahead+0x1bb/0x1f0 Apr 19 12:11:20 triumph kernel: [ 4498.375418] [<ffffffff8110b70f>] ra_submit+0x2f/0x50 Apr 19 12:11:20 triumph kernel: [ 4498.375430] [<ffffffff8110b95d>] ondemand_readahead+0x15d/0x310 Apr 19 12:11:20 triumph kernel: [ 4498.375443] [<ffffffff8110bbfd>] page_cache_sync_readahead+0x2d/0x50 Apr 19 12:11:20 triumph kernel: [ 4498.375454] [<ffffffff811001e6>] T.777+0x2b6/0x440 Apr 19 12:11:20 triumph kernel: [ 4498.375466] [<ffffffff81100436>] generic_file_aio_read+0xc6/0x1f0 Apr 19 12:11:20 triumph kernel: [ 4498.375492] [<ffffffffa0556515>] xfs_read+0x165/0x3c0 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.375588] [<ffffffffa0550d8e>] xfs_file_aio_read+0x6e/0x90 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.375667] [<ffffffff8114bea2>] do_sync_read+0x102/0x160 Apr 19 12:11:20 triumph kernel: [ 4498.375679] [<ffffffff8114c3d5>] vfs_read+0xd5/0x1c0 Apr 19 12:11:20 triumph kernel: [ 4498.375690] [<ffffffff8114cafb>] sys_read+0x5b/0xa0 Apr 19 12:11:20 triumph kernel: [ 4498.375702] [<ffffffff8100c682>] system_call_fastpath+0x16/0x1b Apr 19 12:11:20 triumph kernel: [ 4498.375715] [<00007fa7b6498a90>] 0x7fa7b6498a90 Apr 19 12:11:20 triumph kernel: [ 4498.375731] XFS internal error XFS_WANT_CORRUPTED_GOTO at line 4617 of file /usr/src/packages/BUILD/kernel-desktop-2.6.31.12/linux-2.6.31/fs/xfs/xfs_bmap.c. Caller 0xffffffffa0529ef9 Apr 19 12:11:20 triumph kernel: [ 4498.375747] Pid: 14997, comm: cp Not tainted 2.6.31.12-0.2-desktop #1 Apr 19 12:11:20 triumph kernel: [ 4498.375756] Call Trace: Apr 19 12:11:20 triumph kernel: [ 4498.375765] [<ffffffff81011a19>] try_stack_unwind+0x189/0x1b0 Apr 19 12:11:20 triumph kernel: [ 4498.375777] [<ffffffff8101025d>] dump_trace+0xad/0x3a0 Apr 19 12:11:20 triumph kernel: [ 4498.375789] [<ffffffff81011524>] show_trace_log_lvl+0x64/0x90 Apr 19 12:11:20 triumph kernel: [ 4498.375801] [<ffffffff81011573>] show_trace+0x23/0x40 Apr 19 12:11:20 triumph kernel: [ 4498.375812] [<ffffffff81552b46>] dump_stack+0x81/0x9e Apr 19 12:11:20 triumph kernel: [ 4498.375838] [<ffffffffa0520b4a>] xfs_error_report+0x5a/0x70 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.375898] [<ffffffffa0503294>] xfs_bmap_read_extents+0x2d4/0x3b0 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.375944] [<ffffffffa0529ef9>] xfs_iread_extents+0x99/0x130 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.376004] [<ffffffffa050860e>] xfs_bmapi+0x1ce/0x1320 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.376067] [<ffffffffa052ea9b>] xfs_iomap+0x12b/0x300 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.376138] [<ffffffffa054b50e>] __xfs_get_blocks+0x8e/0x230 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.376228] [<ffffffffa054b725>] xfs_get_blocks+0x25/0x40 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.376302] [<ffffffff81185bbe>] do_mpage_readpage+0x17e/0x700 Apr 19 12:11:20 triumph kernel: [ 4498.376316] [<ffffffff811862c3>] mpage_readpages+0xf3/0x150 Apr 19 12:11:20 triumph kernel: [ 4498.376343] [<ffffffffa054bf0b>] xfs_vm_readpages+0x2b/0x50 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.376418] [<ffffffff8110b203>] read_pages+0x43/0x110 Apr 19 12:11:20 triumph kernel: [ 4498.376431] [<ffffffff8110b6ab>] __do_page_cache_readahead+0x1bb/0x1f0 Apr 19 12:11:20 triumph kernel: [ 4498.376443] [<ffffffff8110b70f>] ra_submit+0x2f/0x50 Apr 19 12:11:20 triumph kernel: [ 4498.376455] [<ffffffff8110b95d>] ondemand_readahead+0x15d/0x310 Apr 19 12:11:20 triumph kernel: [ 4498.376468] [<ffffffff8110bbfd>] page_cache_sync_readahead+0x2d/0x50 Apr 19 12:11:20 triumph kernel: [ 4498.376480] [<ffffffff811001e6>] T.777+0x2b6/0x440 Apr 19 12:11:20 triumph kernel: [ 4498.376491] [<ffffffff81100436>] generic_file_aio_read+0xc6/0x1f0 Apr 19 12:11:20 triumph kernel: [ 4498.376517] [<ffffffffa0556515>] xfs_read+0x165/0x3c0 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.376614] [<ffffffffa0550d8e>] xfs_file_aio_read+0x6e/0x90 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.376693] [<ffffffff8114bea2>] do_sync_read+0x102/0x160 Apr 19 12:11:20 triumph kernel: [ 4498.376705] [<ffffffff8114c3d5>] vfs_read+0xd5/0x1c0 Apr 19 12:11:20 triumph kernel: [ 4498.376716] [<ffffffff8114cafb>] sys_read+0x5b/0xa0 Apr 19 12:11:20 triumph kernel: [ 4498.376728] [<ffffffff8100c682>] system_call_fastpath+0x16/0x1b Apr 19 12:11:20 triumph kernel: [ 4498.376741] [<00007fa7b6498a90>] 0x7fa7b6498a90 Apr 19 12:11:20 triumph kernel: [ 4498.376755] XFS internal error XFS_WANT_CORRUPTED_GOTO at line 4617 of file /usr/src/packages/BUILD/kernel-desktop-2.6.31.12/linux-2.6.31/fs/xfs/xfs_bmap.c. Caller 0xffffffffa0529ef9 Apr 19 12:11:20 triumph kernel: [ 4498.376770] Pid: 14997, comm: cp Not tainted 2.6.31.12-0.2-desktop #1 Apr 19 12:11:20 triumph kernel: [ 4498.376779] Call Trace: Apr 19 12:11:20 triumph kernel: [ 4498.376789] [<ffffffff81011a19>] try_stack_unwind+0x189/0x1b0 Apr 19 12:11:20 triumph kernel: [ 4498.376801] [<ffffffff8101025d>] dump_trace+0xad/0x3a0 Apr 19 12:11:20 triumph kernel: [ 4498.376812] [<ffffffff81011524>] show_trace_log_lvl+0x64/0x90 Apr 19 12:11:20 triumph kernel: [ 4498.376824] [<ffffffff81011573>] show_trace+0x23/0x40 Apr 19 12:11:20 triumph kernel: [ 4498.376836] [<ffffffff81552b46>] dump_stack+0x81/0x9e Apr 19 12:11:20 triumph kernel: [ 4498.376862] [<ffffffffa0520b4a>] xfs_error_report+0x5a/0x70 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.376922] [<ffffffffa0503294>] xfs_bmap_read_extents+0x2d4/0x3b0 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.376968] [<ffffffffa0529ef9>] xfs_iread_extents+0x99/0x130 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.377044] [<ffffffffa050860e>] xfs_bmapi+0x1ce/0x1320 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.377092] [<ffffffffa052ea9b>] xfs_iomap+0x12b/0x300 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.377163] [<ffffffffa054b50e>] __xfs_get_blocks+0x8e/0x230 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.377252] [<ffffffffa054b725>] xfs_get_blocks+0x25/0x40 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.377327] [<ffffffff8117cf0b>] block_read_full_page+0x1ab/0x410 Apr 19 12:11:20 triumph kernel: [ 4498.377340] [<ffffffff81185e48>] do_mpage_readpage+0x408/0x700 Apr 19 12:11:20 triumph kernel: [ 4498.377352] [<ffffffff811862c3>] mpage_readpages+0xf3/0x150 Apr 19 12:11:20 triumph kernel: [ 4498.377378] [<ffffffffa054bf0b>] xfs_vm_readpages+0x2b/0x50 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.377453] [<ffffffff8110b203>] read_pages+0x43/0x110 Apr 19 12:11:20 triumph kernel: [ 4498.377466] [<ffffffff8110b6ab>] __do_page_cache_readahead+0x1bb/0x1f0 Apr 19 12:11:20 triumph kernel: [ 4498.377478] [<ffffffff8110b70f>] ra_submit+0x2f/0x50 Apr 19 12:11:20 triumph kernel: [ 4498.377490] [<ffffffff8110b95d>] ondemand_readahead+0x15d/0x310 Apr 19 12:11:20 triumph kernel: [ 4498.377502] [<ffffffff8110bbfd>] page_cache_sync_readahead+0x2d/0x50 Apr 19 12:11:20 triumph kernel: [ 4498.377514] [<ffffffff811001e6>] T.777+0x2b6/0x440 Apr 19 12:11:20 triumph kernel: [ 4498.377525] [<ffffffff81100436>] generic_file_aio_read+0xc6/0x1f0 Apr 19 12:11:20 triumph kernel: [ 4498.377552] [<ffffffffa0556515>] xfs_read+0x165/0x3c0 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.377649] [<ffffffffa0550d8e>] xfs_file_aio_read+0x6e/0x90 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.377728] [<ffffffff8114bea2>] do_sync_read+0x102/0x160 Apr 19 12:11:20 triumph kernel: [ 4498.377739] [<ffffffff8114c3d5>] vfs_read+0xd5/0x1c0 Apr 19 12:11:20 triumph kernel: [ 4498.377750] [<ffffffff8114cafb>] sys_read+0x5b/0xa0 Apr 19 12:11:20 triumph kernel: [ 4498.377762] [<ffffffff8100c682>] system_call_fastpath+0x16/0x1b Apr 19 12:11:20 triumph kernel: [ 4498.377775] [<00007fa7b6498a90>] 0x7fa7b6498a90 Apr 19 12:11:20 triumph kernel: [ 4498.377790] XFS internal error XFS_WANT_CORRUPTED_GOTO at line 4617 of file /usr/src/packages/BUILD/kernel-desktop-2.6.31.12/linux-2.6.31/fs/xfs/xfs_bmap.c. Caller 0xffffffffa0529ef9 Apr 19 12:11:20 triumph kernel: [ 4498.377806] Pid: 14997, comm: cp Not tainted 2.6.31.12-0.2-desktop #1 Apr 19 12:11:20 triumph kernel: [ 4498.377815] Call Trace: Apr 19 12:11:20 triumph kernel: [ 4498.377824] [<ffffffff81011a19>] try_stack_unwind+0x189/0x1b0 Apr 19 12:11:20 triumph kernel: [ 4498.377836] [<ffffffff8101025d>] dump_trace+0xad/0x3a0 Apr 19 12:11:20 triumph kernel: [ 4498.377848] [<ffffffff81011524>] show_trace_log_lvl+0x64/0x90 Apr 19 12:11:20 triumph kernel: [ 4498.377860] [<ffffffff81011573>] show_trace+0x23/0x40 Apr 19 12:11:20 triumph kernel: [ 4498.377872] [<ffffffff81552b46>] dump_stack+0x81/0x9e Apr 19 12:11:20 triumph kernel: [ 4498.377899] [<ffffffffa0520b4a>] xfs_error_report+0x5a/0x70 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.377958] [<ffffffffa0503294>] xfs_bmap_read_extents+0x2d4/0x3b0 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.378003] [<ffffffffa0529ef9>] xfs_iread_extents+0x99/0x130 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.378080] [<ffffffffa050860e>] xfs_bmapi+0x1ce/0x1320 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.378129] [<ffffffffa052ea9b>] xfs_iomap+0x12b/0x300 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.378200] [<ffffffffa054b50e>] __xfs_get_blocks+0x8e/0x230 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.378289] [<ffffffffa054b725>] xfs_get_blocks+0x25/0x40 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.378363] [<ffffffff81185bbe>] do_mpage_readpage+0x17e/0x700 Apr 19 12:11:20 triumph kernel: [ 4498.378376] [<ffffffff811862c3>] mpage_readpages+0xf3/0x150 Apr 19 12:11:20 triumph kernel: [ 4498.378402] [<ffffffffa054bf0b>] xfs_vm_readpages+0x2b/0x50 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.378477] [<ffffffff8110b203>] read_pages+0x43/0x110 Apr 19 12:11:20 triumph kernel: [ 4498.378489] [<ffffffff8110b6ab>] __do_page_cache_readahead+0x1bb/0x1f0 Apr 19 12:11:20 triumph kernel: [ 4498.378502] [<ffffffff8110b70f>] ra_submit+0x2f/0x50 Apr 19 12:11:20 triumph kernel: [ 4498.378514] [<ffffffff8110b95d>] ondemand_readahead+0x15d/0x310 Apr 19 12:11:20 triumph kernel: [ 4498.378526] [<ffffffff8110bbfd>] page_cache_sync_readahead+0x2d/0x50 Apr 19 12:11:20 triumph kernel: [ 4498.378538] [<ffffffff811001e6>] T.777+0x2b6/0x440 Apr 19 12:11:20 triumph kernel: [ 4498.378550] [<ffffffff81100436>] generic_file_aio_read+0xc6/0x1f0 Apr 19 12:11:20 triumph kernel: [ 4498.378576] [<ffffffffa0556515>] xfs_read+0x165/0x3c0 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.378673] [<ffffffffa0550d8e>] xfs_file_aio_read+0x6e/0x90 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.378752] [<ffffffff8114bea2>] do_sync_read+0x102/0x160 Apr 19 12:11:20 triumph kernel: [ 4498.378764] [<ffffffff8114c3d5>] vfs_read+0xd5/0x1c0 Apr 19 12:11:20 triumph kernel: [ 4498.378775] [<ffffffff8114cafb>] sys_read+0x5b/0xa0 Apr 19 12:11:20 triumph kernel: [ 4498.378786] [<ffffffff8100c682>] system_call_fastpath+0x16/0x1b Apr 19 12:11:20 triumph kernel: [ 4498.378799] [<00007fa7b6498a90>] 0x7fa7b6498a90 Apr 19 12:11:20 triumph kernel: [ 4498.378813] XFS internal error XFS_WANT_CORRUPTED_GOTO at line 4617 of file /usr/src/packages/BUILD/kernel-desktop-2.6.31.12/linux-2.6.31/fs/xfs/xfs_bmap.c. Caller 0xffffffffa0529ef9 Apr 19 12:11:20 triumph kernel: [ 4498.378828] Pid: 14997, comm: cp Not tainted 2.6.31.12-0.2-desktop #1 Apr 19 12:11:20 triumph kernel: [ 4498.378837] Call Trace: Apr 19 12:11:20 triumph kernel: [ 4498.378846] [<ffffffff81011a19>] try_stack_unwind+0x189/0x1b0 Apr 19 12:11:20 triumph kernel: [ 4498.378858] [<ffffffff8101025d>] dump_trace+0xad/0x3a0 Apr 19 12:11:20 triumph kernel: [ 4498.378870] [<ffffffff81011524>] show_trace_log_lvl+0x64/0x90 Apr 19 12:11:20 triumph kernel: [ 4498.378882] [<ffffffff81011573>] show_trace+0x23/0x40 Apr 19 12:11:20 triumph kernel: [ 4498.378893] [<ffffffff81552b46>] dump_stack+0x81/0x9e Apr 19 12:11:20 triumph kernel: [ 4498.378920] [<ffffffffa0520b4a>] xfs_error_report+0x5a/0x70 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.378979] [<ffffffffa0503294>] xfs_bmap_read_extents+0x2d4/0x3b0 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.379040] [<ffffffffa0529ef9>] xfs_iread_extents+0x99/0x130 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.379112] [<ffffffffa050860e>] xfs_bmapi+0x1ce/0x1320 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.379293] [<ffffffffa052ea9b>] xfs_iomap+0x12b/0x300 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.379363] [<ffffffffa054b50e>] __xfs_get_blocks+0x8e/0x230 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.379451] [<ffffffffa054b725>] xfs_get_blocks+0x25/0x40 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.379524] [<ffffffff8117cf0b>] block_read_full_page+0x1ab/0x410 Apr 19 12:11:20 triumph kernel: [ 4498.379537] [<ffffffff81185e48>] do_mpage_readpage+0x408/0x700 Apr 19 12:11:20 triumph kernel: [ 4498.379550] [<ffffffff811862c3>] mpage_readpages+0xf3/0x150 Apr 19 12:11:20 triumph kernel: [ 4498.379576] [<ffffffffa054bf0b>] xfs_vm_readpages+0x2b/0x50 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.379650] [<ffffffff8110b203>] read_pages+0x43/0x110 Apr 19 12:11:20 triumph kernel: [ 4498.379663] [<ffffffff8110b6ab>] __do_page_cache_readahead+0x1bb/0x1f0 Apr 19 12:11:20 triumph kernel: [ 4498.379676] [<ffffffff8110b70f>] ra_submit+0x2f/0x50 Apr 19 12:11:20 triumph kernel: [ 4498.379687] [<ffffffff8110b95d>] ondemand_readahead+0x15d/0x310 Apr 19 12:11:20 triumph kernel: [ 4498.379700] [<ffffffff8110bbfd>] page_cache_sync_readahead+0x2d/0x50 Apr 19 12:11:20 triumph kernel: [ 4498.379712] [<ffffffff811001e6>] T.777+0x2b6/0x440 Apr 19 12:11:20 triumph kernel: [ 4498.379723] [<ffffffff81100436>] generic_file_aio_read+0xc6/0x1f0 Apr 19 12:11:20 triumph kernel: [ 4498.379749] [<ffffffffa0556515>] xfs_read+0x165/0x3c0 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.379846] [<ffffffffa0550d8e>] xfs_file_aio_read+0x6e/0x90 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.379925] [<ffffffff8114bea2>] do_sync_read+0x102/0x160 Apr 19 12:11:20 triumph kernel: [ 4498.379937] [<ffffffff8114c3d5>] vfs_read+0xd5/0x1c0 Apr 19 12:11:20 triumph kernel: [ 4498.379948] [<ffffffff8114cafb>] sys_read+0x5b/0xa0 Apr 19 12:11:20 triumph kernel: [ 4498.379960] [<ffffffff8100c682>] system_call_fastpath+0x16/0x1b Apr 19 12:11:20 triumph kernel: [ 4498.379973] [<00007fa7b6498a90>] 0x7fa7b6498a90 Apr 19 12:11:20 triumph kernel: [ 4498.379988] XFS internal error XFS_WANT_CORRUPTED_GOTO at line 4617 of file /usr/src/packages/BUILD/kernel-desktop-2.6.31.12/linux-2.6.31/fs/xfs/xfs_bmap.c. Caller 0xffffffffa0529ef9 Apr 19 12:11:20 triumph kernel: [ 4498.380012] Pid: 14997, comm: cp Not tainted 2.6.31.12-0.2-desktop #1 Apr 19 12:11:20 triumph kernel: [ 4498.380023] Call Trace: Apr 19 12:11:20 triumph kernel: [ 4498.380034] [<ffffffff81011a19>] try_stack_unwind+0x189/0x1b0 Apr 19 12:11:20 triumph kernel: [ 4498.380047] [<ffffffff8101025d>] dump_trace+0xad/0x3a0 Apr 19 12:11:20 triumph kernel: [ 4498.380060] [<ffffffff81011524>] show_trace_log_lvl+0x64/0x90 Apr 19 12:11:20 triumph kernel: [ 4498.380073] [<ffffffff81011573>] show_trace+0x23/0x40 Apr 19 12:11:20 triumph kernel: [ 4498.380086] [<ffffffff81552b46>] dump_stack+0x81/0x9e Apr 19 12:11:20 triumph kernel: [ 4498.380114] [<ffffffffa0520b4a>] xfs_error_report+0x5a/0x70 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.380174] [<ffffffffa0503294>] xfs_bmap_read_extents+0x2d4/0x3b0 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.380221] [<ffffffffa0529ef9>] xfs_iread_extents+0x99/0x130 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.380290] [<ffffffffa050860e>] xfs_bmapi+0x1ce/0x1320 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.380337] [<ffffffffa052ea9b>] xfs_iomap+0x12b/0x300 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.380407] [<ffffffffa054b50e>] __xfs_get_blocks+0x8e/0x230 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.380496] [<ffffffffa054b725>] xfs_get_blocks+0x25/0x40 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.380570] [<ffffffff81185bbe>] do_mpage_readpage+0x17e/0x700 Apr 19 12:11:20 triumph kernel: [ 4498.380582] [<ffffffff811862c3>] mpage_readpages+0xf3/0x150 Apr 19 12:11:20 triumph kernel: [ 4498.380608] [<ffffffffa054bf0b>] xfs_vm_readpages+0x2b/0x50 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.380683] [<ffffffff8110b203>] read_pages+0x43/0x110 Apr 19 12:11:20 triumph kernel: [ 4498.380696] [<ffffffff8110b6ab>] __do_page_cache_readahead+0x1bb/0x1f0 Apr 19 12:11:20 triumph kernel: [ 4498.380708] [<ffffffff8110b70f>] ra_submit+0x2f/0x50 Apr 19 12:11:20 triumph kernel: [ 4498.380720] [<ffffffff8110b95d>] ondemand_readahead+0x15d/0x310 Apr 19 12:11:20 triumph kernel: [ 4498.380733] [<ffffffff8110bbfd>] page_cache_sync_readahead+0x2d/0x50 Apr 19 12:11:20 triumph kernel: [ 4498.380745] [<ffffffff811001e6>] T.777+0x2b6/0x440 Apr 19 12:11:20 triumph kernel: [ 4498.380756] [<ffffffff81100436>] generic_file_aio_read+0xc6/0x1f0 Apr 19 12:11:20 triumph kernel: [ 4498.380783] [<ffffffffa0556515>] xfs_read+0x165/0x3c0 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.380879] [<ffffffffa0550d8e>] xfs_file_aio_read+0x6e/0x90 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.380958] [<ffffffff8114bea2>] do_sync_read+0x102/0x160 Apr 19 12:11:20 triumph kernel: [ 4498.380970] [<ffffffff8114c3d5>] vfs_read+0xd5/0x1c0 Apr 19 12:11:20 triumph kernel: [ 4498.380982] [<ffffffff8114cafb>] sys_read+0x5b/0xa0 Apr 19 12:11:20 triumph kernel: [ 4498.380993] [<ffffffff8100c682>] system_call_fastpath+0x16/0x1b Apr 19 12:11:20 triumph kernel: [ 4498.381015] [<00007fa7b6498a90>] 0x7fa7b6498a90 Apr 19 12:11:20 triumph kernel: [ 4498.381029] XFS internal error XFS_WANT_CORRUPTED_GOTO at line 4617 of file /usr/src/packages/BUILD/kernel-desktop-2.6.31.12/linux-2.6.31/fs/xfs/xfs_bmap.c. Caller 0xffffffffa0529ef9 Apr 19 12:11:20 triumph kernel: [ 4498.381048] Pid: 14997, comm: cp Not tainted 2.6.31.12-0.2-desktop #1 Apr 19 12:11:20 triumph kernel: [ 4498.381057] Call Trace: Apr 19 12:11:20 triumph kernel: [ 4498.381067] [<ffffffff81011a19>] try_stack_unwind+0x189/0x1b0 Apr 19 12:11:20 triumph kernel: [ 4498.381080] [<ffffffff8101025d>] dump_trace+0xad/0x3a0 Apr 19 12:11:20 triumph kernel: [ 4498.381093] [<ffffffff81011524>] show_trace_log_lvl+0x64/0x90 Apr 19 12:11:20 triumph kernel: [ 4498.381107] [<ffffffff81011573>] show_trace+0x23/0x40 Apr 19 12:11:20 triumph kernel: [ 4498.381119] [<ffffffff81552b46>] dump_stack+0x81/0x9e Apr 19 12:11:20 triumph kernel: [ 4498.381147] [<ffffffffa0520b4a>] xfs_error_report+0x5a/0x70 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.381207] [<ffffffffa0503294>] xfs_bmap_read_extents+0x2d4/0x3b0 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.381254] [<ffffffffa0529ef9>] xfs_iread_extents+0x99/0x130 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.381321] [<ffffffffa050860e>] xfs_bmapi+0x1ce/0x1320 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.381369] [<ffffffffa052ea9b>] xfs_iomap+0x12b/0x300 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.381439] [<ffffffffa054b50e>] __xfs_get_blocks+0x8e/0x230 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.381527] [<ffffffffa054b725>] xfs_get_blocks+0x25/0x40 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.381601] [<ffffffff8117cf0b>] block_read_full_page+0x1ab/0x410 Apr 19 12:11:20 triumph kernel: [ 4498.381614] [<ffffffff81185e48>] do_mpage_readpage+0x408/0x700 Apr 19 12:11:20 triumph kernel: [ 4498.381626] [<ffffffff811862c3>] mpage_readpages+0xf3/0x150 Apr 19 12:11:20 triumph kernel: [ 4498.381652] [<ffffffffa054bf0b>] xfs_vm_readpages+0x2b/0x50 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.381727] [<ffffffff8110b203>] read_pages+0x43/0x110 Apr 19 12:11:20 triumph kernel: [ 4498.381739] [<ffffffff8110b6ab>] __do_page_cache_readahead+0x1bb/0x1f0 Apr 19 12:11:20 triumph kernel: [ 4498.381752] [<ffffffff8110b70f>] ra_submit+0x2f/0x50 Apr 19 12:11:20 triumph kernel: [ 4498.381764] [<ffffffff8110b95d>] ondemand_readahead+0x15d/0x310 Apr 19 12:11:20 triumph kernel: [ 4498.381776] [<ffffffff8110bbfd>] page_cache_sync_readahead+0x2d/0x50 Apr 19 12:11:20 triumph kernel: [ 4498.381788] [<ffffffff811001e6>] T.777+0x2b6/0x440 Apr 19 12:11:20 triumph kernel: [ 4498.381800] [<ffffffff81100436>] generic_file_aio_read+0xc6/0x1f0 Apr 19 12:11:20 triumph kernel: [ 4498.381826] [<ffffffffa0556515>] xfs_read+0x165/0x3c0 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.381922] [<ffffffffa0550d8e>] xfs_file_aio_read+0x6e/0x90 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.382010] [<ffffffff8114bea2>] do_sync_read+0x102/0x160 Apr 19 12:11:20 triumph kernel: [ 4498.382023] [<ffffffff8114c3d5>] vfs_read+0xd5/0x1c0 Apr 19 12:11:20 triumph kernel: [ 4498.382036] [<ffffffff8114cafb>] sys_read+0x5b/0xa0 Apr 19 12:11:20 triumph kernel: [ 4498.382049] [<ffffffff8100c682>] system_call_fastpath+0x16/0x1b Apr 19 12:11:20 triumph kernel: [ 4498.382063] [<00007fa7b6498a90>] 0x7fa7b6498a90 Apr 19 12:11:20 triumph kernel: [ 4498.382079] XFS internal error XFS_WANT_CORRUPTED_GOTO at line 4617 of file /usr/src/packages/BUILD/kernel-desktop-2.6.31.12/linux-2.6.31/fs/xfs/xfs_bmap.c. Caller 0xffffffffa0529ef9 Apr 19 12:11:20 triumph kernel: [ 4498.382098] Pid: 14997, comm: cp Not tainted 2.6.31.12-0.2-desktop #1 Apr 19 12:11:20 triumph kernel: [ 4498.382108] Call Trace: Apr 19 12:11:20 triumph kernel: [ 4498.382119] [<ffffffff81011a19>] try_stack_unwind+0x189/0x1b0 Apr 19 12:11:20 triumph kernel: [ 4498.382132] [<ffffffff8101025d>] dump_trace+0xad/0x3a0 Apr 19 12:11:20 triumph kernel: [ 4498.382145] [<ffffffff81011524>] show_trace_log_lvl+0x64/0x90 Apr 19 12:11:20 triumph kernel: [ 4498.382158] [<ffffffff81011573>] show_trace+0x23/0x40 Apr 19 12:11:20 triumph kernel: [ 4498.382170] [<ffffffff81552b46>] dump_stack+0x81/0x9e Apr 19 12:11:20 triumph kernel: [ 4498.382198] [<ffffffffa0520b4a>] xfs_error_report+0x5a/0x70 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.382258] [<ffffffffa0503294>] xfs_bmap_read_extents+0x2d4/0x3b0 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.382305] [<ffffffffa0529ef9>] xfs_iread_extents+0x99/0x130 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.382372] [<ffffffffa050860e>] xfs_bmapi+0x1ce/0x1320 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.382420] [<ffffffffa052ea9b>] xfs_iomap+0x12b/0x300 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.382490] [<ffffffffa054b50e>] __xfs_get_blocks+0x8e/0x230 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.382578] [<ffffffffa054b725>] xfs_get_blocks+0x25/0x40 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.382652] [<ffffffff8117cf0b>] block_read_full_page+0x1ab/0x410 Apr 19 12:11:20 triumph kernel: [ 4498.382665] [<ffffffff81185e48>] do_mpage_readpage+0x408/0x700 Apr 19 12:11:20 triumph kernel: [ 4498.382677] [<ffffffff81186199>] mpage_readpage+0x59/0x90 Apr 19 12:11:20 triumph kernel: [ 4498.382703] [<ffffffffa054bfe6>] xfs_vm_readpage+0x26/0x50 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.382777] [<ffffffff8110003c>] T.777+0x10c/0x440 Apr 19 12:11:20 triumph kernel: [ 4498.382789] [<ffffffff81100436>] generic_file_aio_read+0xc6/0x1f0 Apr 19 12:11:20 triumph kernel: [ 4498.382816] [<ffffffffa0556515>] xfs_read+0x165/0x3c0 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.382913] [<ffffffffa0550d8e>] xfs_file_aio_read+0x6e/0x90 [xfs] Apr 19 12:11:20 triumph kernel: [ 4498.382992] [<ffffffff8114bea2>] do_sync_read+0x102/0x160 Apr 19 12:11:20 triumph kernel: [ 4498.383013] [<ffffffff8114c3d5>] vfs_read+0xd5/0x1c0 Apr 19 12:11:20 triumph kernel: [ 4498.383025] [<ffffffff8114cafb>] sys_read+0x5b/0xa0 Apr 19 12:11:20 triumph kernel: [ 4498.383038] [<ffffffff8100c682>] system_call_fastpath+0x16/0x1b Apr 19 12:11:20 triumph kernel: [ 4498.383052] [<00007fa7b6498a90>] 0x7fa7b6498a90 -- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Here is some more evidence that XFS is in play. When I had trouble with the machine I dumped (dd) the partition containing all data onto an external drive. Now when I try to restore the data in some directories I get read errors (not unexpected). When those read errors occur I get the following trace in the kernel log.

Apr 19 12:05:14 triumph kernel: [ 4132.476952] XFS internal error XFS_WANT_CORRUPTED_GOTO at line 4653 of file /usr/src/packages/BUILD/kernel-desktop-2.6.31.12/linux-2.6.31/fs/xfs/xfs_bmap.c. XFS driver complains that the filesystem is corrupted (extent tree block

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c20 Jan Kara changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |NEEDINFO InfoProvider| |rschweikert@novell.com --- Comment #20 from Jan Kara 2010-04-19 21:02:08 UTC --- (In reply to comment #18) pointers are bogus). Given that in the tainted kernel something is scribbling over your memory, it could be caused by that. So could you just install openSUSE 11.2 anew on the problematic desktop and avoid installing any proprietary video card driver - maybe installing a system without X Windows would be the best and see whether the corruption still happens? -- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c22 --- Comment #22 from Robert Schweikert 2010-04-20 11:56:32 UTC --- (In reply to comment #20)

...

Here is some more evidence that XFS is in play. When I had trouble with the machine I dumped (dd) the partition containing all data onto an external drive. Now when I try to restore the data in some directories I get read errors (not unexpected). When those read errors occur I get the following trace in the kernel log.

Apr 19 12:05:14 triumph kernel: [ 4132.476952] XFS internal error XFS_WANT_CORRUPTED_GOTO at line 4653 of file /usr/src/packages/BUILD/kernel-desktop-2.6.31.12/linux-2.6.31/fs/xfs/xfs_bmap.c. XFS driver complains that the filesystem is corrupted (extent tree block

(In reply to comment #18) pointers are bogus). Given that in the tainted kernel something is scribbling over your memory, it could be caused by that.

So could you just install openSUSE 11.2 anew on the problematic desktop and avoid installing any proprietary video card driver - maybe installing a system without X Windows would be the best and see whether the corruption still happens?

Installed openSUSE 11.2 again, this time I formatted the disk with ext4, we'll see how that works. Will report back. -- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c24 Robert Schweikert changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEEDINFO |NEW InfoProvider|rschweikert@novell.com | --- Comment #24 from Robert Schweikert 2010-05-03 11:28:38 UTC --- OK, yest another trace. There appears to be some inconsistency in the messages. First I can find: Not tainted 2.6.31.12-0.2-debug #1 and then at he end of the trace: Disabling lock debugging due to kernel taint I am confused. May 2 11:01:00 triumph kernel: [101098.211863] BUG: Bad page state in process mandb pfn:1c1640 May 2 11:01:00 triumph kernel: [101098.211888] page:ffffea0007059000 flags:0040000000000000 count:-775699968 mapcount:-43821 mapping:(null) index:ef320 May 2 11:01:00 triumph kernel: [101098.211900] Pid: 25227, comm: mandb Not tainted 2.6.31.12-0.2-debug #1 May 2 11:01:00 triumph kernel: [101098.211909] Call Trace: May 2 11:01:00 triumph kernel: [101098.211931] [<ffffffff810117a9>] try_stack_unwind+0x189/0x1b0 May 2 11:01:00 triumph kernel: [101098.211944] [<ffffffff810101bd>] dump_trace+0x9d/0x330 May 2 11:01:00 triumph kernel: [101098.211956] [<ffffffff810112b4>] show_trace_log_lvl+0x64/0x90 May 2 11:01:00 triumph kernel: [101098.211967] [<ffffffff81011303>] show_trace+0x23/0x40 May 2 11:01:00 triumph kernel: [101098.211979] [<ffffffff814d8eaa>] dump_stack+0x81/0x9e May 2 11:01:00 triumph kernel: [101098.212058] [<ffffffff8110f32b>] bad_page+0xeb/0x150 May 2 11:01:00 triumph kernel: [101098.212090] [<ffffffff811103db>] prep_new_page+0x3b/0x1c0 May 2 11:01:00 triumph kernel: [101098.212159] [<ffffffff811108ee>] get_page_from_freelist+0x38e/0x700 May 2 11:01:00 triumph kernel: [101098.212179] [<ffffffff81111362>] __alloc_pages_nodemask+0x112/0x230 May 2 11:01:00 triumph kernel: [101098.212223] [<ffffffff81146e50>] alloc_page_vma+0x80/0x120 May 2 11:01:00 triumph kernel: [101098.212270] [<ffffffff8112d0bc>] do_wp_page+0x1fc/0x860 May 2 11:01:00 triumph kernel: [101098.212283] [<ffffffff8112df0c>] handle_mm_fault+0x33c/0x430 May 2 11:01:00 triumph kernel: [101098.212295] [<ffffffff814dfe64>] do_page_fault+0x1a4/0x3c0 May 2 11:01:00 triumph kernel: [101098.212307] [<ffffffff814dcfb5>] page_fault+0x25/0x30 May 2 11:01:00 triumph kernel: [101098.212349] [<00007fb4ae0db781>] 0x7fb4ae0db781 May 2 11:01:00 triumph kernel: [101098.212358] Disabling lock debugging due to kernel taint So here is the list of loaded modules: Module Size Used by nfs 398264 0 fscache 52144 1 nfs joydev 14784 0 st 48460 0 ide_gd_mod 36720 0 ide_cd_mod 35920 0 xfs 851328 1 usb_storage 85760 0 deflate 4328 0 zlib_deflate 25016 1 deflate ctr 6376 0 twofish_x86_64 6440 0 twofish_common 15496 1 twofish_x86_64 camellia 20712 0 serpent 19848 0 blowfish 9064 0 cast5 16520 0 des_generic 18408 0 cbc 5096 0 cryptd 10576 0 crypto_wq 2064 1 cryptd aes_x86_64 9576 0 aes_generic 29128 1 aes_x86_64 xcbc 6768 0 rmd160 9352 0 sha256_generic 11624 0 sha1_generic 3144 0 md5 5128 0 hmac 5928 0 nfsd 355040 5 lockd 95472 2 nfs,nfsd nfs_acl 4072 2 nfs,nfsd cryptomgr 109424 0 aead 10632 1 cryptomgr snd_pcm_oss 59872 0 auth_rpcgss 56000 2 nfs,nfsd pcompress 3560 1 cryptomgr crypto_null 4776 0 snd_mixer_oss 22056 1 snd_pcm_oss crypto_blkcipher 17804 5 ctr,cbc,cryptd,cryptomgr,crypto_null sunrpc 266248 15 nfs,nfsd,lockd,nfs_acl,auth_rpcgss crypto_hash 17192 9 cryptd,xcbc,rmd160,sha256_generic,sha1_generic,md5,hmac,cryptomgr,crypto_null crypto_algapi 25584 20 deflate,ctr,twofish_x86_64,camellia,serpent,blowfish,cast5,des_generic,cbc,cryptd,aes_x86_64,aes_generic,xcbc,hmac,cryptomgr,aead,pcompress,crypto_null,crypto_blkcipher,crypto_hash snd_seq 78816 0 exportfs 6120 2 xfs,nfsd af_key 41364 2 edd 13168 0 ipv6 375904 42 bridge 74440 1 stp 3404 1 bridge llc 8720 2 bridge,stp fuse 87824 3 loop 22036 0 dm_mod 101064 4 snd_hda_codec_realtek 325260 1 snd_usb_audio 119104 1 snd_hda_intel 38304 4 snd_usb_lib 26600 1 snd_usb_audio uvcvideo 74452 0 snd_hda_codec 112968 2 snd_hda_codec_realtek,snd_hda_intel ohci1394 38532 0 snd_rawmidi 32512 1 snd_usb_lib videodev 46976 1 uvcvideo snd_pcm 119152 5 snd_pcm_oss,snd_usb_audio,snd_hda_intel,snd_hda_codec v4l1_compat 18380 2 uvcvideo,videodev snd_seq_device 10364 2 snd_seq,snd_rawmidi sr_mod 20420 0 v4l2_compat_ioctl32 15336 1 videodev snd_timer 31952 2 snd_seq,snd_pcm i2c_nforce2 9360 0 snd_hwdep 11600 2 snd_usb_audio,snd_hda_codec ieee1394 120992 1 ohci1394 cdrom 47912 2 ide_cd_mod,sr_mod kvm_intel 61832 0 snd_page_alloc 12440 2 snd_hda_intel,snd_pcm i2c_core 34536 2 videodev,i2c_nforce2 snd 96936 22 snd_pcm_oss,snd_mixer_oss,snd_seq,snd_hda_codec_realtek,snd_usb_audio,snd_hda_intel,snd_usb_lib,snd_hda_codec,snd_rawmidi,snd_pcm,snd_seq_device,snd_timer,snd_hwdep forcedeth 68660 0 thermal 25096 0 processor 56992 0 floppy 73992 0 kvm 237200 1 kvm_intel soundcore 11072 1 snd pcspkr 3720 0 button 8232 0 thermal_sys 21896 2 thermal,processor hwmon 4112 1 thermal_sys sg 40416 0 usbhid 62432 0 hid 87744 1 usbhid ohci_hcd 47820 0 ehci_hcd 69824 0 rtc_cmos 17340 0 rtc_core 27572 1 rtc_cmos rtc_lib 4072 1 rtc_core ext4 426872 1 crc16 2504 1 ext4 jbd2 122688 1 ext4 ide_pci_generic 5516 0 amd74xx 8112 0 ide_core 147904 4 ide_gd_mod,ide_cd_mod,ide_pci_generic,amd74xx aic7xxx 156476 0 sym53c8xx 96044 2 scsi_transport_spi 33864 2 aic7xxx,sym53c8xx pata_jmicron 4584 0 ata_generic 6540 0 sata_nv 32148 0 pata_amd 16780 0 After running without an oops for 8 days, only SATA drive installed formatted with ext4, I re-installed the 2 SCSI drives I have. The drives are formatted with XFS and collected in an LVM2 volume. I installed the drives on Saturday May 1, and as you can see it didn't take long for a kernel oops. The aic7xxx scsi diver is also loaded when the drives are not installed as it is the interface to the scanner. I think this narrows the search a bit. - driver for sym53c8xx - xfs code - LVM2 code -- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c26 --- Comment #26 from Robert Schweikert 2010-05-03 14:23:48 UTC --- (In reply to comment #25)

Thanks for testing Robert. It's again almost the same corruption pattern as in the message from Apr 17 01:18:35. BTW: The "Disabling lock debugging due to kernel taint" message is OK. BUG_ON also taints the kernel and so causes lock debugging to be turned off. Just for reference the beginning of the corrupted struct page as raw bytes is: 000000000000040000C2C3D1D354FFFF.

I agree with your analysis that this is either a bug in XFS or in sym53c8xx driver. Two things which would be worth trying to narrow this down a bit more: a) Try running with a 2.6.32 kernel (e.g. from SLE11 SP1) - you can get one from ftp://ftp.suse.com/pub/projects/kernel/kotd/SLE11-SP1/x86_64/. If the problem was already fixed we could try going through changelogs. b) Try formatting the SATA drive with XFS and run from it. That would narrow down whether the problem is in XFS or in the storage driver.

And one more question: Which older kernel worked fine for you (if there was some)?

The 11.1 kernel worked fine. I updated the system on a regular basis, thus I was running the latest patched kernel for openSUSE 11.1 Will try the SLES11-SP1 kernel next and report back. -- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c28 Jan Kara changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |NEEDINFO CC| |hare@novell.com InfoProvider| |rschweikert@novell.com --- Comment #28 from Jan Kara 2010-05-03 16:09:17 UTC --- Yeah, I'd also say that sym53c8xx is the most probable source of the corruption because XFS is much more used (and thus tested). Adding Hannes to CC just in case he is aware of some problems with sym53c8xx driver. We do compile ext4 with SLE11 SP1 kernel. Just it is in the kernel-extra package because it is unsupported. -- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c30 --- Comment #30 from Robert Schweikert 2010-05-06 15:51:21 UTC --- Not sure if these help, here is another trace triggered by umount. May 6 11:39:03 triumph kernel: [ 401.727681] kjournald starting. Commit interval 15 seconds May 6 11:39:03 triumph kernel: [ 401.727725] EXT3 FS on dm-1, internal journal May 6 11:39:03 triumph kernel: [ 401.727731] EXT3-fs: mounted filesystem with ordered data mode. May 6 11:42:12 triumph su: The gnome keyring socket is not owned with the same credentials as the user login: /tmp/keyring-GQ97JR/socket May 6 11:42:12 triumph su: gkr-pam: couldn't unlock 'login' keyring: 255 May 6 11:42:12 triumph su: (to root) rjschwei on /dev/pts/6 May 6 11:42:22 triumph kernel: [ 600.920080] INFO: task umount:14948 blocked for more than 120 seconds. May 6 11:42:22 triumph kernel: [ 600.920087] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 6 11:42:22 triumph kernel: [ 600.920093] umount D ffff88000a059a38 0 14948 5014 0x00000000 May 6 11:42:22 triumph kernel: [ 600.920100] ffff88022ed31d48 0000000000000086 ffff88022ed31ce8 ffff88019db66540 May 6 11:42:22 triumph kernel: [ 600.920107] 0000000000013c80 ffff88022ed31fd8 0000000000013c80 ffff88022ed31fd8 May 6 11:42:22 triumph kernel: [ 600.920113] 0000000000013c80 0000000000013c80 0000000000013c80 0000000000013c80 May 6 11:42:22 triumph kernel: [ 600.920120] Call Trace: May 6 11:42:22 triumph kernel: [ 600.920134] [<ffffffff8118099e>] bdi_sched_wait+0xe/0x20 May 6 11:42:22 triumph kernel: [ 600.920142] [<ffffffff81432112>] __wait_on_bit+0x62/0x90 May 6 11:42:22 triumph kernel: [ 600.920149] [<ffffffff814321b9>] out_of_line_wait_on_bit+0x79/0x90 May 6 11:42:22 triumph kernel: [ 600.920155] [<ffffffff81180b31>] sync_inodes_sb+0x81/0xa0 May 6 11:42:22 triumph kernel: [ 600.920161] [<ffffffff811862a2>] __sync_filesystem+0x82/0x90 May 6 11:42:22 triumph kernel: [ 600.920167] [<ffffffff811864ab>] sync_filesystem+0x4b/0x70 May 6 11:42:22 triumph kernel: [ 600.920173] [<ffffffff8115bb87>] generic_shutdown_super+0x27/0x100 May 6 11:42:22 triumph kernel: [ 600.920180] [<ffffffff8115bc91>] kill_block_super+0x31/0x50 May 6 11:42:22 triumph kernel: [ 600.920185] [<ffffffff8115c565>] deactivate_super+0x85/0xa0 May 6 11:42:22 triumph kernel: [ 600.920192] [<ffffffff8117923a>] mntput_no_expire+0xca/0x110 May 6 11:42:22 triumph kernel: [ 600.920198] [<ffffffff81179918>] sys_umount+0x58/0xc0 May 6 11:42:22 triumph kernel: [ 600.920205] [<ffffffff810032ab>] system_call_fastpath+0x16/0x1b May 6 11:42:22 triumph kernel: [ 600.920233] [<00007f3cf7c5fed7>] 0x7f3cf7c5fed7 May 6 11:44:22 triumph kernel: [ 720.920067] INFO: task umount:14948 blocked for more than 120 seconds. May 6 11:44:22 triumph kernel: [ 720.920072] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. May 6 11:44:22 triumph kernel: [ 720.920077] umount D ffff88000a059a38 0 14948 5014 0x00000000 May 6 11:44:22 triumph kernel: [ 720.920083] ffff88022ed31d48 0000000000000086 ffff88022ed31ce8 ffff88019db66540 May 6 11:44:22 triumph kernel: [ 720.920089] 0000000000013c80 ffff88022ed31fd8 0000000000013c80 ffff88022ed31fd8 May 6 11:44:22 triumph kernel: [ 720.920095] 0000000000013c80 0000000000013c80 0000000000013c80 0000000000013c80 May 6 11:44:22 triumph kernel: [ 720.920100] Call Trace: May 6 11:44:22 triumph kernel: [ 720.920113] [<ffffffff8118099e>] bdi_sched_wait+0xe/0x20 May 6 11:44:22 triumph kernel: [ 720.920120] [<ffffffff81432112>] __wait_on_bit+0x62/0x90 May 6 11:44:22 triumph kernel: [ 720.920126] [<ffffffff814321b9>] out_of_line_wait_on_bit+0x79/0x90 May 6 11:44:22 triumph kernel: [ 720.920131] [<ffffffff81180b31>] sync_inodes_sb+0x81/0xa0 May 6 11:44:22 triumph kernel: [ 720.920137] [<ffffffff811862a2>] __sync_filesystem+0x82/0x90 May 6 11:44:22 triumph kernel: [ 720.920142] [<ffffffff811864ab>] sync_filesystem+0x4b/0x70 May 6 11:44:22 triumph kernel: [ 720.920148] [<ffffffff8115bb87>] generic_shutdown_super+0x27/0x100 May 6 11:44:22 triumph kernel: [ 720.920153] [<ffffffff8115bc91>] kill_block_super+0x31/0x50 May 6 11:44:22 triumph kernel: [ 720.920158] [<ffffffff8115c565>] deactivate_super+0x85/0xa0 May 6 11:44:22 triumph kernel: [ 720.920163] [<ffffffff8117923a>] mntput_no_expire+0xca/0x110 May 6 11:44:22 triumph kernel: [ 720.920169] [<ffffffff81179918>] sys_umount+0x58/0xc0 May 6 11:44:22 triumph kernel: [ 720.920175] [<ffffffff810032ab>] system_call_fastpath+0x16/0x1b May 6 11:44:22 triumph kernel: [ 720.920197] [<00007f3cf7c5fed7>] 0x7f3cf7c5fed7 -- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c32 --- Comment #32 from Jan Kara 2010-05-06 18:35:59 UTC --- These messages from umount are unlikely to be related and basically they just say we wait for writing data on umount for more than 2 minutes (older kernels did writeback on umount differently so kernel didn't issue such messages). To your memory corruption: I've looked again at all your kernel oopses. What we can infer is that it's not a normal use-after-free or write-beyond-end corruption because struct page is corrupted. Space for these structures is allocated during boot as a continguous array of pages. So nothing ever gets allocated in this area. OTOH we see that at least once, XFS in-memory inode has been corrupted so the corruption is not limited to the area where page structures reside. I'm slightly out of ideas how to debug this (besides bisecting kernel versions upto the change which breaks your system which would be rather time consuming). Before we go down this slow road, I've built a special debug kernel with more strict memory checking enabled - unallocated pages are marked read-only, mmio debugging enabled, etc (these checks aren't enabled in our standard -debug kernel because they make the machine considerably slower). Maybe we'll be lucky and the bad code will write to some protected area. The kernel is at beta.suse.com/private/jack/566288/. Could you please try it? -- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c36 --- Comment #36 from Robert Schweikert 2010-05-07 16:42:58 UTC --- Got it. Running now. I am traveling next week. Will report back when something interesting happens. Thanks -- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c38 --- Comment #38 from Jan Kara 2010-05-10 06:37:15 UTC --- Robert, this is the same trace as in comments 30 and 31 and is basically harmless. There's no sign of corruption in this trace so please keep testing the provided kernel. You can do "echo 0

/proc/sys/kernel/hung_task_timeout_secs" to disable the above warning to not disturb you.

-- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c40 --- Comment #40 from Robert Schweikert 2010-05-15 10:19:01 UTC --- No traceback, but the system hung over night. At some point after my backup process started the system dropped into never never land. Here is a snippet from the syslog: May 15 00:45:33 triumph rsyslogd: -- MARK -- May 15 01:05:33 triumph rsyslogd: -- MARK -- May 15 01:12:01 triumph /usr/sbin/cron[10659]: (root) CMD (/usr/local/bin/simBackup --verbose) May 15 06:07:40 triumph kernel: imklog 4.4.1, log source = /proc/kmsg started. May 15 06:07:40 triumph rsyslogd: [origin software="rsyslogd" swVersion="4.4.1" x-pid="1917" x-info="http://www.rsyslog.com"] (re)start At 1:12 my backup script started and then at some point the system hung. At 6:07 is the reboot. I take it that instead of a corruption and traceback the protection of memory in this kernel now triggers a hang. What else can I do? -- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

No traceback, but the system hung over night. .. I take it that instead of a corruption and traceback the protection of memory in this kernel now triggers a hang.

What else can I do? That would be a good sign (that we manage to catch the corruption earlier). Any chance of setting up a serial console or having a look at VGA console so

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c42 --- Comment #42 from Jan Kara 2010-05-17 17:04:53 UTC --- (In reply to comment #40) that we can see whether something is written there before the machine hangs? -- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c44 --- Comment #44 from Jan Kara 2010-05-24 12:22:43 UTC --- Are you able to switch terminals on the screen? The easiest is to check whether there's not something on the screen of the machine (or actually on syslog terminal SUSE has - tty10). If you're unable to switch terminals while the machine is hung, you can try switching to console 10 before trying to reproduce the hang. Other alternatives are using USB<->serial convertors or netconsole (see Documentation/networking/netconsole.txt in the kernel sources). BTW: This is very likely a different problem so it would make sense to create a separate bug for it. But we can wait a bit until you find out something about why the machine has hung. -- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c46 --- Comment #46 from Robert Schweikert 2010-05-24 13:29:10 UTC --- (In reply to comment #45)

(In reply to comment #44)

...

Are you able to switch terminals on the screen?

No, I cannot. The machine is in neverland when it hangs, i.e. no keyboard, or mouse action possible. I cannot ping the machine either.

...

The easiest is to check whether there's not something on the screen of the machine (or actually on syslog terminal SUSE has - tty10). If you're unable to switch terminals while the machine is hung, you can try switching to console 10 before trying to reproduce the hang.

Other alternatives are using USB<->serial convertors or netconsole (see Documentation/networking/netconsole.txt in the kernel sources).

Still running the 2.6.32.12-0.4-debug kernel you provided, with the extra package installed as wel to gain ext4 support. However, there's no netconsole module for this kernel, is it built in or not built at all?

...

BTW: This is very likely a different problem so it would make sense to create a separate bug for it. But we can wait a bit until you find out something about why the machine has hung.

-- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c48 --- Comment #48 from Robert Schweikert 2010-05-24 17:36:17 UTC --- Yes, found it now, but I cannot insmod it. # insmod netconsole netconsole=@/,@192.168.1.5/ insmod: can't read 'netconsole': No such file or directory # uname -a Linux triumph 2.6.32.12-0.4-debug #1 SMP 2010-05-06 15:28:06 +0200 x86_64 x86_64 x86_64 GNU/Linux # ls /lib/modules/2.6.32.12-0.4-debug/kernel/drivers/net/netc* /lib/modules/2.6.32.12-0.4-debug/kernel/drivers/net/netconsole.ko -- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c50 --- Comment #50 from Robert Schweikert 2010-05-25 18:51:56 UTC --- Thanks, looks like something is still not right. # insmod /lib/modules/2.6.32.12-0.4-debug/kernel/drivers/net/netconsole.ko netconsole=@/,@192.168.1.5/ insmod: error inserting '/lib/modules/2.6.32.12-0.4-debug/kernel/drivers/net/netconsole.ko': -1 Unknown symbol in module modprobe does not behave either # modprobe netconsole netconsole="@/,@192.168.1.5/" WARNING: All config files need .conf: /etc/modprobe.d/generic_serial-blacklist, it will be ignored in a future release. FATAL: Error inserting netconsole (/lib/modules/2.6.32.12-0.4-debug/kernel/drivers/net/netconsole.ko): Destination address required # modprobe netconsole netconsole="@/,@192.168.1.5/00:1B:77:46:2E:F7" WARNING: All config files need .conf: /etc/modprobe.d/generic_serial-blacklist, it will be ignored in a future release. FATAL: Error inserting netconsole (/lib/modules/2.6.32.12-0.4-debug/kernel/drivers/net/netconsole.ko): Destination address required The machine is reachable:

ping -c1 192.168.1.5 PING 192.168.1.5 (192.168.1.5) 56(84) bytes of data. 64 bytes from 192.168.1.5: icmp_seq=1 ttl=64 time=0.669 ms

-- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c52 --- Comment #52 from Robert Schweikert 2010-05-26 13:54:13 UTC --- (In reply to comment #51)

That is strange. For me your command line works just fine. Can you strace the failing modprobe and see with what arguments is init_module function called?

mmap(NULL, 24832, PROT_READ|PROT_WRITE, MAP_PRIVATE, 3, 0) = 0x7fa9bdc9b000 init_module(0x7fa9bdc9b000, 24832, "netconsole=@/,@192.168.1.5/") = -1 EDESTADDRREQ (Destination address required) Could this be related to my network being setup as a bridge, i.e. I have br0 bound to eth1 -- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c54 --- Comment #54 from Robert Schweikert 2010-05-26 14:32:18 UTC --- (In reply to comment #53)

Ah, you have a bridge, that explains it. If you do not want to use eth0 as an interface you send UDP packets from, you have to explicitely state it in the netconsole argument. I.e., in your case you should have something like netconsole=@/br0,@192.168.1.5/

duh looked at the docs for netconsole a few times and it still didn't sink in. -- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c56 --- Comment #56 from Jan Kara 2010-05-26 15:02:57 UTC --- You should get more information about the error in the kernel log... In this case I'd guess that br0 doesn't support some functionality netconsole needs so maybe try using eth1? -- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

http://bugzilla.novell.com/show_bug.cgi?id=566288 http://bugzilla.novell.com/show_bug.cgi?id=566288#c58 --- Comment #58 from Jan Kara 2010-05-26 20:56:31 UTC --- I've checked and indeed netpoll isn't supported for bridge interfaces so you cannot use netconsole over bridge and obviously it doesn't work when the interface is part of a bridge either. So you either have to change the network setup to get rid of the bridge, or add a new network card and use netconsole over it, or you can resort to USB-serial convertors... -- Configure bugmail: http://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.