https://bugzilla.novell.com/show_bug.cgi?id=400772 User pavel@novell.com added comment https://bugzilla.novell.com/show_bug.cgi?id=400772#c2 --- Comment #2 from Pavel Machek 2008-06-19 03:37:59 MDT --- Jack did the analysis of corrupted filesystem, and it seems that 4K directory block was overwritten by garbage (random-looking). -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=400772 User pavel@novell.com added comment https://bugzilla.novell.com/show_bug.cgi?id=400772#c4 --- Comment #4 from Pavel Machek 2008-06-19 16:24:45 MDT --- There was nothing suspect in the syslog: ext3 corruption detected by htree code was first sign of problems. There were no scary MCEs around. I'll check the ECC on memory (that should be visible in BIOS, right?), but corruption was not consistent with anything ECC would prevent -- we had 4K of random data, not few bits flipped. Older warthogs were unstable in similar way (jet was machine pmladek was using), but I guess we can ask pmladek to use cuk for a while. gek is where latest incident happened. It will take a while -- we can't make it corrupt data on demand :-(. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=400772 User pavel@novell.com added comment https://bugzilla.novell.com/show_bug.cgi?id=400772#c7 --- Comment #7 from Pavel Machek 2008-06-20 02:49:27 MDT --- Created an attachment (id=223303) --> (https://bugzilla.novell.com/attachment.cgi?id=223303) /var/log/messages from gek -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=400772 User pavel@novell.com added comment https://bugzilla.novell.com/show_bug.cgi?id=400772#c9 Pavel Machek changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEEDINFO |ASSIGNED Info Provider|pavel@novell.com | --- Comment #9 from Pavel Machek 2008-06-20 03:04:12 MDT --- ECC was disabled on gek... (I guess that has to be BIOS default, because we did BIOS update yesterday... hmm, but that means that logs I posted are from older BIOS.) I set ECC Mode to "max", lets see what happens. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=400772 User pmladek@novell.com added comment https://bugzilla.novell.com/show_bug.cgi?id=400772#c11 --- Comment #11 from Petr Mladek 2008-06-20 06:06:39 MDT --- Created an attachment (id=223375) --> (https://bugzilla.novell.com/attachment.cgi?id=223375) broken files The machine just did another data corruption. The attached archive includes the broken files from gek, see + zcodec/zcodec.broken/makefile.mk + zcodec/zcodec.broken/zcodec.cxx It also includes the correct files, see + zcodec/zcodec.good/makefile.mk + zcodec/zcodec.good/zcodec.cxx These were just unpacked OpenOffice.org source files. The build based on the same source files succeeded on two other machines. I do not see anything in dmesg. It was still the same machine. If Pavel agreed, I would start using the second similar machine the following week. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=400772 User pavel@novell.com added comment https://bugzilla.novell.com/show_bug.cgi?id=400772#c13 --- Comment #13 from Pavel Machek 2008-06-23 02:06:16 MDT --- cuk goes to pmladek for testing -- it is useless to me without bigger BIOS chip, anyway. We moved the harddrive; on the next boot in cuk, fsck found some problems. I'll have more details in few hours. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=400772 User pavel@novell.com added comment https://bugzilla.novell.com/show_bug.cgi?id=400772#c15 --- Comment #15 from Pavel Machek 2008-06-23 02:45:47 MDT --- (/dev/sda6 was actually marked clean) /dev/sda1 was marked as containing errors. Indirect blocks from dvb/ttpci/budget-ci.ko contain garbage. ..that means we got write to somewhere else going into budget-ci.ko's indirect blcoks, because there is no reason why .ko should be changing. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.