https://bugzilla.novell.com/show_bug.cgi?id=711818 https://bugzilla.novell.com/show_bug.cgi?id=711818#c0 Summary: XFS crashes taking filesystem offline on xfs_fsr Classification: openSUSE Product: openSUSE 11.4 Version: Final Platform: x86-64 OS/Version: openSUSE 11.4 Status: NEW Severity: Major Priority: P5 - None Component: Kernel AssignedTo: kernel-maintainers@forge.provo.novell.com ReportedBy: brian.holt@sagebase.org QAContact: qa@suse.de Found By: --- Blocker: --- User-Agent: Mozilla/5.0 (Windows NT 6.1) AppleWebKit/535.1 (KHTML, like Gecko) Chrome/13.0.782.112 Safari/535.1 On a storage server with a large 33 TB raid filesystem on a Areca RAID Controller4, doing a xfs_fsr on the filesystem causes a kernel oops taking the filesystem offline permanently until reboot. This behavior only started happening after upgrading from 11.3 to 11.4. Kernel Uname: Linux ravenna 2.6.37.6-0.7-desktop #1 SMP PREEMPT 2011-07-21 02:17:24 +0200 x86_64 x86_64 x86_64 GNU/Linux Messages log from crash included in results. Reproducible: Always Steps to Reproduce: 1. Execute a xfs_fsr on an opensuse 11.4 x86_64 opensuse system Actual Results: Aug 11 00:15:21 ravenna fsr[11408]: xfs_fsr -m /proc/mounts -t 21600 -f /var/tmp/.fsrlast_xfs ... Aug 11 00:15:21 ravenna fsr[11409]: /gluster start inode=0 Aug 11 00:15:21 ravenna kernel: [53209.569036] xfs_iunlink_remove: xfs_inotobp() returned an error 22 on sdb1. Returning error. Aug 11 00:15:21 ravenna kernel: [53209.569042] xfs_inactive: xfs_ifree() returned an error = 22 on sdb1 Aug 11 00:15:21 ravenna kernel: [53209.569048] xfs_force_shutdown(sdb1,0x1) called from line 1176 of file /usr/src/packages/BUILD/kernel-desktop-2.6.37.6/linux-2.6.37/fs/xfs/xfs_vnodeops.c. Return address = 0xffffffffa048e802 Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag0: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag1: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag2: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag3: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag4: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag5: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag6: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag7: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag8: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag9: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag10: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag11: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag12: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag13: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag14: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag15: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag16: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag17: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag18: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag19: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag20: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag21: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag22: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag23: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag24: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag25: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag26: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag27: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag28: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag29: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr/ag30: Input/output error Aug 11 00:15:21 ravenna fsr[11409]: could not remove tmpdir: /gluster/.fsr: Input/output error Aug 11 00:15:21 ravenna fsr[11410]: /gluster start inode=0 Aug 11 00:15:21 ravenna kernel: [53209.574885] Filesystem "sdb1": I/O Error Detected. Shutting down filesystem: sdb1 Aug 11 00:15:21 ravenna kernel: [53209.574888] Please umount the filesystem, and rectify the problem(s) Aug 11 00:15:21 ravenna kernel: [53209.574900] Filesystem "sdb1": xfs_imap: xfs_ialloc_read_agi() returned error 5, agno 0 Aug 11 00:15:21 ravenna fsr[11410]: unable to get handle: /gluster: Bad file descriptor Aug 11 00:15:21 ravenna fsr[11411]: /gluster start inode=0 Aug 11 00:15:21 ravenna fsr[11411]: unable to get handle: /gluster: Bad file descriptor Aug 11 00:15:21 ravenna fsr[11412]: /gluster start inode=0 Aug 11 00:15:21 ravenna fsr[11412]: unable to get handle: /gluster: Bad file descriptor Aug 11 00:15:21 ravenna fsr[11410]: unable to get handle: /gluster: Bad file descriptor Aug 11 00:15:21 ravenna fsr[11411]: /gluster start inode=0 Aug 11 00:15:21 ravenna fsr[11411]: unable to get handle: /gluster: Bad file descriptor Aug 11 00:15:21 ravenna fsr[11412]: /gluster start inode=0 Aug 11 00:15:21 ravenna fsr[11412]: unable to get handle: /gluster: Bad file descriptor Aug 11 00:15:21 ravenna fsr[11413]: /gluster start inode=0 Aug 11 00:15:21 ravenna fsr[11413]: unable to get handle: /gluster: Bad file descriptor Aug 11 00:15:21 ravenna fsr[11414]: /gluster start inode=0 Aug 11 00:15:21 ravenna fsr[11414]: unable to get handle: /gluster: Bad file descriptor Aug 11 00:15:21 ravenna fsr[11415]: /gluster start inode=0 Aug 11 00:15:21 ravenna fsr[11415]: unable to get handle: /gluster: Bad file descriptor Aug 11 00:15:21 ravenna fsr[11416]: /gluster start inode=0 Aug 11 00:15:21 ravenna fsr[11416]: unable to get handle: /gluster: Bad file descriptor Aug 11 00:15:21 ravenna fsr[11417]: /gluster start inode=0 Aug 11 00:15:21 ravenna fsr[11417]: unable to get handle: /gluster: Bad file descriptor Aug 11 00:15:21 ravenna fsr[11418]: /gluster start inode=0 Aug 11 00:15:21 ravenna fsr[11418]: unable to get handle: /gluster: Bad file descriptor Aug 11 00:15:21 ravenna fsr[11408]: Completed all 10 passes Aug 11 00:15:21 ravenna fsr[11408]: open(/var/tmp/.fsrlast_xfs) failed: File exists Expected Results: Should execute cleanly after a few minutes. Although the filesystem listed above is mounted on /gluster, we're not actually running gluster right now. The filesystem is exported via nfs4. Xfs_db returns cleanly: ravenna:/var/log # xfs_db -r /dev/sdb1 -c frag actual 9142751, ideal 9093349, fragmentation factor 0.54% -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.