[Bug 1186726] New: XFS: Metadata corruption detected at __xfs_buf_mark_corrupt
https://bugzilla.suse.com/show_bug.cgi?id=1186726 Bug ID: 1186726 Summary: XFS: Metadata corruption detected at __xfs_buf_mark_corrupt Classification: openSUSE Product: openSUSE Distribution Version: Leap 15.2 Hardware: Other OS: Other Status: NEW Severity: Normal Priority: P5 - None Component: Kernel Assignee: kernel-bugs@opensuse.org Reporter: martin.wilck@suse.com QA Contact: qa-bugs@suse.de Found By: --- Blocker: --- XFS ended up corrupted after the BUG reported in bug 1186724. kernel 5.3.18-lp152.66-default. This system uses ecryptfs home on to of XFS. XFS started logging errors ~25s after the BUG message (full log in https://bugzilla.suse.com/attachment.cgi?id=849866) This happend on April 1, 2021.
[362091.622962] artemis.mittagstun.de kernel: XFS (dm-0): xlog_space_left: head behind tail [362091.622973] artemis.mittagstun.de kernel: XFS (dm-0): tail_cycle = 2348, tail_bytes = 1957888 [362091.622978] artemis.mittagstun.de kernel: XFS (dm-0): GH cycle = 2348, GH bytes = 1933664 [362091.622982] artemis.mittagstun.de kernel: XFS (dm-0): xlog_space_left: head behind tail [362091.622987] artemis.mittagstun.de kernel: XFS (dm-0): tail_cycle = 2348, tail_bytes = 1957888 [362091.622991] artemis.mittagstun.de kernel: XFS (dm-0): GH cycle = 2348, GH bytes = 1933664 [362091.623082] artemis.mittagstun.de kernel: XFS (dm-0): xlog_space_left: head behind tail [362091.623087] artemis.mittagstun.de kernel: XFS (dm-0): tail_cycle = 2348, tail_bytes = 1957888 [362091.623092] artemis.mittagstun.de kernel: XFS (dm-0): GH cycle = 2348, GH bytes = 1944348 [362091.623096] artemis.mittagstun.de kernel: XFS (dm-0): xlog_space_left: head behind tail
Eventually the system rebooted.
[ 15.884313] artemis kernel: SGI XFS with ACLs, security attributes, no debug enabled [ 15.905008] artemis kernel: audit: type=1400 audit(1617303345.346:6): apparmor="STATUS" operation="profile_load" profile="unconfined" name="klogd" pid=1028 comm="apparmor_parser" [ 15.905832] artemis kernel: XFS (dm-1): Mounting V4 Filesystem [ 15.989685] artemis kernel: XFS (dm-0): Mounting V4 Filesystem [ 16.293642] artemis kernel: XFS (dm-1): Starting recovery (logdev: internal) [ 16.402584] artemis kernel: XFS (dm-1): Ending recovery (logdev: internal) [ 16.408717] artemis kernel: XFS (dm-0): Starting recovery (logdev: internal) [ 17.015270] artemis kernel: XFS (dm-0): Ending recovery (logdev: internal)
After I logged in and ecryptfs was mounted, I saw the issue
[ 349.629100] artemis.mittagstun.de kernel: XFS (dm-0): Metadata corruption detected at __xfs_buf_mark_corrupt+0xe/0x20 [xfs], xfs_agi block 0x1900010 [ 349.629102] artemis.mittagstun.de kernel: XFS (dm-0): Unmount and run xfs_repair [ 349.629156] artemis.mittagstun.de kernel: XFS (dm-0): Internal error xfs_trans_cancel at line 1073 of file ../fs/xfs/xfs_trans.c. Caller xfs_remove+0x19e/0x2d0 [xfs] [ 349.629160] artemis.mittagstun.de kernel: CPU: 2 PID: 2951 Comm: gvfsd-metadata Not tainted 5.3.18-lp152.66-default #1 openSUSE Leap 15.2 [ 349.629161] artemis.mittagstun.de kernel: Hardware name: FUJITSU LIFEBOOK S904/FJNB272, BIOS Version 1.20 07/25/2014 [ 349.629161] artemis.mittagstun.de kernel: Call Trace: [ 349.629169] artemis.mittagstun.de kernel: dump_stack+0x66/0x8b [ 349.629222] artemis.mittagstun.de kernel: xfs_trans_cancel+0x12a/0x150 [xfs] [ 349.629272] artemis.mittagstun.de kernel: xfs_remove+0x19e/0x2d0 [xfs] [ 349.629320] artemis.mittagstun.de kernel: xfs_vn_unlink+0x55/0xa0 [xfs] [ 349.629325] artemis.mittagstun.de kernel: ? may_delete+0x79/0x180 [ 349.629327] artemis.mittagstun.de kernel: vfs_unlink+0x106/0x1f0 [ 349.629335] artemis.mittagstun.de kernel: ecryptfs_do_unlink+0x7d/0x170 [ecryptfs] [ 349.629338] artemis.mittagstun.de kernel: vfs_unlink+0x106/0x1f0 [ 349.629341] artemis.mittagstun.de kernel: do_unlinkat+0x2ba/0x320 [ 349.629346] artemis.mittagstun.de kernel: do_syscall_64+0x65/0x1f0 [ 349.629350] artemis.mittagstun.de kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9 [ 349.629353] artemis.mittagstun.de kernel: RIP: 0033:0x7f61067f7cf7 [ 349.629355] artemis.mittagstun.de kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 9e 51 2c 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 b8 57 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 71 51 2c 00 f7 d8 64 89 01 48 [ 349.629357] artemis.mittagstun.de kernel: RSP: 002b:00007ffebcac3d98 EFLAGS: 00000202 ORIG_RAX: 0000000000000057 [ 349.629359] artemis.mittagstun.de kernel: RAX: ffffffffffffffda RBX: 00005653c129df60 RCX: 00007f61067f7cf7 [ 349.629361] artemis.mittagstun.de kernel: RDX: 0000000000000028 RSI: 0000000000000000 RDI: 00005653c181bc40 [ 349.629362] artemis.mittagstun.de kernel: RBP: 00005653c181bc40 R08: 0000000000000000 R09: 0000000000000000 [ 349.629363] artemis.mittagstun.de kernel: R10: 0000000000000001 R11: 0000000000000202 R12: 00000000682f2784 [ 349.629364] artemis.mittagstun.de kernel: R13: 00005653c181b400 R14: 00005653c180e320 R15: 00005653c12962a0 [ 349.629372] artemis.mittagstun.de kernel: XFS (dm-0): xfs_do_force_shutdown(0x8) called from line 1074 of file ../fs/xfs/xfs_trans.c. Return address = 00000000f0fbc3d0 [ 349.629373] artemis.mittagstun.de kernel: XFS (dm-0): Corruption of in-memory data detected. Shutting down filesystem [ 349.629374] artemis.mittagstun.de kernel: XFS (dm-0): Please unmount the filesystem and rectify the problem(s) [ 349.629382] artemis.mittagstun.de kernel: Error in vfs_unlink; rc = [-117] [ 349.629554] artemis.mittagstun.de kernel: Error opening lower file for lower_dentry [0x000000005209f793] and lower_mnt [0x0000000047a76273]; rc = [-5] [ 349.629556] artemis.mittagstun.de kernel: ecryptfs_open: Error attempting to initialize the lower file for the dentry with name [root]; rc = [-5] [ 349.629845] artemis.mittagstun.de kernel: Error opening lower file for lower_dentry [0x000000005209f793] and lower_mnt [0x0000000047a76273]; rc = [-5] [ 349.629847] artemis.mittagstun.de kernel: ecryptfs_open: Error attempting to initialize the lower file for the dentry with name [root]; rc = [-5] [ 350.052544] artemis.mittagstun.de unknown[2951]: meta_tree_flush_locked: tree->root == NULL, possible data loss corrupted file was moved to: /home/martin/.local/share/gvfs-metadata/root.backup.2021-04-01T19:01:19.071895Z (please make a comment on https://bugzilla.gnome.org/show_bug.cgi?id=598561 and attach the corrupted file) [ 350.059894] artemis.mittagstun.de gvfsd-metadata[2951]: ** [ 350.059894] artemis.mittagstun.de gvfsd-metadata[2951]: GVFS:ERROR:../metadata/metatree.c:2419:meta_tree_flush_locked: assertion failed: (res) [ 350.059894] artemis.mittagstun.de gvfsd-metadata[2951]: Bail out! GVFS:ERROR:../metadata/metatree.c:2419:meta_tree_flush_locked: assertion failed: (res)
Unfortunately, I didn't realize this corruption immediately, and thus didn't run xfs_repair at the first opportunity as I should have. The system appeared to work fine after the next reboot. Late issues have made me realize, though, that XFS issues had persisted until the present day. -- You are receiving this mail because: You are the assignee for the bug.
https://bugzilla.suse.com/show_bug.cgi?id=1186726
https://bugzilla.suse.com/show_bug.cgi?id=1186726#c1
--- Comment #1 from Martin Wilck
[49717.950150] artemis.mittagstun.de kernel: XFS (dm-0): Internal error XFS_WANT_CORRUPTED_RETURN at line 442 of file ../fs/xfs/libxfs/xfs_alloc.c. Caller xfs_alloc_ag> [49717.950154] artemis.mittagstun.de kernel: CPU: 3 PID: 9934 Comm: vi Not tainted 5.3.18-lp152.69-default #1 openSUSE Leap 15.2 [49717.950155] artemis.mittagstun.de kernel: Hardware name: FUJITSU LIFEBOOK S904/FJNB272, BIOS Version 1.20 07/25/2014 [49717.950156] artemis.mittagstun.de kernel: Call Trace: [49717.950165] artemis.mittagstun.de kernel: dump_stack+0x66/0x8b [49717.950195] artemis.mittagstun.de kernel: xfs_alloc_fixup_trees+0x263/0x390 [xfs] [49717.950225] artemis.mittagstun.de kernel: xfs_alloc_ag_vextent_near+0x8b7/0xb20 [xfs] [49717.950255] artemis.mittagstun.de kernel: xfs_alloc_ag_vextent+0x140/0x150 [xfs] [49717.950284] artemis.mittagstun.de kernel: xfs_alloc_vextent+0x3f3/0x560 [xfs] [49717.950315] artemis.mittagstun.de kernel: xfs_bmap_btalloc+0x2f1/0x8d0 [xfs] [49717.950348] artemis.mittagstun.de kernel: xfs_bmapi_allocate+0x106/0x2c0 [xfs] [49717.950386] artemis.mittagstun.de kernel: xfs_bmapi_convert_delalloc+0x289/0x4b0 [xfs] [49717.950428] artemis.mittagstun.de kernel: xfs_map_blocks+0x15d/0x3f0 [xfs] [49717.950479] artemis.mittagstun.de kernel: xfs_do_writepage+0x10c/0x400 [xfs] [49717.950483] artemis.mittagstun.de kernel: write_cache_pages+0x16b/0x400 [49717.950515] artemis.mittagstun.de kernel: ? xfs_vm_writepages+0xa0/0xa0 [xfs] [49717.950521] artemis.mittagstun.de kernel: ? ecryptfs_write_inode_size_to_metadata+0x6b/0x190 [ecryptfs] [49717.950558] artemis.mittagstun.de kernel: xfs_vm_writepages+0x64/0xa0 [xfs] [49717.950561] artemis.mittagstun.de kernel: do_writepages+0x4b/0xe0 [49717.950564] artemis.mittagstun.de kernel: ? __filemap_fdatawrite_range+0xcb/0x100 [49717.950566] artemis.mittagstun.de kernel: __filemap_fdatawrite_range+0xcb/0x100 [49717.950568] artemis.mittagstun.de kernel: file_write_and_wait_range+0x5e/0xb0 [49717.950609] artemis.mittagstun.de kernel: xfs_file_fsync+0x5d/0x1d0 [xfs] [49717.950616] artemis.mittagstun.de kernel: do_fsync+0x38/0x60 [49717.950619] artemis.mittagstun.de kernel: __x64_sys_fsync+0x10/0x20 [49717.950623] artemis.mittagstun.de kernel: do_syscall_64+0x65/0x1f0 [49717.950627] artemis.mittagstun.de kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9 [49717.950630] artemis.mittagstun.de kernel: RIP: 0033:0x7f375b8095c4 [49717.950632] artemis.mittagstun.de kernel: Code: c0 ff ff ff ff eb b7 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 8b 05 aa bb 20 00 48 63 ff 85 c0 75 13 b8 4a 00 00 > [49717.950633] artemis.mittagstun.de kernel: RSP: 002b:00007ffe187334e8 EFLAGS: 00000246 ORIG_RAX: 000000000000004a [49717.950635] artemis.mittagstun.de kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f375b8095c4 [49717.950636] artemis.mittagstun.de kernel: RDX: 00007ffe18733390 RSI: 0000557116945a30 RDI: 0000000000000004 [49717.950636] artemis.mittagstun.de kernel: RBP: 0000000000000001 R08: 00007ffe18733300 R09: 0000000000000001 [49717.950637] artemis.mittagstun.de kernel: R10: 000000000000009d R11: 0000000000000246 R12: 0000557116fa0f70 [49717.950638] artemis.mittagstun.de kernel: R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000 [49717.950648] artemis.mittagstun.de kernel: XFS (dm-0): page discard on page 00000000eedbe0be, inode 0x400da67, offset 24576. [49717.950658] artemis.mittagstun.de kernel: XFS (dm-0): writeback error on sector 26277768 [49729.665621] artemis.mittagstun.de kernel: XFS (dm-0): Internal error XFS_WANT_CORRUPTED_RETURN at line 442 of file ../fs/xfs/libxfs/xfs_alloc.c. Caller xfs_alloc_ag> [49729.665625] artemis.mittagstun.de kernel: CPU: 3 PID: 9934 Comm: vi Not tainted 5.3.18-lp152.69-default #1 openSUSE Leap 15.2 [49729.665626] artemis.mittagstun.de kernel: Hardware name: FUJITSU LIFEBOOK S904/FJNB272, BIOS Version 1.20 07/25/2014 [49729.665627] artemis.mittagstun.de kernel: Call Trace: [49729.665636] artemis.mittagstun.de kernel: dump_stack+0x66/0x8b [49729.665667] artemis.mittagstun.de kernel: xfs_alloc_fixup_trees+0x263/0x390 [xfs] [49729.665697] artemis.mittagstun.de kernel: xfs_alloc_ag_vextent_near+0x8b7/0xb20 [xfs] [49729.665728] artemis.mittagstun.de kernel: xfs_alloc_ag_vextent+0x140/0x150 [xfs] [49729.665757] artemis.mittagstun.de kernel: xfs_alloc_vextent+0x3f3/0x560 [xfs] [49729.665789] artemis.mittagstun.de kernel: xfs_bmap_btalloc+0x2f1/0x8d0 [xfs] [49729.665821] artemis.mittagstun.de kernel: xfs_bmapi_allocate+0x106/0x2c0 [xfs] [49729.665853] artemis.mittagstun.de kernel: xfs_bmapi_convert_delalloc+0x289/0x4b0 [xfs] [49729.665896] artemis.mittagstun.de kernel: xfs_map_blocks+0x15d/0x3f0 [xfs] [49729.665936] artemis.mittagstun.de kernel: xfs_do_writepage+0x10c/0x400 [xfs] [49729.665941] artemis.mittagstun.de kernel: write_cache_pages+0x16b/0x400 [49729.665977] artemis.mittagstun.de kernel: ? xfs_vm_writepages+0xa0/0xa0 [xfs] [49729.665984] artemis.mittagstun.de kernel: ? ecryptfs_write_inode_size_to_metadata+0x6b/0x190 [ecryptfs] [49729.666019] artemis.mittagstun.de kernel: xfs_vm_writepages+0x64/0xa0 [xfs] [49729.666023] artemis.mittagstun.de kernel: do_writepages+0x4b/0xe0 [49729.666026] artemis.mittagstun.de kernel: ? __filemap_fdatawrite_range+0xcb/0x100 [49729.666028] artemis.mittagstun.de kernel: __filemap_fdatawrite_range+0xcb/0x100 [49729.666030] artemis.mittagstun.de kernel: file_write_and_wait_range+0x5e/0xb0 [49729.666083] artemis.mittagstun.de kernel: xfs_file_fsync+0x5d/0x1d0 [xfs] [49729.666088] artemis.mittagstun.de kernel: do_fsync+0x38/0x60 [49729.666091] artemis.mittagstun.de kernel: __x64_sys_fsync+0x10/0x20 [49729.666094] artemis.mittagstun.de kernel: do_syscall_64+0x65/0x1f0 [49729.666098] artemis.mittagstun.de kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9 [49729.666100] artemis.mittagstun.de kernel: RIP: 0033:0x7f375b8095c4 [49729.666102] artemis.mittagstun.de kernel: Code: c0 ff ff ff ff eb b7 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 8b 05 aa bb 20 00 48 63 ff 85 c0 75 13 b8 4a 00 00 > [49729.666103] artemis.mittagstun.de kernel: RSP: 002b:00007ffe187334e8 EFLAGS: 00000246 ORIG_RAX: 000000000000004a [49729.666105] artemis.mittagstun.de kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f375b8095c4 [49729.666106] artemis.mittagstun.de kernel: RDX: 00007ffe18733390 RSI: 0000557116945a30 RDI: 0000000000000004 [49729.666106] artemis.mittagstun.de kernel: RBP: 0000000000000001 R08: 00007ffe18733300 R09: 0000000000000001 [49729.666107] artemis.mittagstun.de kernel: R10: 00007ffe18733410 R11: 0000000000000246 R12: 0000557116fa0f70 [49729.666108] artemis.mittagstun.de kernel: R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000 [49729.666116] artemis.mittagstun.de kernel: XFS (dm-0): page discard on page 00000000eedbe0be, inode 0x400da67, offset 24576. [49729.666129] artemis.mittagstun.de kernel: XFS (dm-0): writeback error on sector 26277744 [49754.062137] artemis.mittagstun.de kernel: XFS (dm-0): Internal error XFS_WANT_CORRUPTED_RETURN at line 442 of file ../fs/xfs/libxfs/xfs_alloc.c. Caller xfs_alloc_ag> [49754.062141] artemis.mittagstun.de kernel: CPU: 1 PID: 9934 Comm: vi Not tainted 5.3.18-lp152.69-default #1 openSUSE Leap 15.2 [49754.062142] artemis.mittagstun.de kernel: Hardware name: FUJITSU LIFEBOOK S904/FJNB272, BIOS Version 1.20 07/25/2014 [49754.062143] artemis.mittagstun.de kernel: Call Trace: [49754.062154] artemis.mittagstun.de kernel: dump_stack+0x66/0x8b [49754.062184] artemis.mittagstun.de kernel: xfs_alloc_fixup_trees+0x263/0x390 [xfs] [49754.062216] artemis.mittagstun.de kernel: xfs_alloc_ag_vextent_near+0x8b7/0xb20 [xfs] [49754.062245] artemis.mittagstun.de kernel: xfs_alloc_ag_vextent+0x140/0x150 [xfs] [49754.062274] artemis.mittagstun.de kernel: xfs_alloc_vextent+0x3f3/0x560 [xfs] [49754.062305] artemis.mittagstun.de kernel: xfs_bmap_btalloc+0x2f1/0x8d0 [xfs] [49754.062338] artemis.mittagstun.de kernel: xfs_bmapi_allocate+0x106/0x2c0 [xfs] [49754.062369] artemis.mittagstun.de kernel: xfs_bmapi_convert_delalloc+0x289/0x4b0 [xfs] [49754.062413] artemis.mittagstun.de kernel: xfs_map_blocks+0x15d/0x3f0 [xfs] [49754.062453] artemis.mittagstun.de kernel: xfs_do_writepage+0x10c/0x400 [xfs] [49754.062458] artemis.mittagstun.de kernel: write_cache_pages+0x16b/0x400 [49754.062495] artemis.mittagstun.de kernel: ? xfs_vm_writepages+0xa0/0xa0 [xfs] [49754.062501] artemis.mittagstun.de kernel: ? ecryptfs_write_inode_size_to_metadata+0x6b/0x190 [ecryptfs] [49754.062536] artemis.mittagstun.de kernel: xfs_vm_writepages+0x64/0xa0 [xfs] [49754.062540] artemis.mittagstun.de kernel: do_writepages+0x4b/0xe0 [49754.062543] artemis.mittagstun.de kernel: ? __filemap_fdatawrite_range+0xcb/0x100 [49754.062545] artemis.mittagstun.de kernel: __filemap_fdatawrite_range+0xcb/0x100 [49754.062547] artemis.mittagstun.de kernel: file_write_and_wait_range+0x5e/0xb0 [49754.062589] artemis.mittagstun.de kernel: xfs_file_fsync+0x5d/0x1d0 [xfs] [49754.062595] artemis.mittagstun.de kernel: do_fsync+0x38/0x60 [49754.062599] artemis.mittagstun.de kernel: __x64_sys_fsync+0x10/0x20 [49754.062602] artemis.mittagstun.de kernel: do_syscall_64+0x65/0x1f0 [49754.062606] artemis.mittagstun.de kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9 [49754.062608] artemis.mittagstun.de kernel: RIP: 0033:0x7f375b8095c4 [49754.062611] artemis.mittagstun.de kernel: Code: c0 ff ff ff ff eb b7 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 8b 05 aa bb 20 00 48 63 ff 85 c0 75 13 b8 4a 00 00 > [49754.062612] artemis.mittagstun.de kernel: RSP: 002b:00007ffe187334e8 EFLAGS: 00000246 ORIG_RAX: 000000000000004a [49754.062614] artemis.mittagstun.de kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f375b8095c4 [49754.062615] artemis.mittagstun.de kernel: RDX: 00007ffe18733390 RSI: 0000557116945a30 RDI: 0000000000000004 [49754.062616] artemis.mittagstun.de kernel: RBP: 0000000000000001 R08: 00007ffe18733300 R09: 0000000000000001 [49754.062617] artemis.mittagstun.de kernel: R10: 00007ffe18733410 R11: 0000000000000246 R12: 0000557116fa0f70 [49754.062618] artemis.mittagstun.de kernel: R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000 [49754.062627] artemis.mittagstun.de kernel: XFS (dm-0): page discard on page 00000000eedbe0be, inode 0x400da67, offset 24576. [49754.062636] artemis.mittagstun.de kernel: XFS (dm-0): writeback error on sector 26277784
This was seen once more on Apr 25, but not any more after that. -- You are receiving this mail because: You are the assignee for the bug.
https://bugzilla.suse.com/show_bug.cgi?id=1186726
https://bugzilla.suse.com/show_bug.cgi?id=1186726#c2
--- Comment #2 from Martin Wilck
[809870.813895] artemis.mittagstun.de kernel: XFS (dm-0): Metadata corruption detected at __xfs_buf_mark_corrupt+0xe/0x20 [xfs], xfs_agi block 0x1900010 [809870.813897] artemis.mittagstun.de kernel: XFS (dm-0): Unmount and run xfs_repair [809870.813934] artemis.mittagstun.de kernel: XFS (dm-0): Internal error xfs_trans_cancel at line 1073 of file ../fs/xfs/xfs_trans.c. Caller xfs_remove+0x1be/0x2f0 [xf> [809870.813937] artemis.mittagstun.de kernel: CPU: 2 PID: 679 Comm: DOM Worker Not tainted 5.3.18-lp152.72-preempt #1 openSUSE Leap 15.2 [809870.813938] artemis.mittagstun.de kernel: Hardware name: FUJITSU LIFEBOOK S904/FJNB272, BIOS Version 1.20 07/25/2014 [809870.813939] artemis.mittagstun.de kernel: Call Trace: [809870.813947] artemis.mittagstun.de kernel: dump_stack+0x66/0x8b [809870.813981] artemis.mittagstun.de kernel: xfs_trans_cancel+0x13a/0x160 [xfs] [809870.814014] artemis.mittagstun.de kernel: xfs_remove+0x1be/0x2f0 [xfs] [809870.814044] artemis.mittagstun.de kernel: xfs_vn_unlink+0x55/0xa0 [xfs] [809870.814049] artemis.mittagstun.de kernel: ? may_delete+0x79/0x180 [809870.814051] artemis.mittagstun.de kernel: vfs_unlink+0x106/0x1f0 [809870.814057] artemis.mittagstun.de kernel: ecryptfs_do_unlink+0x7d/0x170 [ecryptfs] [809870.814060] artemis.mittagstun.de kernel: vfs_unlink+0x106/0x1f0 [809870.814062] artemis.mittagstun.de kernel: do_unlinkat+0x2ba/0x320 [809870.814068] artemis.mittagstun.de kernel: do_syscall_64+0x65/0x1f0 [809870.814071] artemis.mittagstun.de kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9 [809870.814073] artemis.mittagstun.de kernel: RIP: 0033:0x7f0d5c1ffcf7 [809870.814075] artemis.mittagstun.de kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 9e 51 2c 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 b8 57 00 00> [809870.814076] artemis.mittagstun.de kernel: RSP: 002b:00007f0d3e2fb5c8 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 [809870.814078] artemis.mittagstun.de kernel: RAX: ffffffffffffffda RBX: 0000000000000008 RCX: 00007f0d5c1ffcf7 [809870.814079] artemis.mittagstun.de kernel: RDX: 0000000000000000 RSI: 00007f0d3e2fb500 RDI: 00007f0d2d3428b0 [809870.814080] artemis.mittagstun.de kernel: RBP: 00007f0d3e2fb5d0 R08: 000000000000008e R09: 00007f0d2d3428b0 [809870.814080] artemis.mittagstun.de kernel: R10: 00007f0d3e2fb520 R11: 0000000000000246 R12: 00007f0d3e2fb670 [809870.814081] artemis.mittagstun.de kernel: R13: 0000000000000000 R14: 0000000000000000 R15: 00007f0d3e2fb5d0 [809870.818881] artemis.mittagstun.de kernel: XFS (dm-0): xfs_do_force_shutdown(0x8) called from line 1074 of file ../fs/xfs/xfs_trans.c. Return address = 0000000033e6d> [809870.818884] artemis.mittagstun.de kernel: XFS (dm-0): Corruption of in-memory data detected. Shutting down filesystem [809870.818885] artemis.mittagstun.de kernel: XFS (dm-0): Please unmount the filesystem and rectify the problem(s) [809870.818892] artemis.mittagstun.de kernel: Error in vfs_unlink; rc = [-117] [809870.902014] artemis.mittagstun.de kernel: Error in vfs_unlink; rc = [-5] [809871.841011] artemis.mittagstun.de kernel: Error in vfs_unlink; rc = [-5] [809871.868968] artemis.mittagstun.de kernel: Error in vfs_unlink; rc = [-5] [809880.491761] artemis.mittagstun.de kernel: Error opening lower file for lower_dentry [0x0000000088bca742] and lower_mnt [0x000000006c3d0b69]; rc = [-5] [809880.491764] artemis.mittagstun.de kernel: ecryptfs_open: Error attempting to initialize the lower file for the dentry with name [Ferien]; rc = [-5] [809880.709418] artemis.mittagstun.de kernel: Error opening lower file for lower_dentry [0x0000000088bca742] and lower_mnt [0x000000006c3d0b69]; rc = [-5] [809880.709431] artemis.mittagstun.de kernel: ecryptfs_open: Error attempting to initialize the lower file for the dentry with name [Ferien]; rc = [-5] [809880.709969] artemis.mittagstun.de kernel: ecryptfs_encrypt_page: Error attempting to write lower page; rc = [-5] [809880.709972] artemis.mittagstun.de kernel: ecryptfs_write_end: Error encrypting page (upper index [0x0000000000000050]) [809880.710086] artemis.mittagstun.de kernel: ecryptfs_encrypt_page: Error attempting to write lower page; rc = [-5]
... and the same issue was again observed today, with some ecryptfs messages first, after another kernel udpate (5.3.18-lp152.75-preempt):
[50729.019499] artemis.mittagstun.de kernel: Valid eCryptfs headers not found in file header region or xattr region, inode 201435392 [50729.029506] artemis.mittagstun.de kernel: Valid eCryptfs headers not found in file header region or xattr region, inode 551574 [50729.030775] artemis.mittagstun.de kernel: Valid eCryptfs headers not found in file header region or xattr region, inode 551578 [50729.277296] artemis.mittagstun.de kernel: XFS (dm-0): Metadata corruption detected at __xfs_buf_mark_corrupt+0xe/0x20 [xfs], xfs_agi block 0x1900010 [50729.277299] artemis.mittagstun.de kernel: XFS (dm-0): Unmount and run xfs_repair [50729.277375] artemis.mittagstun.de kernel: XFS (dm-0): Internal error xfs_trans_cancel at line 1073 of file ../fs/xfs/xfs_trans.c. Caller xfs_remove+0x1be/0x2f0 [xfs] [50729.277378] artemis.mittagstun.de kernel: CPU: 1 PID: 7127 Comm: DOM Worker Not tainted 5.3.18-lp152.75-preempt #1 openSUSE Leap 15.2 [50729.277379] artemis.mittagstun.de kernel: Hardware name: FUJITSU LIFEBOOK S904/FJNB272, BIOS Version 1.20 07/25/2014 [50729.277380] artemis.mittagstun.de kernel: Call Trace: [50729.277393] artemis.mittagstun.de kernel: dump_stack+0x66/0x8b [50729.277460] artemis.mittagstun.de kernel: xfs_trans_cancel+0x13a/0x160 [xfs] [50729.277524] artemis.mittagstun.de kernel: xfs_remove+0x1be/0x2f0 [xfs] [50729.277587] artemis.mittagstun.de kernel: xfs_vn_unlink+0x55/0xa0 [xfs] [50729.277592] artemis.mittagstun.de kernel: ? may_delete+0x79/0x180 [50729.277596] artemis.mittagstun.de kernel: vfs_unlink+0x106/0x1f0 [50729.277604] artemis.mittagstun.de kernel: ecryptfs_do_unlink+0x7d/0x170 [ecryptfs] [50729.277608] artemis.mittagstun.de kernel: vfs_unlink+0x106/0x1f0 [50729.277611] artemis.mittagstun.de kernel: do_unlinkat+0x2ba/0x320 [50729.277618] artemis.mittagstun.de kernel: do_syscall_64+0x65/0x1f0 [50729.277621] artemis.mittagstun.de kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9 [50729.277624] artemis.mittagstun.de kernel: RIP: 0033:0x7ff5b16e8cf7 [50729.277627] artemis.mittagstun.de kernel: Code: f0 ff ff 73 01 c3 48 8b 0d 9e 51 2c 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 b8 57 00 00 > [50729.277629] artemis.mittagstun.de kernel: RSP: 002b:00007ff58fffb7f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000057 [50729.277631] artemis.mittagstun.de kernel: RAX: ffffffffffffffda RBX: 0000000000000008 RCX: 00007ff5b16e8cf7 [50729.277632] artemis.mittagstun.de kernel: RDX: 0000000000000000 RSI: 00007ff58fffb730 RDI: 00007ff580fa2f70 [50729.277634] artemis.mittagstun.de kernel: RBP: 00007ff58fffb800 R08: 000000000000008e R09: 00007ff580fa2f70 [50729.277635] artemis.mittagstun.de kernel: R10: 00007ff58fffb750 R11: 0000000000000246 R12: 00007ff58fffb8a0 [50729.277636] artemis.mittagstun.de kernel: R13: 0000000000000000 R14: 0000000000000000 R15: 00007ff58fffb800 [50729.286001] artemis.mittagstun.de kernel: XFS (dm-0): xfs_do_force_shutdown(0x8) called from line 1074 of file ../fs/xfs/xfs_trans.c. Return address = 00000000b072fe> [50729.286005] artemis.mittagstun.de kernel: XFS (dm-0): Corruption of in-memory data detected. Shutting down filesystem [50729.286007] artemis.mittagstun.de kernel: XFS (dm-0): Please unmount the filesystem and rectify the problem(s) [50729.286022] artemis.mittagstun.de kernel: Error in vfs_unlink; rc = [-117] [50729.291631] artemis.mittagstun.de kernel: ecryptfs_dir_open: Error attempting to initialize the lower file for the dentry with name [archived]; rc = [-5]
When the issue is observed, I typically see some PackageKit messages beforehand. But I don't think that say much except that PackageKit does some IO on the file system iin question. -- You are receiving this mail because: You are the assignee for the bug.
https://bugzilla.suse.com/show_bug.cgi?id=1186726
https://bugzilla.suse.com/show_bug.cgi?id=1186726#c3
--- Comment #3 from Martin Wilck
https://bugzilla.suse.com/show_bug.cgi?id=1186726
https://bugzilla.suse.com/show_bug.cgi?id=1186726#c4
--- Comment #4 from Martin Wilck
https://bugzilla.suse.com/show_bug.cgi?id=1186726
https://bugzilla.suse.com/show_bug.cgi?id=1186726#c5
Anthony Iliopoulos
participants (1)
-
bugzilla_noreply＠suse.com