If an filesystem error occurs due to power outage, and it fixes the filesystem
errors, it still get's stuck in rescue mode.
`journcalctl -b` shows:
May 16 10:01:31 edge.vendanor.com systemd[1]: Finished Cryptography Setup for
rpi_rootfs.
May 16 10:01:31 edge.vendanor.com systemd[1]: Found device
/dev/disk/by-uuid/6d048af7-a4ba-4e50-8808-d686e13c286e.
May 16 10:01:31 edge.vendanor.com systemd[1]: Reached target Local Encrypted
Volumes.
May 16 10:01:31 edge.vendanor.com systemd[1]: Reached target Initrd Root
Device.
May 16 10:01:31 edge.vendanor.com systemd[1]: Reached target System
Initialization.
May 16 10:01:31 edge.vendanor.com systemd[1]: Reached target Basic System.
May 16 10:01:32 edge.vendanor.com systemd[1]: Finished dracut initqueue hook.
May 16 10:01:32 edge.vendanor.com systemd[1]: Reached target Preparation for
Remote File Systems.
May 16 10:01:32 edge.vendanor.com systemd[1]: Reached target Remote Encrypted
Volumes.
May 16 10:01:32 edge.vendanor.com systemd[1]: Reached target Remote File
Systems.
May 16 10:01:32 edge.vendanor.com systemd[1]: dracut pre-mount hook was skipped
because no trigger condition checks were met.
May 16 10:01:32 edge.vendanor.com systemd[1]: Starting File System Check on
/dev/disk/by-uuid/6d048af7-a4ba-4e50-8808-d686e13c286e...
May 16 10:01:32 edge.vendanor.com systemd-fsck[799]: e2fsck 1.47.0 (5-Feb-2023)
May 16 10:01:32 edge.vendanor.com systemd-fsck[799]: ROOT: recovering journal
May 16 10:01:32 edge.vendanor.com systemd[1]: clevis-luks-askpass.service:
Deactivated successfully.
May 16 10:01:32 edge.vendanor.com systemd[1]: clevis-luks-askpass.service:
Consumed 3.372s CPU time, 6.6M memory peak, 0B memory swap peak.
May 16 10:01:32 edge.vendanor.com systemd-fsck[799]: Clearing orphaned inode
18323 (uid=1001, gid=1001, mode=0100600, size=4194304)
May 16 10:01:32 edge.vendanor.com systemd-fsck[799]: Clearing orphaned inode
48587 (uid=1001, gid=1001, mode=040700, size=4096)
May 16 10:01:32 edge.vendanor.com systemd-fsck[799]: Truncating orphaned inode
130498 (uid=1000, gid=1000, mode=0100644, size=0)
May 16 10:01:32 edge.vendanor.com systemd-fsck[799]: Setting free blocks count
to 263168 (was 263539)
May 16 10:01:32 edge.vendanor.com systemd-fsck[799]: ROOT: clean, 65957/323840
files, 1043456/1306624 blocks
May 16 10:01:32 edge.vendanor.com systemd[1]: Finished File System Check on
/dev/disk/by-uuid/6d048af7-a4ba-4e50-8808-d686e13c286e.
May 16 10:01:32 edge.vendanor.com systemd[1]: Mounting /sysroot...
May 16 10:01:32 edge.vendanor.com kernel: EXT4-fs (dm-0): orphan cleanup on
readonly fs
May 16 10:01:32 edge.vendanor.com kernel: EXT4-fs error (device dm-0):
ext4_orphan_get:1420: comm mount: bad orphan inode 18323
May 16 10:01:32 edge.vendanor.com kernel: ext4_test_bit(bit=2130, block=304) =
0
May 16 10:01:33 edge.vendanor.com kernel: EXT4-fs error (device dm-0):
ext4_orphan_get:1420: comm mount: bad orphan inode 48587
May 16 10:01:33 edge.vendanor.com kernel: ext4_test_bit(bit=10, block=308) = 0
May 16 10:01:33 edge.vendanor.com kernel: EXT4-fs (dm-0): 1 truncate cleaned up
May 16 10:01:33 edge.vendanor.com kernel: EXT4-fs (dm-0): recovery complete
May 16 10:01:33 edge.vendanor.com kernel: EXT4-fs error (device dm-0):
ext4_mark_recovery_complete:6245: comm mount: Orphan file not empty on
read-only fs.
May 16 10:01:33 edge.vendanor.com kernel: EXT4-fs (dm-0): mount failed
May 16 10:01:33 edge.vendanor.com mount[822]: mount: /sysroot: mount system
call failed: Structure needs cleaning.
May 16 10:01:33 edge.vendanor.com mount[822]: dmesg(1) may have more
information after failed mount system call.
May 16 10:01:33 edge.vendanor.com systemd[1]: sysroot.mount: Mount process
exited, code=exited, status=32/n/a
May 16 10:01:33 edge.vendanor.com systemd[1]: sysroot.mount: Failed with result
'exit-code'.
May 16 10:01:33 edge.vendanor.com systemd[1]: Failed to mount /sysroot.
May 16 10:01:33 edge.vendanor.com systemd[1]: Dependency failed for Initrd Root
File System.
May 16 10:01:33 edge.vendanor.com systemd[1]: Dependency failed for Mountpoints
Configured in the Real Root.
May 16 10:01:33 edge.vendanor.com systemd[1]: initrd-parse-etc.service: Job
initrd-parse-etc.service/start failed with result 'dependency'.
May 16 10:01:33 edge.vendanor.com systemd[1]: initrd-parse-etc.service:
Triggering OnFailure= dependencies.
May 16 10:01:33 edge.vendanor.com systemd[1]: initrd-root-fs.target: Job
initrd-root-fs.target/start failed with result 'dependency'.
May 16 10:01:33 edge.vendanor.com systemd[1]: initrd-root-fs.target: Triggering
OnFailure= dependencies.
May 16 10:01:33 edge.vendanor.com systemd[1]: Stopped target Basic System.
May 16 10:01:33 edge.vendanor.com systemd[1]: Reached target Initrd File
Systems.
May 16 10:01:33 edge.vendanor.com systemd[1]: Stopped target System
Initialization.
May 16 10:01:33 edge.vendanor.com systemd[1]: dracut-initqueue.service:
Deactivated successfully.
May 16 10:01:33 edge.vendanor.com systemd[1]: Stopped dracut initqueue hook.
May 16 10:01:33 edge.vendanor.com systemd[1]: dracut-pre-udev.service:
Deactivated successfully.
May 16 10:01:33 edge.vendanor.com systemd[1]: Stopped dracut pre-udev hook.
May 16 10:01:33 edge.vendanor.com systemd[1]: dracut-cmdline.service:
Deactivated successfully.
May 16 10:01:33 edge.vendanor.com systemd[1]: Stopped dracut cmdline hook.
May 16 10:01:33 edge.vendanor.com systemd[1]: dracut-cmdline-ask.service:
Deactivated successfully.
May 16 10:01:33 edge.vendanor.com systemd[1]: Stopped dracut ask for additional
cmdline parameters.
May 16 10:01:33 edge.vendanor.com systemd[1]: Started Emergency Shell.
May 16 10:01:33 edge.vendanor.com systemd[1]: Reached target Emergency Mode.
May 16 10:01:33 edge.vendanor.com systemd[1]: Startup finished in 1.878s
(kernel) + 0 (initrd) + 13.097s (userspace) = 14.976s.
May 16 10:01:33 edge.vendanor.com systemd[1]: Received SIGRTMIN+21 from PID 414
(plymouthd).
May 16 10:01:33 edge.vendanor.com systemd[1]: Received SIGRTMIN+21 from PID 414
(plymouthd).
This is on Raspberry Pi CM4, filesystem is setup like this:
/etc/fstab:
/dev/mapper/rpi_rootfs / ext4 defaults,noatime 0 1
/dev/mmcblk0p2 /boot ext4 defaults,noatime 0 0
/dev/mmcblk0p1 /boot/efi vfat utf8 0 2
/etc/crypttab:
rpi_rootfs UUID=4fb99d03-eec8-4a6c-8d46-e14a6afd975a none x-initrd.attach
GRUB_CMDLINE_LINUX_DEFAULT from /etc/default/grub:
GRUB_CMDLINE_LINUX_DEFAULT="systemd.show_status=0 vt.global_cursor_default=0
plymouth.ignore-serial-consoles video=HDMI-A-1:1920x1080M@60,rotate=90
fsck.repair=yes cgroup_enable=memory swapaccount=1 net.ifnames=0 rd.neednet=1
ip=192.168.250.20::192.168.250.200:255.255.255.0::eth0:off quiet splash"