http://bugzilla.opensuse.org/show_bug.cgi?id=937403 Bug ID: 937403 Summary: 100% reproduceable I/O hang on process doing 'strip' as invoked by mkinitrd/dracut Classification: openSUSE Product: openSUSE Factory Version: 201505* Hardware: Other OS: Other Status: NEW Severity: Major Priority: P5 - None Component: Kernel Assignee: kernel-maintainers@forge.provo.novell.com Reporter: jnelson-suse@jamponi.net QA Contact: qa-bugs@suse.de Found By: --- Blocker: --- I'm seeing a 100% reproduceable I/O hang on the 'strip' process which is invoked as part of mkinitrd/dracut. First, a copy and paste from ps wauxf: root 8444 0.8 1.1 338652 92992 pts/0 S+ 08:47 0:36 | \_ zypper -v up root 8582 0.0 0.0 0 0 pts/0 Z+ 08:50 0:00 | \_ [tar] <defunct> root 8584 0.0 0.0 45660 7224 pts/0 S+ 08:50 0:00 | \_ /usr/bin/python /usr/lib/zypp/plugins/commit/btrfs-defrag-plugin.py root 8585 0.0 0.1 51764 8924 pts/0 S+ 08:50 0:00 | \_ /usr/bin/python /usr/lib/zypp/plugins/commit/snapper.py root 19955 0.0 0.0 11784 2372 pts/0 S+ 08:56 0:00 | \_ /bin/sh /var/adm/update-scripts/posttranstILNML/kernel-firmware-20150 616git-1.1.noarch.rpmQDDetv root 19956 0.0 0.0 11784 2648 pts/0 S+ 08:56 0:00 | \_ /bin/bash -hB /usr/lib/module-init-tools/regenerate-initrd-posttr ans root 19959 0.0 0.0 11920 2936 pts/0 S+ 08:56 0:00 | \_ /bin/bash --norc /sbin/mkinitrd root 19972 0.0 0.0 15348 5468 pts/0 S+ 08:56 0:00 | \_ /bin/bash --norc /usr/bin/dracut --logfile /var/log/YaST2 /mkinitrd.log --force /boot/initrd-4.0.5-3-desktop 4.0.5-3-desktop root 27717 0.0 0.0 6032 1324 pts/0 S+ 08:57 0:00 | \_ xargs -r -0 strip -g root 27718 0.0 0.0 14796 5192 pts/0 D+ 08:57 0:00 | \_ strip -g /tmp/initramfs.PllOgo/lib/dracut/hooks/cmdline/91-dhcp-root.sh /tmp/initramfs.PllOgo/lib/dracut/hooks/cmdline/92-parse-ibft.sh /tmp/initramfs.PllOgo/lib/dracut/hooks/cmdline/95-parse-vlan.sh /tmp/initramfs.PllOgo/lib/dracut/hooks/cmdline/96-parse-bond.sh /tmp/initramfs.PllOgo/lib/dracut/hooks/cmdline/96-parse-team.sh /tmp/initramfs.PllOgo/lib/dracut/hooks/cmdline/97-parse-bridge.sh /tmp/initramfs.PllOgo/lib/dracut/hooks/cmdline/98-parse-ip-opts.sh /tmp/initramfs.PllOgo/lib/dracut/hooks/cmdline/99-parse-ifname.sh /tmp/initramfs.PllOgo/lib/dracut/hooks/cmdline/10-parse-keydev.sh /tmp/initramfs.PllOgo/lib/dracut/hooks/cmdline/30-parse-crypt.sh /tmp/initramfs.PllOgo/lib/dracut/hooks/cmdline/99-parse-suse-initrd.sh /tmp/initramfs.PllOgo/lib/dracut/hooks/pre-udev/50-ifname-genrules.sh /tmp/initramfs.PllOgo/lib/dracut/hooks/pre-udev/60-net-genrules.sh /tmp/initramfs.PllOgo/lib/dracut/hooks/pre-udev/30-dm-pre-udev.sh /tmp/initramfs.PllOgo/lib/dracut/hooks/pre-trigger/00-warpclock.sh /tmp/initramfs.PllOgo/lib/dracut/hooks/initqueue/timeout/99-rootfallback.sh /tmp/initramfs.PllOgo/lib/dracut/hooks/emergency/50-plymouth-emergency.sh /tmp/initramfs.PllOgo/lib/dracut/hooks/shutdown/30-dm-shutdown.sh /tmp/initramfs.PllOgo/lib/net-lib.sh /tmp/initramfs.PllOgo/lib/dracut-crypt-lib.sh /tmp/initramfs.PllOgo/lib/dracut-lib.sh /tmp/initramfs.PllOgo/lib/fs-lib.sh /tmp/initramfs.PllOgo/usr/bin/setfont /tmp/initramfs.PllOgo/usr/bin/loadkeys /tmp/initramfs.PllOgo/usr/bin/kbd_mode /tmp/initramfs.PllOgo/usr/bin/stty /tmp/initramfs.PllOgo/usr/bin/hostname /tmp/initramfs.PllOgo/usr/bin/sed /tmp/initramfs.PllOgo/usr/bin/ping /tmp/initramfs.PllOgo/usr/bin/ping6 /tmp/initramfs.PllOgo/usr/bin/plymouth /tmp/initramfs.PllOgo/usr/bin/readlink /tmp/initramfs.PllOgo/usr/bin/rmdir /tmp/initramfs.PllOgo/usr/bin/umount /tmp/initramfs.PllOgo/usr/bin/systemd-ask-password /tmp/initramfs.PllOgo/usr/bin/systemd-tty-ask-password-agent /tmp/initramfs.PllOgo/usr/bin/tr /tmp/initramfs.PllOgo/usr/bin/udevadm /tmp/initramfs.PllOgo/usr/bin/cat /tmp/initramfs.PllOgo/usr/bin/uname /tmp/initramfs.PllOgo/usr/bin/sg_inq /tmp/initramfs.PllOgo/usr/bin/journalctl /tmp/initramfs.PllOgo/usr/bin/systemctl /tmp/initramfs.PllOgo/usr/bin/echo /tmp/initramfs.PllOgo/usr/bin/systemd-cgls /tmp/initramfs.PllOgo/usr/bin/systemd-tmpfiles /tmp/initramfs.PllOgo/usr/bin/true /tmp/initramfs.PllOgo/usr/bin/mount /tmp/initramfs.PllOgo/usr/bin/mknod /tmp/initramfs.PllOgo/usr/bin/mkdir /tmp/initramfs.PllOgo/usr/bin/sleep /tmp/initramfs.PllOgo/usr/bin/chroot /tmp/initramfs.PllOgo/usr/bin/chown /tmp/initramfs.PllOgo/usr/bin/ls /tmp/initramfs.PllOgo/usr/bin/flock /tmp/initramfs.PllOgo/usr/bin/cp /tmp/initramfs.PllOgo/usr/bin/mv /tmp/initramfs.PllOgo/usr/bin/dmesg /tmp/initramfs.PllOgo/usr/bin/rm /tmp/initramfs.PllOgo/usr/bin/ln /tmp/initramfs.PllOgo/usr/bin/kmod /tmp/initramfs.PllOgo/usr/bin/mkfifo /tmp/initramfs.PllOgo/usr/bin/setsid /tmp/initramfs.PllOgo/usr/bin/findmnt /tmp/initramfs.PllOgo/usr/bin/less /tmp/initramfs.PllOgo/usr/sbin/hwclock /tmp/initramfs.PllOgo/usr/sbin/ip /tmp/initramfs.PllOgo/usr/sbin/arping /tmp/initramfs.PllOgo/usr/sbin/wickedd-dhcp4 /tmp/initramfs.PllOgo/usr/sbin/wickedd-dhcp6 /tmp/initramfs.PllOgo/usr/sbin/plymouthd /tmp/initramfs.PllOgo/usr/sbin/btrfs /tmp/initramfs.PllOgo/usr/sbin/btrfs-zero-log /tmp/initramfs.PllOgo/usr/sbin/cryptsetup /tmp/initramfs.PllOgo/usr/sbin/blkid /tmp/initramfs.PllOgo/usr/sbin/swapoff /tmp/initramfs.PllOgo/usr/sbin/nologin /tmp/initramfs.PllOgo/usr/sbin/fsck.btrfs /tmp/initramfs.PllOgo/usr/sbin/e2fsck /tmp/initramfs.PllOgo/usr/sbin/fsck /tmp/initramfs.PllOgo/usr/sbin/losetup /tmp/initramfs.PllOgo/usr/sbin/kexec /tmp/initramfs.PllOgo/usr/sbin/fsck.ext4 /tmp/initramfs.PllOgo/usr/lib64/libwicked-0.so.6.18.0 /tmp/initramfs.PllOgo/usr/lib64/libply.so.2.1.0 /tmp/initramfs.PllOgo/usr/lib64/libply-splash-core.so.2.1.0 /tmp/initramfs.PllOgo/usr/lib64/libudev.so.1.6.2 /tmp/initramfs.PllOgo/usr/lib64/plymouth/text.so /tmp/initramfs.PllOgo/usr/lib64/plymouth/details.so /tmp/initramfs.PllOgo/usr/lib64/plymouth/script.so /tmp/initramfs.PllOgo/usr/lib64 jon 28618 0.8 0.0 17136 7188 pts/1 Ss 10:02 0:00 \_ /bin/bash and now a snippet from echoing 'w' into /proc/sysrq-trigger 2015-07-08T10:06:36.954481-05:00 b570 kernel: [138659.080264] sysrq: SysRq : Show Blocked State 2015-07-08T10:06:36.954499-05:00 b570 kernel: [138659.080280] task PC stack pid father 2015-07-08T10:06:36.954501-05:00 b570 kernel: [138659.080345] strip D ffff88023fa14300 0 27718 27717 0x00000080 2015-07-08T10:06:36.954501-05:00 b570 kernel: [138659.080349] ffff88010115fbc8 ffffffff81e14480 ffff880101bca490 0000000000000246 2015-07-08T10:06:36.954502-05:00 b570 kernel: [138659.080352] ffff88010115ffd8 ffff88021de39088 ffff88000907e7c8 ffff88010115fce0 2015-07-08T10:06:36.954503-05:00 b570 kernel: [138659.080354] 0000000000004000 ffff88010115fbe8 ffffffff8168bdf7 0000000000004fff 2015-07-08T10:06:36.954503-05:00 b570 kernel: [138659.080356] Call Trace: 2015-07-08T10:06:36.954504-05:00 b570 kernel: [138659.080368] [<ffffffff8168bdf7>] schedule+0x37/0x90 2015-07-08T10:06:36.954505-05:00 b570 kernel: [138659.080402] [<ffffffffa02f06f1>] lock_extent_bits+0x191/0x1d0 [btrfs] 2015-07-08T10:06:36.954505-05:00 b570 kernel: [138659.080422] [<ffffffffa02de4fb>] btrfs_evict_inode+0x15b/0x550 [btrfs] 2015-07-08T10:06:36.954506-05:00 b570 kernel: [138659.080428] [<ffffffff811f76f0>] evict+0xb0/0x1a0 2015-07-08T10:06:36.954506-05:00 b570 kernel: [138659.080433] [<ffffffff811f3730>] __dentry_kill+0x160/0x1d0 2015-07-08T10:06:36.954507-05:00 b570 kernel: [138659.080438] [<ffffffff811f38f8>] dput+0x158/0x240 2015-07-08T10:06:36.954508-05:00 b570 kernel: [138659.080444] [<ffffffff811ece19>] SYSC_renameat2+0x3f9/0x5d0 2015-07-08T10:06:36.954508-05:00 b570 kernel: [138659.080449] [<ffffffff8169048d>] system_call_fastpath+0x16/0x1b 2015-07-08T10:06:36.954509-05:00 b570 kernel: [138659.080458] [<00007ff230b79567>] 0x7ff230b79567 2015-07-08T10:06:36.954510-05:00 b570 kernel: [138659.080463] Sched Debug Version: v0.11, 4.0.5-3-desktop #1 2015-07-08T10:06:36.954510-05:00 b570 kernel: [138659.080465] ktime : 138582480.382923 2015-07-08T10:06:36.954511-05:00 b570 kernel: [138659.080466] sched_clk : 138659080.462129 2015-07-08T10:06:36.954512-05:00 b570 kernel: [138659.080467] cpu_clk : 138659080.462154 2015-07-08T10:06:36.954512-05:00 b570 kernel: [138659.080468] jiffies : 4433249776 2015-07-08T10:06:36.954513-05:00 b570 kernel: [138659.080470] sched_clock_stable() : 1 2015-07-08T10:06:36.954514-05:00 b570 kernel: [138659.080470] 2015-07-08T10:06:36.954514-05:00 b570 kernel: [138659.080471] sysctl_sched 2015-07-08T10:06:36.954515-05:00 b570 kernel: [138659.080473] .sysctl_sched_latency : 12.000000 2015-07-08T10:06:36.954515-05:00 b570 kernel: [138659.080474] .sysctl_sched_min_granularity : 1.500000 2015-07-08T10:06:36.954516-05:00 b570 kernel: [138659.080475] .sysctl_sched_wakeup_granularity : 2.000000 2015-07-08T10:06:36.954517-05:00 b570 kernel: [138659.080476] .sysctl_sched_child_runs_first : 0 2015-07-08T10:06:36.954517-05:00 b570 kernel: [138659.080477] .sysctl_sched_features : 77435 2015-07-08T10:06:36.954518-05:00 b570 kernel: [138659.080479] .sysctl_sched_tunable_scaling : 1 (logaritmic) 2015-07-08T10:06:36.954518-05:00 b570 kernel: [138659.080480] This persists across reboots. btrfs scrub shows nothing wrong. Kernels up *through* 4.0.5-3-desktop. -- You are receiving this mail because: You are on the CC list for the bug.