[Bug 1110259] New: btrfsmaintenance update hangs waiting for job restarts
http://bugzilla.opensuse.org/show_bug.cgi?id=1110259 Bug ID: 1110259 Summary: btrfsmaintenance update hangs waiting for job restarts Classification: openSUSE Product: openSUSE Tumbleweed Version: Current Hardware: Other OS: Other Status: NEW Severity: Normal Priority: P5 - None Component: Basesystem Assignee: bnc-team-screening@forge.provo.novell.com Reporter: arvidjaar@gmail.com QA Contact: qa-bugs@suse.de Found By: --- Blocker: --- My best guess is that job state is lost during daemon reload. I will leave VM in this state in case something else is needed, but it tends to lockup across host suspend.
From zypper run:
The following product is going to be upgraded: openSUSE Tumbleweed 20180919-0 -> 20180926-0 ... hecking for file conflicts: .............................................[done] ( 1/142) Installing: btrfsmaintenance-0.4.2-1.1.noarch ---------------------[\] It stays so for couple of hours already. Current time: bor@10:~> date Sun Sep 30 20:59:58 MSK 2018
From journalctl:
Sep 30 18:53:41 10.0.2.15 [RPM][2837]: Transaction ID 5bb0f185 started Sep 30 18:53:43 10.0.2.15 [RPM][2837]: erase btrfsmaintenance-0.4.1-2.1.noarch: success Sep 30 18:54:03 10.0.2.15 systemd[1]: Reloading. Sep 30 18:54:04 10.0.2.15 systemd[1]: nss-lookup.target: Dependency Before=nss-lookup.target dropped Sep 30 18:54:04 10.0.2.15 systemd[1]: Starting Update cron periods from /etc/sysconfig/btrfsmaintenance... Sep 30 18:54:08 10.0.2.15 btrfsmaintenance-refresh-cron.sh[2875]: Refresh script btrfs-scrub.sh for uninstall Sep 30 18:54:08 10.0.2.15 btrfsmaintenance-refresh-cron.sh[2875]: Refresh script btrfs-defrag.sh for uninstall Sep 30 18:54:08 10.0.2.15 btrfsmaintenance-refresh-cron.sh[2875]: Refresh script btrfs-balance.sh for uninstall Sep 30 18:54:08 10.0.2.15 btrfsmaintenance-refresh-cron.sh[2875]: Refresh script btrfs-trim.sh for uninstall Sep 30 18:54:08 10.0.2.15 btrfsmaintenance-refresh-cron.sh[2875]: Refresh timer btrfs-scrub for none Sep 30 18:54:08 10.0.2.15 systemd[1]: Reloading. Sep 30 18:54:08 10.0.2.15 [RPM][2837]: install btrfsmaintenance-0.4.2-1.1.noarch: success Sep 30 18:54:08 10.0.2.15 systemd[1]: nss-lookup.target: Dependency Before=nss-lookup.target dropped Sep 30 18:54:08 10.0.2.15 btrfsmaintenance-refresh-cron.sh[2875]: Refresh timer btrfs-defrag for none Sep 30 18:54:08 10.0.2.15 systemd[1]: Reloading. Sep 30 18:54:08 10.0.2.15 systemd[1]: nss-lookup.target: Dependency Before=nss-lookup.target dropped Sep 30 18:54:08 10.0.2.15 systemd[1]: Started CUPS Scheduler. Sep 30 18:54:08 10.0.2.15 systemd[1]: Reloading. Sep 30 18:54:09 10.0.2.15 systemd[1]: nss-lookup.target: Dependency Before=nss-lookup.target dropped Sep 30 18:54:09 10.0.2.15 btrfsmaintenance-refresh-cron.sh[2875]: Refresh timer btrfs-balance for weekly Sep 30 18:54:09 10.0.2.15 systemd[1]: Stopped Balance block groups on a btrfs filesystem. Sep 30 18:54:09 10.0.2.15 systemd[1]: Stopping Balance block groups on a btrfs filesystem. Sep 30 18:54:09 10.0.2.15 systemd[1]: Started Balance block groups on a btrfs filesystem. Sep 30 18:54:09 10.0.2.15 systemd[1]: btrfsmaintenance-refresh.service: Main process exited, code=killed, status=15/TERM Sep 30 18:54:09 10.0.2.15 systemd[1]: btrfsmaintenance-refresh.service: Failed with result 'signal'. Sep 30 18:54:09 10.0.2.15 systemd[1]: Stopped Update cron periods from /etc/sysconfig/btrfsmaintenance. Sep 30 18:54:09 10.0.2.15 systemd[1]: Stopped Watch /etc/sysconfig/btrfsmaintenance. Sep 30 18:54:09 10.0.2.15 systemd[1]: Stopping Watch /etc/sysconfig/btrfsmaintenance. Sep 30 18:54:09 10.0.2.15 systemd[1]: Started Watch /etc/sysconfig/btrfsmaintenance. Sep 30 18:54:09 10.0.2.15 systemd[1]: Starting Update cron periods from /etc/sysconfig/btrfsmaintenance... Sep 30 18:54:09 10.0.2.15 btrfsmaintenance-refresh-cron.sh[2952]: Refresh script btrfs-scrub.sh for uninstall Sep 30 18:54:09 10.0.2.15 btrfsmaintenance-refresh-cron.sh[2952]: Refresh script btrfs-defrag.sh for uninstall Sep 30 18:54:09 10.0.2.15 btrfsmaintenance-refresh-cron.sh[2952]: Refresh script btrfs-balance.sh for uninstall Sep 30 18:54:09 10.0.2.15 btrfsmaintenance-refresh-cron.sh[2952]: Refresh script btrfs-trim.sh for uninstall Sep 30 18:54:09 10.0.2.15 btrfsmaintenance-refresh-cron.sh[2952]: Refresh timer btrfs-scrub for none Sep 30 18:54:09 10.0.2.15 systemd[1]: Reloading. Sep 30 18:54:09 10.0.2.15 systemd[1]: nss-lookup.target: Dependency Before=nss-lookup.target dropped Sep 30 18:54:09 10.0.2.15 btrfsmaintenance-refresh-cron.sh[2952]: Refresh timer btrfs-defrag for none Sep 30 18:54:09 10.0.2.15 systemd[1]: Reloading. Sep 30 18:54:10 10.0.2.15 systemd[1]: nss-lookup.target: Dependency Before=nss-lookup.target dropped Sep 30 18:54:10 10.0.2.15 btrfsmaintenance-refresh-cron.sh[2952]: Refresh timer btrfs-balance for weekly Sep 30 18:54:10 10.0.2.15 systemd[1]: Reloading. Sep 30 18:54:10 10.0.2.15 systemd[1]: nss-lookup.target: Dependency Before=nss-lookup.target dropped Sep 30 18:54:10 10.0.2.15 btrfsmaintenance-refresh-cron.sh[2952]: Refresh timer btrfs-trim for none Sep 30 18:54:10 10.0.2.15 systemd[1]: Reloading. Sep 30 18:54:10 10.0.2.15 systemd[1]: nss-lookup.target: Dependency Before=nss-lookup.target dropped Sep 30 18:54:10 10.0.2.15 systemd[1]: Started Update cron periods from /etc/sysconfig/btrfsmaintenance. Processes: bor@10:~> pstree -lp 2326 zypper(2326)─┬─btrfs-defrag-pl(2356) ├─rpm(2837)───sh(2891)───sh(2929)───systemctl(2930) ├─snapper.py(2359) └─systemd-inhibit(2355)───cat(2357) bor@10:~> ps -fwwp 2930 UID PID PPID C STIME TTY TIME CMD root 2930 2929 0 18:54 pts/0 00:00:00 /usr/bin/systemctl try-restart btrfsmaintenance-refresh.service btrfsmaintenance-refresh.path btrfs-balance.service btrfs-balance.timer btrfs-defrag.service btrfs-defrag.timer btrfs-scrub.service btrfs-scrub.timer btrfs-trim.service btrfs-trim.timer bor@10:~> systemctl list-jobs JOB UNIT TYPE STATE 3285 btrfs-balance.service nop waiting 3381 btrfs-defrag.service nop waiting 2 jobs listed. bor@10:~> sudo systemctl status btrfsmaintenance-refresh.service btrfsmaintenance-refresh.path btrfs-balance.service btrfs-balance.timer btrfs-defrag.service btrfs-defrag.timer btrfs-scrub.service btrfs-scrub.timer btrfs-trim.service btrfs-trim.timer ● btrfsmaintenance-refresh.service - Update cron periods from /etc/sysconfig/btrfsmaintenance Loaded: loaded (/usr/lib/systemd/system/btrfsmaintenance-refresh.service; enabled; vendor preset: enabled) Active: inactive (dead) since Sun 2018-09-30 18:54:10 MSK; 2h 4min ago Process: 2952 ExecStart=/usr/share/btrfsmaintenance/btrfsmaintenance-refresh-cron.sh systemd-timer (code=exited, status=0/SUCCESS) Main PID: 2952 (code=exited, status=0/SUCCESS) Sep 30 18:54:09 10.0.2.15 systemd[1]: Starting Update cron periods from /etc/sysconfig/btrfsmaintenance... Sep 30 18:54:09 10.0.2.15 btrfsmaintenance-refresh-cron.sh[2952]: Refresh script btrfs-scrub.sh for uninstall Sep 30 18:54:09 10.0.2.15 btrfsmaintenance-refresh-cron.sh[2952]: Refresh script btrfs-defrag.sh for uninstall Sep 30 18:54:09 10.0.2.15 btrfsmaintenance-refresh-cron.sh[2952]: Refresh script btrfs-balance.sh for uninstall Sep 30 18:54:09 10.0.2.15 btrfsmaintenance-refresh-cron.sh[2952]: Refresh script btrfs-trim.sh for uninstall Sep 30 18:54:09 10.0.2.15 btrfsmaintenance-refresh-cron.sh[2952]: Refresh timer btrfs-scrub for none Sep 30 18:54:09 10.0.2.15 btrfsmaintenance-refresh-cron.sh[2952]: Refresh timer btrfs-defrag for none Sep 30 18:54:10 10.0.2.15 btrfsmaintenance-refresh-cron.sh[2952]: Refresh timer btrfs-balance for weekly Sep 30 18:54:10 10.0.2.15 btrfsmaintenance-refresh-cron.sh[2952]: Refresh timer btrfs-trim for none Sep 30 18:54:10 10.0.2.15 systemd[1]: Started Update cron periods from /etc/sysconfig/btrfsmaintenance. ● btrfsmaintenance-refresh.path - Watch /etc/sysconfig/btrfsmaintenance Loaded: loaded (/usr/lib/systemd/system/btrfsmaintenance-refresh.path; enabled; vendor preset: disabled) Active: active (waiting) since Sun 2018-09-30 18:54:09 MSK; 2h 4min ago Sep 30 18:54:09 10.0.2.15 systemd[1]: Started Watch /etc/sysconfig/btrfsmaintenance. ● btrfs-balance.service - Balance block groups on a btrfs filesystem Loaded: loaded (/usr/lib/systemd/system/btrfs-balance.service; static; vendor preset: disabled) Active: inactive (dead) Docs: man:btrfs-balance ● btrfs-balance.timer - Balance block groups on a btrfs filesystem Loaded: loaded (/usr/lib/systemd/system/btrfs-balance.timer; enabled; vendor preset: enabled) Drop-In: /etc/systemd/system/btrfs-balance.timer.d └─schedule.conf Active: active (waiting) since Sun 2018-09-30 18:54:09 MSK; 2h 4min ago Trigger: Mon 2018-10-01 00:00:00 MSK; 3h 1min left Docs: man:btrfs-balance Sep 30 18:54:09 10.0.2.15 systemd[1]: Started Balance block groups on a btrfs filesystem. ● btrfs-defrag.service - Defragment file data on a mounted filesystem Loaded: loaded (/usr/lib/systemd/system/btrfs-defrag.service; static; vendor preset: disabled) Active: inactive (dead) Docs: man:btrfs-filesystem ● btrfs-defrag.timer - Defragment file data and/or directory metadata Loaded: loaded (/usr/lib/systemd/system/btrfs-defrag.timer; disabled; vendor preset: enabled) Active: inactive (dead) Trigger: n/a Docs: man:btrfs-filesystem ● btrfs-scrub.service - Scrub btrfs filesystem, verify block checksums Loaded: loaded (/usr/lib/systemd/system/btrfs-scrub.service; static; vendor preset: disabled) Active: inactive (dead) Docs: man:fstrim ● btrfs-scrub.timer - Scrub btrfs filesystem, verify block checksums Loaded: loaded (/usr/lib/systemd/system/btrfs-scrub.timer; disabled; vendor preset: enabled) Active: inactive (dead) Trigger: n/a Docs: man:btrfs-scrub ● btrfs-trim.service - Discard unused blocks on a mounted filesystem Loaded: loaded (/usr/lib/systemd/system/btrfs-trim.service; static; vendor preset: disabled) Active: inactive (dead) Docs: man:fstrim ● btrfs-trim.timer - Discard unused blocks on a mounted filesystem Loaded: loaded (/usr/lib/systemd/system/btrfs-trim.timer; disabled; vendor preset: enabled) Active: inactive (dead) Trigger: n/a Docs: man:fstrim bor@10:~> -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.opensuse.org/show_bug.cgi?id=1110259 Andrei Borzenkov <arvidjaar@gmail.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |systemd-maintainers@suse.de -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.opensuse.org/show_bug.cgi?id=1110259 http://bugzilla.opensuse.org/show_bug.cgi?id=1110259#c7 Michael Voronov <mikivo@list.ru> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |mikivo@list.ru --- Comment #7 from Michael Voronov <mikivo@list.ru> --- I can confirm it on OpenSUSE Tumbleweed. It hangs when zypper tries to delete the old version. The workaround is to delete it with: sudo zypper rm btrfsmaintenance-0.4.2-2.1 And then restart zypper dup -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.opensuse.org/show_bug.cgi?id=1110259 http://bugzilla.opensuse.org/show_bug.cgi?id=1110259#c8 Neil Rickert <nwr10cst-oslnx@yahoo.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |nwr10cst-oslnx@yahoo.com --- Comment #8 from Neil Rickert <nwr10cst-oslnx@yahoo.com> --- Created attachment 806607 --> http://bugzilla.opensuse.org/attachment.cgi?id=806607&action=edit "ps" and other output from hung process. I had the same problem in the update to 20190529. The attached file contains a segment from screenlog.0 (terminal log of "zypper dup" to which I have appended a "typescript" log looking at hung processes from another terminal. I killed process 5027 after it appeared hung for 15 minutes. The update resumed without problem. I do not have any "btrfs" file systems on that computer, so any scripts using "btrfsmaintenance" should have finished quickly. -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.opensuse.org/show_bug.cgi?id=1110259 http://bugzilla.opensuse.org/show_bug.cgi?id=1110259#c9 --- Comment #9 from Neil Rickert <nwr10cst-oslnx@yahoo.com> --- *** Bug 1130702 has been marked as a duplicate of this bug. *** -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.opensuse.org/show_bug.cgi?id=1110259 http://bugzilla.opensuse.org/show_bug.cgi?id=1110259#c10 Frank Kruger <fkrueger@mailbox.org> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |fkrueger@mailbox.org --- Comment #10 from Frank Kruger <fkrueger@mailbox.org> --- (In reply to Neil Rickert from comment #8)
Created attachment 806607 [details] "ps" and other output from hung process.
I do not have any "btrfs" file systems on that computer, so any scripts using "btrfsmaintenance" should have finished quickly.
FYI: https://bugzilla.suse.com/show_bug.cgi?id=1124823#c3 -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.opensuse.org/show_bug.cgi?id=1110259 Oliver Kurz <okurz@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |okurz@suse.com See Also| |https://bugzilla.opensuse.o | |rg/show_bug.cgi?id=1137084 -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.opensuse.org/show_bug.cgi?id=1110259 André asdfg <andret@tuta.io> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |andret@tuta.io -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.opensuse.org/show_bug.cgi?id=1110259 Michael K <f4tmike@web.de> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |f4tmike@web.de -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.opensuse.org/show_bug.cgi?id=1110259 Nico Kruber <nico.kruber@gmail.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |nico.kruber@gmail.com -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.opensuse.org/show_bug.cgi?id=1110259 http://bugzilla.opensuse.org/show_bug.cgi?id=1110259#c12 Jean Delvare <jdelvare@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |martin.liska@suse.com --- Comment #12 from Jean Delvare <jdelvare@suse.com> --- *** Bug 1137084 has been marked as a duplicate of this bug. *** -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.opensuse.org/show_bug.cgi?id=1110259 Jean Delvare <jdelvare@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |jdelvare@suse.com -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.opensuse.org/show_bug.cgi?id=1110259 http://bugzilla.opensuse.org/show_bug.cgi?id=1110259#c13 Tristan Miller <psychonaut@nothingisreal.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |psychonaut@nothingisreal.co | |m --- Comment #13 from Tristan Miller <psychonaut@nothingisreal.com> --- (In reply to Michael Voronov from comment #7)
I can confirm it on OpenSUSE Tumbleweed. It hangs when zypper tries to delete the old version. The workaround is to delete it with: sudo zypper rm btrfsmaintenance-0.4.2-2.1 And then restart zypper dup
I think that's a pretty poor workaround as you will end up skipping all the post-installation scripts of the packages that were successfully installed. A better workaround is to kill the command that is causing the installation of btrfsmaintenance to hang, as in Comment 8. I did this by running "ps -ft pts/0", making note of the PPID of the "/usr/bin/systemctl try-restart btrfsmaintenance-refresh.service" process, and killing it. -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.opensuse.org/show_bug.cgi?id=1110259 http://bugzilla.opensuse.org/show_bug.cgi?id=1110259#c14 Miko G <peeledbanana@tutanota.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |peeledbanana@tutanota.com --- Comment #14 from Miko G <peeledbanana@tutanota.com> --- Installing Tumbleweed I got btrfsmaintenance going through a cron loop after install. I've verified the iso and it was ok. Reinstalling also did not help. -- You are receiving this mail because: You are on the CC list for the bug.
participants (1)
-
bugzilla_noreply＠novell.com