http://bugzilla.suse.com/show_bug.cgi?id=929224 Bug ID: 929224 Summary: system can't start/top services anymore, can't reboot, can't be shutdown Classification: openSUSE Product: openSUSE Distribution Version: 13.2 Hardware: x86-64 OS: Other Status: NEW Severity: Major Priority: P5 - None Component: Basesystem Assignee: bnc-team-screening@forge.provo.novell.com Reporter: chuller@suse.com QA Contact: qa-bugs@suse.de Found By: --- Blocker: --- The problem manifested itself the first time i tried to restart libvirtd: ------------------------snip-------------------------- skaro:~ # rclibvirtd restart Failed to restart libvirtd.service: Transaction is destructive ------------------------snip-------------------------- The message only appeared lie 5 minutes after entering the command Next i wanted to reboot the system, which simply just did not do anything at all, it just hung: ------------------------snip-------------------------- skaro:/usr/src/chuller/pennyworth # reboot ------------------------snip-------------------------- So I started looking for logs or any indication on why it does behave so weird. dmesg did not show anything suspicious but one i ran journalctl it became pretty clear that systemd somehow seems to be responsible for the current state my machine was in. It showed a entry saying "systemd[1]: Looping too fast. Throttling execution a little." every single second: ------------------------snip-------------------------- -- Logs begin at Fri 2014-11-28 18:35:55 CET, end at Thu 2015-04-30 14:53:41 CEST. -- Apr 30 14:53:41 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:40 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:39 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:38 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:36 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:35 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:34 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:32 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:31 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:30 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:28 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:27 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:26 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:24 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:23 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:22 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:21 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:19 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:18 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:17 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:15 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:14 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:13 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:11 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:10 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:09 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:08 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:06 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:05 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:04 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:02 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:01 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:53:00 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:58 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:57 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:56 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:54 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:53 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:52 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:51 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:49 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:48 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:47 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:45 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:44 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:43 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:41 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:40 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:39 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:38 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:36 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:35 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:34 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:32 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:31 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:30 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:28 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:27 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:26 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:25 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:23 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:22 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:21 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:19 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:18 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:17 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:15 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:14 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:13 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:12 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:10 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:09 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:08 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:06 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:05 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:04 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:02 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:01 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:52:00 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:51:58 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:51:57 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:51:56 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:51:54 skaro systemd[1]: Looping too fast. Throttling execution a little. Apr 30 14:51:53 skaro systemd[1]: Looping too fast. Throttling execution a little. ------------------------snip-------------------------- which also made me chek ho much of diskspace the log file already uses: ------------------------snip-------------------------- skaro:~ # journalctl --disk-usage Journals take up 552.0M on disk. ------------------------snip-------------------------- that made me try some more journalctl functions and it turned out my journal was not consistent anymore as well: ------------------------snip-------------------------- skaro:~ # journalctl --verify 392b28: unused data (entry_offset==0)░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░ 0% 3912e8: unused data (entry_offset==0)░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░ 0% ccbd68: unused data (entry_offset==0)██████████████████████████████████░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░ 46% ccbdc8: unused data (entry_offset==0) Entry number mismatch File corruption detected at /var/log/journal/74fc18841ff54a7f8e09f6b58d4bad53/system@00051483eed4fe2e-4ab91595e03ea8a3.journal~:000000 (of 16777216 bytes, 0%). FAIL: /var/log/journal/74fc18841ff54a7f8e09f6b58d4bad53/system@00051483eed4fe2e-4ab91595e03ea8a3.journal~ (Bad message) 391bb0: unused data (entry_offset==0)░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░ 0% Data object references invalid entry at 4002856███████████████████████████████████████████████████████████████████░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░ 75% File corruption detected at /var/log/journal/74fc18841ff54a7f8e09f6b58d4bad53/system.journal:000000 (of 16777216 bytes, 0%). FAIL: /var/log/journal/74fc18841ff54a7f8e09f6b58d4bad53/system.journal (Bad message) ------------------------snip-------------------------- Please advise on how to be able to reboot the system once in such a stage, or even better on how to fix the problem without a reboot. I currently am unable to do productive work with it and need to get it back into a state where i can do QA on kvm/libvirt environments. -- You are receiving this mail because: You are on the CC list for the bug.