Bug ID 929224
Summary system can't start/top services anymore, can't reboot, can't be shutdown
Classification openSUSE
Product openSUSE Distribution
Version 13.2
Hardware x86-64
OS Other
Status NEW
Severity Major
Priority P5 - None
Component Basesystem
Assignee bnc-team-screening@forge.provo.novell.com
Reporter chuller@suse.com
QA Contact qa-bugs@suse.de
Found By ---
Blocker ---

The problem manifested itself the first time i tried to restart libvirtd:

------------------------snip--------------------------
skaro:~ # rclibvirtd restart
Failed to restart libvirtd.service: Transaction is destructive
------------------------snip--------------------------

The message only appeared lie 5 minutes after entering the command


Next i wanted to reboot the system, which simply just did not do anything at
all, it just hung:

------------------------snip--------------------------
skaro:/usr/src/chuller/pennyworth # reboot



------------------------snip--------------------------


So I started looking for logs or any indication on why it does behave so weird.
dmesg did not show anything suspicious but one i ran journalctl it became
pretty clear that systemd somehow seems to be responsible for the current state
my machine was in. It showed a entry saying "systemd[1]: Looping too fast.
Throttling execution a little." every single second:

------------------------snip--------------------------
-- Logs begin at Fri 2014-11-28 18:35:55 CET, end at Thu 2015-04-30 14:53:41
CEST. --
Apr 30 14:53:41 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:40 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:39 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:38 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:36 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:35 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:34 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:32 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:31 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:30 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:28 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:27 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:26 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:24 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:23 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:22 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:21 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:19 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:18 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:17 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:15 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:14 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:13 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:11 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:10 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:09 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:08 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:06 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:05 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:04 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:02 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:01 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:53:00 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:58 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:57 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:56 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:54 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:53 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:52 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:51 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:49 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:48 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:47 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:45 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:44 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:43 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:41 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:40 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:39 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:38 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:36 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:35 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:34 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:32 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:31 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:30 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:28 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:27 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:26 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:25 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:23 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:22 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:21 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:19 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:18 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:17 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:15 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:14 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:13 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:12 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:10 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:09 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:08 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:06 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:05 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:04 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:02 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:01 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:52:00 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:51:58 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:51:57 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:51:56 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:51:54 skaro systemd[1]: Looping too fast. Throttling execution a
little.
Apr 30 14:51:53 skaro systemd[1]: Looping too fast. Throttling execution a
little.
------------------------snip--------------------------

which also made me chek ho much of diskspace the log file already uses:

------------------------snip--------------------------
skaro:~ # journalctl --disk-usage
Journals take up 552.0M on disk.
------------------------snip--------------------------

that made me try some more journalctl functions and it turned out my journal
was not consistent anymore as well:

------------------------snip--------------------------
skaro:~ # journalctl --verify
392b28: unused data
(entry_offset==0)������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������
  0%
3912e8: unused data
(entry_offset==0)������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������
  0%
ccbd68: unused data
(entry_offset==0)������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������
 46%
ccbdc8: unused data (entry_offset==0)
Entry number mismatch
File corruption detected at
/var/log/journal/74fc18841ff54a7f8e09f6b58d4bad53/system@00051483eed4fe2e-4ab91595e03ea8a3.journal~:000000
(of 16777216 bytes, 0%).
FAIL:
/var/log/journal/74fc18841ff54a7f8e09f6b58d4bad53/system@00051483eed4fe2e-4ab91595e03ea8a3.journal~
(Bad message)
391bb0: unused data
(entry_offset==0)������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������
  0%
Data object references invalid entry at
4002856������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������
 75%
File corruption detected at
/var/log/journal/74fc18841ff54a7f8e09f6b58d4bad53/system.journal:000000 (of
16777216 bytes, 0%).                                  
FAIL: /var/log/journal/74fc18841ff54a7f8e09f6b58d4bad53/system.journal (Bad
message)
------------------------snip--------------------------


Please advise on how to be able to reboot the system once in such a stage, or
even better on how to fix the problem without a reboot.
I currently am unable to do productive work with it and need to get it back
into a state where i can do QA on kvm/libvirt environments.


You are receiving this mail because: