some of us have been talking about "kruemel.infra.opensuse.org" during
the weekend. This machine is hosting "planet.opensuse.org" and was
broken for a while, as most of us couldn't log into it.
"salt-minion" was also not running any more, so we couldn't use Salt to
get back in.
It seems that the machine was broken during a "zypper dup" on Aug 29.
Even basic commands like "zypper" and/or "vim" where no longer
due to missing libraries (libzypp, libperl, etc. pp.).
I was able to get the machine back by copying those files in place and
afterwards re-installing the affected RPMs.
The machine is now back and working as expected. I've upgraded it to the
latest and greatest, and the monitoring is "happy".
"planet.opensuse.org" also seems to work as expected.
I've also run a state.apply via Salt, so the machine should be back to
normal. Unfortunately there seems to be no responsible person for this
machine (at least according to the pillar data). In case anyone knows
something / someone, please double-check that everything works as
P.S.: This service / machine is probably another good candidate for
containerization, as we are running a whole VM for a simple stupid web