Forgot to add some info before posting, sorry. In addition to what written above (how to reproduce), the issue is that oscap is treating some rules as "not applicable" instead of "fail". This happens only on openSUSE Leap 15.5 aarch64, while the test passes on: - openSUSE TW aarch64/x86_64 - SLES 15.5 x86_64/aarch64 Related openqa test: https://openqa.opensuse.org/tests/2656844