Judging from my manual tests and from the source code, it does write all settings correctly despite the crash - except for the LSM settings: https://github.com/yast/yast-security/blob/master/src/modules/Security.rb#L764 I crashes right before write_lsm_config(), so that part won't be written. Is that what this OpenQA tests is testing? Or does it check for error return codes in general? I am confused with all those screenshots in the yast2_system_settings part of https://openqa.opensuse.org/tests/2919011# .