On Wed, 2017-09-13 at 18:24 +0200, Simon Becherer wrote:
Hi,
Please check the known defects of this snapshot before upgrading: https://openqa.opensuse.org/tests/overview?distri=opensuse&groupid=1& version=Tumbleweed&build=20170911
is there anywhere a description for:
red/yellow/green - faild/soft-failed/passed
to understand better whats going on?
The openQA documentation explains faild/sottfailed/passed like this: passed ------ No critical check failed during the process. It does n’t necessarily mean that all testmodules were successful or that no single assertion failed. failed ------ At least one assertion considered to be critical was not satisfied at some point. softfailed ---------- At least one non-critical assertion was not satisfied at some point (eg. a softfailure has been recorded explicitly via record_soft_failure) or workaround needles are in place. See http://open.qa/docs/current.pdf We assign softfails either for 'test related bugs' or 'product bugs, that can be worked around'; every of the 'yellow test' has details inside which bugs it triggere so for example the test rnu https://openqa.opensuse.org/tests/484279 (update from Tumblewed to 'the next tumbleweed snapshot') triggered a softfail in force_cron_run which is further described at: # Soft Failure: bsc#1017461 - long running btrfs cron jobs can make system unresponsive and # Soft Failure: bsc#1017461: needle(s) top-load-decreased not found within 30 Everything on that run is green. Does that help you? Cheers Dominique