Mailinglist Archive: opensuse-factory (331 mails)

< Previous Next >
Re: [opensuse-factory] New Tumbleweed snapshot 20170911 released!
On Wed, 2017-09-13 at 18:24 +0200, Simon Becherer wrote:
Hi,

Please check the known defects of this snapshot before upgrading:
https://openqa.opensuse.org/tests/overview?distri=opensuse&groupid=1&;
version=Tumbleweed&build=20170911

is there anywhere a description for:

red/yellow/green - faild/soft-failed/passed

to understand better whats going on?


The openQA documentation explains faild/sottfailed/passed like this:


passed
------
No critical check failed during the process. It does
n’t necessarily mean that all
testmodules were successful or that no single assertion failed.

failed
------
At least one assertion considered to be critical was not satisfied at
some point.

softfailed
----------
At least one non-critical assertion was not satisfied at some point
(eg. a softfailure has
been recorded explicitly via record_soft_failure) or workaround needles
are in place.

See http://open.qa/docs/current.pdf

We assign softfails either for 'test related bugs' or 'product bugs,
that can be worked around'; every of the 'yellow test' has details
inside which bugs it triggere

so for example the test rnu https://openqa.opensuse.org/tests/484279
(update from Tumblewed to 'the next tumbleweed snapshot') triggered a
softfail in force_cron_run which is further described at:

# Soft Failure:
bsc#1017461 - long running btrfs cron jobs can make system
unresponsive

and

# Soft Failure:
bsc#1017461: needle(s) top-load-decreased not found within 30

Everything on that run is green.

Does that help you?

Cheers
Dominique
< Previous Next >
Follow Ups