-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Yes thanks, that was what i am searching for. simoN Am 13.09.2017 um 18:38 schrieb Dominique Leuenberger / DimStar:
On Wed, 2017-09-13 at 18:24 +0200, Simon Becherer wrote:
Hi,
Please check the known defects of this snapshot before upgrading: https://openqa.opensuse.org/tests/overview?distri=opensuse&groupid=1& version=Tumbleweed&build=20170911
is there anywhere a description for:
red/yellow/green - faild/soft-failed/passed
to understand better whats going on?
The openQA documentation explains faild/sottfailed/passed like this:
passed ------ No critical check failed during the process. It does n’t necessarily mean that all testmodules were successful or that no single assertion failed.
failed ------ At least one assertion considered to be critical was not satisfied at some point.
softfailed ---------- At least one non-critical assertion was not satisfied at some point (eg. a softfailure has been recorded explicitly via record_soft_failure) or workaround needles are in place.
See http://open.qa/docs/current.pdf
We assign softfails either for 'test related bugs' or 'product bugs, that can be worked around'; every of the 'yellow test' has details inside which bugs it triggere
so for example the test rnu https://openqa.opensuse.org/tests/484279 (update from Tumblewed to 'the next tumbleweed snapshot') triggered a softfail in force_cron_run which is further described at:
# Soft Failure: bsc#1017461 - long running btrfs cron jobs can make system unresponsive
and
# Soft Failure: bsc#1017461: needle(s) top-load-decreased not found within 30
Everything on that run is green.
Does that help you?
Cheers Dominique
- -- B e c h e r e r GmbH Sondermaschinenbau Mauermatten Strasse 22 79183 Waldkirch Germany Tel.: (+49) (0)7681 3134 Fax: (+49) (0)7681 4378 Mail: info@becherer.de Web: www.becherer.de USt-ID-Nr.: DE 814912198 Registergericht: Freiburg HRB 701860 Geschäftsführer: Dipl.-Ing. (FH), EWE Simon H. Becherer Gerichtsstand / Sitz: Waldkirch Es gelten ausschließlich unsere allgemeinen Liefer- und Zahlungsbedingungen / Einkaufsbedingungen: www.becherer.de/AGB -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.19 (GNU/Linux) iQIcBAEBAgAGBQJZuWY2AAoJEOuDxDCJWQG+ahQP+wU97P09CONleeclOISXbP6P IXa4nqhrwMuSCVMBONo+BGNxhUfKdBDg4VRn9XMSN3fjy06DMWCckGvBZSY/yrwy rjgbhQVmXown1XApRRCp/t7K9W2qWBVoaYWwWzL8MBnByY2AIDxnBEgk+UT5Q9I1 hf0rVLATvVbeWJrYK7jV2q4k/fFZ+etGWYFwXzCOPWfmSqqdghwoKiEPEeUGC4jw lnFHt5OROrQf17PnyboR9x/TKcn14R+Er05B8w0f1wrwFSYIe2UKgOHYaDCuyS4d hLzAXme7393Lb6gl3bKVxgGAz1oe4I3hjFP+cBk9ZfeBq6/K2L5JtN7ee1HeJgp3 f0Zz+2+PU+ek5m1T0Ad96MtKRKiBGdjPNy18Vu1ij+cmNBFzhl8AWgsZQlk7r4cz aEWu7C5dKELaOkT5sBUXiOEosouf5bMal1Nu7/O3RNONDjdO5Gzg3i7I6gxL5rz+ JFSbziQh8YIAvb98IAybY//wU/7ZkeHkBeYxUCidORUFzs2qvpHfm4ZN14vSjRh6 B4YJ3DaXgTI1Oug+iMAU1Lpc1o01ld2hyzTvDPXvVnYBIpL6nbFWiRfERBPUfNNB lrRkJy5N5ZXWim/aw6NaoFJTRfCyfXMIcwH7cmrGgnIzw0dn4eqCRRjcXIbXeZXg gqNb5PGyuD5NVOmDxfZi =Gign -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-factory+owner@opensuse.org