Testing: [WAS: Re: [opensuse] Brasero crashes attempting to burn a DVD]
On Mon, Dec 8, 2014 at 12:27 PM, jdd
Le 08/12/2014 18:23, Marco Calistri a écrit :
I'm not tester, developer nor maintainer, I'm a simple and dumb user and I expect the software bundled into the release being at least tested :-/
tested for sure, but not on your computer :-(
everybody can be a tester is he accept to try factory (at least at free time)
Agreed, except your terminology is a month out of date. (ie. In October, what you said was right, but the names have been changed to confuse the innocent.) - As of Dec 2014 - tumbleweed testing is supposed to be appropriate for everyone. It has at a minimum passed autoQA and thus boots in the tested configs as well as passing various other autoQA tests. - factory testing should be reserved for individuals who troubleshoot autoQA failures. For a little info on autoQA: https://openqa.opensuse.org/ It is very interesting to review the results of openQA https://openqa.opensuse.org/tests/ Take a look at all the choices in the "testsuite" pull-down. The last column to the right shows the number of failed tests. Find a test with some failures, then go to the far left hand column and click the test number to get details. Here's an example: https://openqa.opensuse.org/tests/38005 It has 3 failed tests, but let's ignore those for now. It does successfully install gimp and launch it. You can see some screenshots from that process at: https://openqa.opensuse.org/tests/38005/modules/gimp/steps/1 Thus, if you are a dev, you can drill down into the autoQA testing and take a look at what is / isn't working. For test 38005 you can see an overview of the failures at https://openqa.opensuse.org/tests/overview?build=261.2&distri=opensuse&version=Core For test 38005 you can see oocalc failed to start at: https://openqa.opensuse.org/tests/38005/modules/oocalc/steps/1 If you look at that same test harness in test 38100 (run with Tumbleweed and gnome) you see it passed: https://openqa.opensuse.org/tests/38100/modules/oocalc/steps/1 Thus if you are a Tumbleweed user you hopefully won't experience oocalc failing. If you are a dev and you want to reproduce that failure you have to download the ISO for the build under test and give it a shot. Thus investigating failed tests is why one would download factory and/or one of the ring ISOs. The ISO tested by test 38005 is available on the left side under "download iso" at: https://openqa.opensuse.org/tests/38005 I've haven't been a hardcore software developer in over a decade, but openQA is some of the most impressive automated distro testing I've ever seen. Greg -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org
Le 08/12/2014 19:48, Greg Freemyer a écrit :
On Mon, Dec 8, 2014 at 12:27 PM, jdd
wrote: Le 08/12/2014 18:23, Marco Calistri a écrit :
I'm not tester, developer nor maintainer, I'm a simple and dumb user and I expect the software bundled into the release being at least tested :-/
tested for sure, but not on your computer :-(
everybody can be a tester is he accept to try factory (at least at free time)
Agreed, except your terminology is a month out of date. (ie. In October, what you said was right, but the names have been changed to confuse the innocent.)
very good post to clarify a not so clear situation :-) - do i keep it below
right now I just try to debug stable 13.2 (and it's not that easy).
There are just too many - As of Dec 2014 - tumbleweed testing is supposed to be appropriate
for everyone. It has at a minimum passed autoQA and thus boots in the
tested configs as well as passing various other autoQA tests. - factory testing should be reserved for individuals who troubleshoot
autoQA failures. For a little info on autoQA: https://openqa.opensuse.org/ It is very interesting to review the results of openQA https://openqa.opensuse.org/tests/ Take a look at all the choices in the "testsuite" pull-down. The last column to the right shows the number of failed tests. Find a
test with some failures, then go to the far left hand column and click
the test number to get details. Here's an example: https://openqa.opensuse.org/tests/38005 It has 3 failed tests, but let's ignore those for now. It does
successfully install gimp and launch it. You can see some screenshots
from that process at:
https://openqa.opensuse.org/tests/38005/modules/gimp/steps/1 Thus, if you are a dev, you can drill down into the autoQA testing and
take a look at what is / isn't working. For test 38005 you can see an overview of the failures at
https://openqa.opensuse.org/tests/overview?build=261.2&distri=opensuse&version=Core For test 38005 you can see oocalc failed to start at:
https://openqa.opensuse.org/tests/38005/modules/oocalc/steps/1 If you look at that same test harness in test 38100 (run with
Tumbleweed and gnome) you see it passed:
https://openqa.opensuse.org/tests/38100/modules/oocalc/steps/1 Thus if you are a Tumbleweed user you hopefully won't experience
oocalc failing. If you are a dev and you want to reproduce that
failure you have to download the ISO for the build under test and give
it a shot. Thus investigating failed tests is why one would download factory
and/or one of the ring ISOs. The ISO tested by test 38005 is available on the left side under
"download iso" at:
https://openqa.opensuse.org/tests/38005 I've haven't been a hardcore software developer in over a decade, but
openQA is some of the most impressive automated distro testing I've
ever seen. Greg --
To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org
To contact the owner, e-mail: opensuse+owner@opensuse.org
participants (2)
-
Greg Freemyer
-
jdd