[opensuse-factory] openQA Questions running tests manually
I'm new to openQA. I have devoured and digested the openQA docs: Getting Started, Installing, Writing Tests, etc. I have openQA installed and running on an openSUSE 13.2 box. From the “Getting Started” documentation I ran the “/usr/share/openqa/script/fetchneedles” script that downloaded the openSUSE tests and needles and loaded the “/var/lib/openqa/tests/opensuse/templates” file. From the “Getting Started” document under sub-heading “Adding a new ISO to test” I followed the example there to the test. But what I am really interested in is running just the “...opensuse/tests/x11regressions/firefox” tests. How can I manually run this subset? Is there a way via the client command to tell it to just run a specific set of tests? Or how exactly is this done? There is a main.pm file in the opensuse/ directory. This seems to be the entry point for running the tests. Do I modify this file to control which tests are run, which are not by setting various variables? There is so much that seems vague especially to a newbie. The docs should be updated to eliminate any confusion. Thank you for any help you can give. Charles Robertson
Charles G Robertson wrote:
But what I am really interested in is running just the “...opensuse/tests/x11regressions/firefox” tests. How can I manually run this subset? Is there a way via the client command to tell it to just run a specific set of tests? Or how exactly is this done?
The current code in opensuse/tests mostly assumes that it first has to do an installation and then test all applications in one run. That's the scenario we use openQA for atm.
There is a main.pm file in the opensuse/ directory. This seems to be the entry point for running the tests. Do I modify this file to control which tests are run, which are not by setting various variables?
Yes, for development purposes you could modify main.pm to only run the tests you need. Instead of POSTing an iso to create jobs you can also pass an already installed hard disk image. So you basically can reduce main.pm to call two tests. One that makes sure the desktop is booted and another one that tests your application.
There is so much that seems vague especially to a newbie. The docs should be updated to eliminate any confusion.
The usual problem, those that write the docu already know how it works so it's not obvious what's missing. Patches welcome :-) cu Ludwig -- (o_ Ludwig Nussel //\ V_/_ http://www.suse.de/ SUSE Linux GmbH, GF: Felix Imendörffer, Jane Smithard, Dilip Upmanyu, Graham Norton, HRB 21284 (AG Nürnberg) -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-factory+owner@opensuse.org
participants (2)
-
Charles G Robertson -
Ludwig Nussel