On Fri, 2020-11-27 at 20:52 +0100, Oliver Kurz wrote:
To all users of openQA or anyone interested in running system-level tests in CI jobs,
I would like to make you aware of a new approach for running system- level tests using "isotovideo", the main backend of openQA tests, within continuous integration (CI) services, for example github actions, travis CI, gitlab CI, etc.
Following an updated section https://github.com/os-autoinst/os-autoinst#getting-started it is possible to run "openQA tests" using a simple, convenient container based on tests that can be provided for example in a git repository.
An easy example is described in https://github.com/os-autoinst/os-autoinst-distri-example#local-testing-and-...
Find the latest example CI run directly following https://github.com/os-autoinst/os-autoinst-distri-example/actions
Unless I'm missing something essential, the test step "Run isotovideo against test code in happy-path scenario" returned 0, although the test failed. [2020-11-26T15:08:23.011 UTC] [debug] >>> testapi::_check_backend_response: match=bootloader timed out after 30 (assert_screen) [2020-11-26T15:08:23.092 UTC] [info] ::: basetest::runtest: # Test died: no candidate needle with tag(s) 'bootloader' matched ... 1: EXIT 0 I suppose the test fails because it's "one simple test where you need to create the needles for". Forgive my ignorance - how would I do that? Can I fetch them from somewhere? More importantly, how would I set up this test so that it actually fails the CI when it the test fails? Martin -- Dr. Martin Wilck <mwilck@suse.com>, Tel. +49 (0)911 74053 2107 SUSE Software Solutions Germany GmbH HRB 36809, AG Nürnberg GF: Felix Imendörffer