[yast-devel] Running AutoYaST integration tests on openQA
After meeting Schubi and Ancor, we've reached an agreement about how we could run AutoYaST integration tests on openQA. = Background On the openQA side, it looks like: * They use an openQA variable to set the profile name (called 'AUTOYAST')[1]. Also an AUTOUPGRADE variable is available. * They have some modules/tests to check the AutoYaST installation process[2]. On our side, we have a set of profiles and tests. Those tests are just RSpec aspects which run some scripts to check everything is ok. Profile and tests are matched by name. So, if you install a system using the 'sles12.xml' profile, you should run 'sles12.rb' test. = Proposed solution The idea is to create a RPM package containing profiles and tests (basically, the 'test' directory[3] from AutoYaST integration tests). Then, we'll add a new openQA module/test which: * Install the tests package (can be fetched from OBS/IBS). * Install RSpec. * Run the tests which match the AutoYaST profile and report the result. * Clean-up the installed packages. There're some minor issues to solve like, if we finally use RSpec to run the tests, the helper should be smart enough to run those tests locally. But it's something really easy to solve. Also this solution opens the door to use openQA as a backend for AutoYaST integration tests in the future. Please, feedback is welcome! Regards, Imo [1] https://openqa.suse.de/tests/157785 [2] https://openqa.suse.de/tests/157785/modules/system/steps/1 [3] https://github.com/yast/autoyast-integration-test/tree/master/test -- Imobach González Sosa YaST Team at SUSE LINUX GmbH
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 10.11.2015 13:59, Imobach González Sosa wrote:
Please, feedback is welcome!
The team currently works on their proposal for requirements at: https://etherpad.nue.suse.com/p/autoyast-testing This is still "not official" and unfinished yet :) - From my POV we should first have a better overview/summary what we want to solve, where we want to get. Then we could say how. Lukas - -- Lukas Ocilka, Systems Management (Yast) Team Leader SLE Department, SUSE Linux -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iEYEARECAAYFAlZB7D8ACgkQVSqMdRCqTizURQCfdW+E/qzysJWQ3S5JNAlLyf7H 0+4AnjimjmnY0bHTFImcYhzqQ1iaSyyY =ZAri -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: yast-devel+unsubscribe@opensuse.org To contact the owner, e-mail: yast-devel+owner@opensuse.org
On Tuesday, November 10, 2015 02:08:16 PM Lukas Ocilka wrote:
On 10.11.2015 13:59, Imobach González Sosa wrote:
Please, feedback is welcome!
The team currently works on their proposal for requirements at:
https://etherpad.nue.suse.com/p/autoyast-testing
This is still "not official" and unfinished yet :) From my POV we should first have a better overview/summary what we want to solve, where we want to get. Then we could say how.
I've started to write in that etherpad but after reading your mail again, I moved all the content to https://etherpad.nue.suse.com/p/autoyast-tests-on-openqa Maybe we should share this link with them. Regards, Imo -- Imobach González Sosa YaST Team at SUSE LINUX GmbH
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 10.11.2015 14:23, Imobach González Sosa wrote:
I've started to write in that etherpad but after reading your mail again, I moved all the content to https://etherpad.nue.suse.com/p/autoyast-tests-on-openqa
Maybe we should share this link with them.
Yes, but better share the link with them + talk to them about it :) Find out what is missing in your proposal, but wanted by them (and why). Thanks Lukas PS: I've added a few notes there in yellow color :) - -- Lukas Ocilka, Systems Management (Yast) Team Leader SLE Department, SUSE Linux -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iEYEARECAAYFAlZC8BoACgkQVSqMdRCqTiztBQCePy/K6BUhjDAvRPkrlG6kqfLd MSwAn06O9JjqFKUFLS2ce6DwaedqbSug =s3u4 -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: yast-devel+unsubscribe@opensuse.org To contact the owner, e-mail: yast-devel+owner@opensuse.org
On Wednesday, November 11, 2015 08:36:58 AM Lukas Ocilka wrote:
On 10.11.2015 14:23, Imobach González Sosa wrote:
I've started to write in that etherpad but after reading your mail again, I moved all the content to https://etherpad.nue.suse.com/p/autoyast-tests-on-openqa
Maybe we should share this link with them.
Yes, but better share the link with them + talk to them about it :)
Yes, Petr contacted me yesterday and we shared the link with them :) Actually, they've contributed some ideas to the document already. We'll keep the discussion.
Find out what is missing in your proposal, but wanted by them (and why).
Thanks Lukas
PS: I've added a few notes there in yellow color :)
Great, thanks! -- Imobach González Sosa YaST Team at SUSE LINUX GmbH
participants (2)
-
Imobach González Sosa
-
Lukas Ocilka