Hi! Michal and I are working on a bug with network configuration using AutoYaST. The fix is rather intrusive so we want to add tests and check for regressions. The basic idea for such tests is to start with a specific AY profile and a matching virtual hardware (network cards), run the installation, and check the resulting filesystem for expected configuration. One test case: - autoyast profile - feature being tested (eg. NIC naming) - helpers for the automated test (multiple pkg repos, disable sig check, final_halt) - a standard installation repo (SP2) - new yast package(s) to test - to be put to a DUD and an add-on repo (on a CD) - virtual hardware configuration (platform: libvirt) - feature-wise (number of NICs and their MACs) - helpers (second CDROM) - assertions to check after the run - simple way: check that some files have excactly some expected content Automating multiple runs of multiple test cases: TBD If this sounds too abstract, here's our existing manual test plan for the bug: http://idontknow.suse.cz/install/ (internal, hrefs work) https://gist.github.com/4194824 (external, hrefs broken online) AFAIK we don't have a framework for such tests, so we want to build one. Well, I know of some related work: - OpenQA - Hamsta - Jenkins CI - AutoYaST tests that I don't know of? So that's why I'm sharing the design and want to check with you: Are we reinventing the wheel? Can we reuse the existing projects? -- Martin Vidner, Cloud & Systems Management Team http://en.opensuse.org/User:Mvidner Kuracke oddeleni v restauraci je jako fekalni oddeleni v bazenu