Announcement:New openQA features available: Custom hook scripts on "job done" + the auto-review workflow
To all users of openQA, good news everyone! openQA has gained a new feature called "Custom hook scripts on 'job done' based on result". With this every openQA instance can be configured to run custom scripts or applications whenever a openQA job finishes. Based on the result of the job different scripts can be called, for example for a "failed" or "incomplete" or "passed" job. Next to the already existing AMQP events (http://open.qa/docs/#_configuring_amqp_message_emission) in openQA this could be used to send notifications, trigger other steps of a bigger CI pipeline or run additional analysis steps on test results. Our common openSUSE instance openqa.opensuse.org is using this feature already and triggers the so called "auto-review"-workflow, see https://github.com/os-autoinst/scripts/#auto-review---automatically-detect-k... for details. With this incomplete and failed jobs are automatically labeled with ticket links for "known issues" based on simple regex strings specified in tickets on progress.opensuse.org, our main issue tracker for test issues. Also, where specified accordingly in these tickets, jobs are automatically retriggered. With this we envision that the review of openQA test results can become much easier. Of course we are never tired to improve the workflows even further, work on new ideas and improve the overall quality even more. If you want to know more about openQA in general visit http://open.qa/ Have fun, Oliver for the SUSE QE Tools team
On 11/12/2020 08.08, Oliver Kurz wrote:
Of course we are never tired to improve the workflows even further, work on new ideas and improve the overall quality even more.
https://en.wikipedia.org/wiki/Webhook to me seems like a good way to notify relevant parties/tools I guess, with the new custom hook scripts, one can easily implement a webhook-trigger. The advantage is then that you do not need to trust other people's code, because you just send a HTTP-request there.
Hi Oliver, Oliver Kurz <okurz@suse.de> writes:
To all users of openQA, good news everyone!
openQA has gained a new feature called "Custom hook scripts on 'job done' based on result". With this every openQA instance can be configured to run custom scripts or applications whenever a openQA job finishes. Based on the result of the job different scripts can be called, for example for a "failed" or "incomplete" or "passed" job. Next to the already existing AMQP events (http://open.qa/docs/#_configuring_amqp_message_emission) in openQA this could be used to send notifications, trigger other steps of a bigger CI pipeline or run additional analysis steps on test results.
This is very cool! In case anyone is looking for the docs of this feature, they are here: http://open.qa/docs/#_enable_custom_hook_scripts_on_job_done_based_on_result tl;dr; you just have to set a variable called `OPENQA_JOB_DONE_HOOK_$RESULT` (replacing $RESULT with FAILED, SUCCEEDED, etc) that points to an executable on the openQA system. Or you can configure the hooks via openQA's config file too.
Our common openSUSE instance openqa.opensuse.org is using this feature already and triggers the so called "auto-review"-workflow, see https://github.com/os-autoinst/scripts/#auto-review---automatically-detect-k... for details. With this incomplete and failed jobs are automatically labeled with ticket links for "known issues" based on simple regex strings specified in tickets on progress.opensuse.org, our main issue tracker for test issues. Also, where specified accordingly in these tickets, jobs are automatically retriggered. With this we envision that the review of openQA test results can become much easier.
Of course we are never tired to improve the workflows even further, work on new ideas and improve the overall quality even more.
If you want to know more about openQA in general visit http://open.qa/
Have fun, Oliver for the SUSE QE Tools team _______________________________________________ openSUSE Factory mailing list -- factory@lists.opensuse.org To unsubscribe, email factory-leave@lists.opensuse.org List Netiquette: https://en.opensuse.org/openSUSE:Mailing_list_netiquette List Archives: https://lists.opensuse.org/archives/list/factory@lists.opensuse.org
-- Dan Čermák <dcermak@suse.com> Software Engineer Development tools SUSE Software Solutions Germany GmbH Maxfeldstr. 5 90409 Nuremberg Germany (HRB 36809, AG Nürnberg) Managing Director: Felix Imendörffer
participants (3)
-
Bernhard M. Wiedemann -
Dan Čermák -
Oliver Kurz