Re: KVM preinstall on workers in own obs instance trouble
On Tue, 21 Nov 2023, 12:40:31 +0100, Andreas Schwab wrote:
On Nov 21 2023, Manfred Hollstein wrote:
FWIW, I changed the meta data for Slowroll yesterday after Bernhard's announcement. It now looks like this:
How did it look before?
<repository name="openSUSE_Slowroll"> <path project="openSUSE.org:openSUSE:ALP:Experimental:Slowroll" repository="standard"/> <arch>x86_64</arch> <arch>i586</arch> </repository>
On Tue, 21 Nov 2023, 12:47:55 +0100, Manfred Hollstein wrote:
On Tue, 21 Nov 2023, 12:40:31 +0100, Andreas Schwab wrote:
On Nov 21 2023, Manfred Hollstein wrote:
FWIW, I changed the meta data for Slowroll yesterday after Bernhard's announcement. It now looks like this:
How did it look before?
<repository name="openSUSE_Slowroll"> <path project="openSUSE.org:openSUSE:ALP:Experimental:Slowroll" repository="standard"/> <arch>x86_64</arch> <arch>i586</arch> </repository>
Hmm, I just changed that value back to this in my home repo on PMBS, now the state is buildable and publishable again. I'll do that for the Essentials project, too. But, we're back at what Stefan described in the initial e-mail. Cheers. l8er manfred -- Please avoid sending me Word or PowerPoint attachments. See http://www.fsf.org/philosophy/no-word-attachments.html Manfred Hollstein If you have any questions about GNU software: Hindenburgstr. 13-1 <mailto:manfred.h@gmx.net> 75446 Wiernsheim, FRG GPG fingerprint: 622D AD35 1D38 B7E0 DB60 1FEA AF76 932F 34EB 01E9
On Tue, 21 Nov 2023, 12:52:35 +0100, Manfred Hollstein wrote:
On Tue, 21 Nov 2023, 12:47:55 +0100, Manfred Hollstein wrote:
On Tue, 21 Nov 2023, 12:40:31 +0100, Andreas Schwab wrote:
On Nov 21 2023, Manfred Hollstein wrote:
FWIW, I changed the meta data for Slowroll yesterday after Bernhard's announcement. It now looks like this:
How did it look before?
<repository name="openSUSE_Slowroll"> <path project="openSUSE.org:openSUSE:ALP:Experimental:Slowroll" repository="standard"/> <arch>x86_64</arch> <arch>i586</arch> </repository>
Hmm, I just changed that value back to this in my home repo on PMBS, now the state is buildable and publishable again. I'll do that for the Essentials project, too.
Done. The project's status is no longer broken. Looks like PMBS doesn't see the new openSUSE:Slowroll project via its openSUSE.org link to the OBS API.
But, we're back at what Stefan described in the initial e-mail.
Cheers.
l8er manfred
On Nov 21 2023, Manfred Hollstein wrote:
On Tue, 21 Nov 2023, 12:40:31 +0100, Andreas Schwab wrote:
On Nov 21 2023, Manfred Hollstein wrote:
FWIW, I changed the meta data for Slowroll yesterday after Bernhard's announcement. It now looks like this:
How did it look before?
<repository name="openSUSE_Slowroll"> <path project="openSUSE.org:openSUSE:ALP:Experimental:Slowroll" repository="standard"/>
There is a difference in the meta between openSUSE:ALP:Experimental:Slowroll: <repository name="base"> <path project="openSUSE:Tumbleweed" repository="slowroll"/> <path project="openSUSE:ALP:Experimental:Slowroll:Base" repository="standard"/> and openSUSE:Slowroll: <repository name="base"> <path project="openSUSE:Slowroll:Base" repository="standard"/> <path project="openSUSE:Tumbleweed" repository="slowroll"/> The order of path entries matters. -- Andreas Schwab, SUSE Labs, schwab@suse.de GPG Key fingerprint = 0196 BAD8 1CE9 1970 F4BE 1748 E4D4 88E3 0EEA B9D7 "And now for something completely different."
On Tue, 21 Nov 2023, 13:11:59 +0100, Andreas Schwab wrote:
On Nov 21 2023, Manfred Hollstein wrote:
On Tue, 21 Nov 2023, 12:40:31 +0100, Andreas Schwab wrote:
On Nov 21 2023, Manfred Hollstein wrote:
FWIW, I changed the meta data for Slowroll yesterday after Bernhard's announcement. It now looks like this:
How did it look before?
<repository name="openSUSE_Slowroll"> <path project="openSUSE.org:openSUSE:ALP:Experimental:Slowroll" repository="standard"/>
There is a difference in the meta between openSUSE:ALP:Experimental:Slowroll:
<repository name="base"> <path project="openSUSE:Tumbleweed" repository="slowroll"/> <path project="openSUSE:ALP:Experimental:Slowroll:Base" repository="standard"/>
and openSUSE:Slowroll:
<repository name="base"> <path project="openSUSE:Slowroll:Base" repository="standard"/> <path project="openSUSE:Tumbleweed" repository="slowroll"/>
The order of path entries matters.
Sure, but this cannot be changed/fixed on the PMBS side, can it? That's probably more in Bernhard's hands... Cheers. l8er manfred
On Dienstag, 21. November 2023, 13:16:21 CET Manfred Hollstein wrote:
On Tue, 21 Nov 2023, 13:11:59 +0100, Andreas Schwab wrote:
On Nov 21 2023, Manfred Hollstein wrote:
On Tue, 21 Nov 2023, 12:40:31 +0100, Andreas Schwab wrote:
On Nov 21 2023, Manfred Hollstein wrote:
FWIW, I changed the meta data for Slowroll yesterday after Bernhard's announcement. It now looks like this:
How did it look before?
<repository name="openSUSE_Slowroll"> <path project="openSUSE.org:openSUSE:ALP:Experimental:Slowroll" repository="standard"/>
There is a difference in the meta between openSUSE:ALP:Experimental:Slowroll:
<repository name="base"> <path project="openSUSE:Tumbleweed" repository="slowroll"/> <path project="openSUSE:ALP:Experimental:Slowroll:Base" repository="standard"/>
and openSUSE:Slowroll:
<repository name="base"> <path project="openSUSE:Slowroll:Base" repository="standard"/> <path project="openSUSE:Tumbleweed" repository="slowroll"/>
The order of path entries matters.
Sure, but this cannot be changed/fixed on the PMBS side, can it? That's probably more in Bernhard's hands...
I was not able to reproduce this problem using a local OBS 2.10 instance. So my guess is still it is actually more on the packman side. However, I may be able to spot a problem in the build job file. Could you grab one which is created by your scheduler and mail it to me? -- Adrian Schroeter <adrian@suse.de> Build Infrastructure Project Manager SUSE Software Solutions Germany GmbH, Frankenstraße 146, 90461 Nürnberg, Germany (HRB 36809, AG Nürnberg) Geschäftsführer: Ivo Totev
On Tue, 21 Nov 2023, 14:23:57 +0100, Adrian Schröter wrote:
On Dienstag, 21. November 2023, 13:16:21 CET Manfred Hollstein wrote:
On Tue, 21 Nov 2023, 13:11:59 +0100, Andreas Schwab wrote:
On Nov 21 2023, Manfred Hollstein wrote:
On Tue, 21 Nov 2023, 12:40:31 +0100, Andreas Schwab wrote:
On Nov 21 2023, Manfred Hollstein wrote:
FWIW, I changed the meta data for Slowroll yesterday after Bernhard's announcement. It now looks like this:
How did it look before?
<repository name="openSUSE_Slowroll"> <path project="openSUSE.org:openSUSE:ALP:Experimental:Slowroll" repository="standard"/>
There is a difference in the meta between openSUSE:ALP:Experimental:Slowroll:
<repository name="base"> <path project="openSUSE:Tumbleweed" repository="slowroll"/> <path project="openSUSE:ALP:Experimental:Slowroll:Base" repository="standard"/>
and openSUSE:Slowroll:
<repository name="base"> <path project="openSUSE:Slowroll:Base" repository="standard"/> <path project="openSUSE:Tumbleweed" repository="slowroll"/>
The order of path entries matters.
Sure, but this cannot be changed/fixed on the PMBS side, can it? That's probably more in Bernhard's hands...
I was not able to reproduce this problem using a local OBS 2.10 instance.
So my guess is still it is actually more on the packman side.
However, I may be able to spot a problem in the build job file. Could you grab one which is created by your scheduler and mail it to me?
After Bernhard having restored the proper settings in his "openSUSE:Slowroll" project, the project "Essentials" on PMBS looks proper again, i.e. it's not broken anymore. FWIW, Mesa has just been built properly: https://pmbs.links2linux.org/package/live_build_log/Essentials/A_tw-Mesa/ope... Looking at the build logs, there have been lots of successful runs since Sep 26th, so I'm not sure if there is still a problem with Slowroll on PMBS. At least there are 20 jobs scheduled but they don't get started, so that might indeed be a problem. How do I "grab a build job file"? - I don't have shell access to PMBS. Cheers. l8er manfred
On Tue, 21 Nov 2023, 14:41:54 +0100, Manfred Hollstein wrote:
On Tue, 21 Nov 2023, 14:23:57 +0100, Adrian Schröter wrote:
[...]
Sure, but this cannot be changed/fixed on the PMBS side, can it? That's probably more in Bernhard's hands...
I was not able to reproduce this problem using a local OBS 2.10 instance.
So my guess is still it is actually more on the packman side.
However, I may be able to spot a problem in the build job file. Could you grab one which is created by your scheduler and mail it to me?
After Bernhard having restored the proper settings in his "openSUSE:Slowroll" project, the project "Essentials" on PMBS looks proper again, i.e. it's not broken anymore. FWIW, Mesa has just been built properly:
https://pmbs.links2linux.org/package/live_build_log/Essentials/A_tw-Mesa/ope...
Looking at the build logs, there have been lots of successful runs since Sep 26th, so I'm not sure if there is still a problem with Slowroll on PMBS. At least there are 20 jobs scheduled but they don't get started, so that might indeed be a problem.
One of the scheduled jobs just got picked up, but this build failed. As this was a PMBS local package as opposed to the linked package (A_tw-Mesa is branched from openSUSE.org:openSUSE:Factory/Mesa). Could it be that it makes a difference if the package is local to the build host compared to externally branched packages? This is the log of the just failing package: https://pmbs.links2linux.org/public/build/Essentials/openSUSE_Slowroll/x86_6...
How do I "grab a build job file"? - I don't have shell access to PMBS.
Cheers. l8er manfred
Am Dienstag, dem 21.11.2023 um 14:41 +0100 schrieb Manfred Hollstein: :
After Bernhard having restored the proper settings in his "openSUSE:Slowroll" project, the project "Essentials" on PMBS looks proper again, i.e. it's not broken anymore. FWIW, Mesa has just been built properly:
https://pmbs.links2linux.org/package/live_build_log/Essentials/A_tw-Mesa/ope...
This is probably the attempt to build a package, but the attempt fails, as the build environment is not set up due to the missing preinstall information in the build job file.
Looking at the build logs, there have been lots of successful runs since Sep 26th, so I'm not sure if there is still a problem with Slowroll on PMBS. At least there are 20 jobs scheduled but they don't get started, so that might indeed be a problem.
How do I "grab a build job file"? - I don't have shell access to PMBS.
I will gather example files tomorrow. Greetings, Stefan -- Stefan Botter zu Hause Bremen
Hi Adrian, Am Dienstag, dem 21.11.2023 um 14:23 +0100 schrieb Adrian Schröter:
So my guess is still it is actually more on the packman side.
However, I may be able to spot a problem in the build job file. Could you grab one which is created by your scheduler and mail it to me?
I will get on this tomorrow morning! Greetings, Stefan -- Stefan Botter zu Hause Bremen
Hi Adrian, Berhard, Manfred and Andreas, thank you for your valuable input! On Tue, 2023-11-21 at 14:23 +0100, Adrian Schröter wrote:
I was not able to reproduce this problem using a local OBS 2.10 instance.
So my guess is still it is actually more on the packman side.
It has been!
However, I may be able to spot a problem in the build job file. Could you grab one which is created by your scheduler and mail it to me?
Your idea with the build job files directed me in the correct direction! There have been stale job files left in /srv/obs/jobs/x86_64 for several packages for the openSUSE_Slowroll project since Sep 28th, between 13:35 and 13:58. The systemd journal from that time does not show any suspicious log entries, there have not been automatic installed updates - especially not regarding obs packages (Aug 10th, and then again Oct 15th). Unfortunately the obs logs from that time span have expired already and the available backup does not go back that far (a pity, because just last weekend I reorganized the backup due to space concerns and probably lost a little bit of backup history for PMBS there). I have no clue why these files were left there. There were no other unexplained files in the jobs directories for the other architectures left. I have deleted the offending files and builds for openSUSE_Slowroll x86_64 are underway again. So thank you again for your time and effort! Greetings, Stefan -- Stefan Botter zu Hause Bremen
On 21/11/2023 13.11, Andreas Schwab wrote:
On Nov 21 2023, Manfred Hollstein wrote:
On Tue, 21 Nov 2023, 12:40:31 +0100, Andreas Schwab wrote:
On Nov 21 2023, Manfred Hollstein wrote:
FWIW, I changed the meta data for Slowroll yesterday after Bernhard's announcement. It now looks like this:
How did it look before?
<repository name="openSUSE_Slowroll"> <path project="openSUSE.org:openSUSE:ALP:Experimental:Slowroll" repository="standard"/>
There is a difference in the meta between openSUSE:ALP:Experimental:Slowroll:
<repository name="base"> <path project="openSUSE:Tumbleweed" repository="slowroll"/> <path project="openSUSE:ALP:Experimental:Slowroll:Base" repository="standard"/>
and openSUSE:Slowroll:
<repository name="base"> <path project="openSUSE:Slowroll:Base" repository="standard"/> <path project="openSUSE:Tumbleweed" repository="slowroll"/>
The order of path entries matters.
I only changed that order today to try if it fixes Packman builds. But it did not. openSUSE:ALP:Experimental:Slowroll does not receive updates anymore, so it would be good if we could figure out a way to get it building with openSUSE:Slowroll. Did someone already try obs_admin --deep-check-project ? Ciao Bernhard M.
On Tue, 21 Nov 2023, 13:43:55 +0100, Bernhard M. Wiedemann wrote:
On 21/11/2023 13.11, Andreas Schwab wrote:
On Nov 21 2023, Manfred Hollstein wrote:
On Tue, 21 Nov 2023, 12:40:31 +0100, Andreas Schwab wrote:
On Nov 21 2023, Manfred Hollstein wrote:
FWIW, I changed the meta data for Slowroll yesterday after Bernhard's announcement. It now looks like this:
How did it look before?
<repository name="openSUSE_Slowroll"> <path project="openSUSE.org:openSUSE:ALP:Experimental:Slowroll" repository="standard"/>
There is a difference in the meta between openSUSE:ALP:Experimental:Slowroll:
<repository name="base"> <path project="openSUSE:Tumbleweed" repository="slowroll"/> <path project="openSUSE:ALP:Experimental:Slowroll:Base" repository="standard"/>
and openSUSE:Slowroll:
<repository name="base"> <path project="openSUSE:Slowroll:Base" repository="standard"/> <path project="openSUSE:Tumbleweed" repository="slowroll"/>
The order of path entries matters.
I only changed that order today to try if it fixes Packman builds. But it did not.
openSUSE:ALP:Experimental:Slowroll does not receive updates anymore, so it would be good if we could figure out a way to get it building with openSUSE:Slowroll.
Did someone already try obs_admin --deep-check-project ?
Not me, as I don't have access to those layers of PMBS. I'm now going to change the repo's meta data again on PMBS. @Stefan, can you give it a try when time permits?
Ciao Bernhard M.
Cheers. l8er manfred
Am Dienstag, dem 21.11.2023 um 13:43 +0100 schrieb Bernhard M. Wiedemann: :
openSUSE:ALP:Experimental:Slowroll does not receive updates anymore, so it would be good if we could figure out a way to get it building with openSUSE:Slowroll.
Did someone already try obs_admin --deep-check-project ?
Sorry, day job got in the way ;) Yes, and no significant change or log. Greetings, Stefan -- Stefan Botter zu Hause Bremen
participants (5)
-
Adrian Schröter
-
Andreas Schwab
-
Bernhard M. Wiedemann
-
Manfred Hollstein
-
Stefan Botter