It appears to me that there might be a server problem and/or outage with opensuse.org. TumbleWeed build 20220526 was published yesterday and build 20220527 was published today as shown here https://openqa.opensuse.org/group_overview/1?limit_builds=20 however the latest build available here is 20220525 https://download.opensuse.org/tumbleweed/iso/ and this says the latest build is 20220525 https://download.opensuse.org/history/latest and the latest build in the list of builds is 20220525 When a new build is published it takes a little while for the ISO to appear and for the build to appear in the history location but it is not normal for a 2nd build to be published and the 1st build has still not appeared Could someone please look into this? I sent a message to the admin too.
status.opensuse.org does not indicate any problems, but the last time I reported a problem it also didn't indicate any problems because the admin was not aware of the problem at the time I reported it.
Am Samstag, 28. Mai 2022, 22:23:19 CEST schrieb Joe Salmeri:
status.opensuse.org does not indicate any problems, but the last time I reported a problem it also didn't indicate any problems because the admin was not aware of the problem at the time I reported it.
There's definitely some problem somewhere, for me "tumbleweed status" randomly comes back with *nothing* for "latest": lemmy@kumiko:~> tumbleweed status latest : target : 20220525 installed: 20220525 cheers MH -- Mathias Homann Mathias.Homann@openSUSE.org Jabber (XMPP): lemmy@tuxonline.tech Matrix: @mathias:eregion.de IRC: [Lemmy] on freenode and ircnet (bouncer active) keybase: https://keybase.io/lemmy gpg key fingerprint: 8029 2240 F4DD 7776 E7D2 C042 6B8E 029E 13F2 C102
Yes I see the same thing. It randomly comes back with latest being blank but I've seen that before once in a while even when there were not issues. /usr/bin/tumbleweed just uses curl to download https://download.opensuse.org/history/latest but if it fails it fails silently "latest" still contains 20220525 despite 20220526 and 20220527 being released. Looking at https://download.opensuse.org/tumbleweed/iso/ there are no ISO files for anything later than 20220525. I suspect that they either ran out of disk space or have a server hw problem. I sent an email to the admin but have not received a response. Also, today I received and email saying that messages from my factory list subscription were bouncing so my subscription was disabled, yet, the email saying that they were bouncing had no problem being received. I wonder if the holiday is causing the delay in response and resolving the issue?
Hello, no solution (yet), just some quick notes about the 3 issues in this mail: Am Sonntag, 29. Mai 2022, 19:56:46 CEST schrieb Joe Salmeri:
It randomly comes back with latest being blank but I've seen that before once in a while even when there were not issues.
/usr/bin/tumbleweed just uses curl to download
https://download.opensuse.org/history/latest
but if it fails it fails silently
That's 1) - you sometimes get an empty file If you can reproduce this with "curl -v", I'd be interested to see the output. (Bonus points if you remember when you've seen this the first time - more than a year ago?)
"latest" still contains 20220525 despite 20220526 and 20220527 being released.
Looking at https://download.opensuse.org/tumbleweed/iso/
there are no ISO files for anything later than 20220525.
I suspect that they either ran out of disk space or have a server hw problem.
That's 2) - download.o.o doesn't have latest Tumbleweed Disk space shouldn't be the problem - download.o.o has 2.7 TB free space. Also, I don't see an obvious issue in the logs. No idea why the new snapshots don't show up. My _guess_ is that publishing is hanging somewhere between OBS and download.o.o. Or the "release trigger" from openQA didn't work as it should.
Also, today I received and email saying that messages from my factory list subscription were bouncing so my subscription was disabled, yet, the email saying that they were bouncing had no problem being received.
That's 3) - "fun" with gmail We had some delivery issues to gmail caused by a buggy SPF record. This is fixed now, and therefore the mail informing you about your disabled subscription could be delivered ;-)
I wonder if the holiday is causing the delay in response and resolving the issue?
Yes, it's always "nice" if such issues happen on a weekend or during public holidays. Regards, Christian Boltz -- Do you realise that mentioning mahjongg style compulsive clicking games in here endangers the release? ;) [Will Stephenson in opensuse-factory]
* Christian Boltz
Hello,
no solution (yet), just some quick notes about the 3 issues in this mail:
Am Sonntag, 29. Mai 2022, 19:56:46 CEST schrieb Joe Salmeri:
It randomly comes back with latest being blank but I've seen that before once in a while even when there were not issues.
/usr/bin/tumbleweed just uses curl to download
https://download.opensuse.org/history/latest
but if it fails it fails silently
That's 1) - you sometimes get an empty file
If you can reproduce this with "curl -v", I'd be interested to see the output.
(Bonus points if you remember when you've seen this the first time - more than a year ago?)
I have changed to: lftp http://download.opensuse.org/factory/repo/oss/media.1/media -e \ "cat media |grep Build|grep -v Media"
"latest" still contains 20220525 despite 20220526 and 20220527 being released.
I get: openSUSE-20220525-i586-x86_64-Build3230.2 -- (paka)Patrick Shanahan Plainfield, Indiana, USA @ptilopteri http://en.opensuse.org openSUSE Community Member facebook/ptilopteri Photos: http://wahoo.no-ip.org/piwigo paka @ IRCnet oftc
Hi Christian, thanks for looking into these. Just wondering - in case you missed it - do you happen to have any idea about the digest issues reported by the net installer (first reported in this list 5/28/22 20:01 by Adam Mizerski)? I encountered those as well whilst booting the rescue system off download.opensuse.org during the last days - skipping the warning worked but likely is not something to recommend... :-) Thank you! Georg On 5/29/22 23:30, Christian Boltz wrote:
Hello,
no solution (yet), just some quick notes about the 3 issues in this mail:
Am Sonntag, 29. Mai 2022, 19:56:46 CEST schrieb Joe Salmeri:
It randomly comes back with latest being blank but I've seen that before once in a while even when there were not issues.
/usr/bin/tumbleweed just uses curl to download
https://download.opensuse.org/history/latest
but if it fails it fails silently
That's 1) - you sometimes get an empty file
If you can reproduce this with "curl -v", I'd be interested to see the output.
(Bonus points if you remember when you've seen this the first time - more than a year ago?)
"latest" still contains 20220525 despite 20220526 and 20220527 being released.
Looking at https://download.opensuse.org/tumbleweed/iso/
there are no ISO files for anything later than 20220525.
I suspect that they either ran out of disk space or have a server hw problem.
That's 2) - download.o.o doesn't have latest Tumbleweed
Disk space shouldn't be the problem - download.o.o has 2.7 TB free space. Also, I don't see an obvious issue in the logs.
No idea why the new snapshots don't show up. My _guess_ is that publishing is hanging somewhere between OBS and download.o.o. Or the "release trigger" from openQA didn't work as it should.
Also, today I received and email saying that messages from my factory list subscription were bouncing so my subscription was disabled, yet, the email saying that they were bouncing had no problem being received.
That's 3) - "fun" with gmail
We had some delivery issues to gmail caused by a buggy SPF record. This is fixed now, and therefore the mail informing you about your disabled subscription could be delivered ;-)
I wonder if the holiday is causing the delay in response and resolving the issue?
Yes, it's always "nice" if such issues happen on a weekend or during public holidays.
Regards,
Christian Boltz
Christian Boltz wrote:
That's 2) - download.o.o doesn't have latest Tumbleweed
Disk space shouldn't be the problem - download.o.o has 2.7 TB free space. Also, I don't see an obvious issue in the logs.
No idea why the new snapshots don't show up. My _guess_ is that publishing is hanging somewhere between OBS and download.o.o. Or the "release trigger" from openQA didn't work as it should.
download.o.o does have the newer snapshots, but in ftp-stage/ only. Yes, I also expect some hiccup in the publishing process. -- Per Jessen, Zürich (12.5°C) Member, openSUSE Heroes
On Sun, 2022-05-29 at 23:30 +0200, Christian Boltz wrote:
"latest" still contains 20220525 despite 20220526 and 20220527 being released.
Looking at https://download.opensuse.org/tumbleweed/iso/
there are no ISO files for anything later than 20220525.
I suspect that they either ran out of disk space or have a server hw problem.
That's 2) - download.o.o doesn't have latest Tumbleweed
Disk space shouldn't be the problem - download.o.o has 2.7 TB free space. Also, I don't see an obvious issue in the logs.
No idea why the new snapshots don't show up. My _guess_ is that publishing is hanging somewhere between OBS and download.o.o. Or the "release trigger" from openQA didn't work as it should.
The Kubic media have been retired and sync script, performing the actual publish from stage to real download area had a safeguard to be sure all media it expects are in place. I fixed the script this mornign for it to no longer expect Kubic media to be present. Snapshot 0527 has been put in place on download.o.o since. Nothing was lost, of course, snapshot 0526 was flagged for publish and just never found its way to be enabled as snapshot. The changes of the snapshot are, as usual, included in 0527. The long weekend (on my part) did not help to get this resorted quicker. Apologies for that. Cheers, Dominique
On Mon, 2022-05-30 at 14:40 +0200, Dominique Leuenberger / DimStar wrote:
en retired and sync script, performing the actual publish from stage to real download area had a safeguard to be sure all media it expects are in place.
I fixed the script this mornign for it to no longer expect Kubic media to be present. Snapshot 0527 has been put in place on download.o.o since.
Nothing was lost, of course, snapshot 0526 was flagged for publish and just never found its way to be enabled as snapshot. The changes of the snapshot are, as usual, included in 0527.
The long weekend (on my part) did not help to get this resorted quicker. Apologies for that.
Likewise, Mea Culpa from me..didn't expect my submitted Kubic changes to be merged while I also was on a long weekend..and I had hoped we'd have caught such issues before merging them. Apologies, and thanks for everyone's paitence -- Richard Brown Linux Distribution Engineer - Future Technology Team SUSE Software Solutions Germany GmbH, Maxfeldstr. 5, D-90409 Nuremberg, Germany (HRB 36809, AG Nürnberg) Managing Directors/Geschäftsführer: Ivo Totev, Andrew Myers, Andrew McDonald, Martje Boudien Moerman
participants (8)
-
Christian Boltz -
Dominique Leuenberger / DimStar -
Georg Pfuetzenreuter -
Joe Salmeri -
Mathias Homann -
Patrick Shanahan -
Per Jessen -
Richard Brown