[Bug 1159688] New: mirrors not carrying latest release for tumbleweed (factory)
http://bugzilla.opensuse.org/show_bug.cgi?id=1159688 Bug ID: 1159688 Summary: mirrors not carrying latest release for tumbleweed (factory) Classification: openSUSE Product: openSUSE Tumbleweed Version: Current Hardware: All OS: openSUSE Factory Status: NEW Severity: Critical Priority: P5 - None Component: Network Assignee: bnc-team-screening@forge.provo.novell.com Reporter: Astara@tlinx.org QA Contact: qa-bugs@suse.de Found By: --- Blocker: --- I downloaded repomd.xml from download.opensuse.org/tumbleweed/repo/non-oss/repodata/repomd.xml. That directory had files for Dec 16th. When I tried to open one of the file in that directory ( http://download.opensuse.org/tumbleweed/repo/non-oss/repodata/a424c3aaba9f6e... ) I was taken to mirrors.edge.kernel.org. Unfortunately, the latest files in that directory were from the 14th (today is the 20th). The above file wasn't in the outdated mirror. This prevents download of current releases. Perhaps before blindly sending us off to some mirror site, a database should be checked to see what mirrors have which versions and not send us to a site that doesn't have the files for the version that repomd references. This really resolves to 'zero' confidence in the mirror system and low confidence in being able to download a coherent version of the distribution. -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.opensuse.org/show_bug.cgi?id=1159688 http://bugzilla.opensuse.org/show_bug.cgi?id=1159688#c1 Felix Miata <mrmazda@earthlink.net> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |mrmazda@earthlink.net, | |per@computer.org --- Comment #1 from Felix Miata <mrmazda@earthlink.net> --- According to https://mirrors.opensuse.org/ there are zero North American mirrors hosting TW repos, though there are some that host TW isos, and checking with SeaMonkey browser I see leaseweb.net @ 209.58.135.187 in San Jose, CA does carry TW repos. sfo-korg-mirror.kernel.org mentioned by reporter in one of the mailing list posts carries 149.20.37.36 from the state of Kansas and hosts only the isos. Reporter's 4 "unique" mailing list threads, as a result of sending the same two OPs to two different lists begin @: https://lists.opensuse.org/opensuse/2019-12/msg00590.html https://lists.opensuse.org/opensuse/2019-12/msg00598.html https://lists.opensuse.org/opensuse-factory/2019-12/msg00136.html https://lists.opensuse.org/opensuse-factory/2019-12/msg00137.html FWIW, since the first of reporter's list threads, latency on opensuse.org has been atrocious, with complete timeouts variously up to 10 minutes or more on bugzilla.o.o, forums.o.o, lizards.o.o, static.o.o, beans.o.o, en.o.o, download.o.o, features.o.o and plant.o.o. -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.opensuse.org/show_bug.cgi?id=1159688 http://bugzilla.opensuse.org/show_bug.cgi?id=1159688#c2 Bernhard Wiedemann <bwiedemann@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |bwiedemann@suse.com Component|Network |Other Assignee|bnc-team-screening@forge.pr |bwiedemann@suse.com |ovo.novell.com | --- Comment #2 from Bernhard Wiedemann <bwiedemann@suse.com> --- @Felix : are you sure about download.o.o and static.o.o ? Because those are hosted by us in Nuremberg and it would be surprising to see them suffer the same as the other services hosted in Provo. @Linda As for the mirrors, there is work ongoing to rewrite the mirrorbrain redirection software and to get a new rsync.opensuse.org machine. Maybe that can get rid of some of such problems. But both of them can take months to complete. -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.opensuse.org/show_bug.cgi?id=1159688 http://bugzilla.opensuse.org/show_bug.cgi?id=1159688#c3 --- Comment #3 from Felix Miata <mrmazda@earthlink.net> --- I'm not sure about anything other than chronically being frustrated by long waits that usually seem multiplied on weekends. During the week it's usually tolerable, but on Friday afternoon or evening (FL/USA EST) the latency escalates, and waiting for opensuse.org or waiting for suse.com seem permanently affixed to the statusbar. This is what I sent to the heroes mailing list on 2020-01-17 20:20 (UTC-0500): I just waited 13.5 minutes for http://download.opensuse.org/distribution/leap/15.2/repo/oss/x86_64/ to completely load in SeaMonkey, 11.5 minutes before it even started to paint anything, 75,987,605 bytes of html. This is just after it took 45 minutes between submitting a new bug, and succeeding to add 3 additional attachments (in 4 parts: 3 15.2 initrds, one too large for acceptance which had to be split) to B.O.O.: bug 1161238 http://ftp5.gwdg.de/pub/opensuse/distribution/leap/15.2/repo/oss/x86_64/ took 5 seconds to load html, 2,890,366 bytes. Nothing fancy. It just works. Not counting the gartantuan browser load times for repos, download speed is not usually an issue. Once wget is launched with a fetched URL, speed is normally very good. Zypper updates and upgrades usually seem fine as well. -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.opensuse.org/show_bug.cgi?id=1159688 http://bugzilla.opensuse.org/show_bug.cgi?id=1159688#c5 --- Comment #5 from Felix Miata (offline until ???) <mrmazda@earthlink.net> --- 20200220 to 20201209 on 32bit P4 with 10/100 NIC went well enough from mirrorcache.opensuse.org in around 2+ hours. -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.opensuse.org/show_bug.cgi?id=1159688 http://bugzilla.opensuse.org/show_bug.cgi?id=1159688#c6 --- Comment #6 from L. Walsh <Astara@tlinx.org> --- FWIW, It may be a while before I can attempt to reproduce this problem since my local distro copy got wiped due to a flakey controller that wiped several, maybe up to around 20TB, of data originally coming from the net, including several opensuse distros going back to around OpenSUSE 10.3. Complicating restoring opensuse related info has been a switch in to a different encoding (compression) for RPM's that isn't readable by earlier opensuse RPMs. The newer RPM can only be built on the suse OBS (OpenBuildSystem) where the OBS's PATHs and MACROs are used. From that comes an RPM package that is built to run a OBS-compatible build system. This means that unless your settings match that target, the built RPM won't run unless your local system already matches that of SUSE's OBS. At this point, there doesn't seem to be anything one can install on a local system that will build an OBS compatible RPM. This means that you can't get to "there" from "here", directly, but by some, yet-to-be-determined, locally-hosted, OBS-compatible-build-system. Until that can be built, current OBS-built RPM's that can be downloaded, are useless for end-users that don't already have an OBS-compatible runtime. I.e. -- "It may be a while before I can attempt to reproduce this problem" -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.opensuse.org/show_bug.cgi?id=1159688 http://bugzilla.opensuse.org/show_bug.cgi?id=1159688#c7 --- Comment #7 from Felix Miata (offline until ???) <mrmazda@earthlink.net> --- Over the weekend I updated/upgraded 4 installations using mirrorcache.opensuse.org without any apparent foibles. -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.opensuse.org/show_bug.cgi?id=1159688 http://bugzilla.opensuse.org/show_bug.cgi?id=1159688#c8 --- Comment #8 from Felix Miata (offline until ???) <mrmazda@earthlink.net> --- http://mirrorcache.opensuse.org/download/tumbleweed/repo/oss/ seems to be stone dead today, 404 for everything. -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.opensuse.org/show_bug.cgi?id=1159688 Bernhard Wiedemann <bwiedemann@suse.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |andrii.nikitin@suse.com -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.opensuse.org/show_bug.cgi?id=1159688 http://bugzilla.opensuse.org/show_bug.cgi?id=1159688#c9 --- Comment #9 from Andrii Nikitin <andrii.nikitin@suse.com> --- Just fyi: mirrorcache operates in two modes: - if it has information about requested path on mirrors - it will redirect to one of mirrors (making sure that the file present on the mirror). - otherwise - it will just redirect to download.opensuse.org and schedule a background job to scan mirrors for the path. I am not sure which problem could be on 27th - I did check logs and they don't have 404 errors and was able to serve the path:
[2020-12-27 07:20:18.22619] [8273] [debug] [pTPq2Wzk] GET "/download/tumbleweed/repo/oss/x86_64/openSUSE-release-ftp-20201225-808.1.x86_64.rpm" [2020-12-27 07:20:18.26012] [8273] [debug] [pTPq2Wzk] 302 Found (0.033914s, 29.486/s)
[2020-12-27 10:35:53.91825] [8273] [debug] [zHvG1CiE] GET "/download/tumbleweed/repo/oss/repodata/4bf682d313436bcfe78ffd3c93c1bc375794f5c421f8bd687c6fc15bf14883f8-appdata.xml.gz" [2020-12-27 10:35:53.95341] [8273] [debug] [zHvG1CiE] 302 Found (0.035119s, 28.475/s)
[2020-12-27 10:37:34.73667] [8273] [debug] [jE3h4PS6] GET "/download/tumbleweed/repo/oss/media.1/media" [2020-12-27 10:37:34.84522] [8273] [debug] [jE3h4PS6] 302 Found (0.108448s, 9.221/s)
[2020-12-27 19:50:15.93174] [8273] [debug] [sl-5Vn7k] GET "/download/repositories/openSUSE:/Tumbleweed/standard/x86_64/libnilfsgc0-2.2.3-1.18.x86_64.rpm" [2020-12-27 19:50:15.96094] [8273] [debug] [sl-5Vn7k] 302 Found (0.029177s, 34.274/s)
I also did `zypper dup` on my TW laptop yesterday and it went without problem. In case if you encounter the problem with some request - could you log output of > curl -IL http://mirrorcache.opensuse.org/download/<path> -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.opensuse.org/show_bug.cgi?id=1159688 http://bugzilla.opensuse.org/show_bug.cgi?id=1159688#c10 --- Comment #10 from Felix Miata (offline until ???) <mrmazda@earthlink.net> --- Last night for TW using mirrorcache, I left my workspace for a while. When I came back, it was waiting for an answer what to do because of an rpm not found. I selected retry and had no further trouble. -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.opensuse.org/show_bug.cgi?id=1159688 http://bugzilla.opensuse.org/show_bug.cgi?id=1159688#c12 Alan Hanigan <alan.hanigan@gmail.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |alan.hanigan@gmail.com --- Comment #12 from Alan Hanigan <alan.hanigan@gmail.com> --- Latest kernel 5.18.11 not on rsync mirror. Only 5.18.9. -- You are receiving this mail because: You are on the CC list for the bug.
participants (2)
-
bugzilla_noreply@novell.com
-
bugzilla_noreply@suse.com