[heroes] 15.3 sle repo delays bug report
https://bugzilla.opensuse.org/show_bug.cgi?id=1198416 There's also this about 15.3: https://forums.opensuse.org/showthread.php/568388-Slow-Repo -- Evolution as taught in public schools is, like religion, based on faith, not based on science. Team OS/2 ** Reg. Linux User #211409 ** a11y rocks! Felix Miata
On 2022-04-17 05:42, Felix Miata wrote:
https://bugzilla.opensuse.org/show_bug.cgi?id=1198416
There's also this about 15.3: https://forums.opensuse.org/showthread.php/568388-Slow-Repo
There is nothing specific in those reports. I just refreshed repos now, and it was fast. When this sort of thing happens, you have to obtain and post logs from zypper, that say what exact mirror server it was hitting and at what exact time. Me, I have seen slowness, but not during repository download, but during some packages downloading that was not yet mirrored, so not the same issue as described. -- Cheers / Saludos, Carlos E. R. (from 15.3 x86_64 at Telcontar)
Carlos E. R. wrote:
On 2022-04-17 05:42, Felix Miata wrote:
https://bugzilla.opensuse.org/show_bug.cgi?id=1198416
There's also this about 15.3: https://forums.opensuse.org/showthread.php/568388-Slow-Repo
There is nothing specific in those reports.
+1. Henk also reported issue #109274, citing that forums thread, but I had to reject it due to lack of information. I would suggest updating that, if there is any further information available.
When this sort of thing happens, you have to obtain and post logs from zypper, that say what exact mirror server it was hitting and at what exact time.
Which mirror and the IP-address of the client. Even with that information, there is most often little we can do. The problem is essentially "slow connection between A and B". Sometimes it might be due to the wrong mirror being handed out, that's just about the only time we can do anything.
Me, I have seen slowness, but not during repository download, but during some packages downloading that was not yet mirrored,
Yes, in that case files are served directly by download.o.o which is very busy with other things. -- Per Jessen, Zürich (9.9°C) Member, openSUSE Heroes
On 2022-04-17 11:53, Per Jessen wrote:
Carlos E. R. wrote:
On 2022-04-17 05:42, Felix Miata wrote:
https://bugzilla.opensuse.org/show_bug.cgi?id=1198416
There's also this about 15.3: https://forums.opensuse.org/showthread.php/568388-Slow-Repo
There is nothing specific in those reports.
+1. Henk also reported issue #109274, citing that forums thread, but I had to reject it due to lack of information. I would suggest updating that, if there is any further information available.
When this sort of thing happens, you have to obtain and post logs from zypper, that say what exact mirror server it was hitting and at what exact time.
Which mirror and the IP-address of the client.
Ah. Good point, the address of the client.
Even with that information, there is most often little we can do. The problem is essentially "slow connection between A and B". Sometimes it might be due to the wrong mirror being handed out, that's just about the only time we can do anything.
Me, I have seen slowness, but not during repository download, but during some packages downloading that was not yet mirrored,
Yes, in that case files are served directly by download.o.o which is very busy with other things.
Maybe for this case an strategy would be to first send to the mirrors all the files (rpms), and only when finished update the repository metadata files. I don't know if it is possible. -- Cheers / Saludos, Carlos E. R. (from 15.3 x86_64 at Telcontar)
Carlos E. R. wrote:
Maybe for this case an strategy would be to first send to the mirrors all the files (rpms),
Maybe or maybe not, but we don't send anything except when we push out the repositiories (to very few mirror sites). The mirror admins decide when and what to pull. -- Per Jessen, Zürich (11.5°C) Member, openSUSE Heroes
On 2022-04-17 13:02, Per Jessen wrote:
Carlos E. R. wrote:
Maybe for this case an strategy would be to first send to the mirrors all the files (rpms),
Maybe or maybe not, but we don't send anything except when we push out the repositiories (to very few mirror sites). The mirror admins decide when and what to pull.
Oh. Then not feasible, except suggest doing that in the instructions somewhere. -- Cheers / Saludos, Carlos E. R. (from 15.3 x86_64 at Telcontar)
# time zypper ref -f --repo UpdateSLE Forcing raw metadata refresh Retrieving repository 'UpdateSLE' metadata ...............................[done] Forcing building of repository cache Building repository 'UpdateSLE' cache ....................................[done] Specified repositories have been refreshed. real 0m15.055s user 0m13.658s sys 0m0.238s # time zypper ref -f --repo Update Forcing raw metadata refresh Retrieving repository 'Update' metadata ..................................[done] Forcing building of repository cache Building repository 'Update' cache .......................................[done] Specified repositories have been refreshed. real 0m1.609s user 0m0.454s sys 0m0.048s # grep sle /etc/zypp/repos.d/*repo /etc/zypp/repos.d/UpdateSLE.repo:baseurl=http://download.opensuse.org/update/leap/15.3/sle/ # grep '/oss/' /etc/zypp/repos.d/*repo | grep date /etc/zypp/repos.d/Update.repo:baseurl=http://download.opensuse.org/update/leap/15.3/oss/ # wget http://download.opensuse.org/update/leap/15.3/sle/repodata/repomd.xml --2022-04-20 17:02:14-- http://download.opensuse.org/update/leap/15.3/sle/repodata/repomd.xml Resolving download.opensuse.org (download.opensuse.org)... 195.135.221.134, 2001:67c:2178:8::13 Connecting to download.opensuse.org (download.opensuse.org)|195.135.221.134|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 3120 (3.0K) [text/xml] Saving to: ‘repomd.xml’ repomd.xml 100%[====================================================================================================>] 3.05K --.-KB/s in 0s 2022-04-20 17:02:15 (589 MB/s) - ‘repomd.xml’ saved [3120/3120] # time wget http://download.opensuse.org/update/leap/15.3/sle/x86_64/util-linux-2.36.2-1... --2022-04-20 17:03:11-- http://download.opensuse.org/update/leap/15.3/sle/x86_64/util-linux-2.36.2-1... Resolving download.opensuse.org (download.opensuse.org)... 195.135.221.134, 2001:67c:2178:8::13 Connecting to download.opensuse.org (download.opensuse.org)|195.135.221.134|:80... connected. HTTP request sent, awaiting response... 302 Found Location: http://mirror.us.leaseweb.net/opensuse/update/leap/15.3/sle/x86_64/util-linu... [following] --2022-04-20 17:03:11-- http://mirror.us.leaseweb.net/opensuse/update/leap/15.3/sle/x86_64/util-linu... Resolving mirror.us.leaseweb.net (mirror.us.leaseweb.net)... 207.244.94.80, 2604:9a00:2010:a0b8::5 Connecting to mirror.us.leaseweb.net (mirror.us.leaseweb.net)|207.244.94.80|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 1279864 (1.2M) [application/x-redhat-package-manager] Saving to: ‘util-linux-2.36.2-150300.4.20.1.x86_64.rpm’ util-linux-2.36.2-150300.4.20.1.x86_64.rpm =============>] 1.22M 3.59MB/s in 0.3s 2022-04-20 17:03:11 (3.59 MB/s) - ‘util-linux-2.36.2-150300.4.20.1.x86_64.rpm’ saved [1279864/1279864] real 0m0.725s user 0m0.001s sys 0m0.018s It's now about 3.7 hours since I reported on IRC opensuse-admin about how slow refresh of SLE repo is. Earlier it had taken many minutes to refresh SLE. -- Evolution as taught in public schools is, like religion, based on faith, not based on science. Team OS/2 ** Reg. Linux User #211409 ** a11y rocks! Felix Miata
Felix Miata wrote:
http://download.opensuse.org/update/leap/15.3/sle/x86_64/util-linux-2.36.2-1... Resolving download.opensuse.org (download.opensuse.org)... 195.135.221.134, 2001:67c:2178:8::13 Connecting to download.opensuse.org (download.opensuse.org)|195.135.221.134|:80... connected. HTTP request sent, awaiting response... 302 Found Location: http://mirror.us.leaseweb.net/opensuse/update/leap/15.3/sle/x86_64/util-linu...
IOW, the mirror is http://mirror.us.leaseweb.net
2022-04-20 17:03:11 (3.59 MB/s) - ‘util-linux-2.36.2-150300.4.20.1.x86_64.rpm’ saved [1279864/1279864]
It's a small file, barely a 1Mb - it's best to grab something bigger to get a useful indication.
It's now about 3.7 hours since I reported on IRC opensuse-admin about how slow refresh of SLE repo is. Earlier it had taken many minutes to refresh SLE. --
We don't exactly have a team of paid sysadmins on duty 24x7 :-) Downloading : http://mirror.us.leaseweb.net/opensuse/update/leap/15.3/sle/repodata/<whatever-the-latest-is>-primary.xml.gz
From my location, (Zurich, Switzerland) - 14.2MB/sec From Provo, Utah, US - 6.6MB/sec From Hetzner, Germany - 12.6MB/sec From Nuernberg, Germany - 26.2MB/sec
(and those numbers varied a lot). Regardless, it is back to a matter of two points and how well connected they are. and how heavily loaded the mirror is. -- Per Jessen, Zürich (10.1°C) Member, openSUSE Heroes
Per Jessen composed on 2022-04-21 10:37 (UTC+0200):
Felix Miata wrote:
http://download.opensuse.org/update/leap/15.3/sle/x86_64/util-linux-2.36.2-1... Resolving download.opensuse.org (download.opensuse.org)... 195.135.221.134, 2001:67c:2178:8::13 Connecting to download.opensuse.org (download.opensuse.org)|195.135.221.134|:80... connected. HTTP request sent, awaiting response... 302 Found Location: http://mirror.us.leaseweb.net/opensuse/update/leap/15.3/sle/x86_64/util-linu...
IOW, the mirror is http://mirror.us.leaseweb.net
Or maybe the problem is that leaseweb.net is a worldwide fleet of mirrors, among those in CONUS: https://www.leaseweb.com/ 185.28.70.130 https://mirror.leaseweb.net/ 207.244.94.80 mirror.dal13.us.leaseweb.net Dallas 209.58.153.1 mirror.mia11.us.leaseweb.net Miami 23.82.143.211 (nearest me) mirror.sfo12.us.leaseweb.net San Jose, CA 209.58.135.187 mirror.wdc1.us.leaseweb.net Manassas, VA 207.244.94.80
2022-04-20 17:03:11 (3.59 MB/s) - ‘util-linux-2.36.2-150300.4.20.1.x86_64.rpm’ saved [1279864/1279864]
It's a small file, barely a 1Mb - it's best to grab something bigger to get a useful indication.
# wget https://mirror.us.leaseweb.net/opensuse/distribution/leap/15.4/repo/oss/x86_... --2022-04-21 17:27:56-- https://mirror.us.leaseweb.net/opensuse/distribution/leap/15.4/repo/oss/x86_... Resolving mirror.us.leaseweb.net (mirror.us.leaseweb.net)... 207.244.94.80, 2604:9a00:2010:a0b8::5 Connecting to mirror.us.leaseweb.net (mirror.us.leaseweb.net)|207.244.94.80|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 89371247 (85M) [application/x-redhat-package-manager] Saving to: ‘kernel-default-5.14.21-150400.17.1.x86_64.rpm’ kernel-default-5.14.21-150400.17.1.x86_64.rpm 100%[====================================================================================================>] 85.23M 10.9MB/s in 8.0s 2022-04-21 17:28:05 (10.6 MB/s) - ‘kernel-default-5.14.21-150400.17.1.x86_64.rpm’ saved [89371247/89371247] # wget https://mirror.us.leaseweb.net/opensuse/distribution/leap/15.4/repo/oss/repo... --2022-04-21 17:29:38-- https://mirror.us.leaseweb.net/opensuse/distribution/leap/15.4/repo/oss/repo... Resolving mirror.us.leaseweb.net (mirror.us.leaseweb.net)... 207.244.94.80, 2604:9a00:2010:a0b8::5 Connecting to mirror.us.leaseweb.net (mirror.us.leaseweb.net)|207.244.94.80|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 10406 (10K) [text/xml] Saving to: ‘repomd.xml’ repomd.xml 100%[====================================================================================================>] 10.16K --.-KB/s in 0s 2022-04-21 17:29:38 (326 MB/s) - ‘repomd.xml’ saved [10406/10406] # wget https://mirror.mia11.us.leaseweb.net/opensuse/update/leap/15.3/oss/repodata/... --2022-04-21 17:32:36-- https://mirror.mia11.us.leaseweb.net/opensuse/update/leap/15.3/oss/repodata/... Resolving mirror.mia11.us.leaseweb.net (mirror.mia11.us.leaseweb.net)... 23.82.143.211 Connecting to mirror.mia11.us.leaseweb.net (mirror.mia11.us.leaseweb.net)|23.82.143.211|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 3131 (3.1K) [text/xml] Saving to: ‘repomd.xml’ repomd.xml 100%[====================================================================================================>] 3.06K --.-KB/s in 0s 2022-04-21 17:32:36 (533 MB/s) - ‘repomd.xml’ saved [3131/3131]
It's now about 3.7 hours since I reported on IRC opensuse-admin about how slow refresh of SLE repo is. Earlier it had taken many minutes to refresh SLE. --
We don't exactly have a team of paid sysadmins on duty 24x7 :-)
Downloading : http://mirror.us.leaseweb.net/opensuse/update/leap/15.3/sle/repodata/<whatever-the-latest-is>-primary.xml.gz
From my location, (Zurich, Switzerland) - 14.2MB/sec From Provo, Utah, US - 6.6MB/sec From Hetzner, Germany - 12.6MB/sec From Nuernberg, Germany - 26.2MB/sec
(and those numbers varied a lot).
Regardless, it is back to a matter of two points and how well connected they are. and how heavily loaded the mirror is. I'm going to try setting SLE to mirror.mia11.us.leaseweb.net for next rounds of Leap updates. -- Evolution as taught in public schools is, like religion, based on faith, not based on science.
Team OS/2 ** Reg. Linux User #211409 ** a11y rocks! Felix Miata
participants (3)
-
Carlos E. R. -
Felix Miata -
Per Jessen