[opensuse-project] zypper refresh takes double time for update/leap/15.x/sle/ than all others combined
Is update/leap/15.3/sle/ the most populous, containing more packages than any other? What else could account for this obvious sloth, twice the time to refresh sle than all others combined? Behavior is similar for 15.4, since farther back than I can remember, probably since 15.3 was originally released. # zypper lr Repository priorities in effect: (See 'zypper lr -P' for details) 72 (raised priority) : 1 repository 90 (raised priority) : 1 repository 99 (default priority) : 7 repositories # | Enabled | GPG Check | URI --+---------+-----------+------------------------------------------------------------------------ 1 | Yes | ( p) Yes | http://silk.apana.org.au/rpm-opensuse15-unstable-dev 2 | Yes | (r ) Yes | http://download.opensuse.org/repositories/KDE:/KDE3/openSUSE_Leap_15.3/ 3 | Yes | (r ) Yes | http://download.opensuse.org/repositories/mozilla/openSUSE_Leap_15.3/ 4 | Yes | (r ) Yes | http://download.opensuse.org/distribution/leap/15.3/repo/non-oss/ 5 | Yes | (r ) Yes | http://download.opensuse.org/distribution/leap/15.3/repo/oss/ 6 | Yes | (r ) Yes | http://ftp.gwdg.de/pub/linux/packman/suse/openSUSE_Leap_15.3/Essentials 7 | Yes | (r ) Yes | http://download.opensuse.org/update/leap/15.3/oss/ 8 | Yes | (r ) Yes | http://download.opensuse.org/update/leap/15.3/backports/ 9 | Yes | (r ) Yes | http://download.opensuse.org/update/leap/15.3/non-oss/ # time zypper ref Repository 'FCL' is up to date. Retrieving repository 'KDE3' metadata ......................................................[done] Building repository 'KDE3' cache ...........................................................[done] Retrieving repository 'Mozilla' metadata ...................................................[done] Building repository 'Mozilla' cache ........................................................[done] Repository 'NonOSS' is up to date. Repository 'OSS' is up to date. Retrieving repository 'PackmanE' metadata ..................................................[done] Building repository 'PackmanE' cache .......................................................[done] Retrieving repository 'Update' metadata ....................................................[done] Building repository 'Update' cache .........................................................[done] Retrieving repository 'UpdateBP' metadata ..................................................[done] Building repository 'UpdateBP' cache .......................................................[done] Retrieving repository 'UpdateNonOSS' metadata ..............................................[done] Building repository 'UpdateNonOSS' cache ...................................................[done] All repositories have been refreshed. real 0m27.997s user 0m2.711s sys 0m0.890s # zypper lr Repository priorities in effect: (See 'zypper lr -P' for details) 72 (raised priority) : 1 repository 90 (raised priority) : 1 repository 99 (default priority) : 8 repositories # | Enabled | GPG Check | URI ---+---------+-----------+------------------------------------------------------------------------ 1 | Yes | ( p) Yes | http://silk.apana.org.au/rpm-opensuse15-unstable-dev 2 | Yes | (r ) Yes | http://download.opensuse.org/repositories/KDE:/KDE3/openSUSE_Leap_15.3/ 3 | Yes | (r ) Yes | http://download.opensuse.org/repositories/mozilla/openSUSE_Leap_15.3/ 4 | Yes | (r ) Yes | http://download.opensuse.org/distribution/leap/15.3/repo/non-oss/ 5 | Yes | (r ) Yes | http://download.opensuse.org/distribution/leap/15.3/repo/oss/ 6 | Yes | (r ) Yes | http://ftp.gwdg.de/pub/linux/packman/suse/openSUSE_Leap_15.3/Essentials 7 | Yes | (r ) Yes | http://download.opensuse.org/update/leap/15.3/oss/ 8 | Yes | (r ) Yes | http://download.opensuse.org/update/leap/15.3/backports/ 9 | Yes | (r ) Yes | http://download.opensuse.org/update/leap/15.3/non-oss/ 10 | Yes | ( p) Yes | http://download.opensuse.org/update/leap/15.3/sle/ # time zypper ref Repository 'FCL' is up to date. Repository 'KDE3' is up to date. Repository 'Mozilla' is up to date. Repository 'NonOSS' is up to date. Repository 'OSS' is up to date. Repository 'PackmanE' is up to date. Repository 'Update' is up to date. Repository 'UpdateBP' is up to date. Repository 'UpdateNonOSS' is up to date. Retrieving repository 'UpdateSLE' metadata .................................................[done] Building repository 'UpdateSLE' cache ......................................................[done] All repositories have been refreshed. real 1m2.752s user 0m23.481s sys 0m2.810s # -- Evolution as taught in public schools is, like religion, based on faith, not based on science. Team OS/2 ** Reg. Linux User #211409 ** a11y rocks! Felix Miata
On 26.07.22 08:22, Felix Miata wrote:
Is update/leap/15.3/sle/ the most populous, containing more packages than any other? What else could account for this obvious sloth, twice the time to refresh sle than all others combined? Behavior is similar for 15.4, since farther back than I can remember, probably since 15.3 was originally released.
Are you sure with 15.4? I'd guess it is because of the bizarre size of the metadata for the 15.3 sle update channel: http://download.opensuse.org/update/leap/15.3/sle/repodata/ which relatively often seems to be not served by a fast mirror but by a slow one (or maybe download.o.o directly?) The uncompressed primary.xml is 769MB (which also will make it hard to handle for small memory machines, I'd guess) Other compression methods might help, too: * with xz standard options, the primary.xml compresses to 15MB and still decompresses faster than the gzip'ed one * zstd standard options: 71MB, compresses and decompresses much faster * zstd -19: 9.9MB(!), compresses much slower but decompresses even faster. But reducing what's in primary.xml might be the best overall future improvement. BUT! it is not like that (yet) for 15.4, at least for me and the metadata file size is much more reasonable: http://download.opensuse.org/update/leap/15.4/sle/repodata/ But this is a technical discussion, probably not that well fitting on project@ list ;-) -- Stefan Seyfried "For a successful technology, reality must take precedence over public relations, for nature cannot be fooled." -- Richard Feynman
Stefan Seyfried composed on 2022-07-26 09:10 (UTC+0200):
Felix Miata wrote:
Is update/leap/15.3/sle/ the most populous, containing more packages than any other? What else could account for this obvious sloth, twice the time to refresh sle than all others combined? Behavior is similar for 15.4, since farther back than I can remember, probably since 15.3 was originally released.
Are you sure with 15.4?
It has alwasys seemed so, but the test on the same PC came out to nearly half as long just for sle update as all other 8 repos combined, 19.4s vs. 40.8s. That makes it inevitable that 15.4 will be like 15.3 is now by the time it gets to be the age 15.3 is now, unless something changes.
http://download.opensuse.org/update/leap/15.3/sle/repodata/ which relatively often seems to be not served by a fast mirror but by a slow one (or maybe download.o.o directly?)
If that's it, it's the routine, the rule rather than the exception. It's always the last and the slowest.
But this is a technical discussion, probably not that well fitting on project@ list ;-)
Which is best is typically a hard question, given so many to choose from, and the chastising that commonly results from a poor choice. Others I considered, in alphabetical order: factory heroes mirrors support -- Evolution as taught in public schools is, like religion, based on faith, not based on science. Team OS/2 ** Reg. Linux User #211409 ** a11y rocks! Felix Miata
On 26/07/2022 08.22, Felix Miata wrote:
Is update/leap/15.3/sle/ the most populous, containing more packages than any other? What else could account for this obvious sloth, twice the time to refresh sle than all others combined? Behavior is similar for 15.4, since farther back than I can remember, probably since 15.3 was originally released.
# zypper lr ... 9 | Yes | (r ) Yes | http://download.opensuse.org/update/leap/15.3/non-oss/ # time zypper ref Repository 'FCL' is up to date. ... All repositories have been refreshed.
real 0m27.997s user 0m2.711s sys 0m0.890s # zypper lr ... 10 | Yes | ( p) Yes | http://download.opensuse.org/update/leap/15.3/sle/ # time zypper ref Repository 'FCL' is up to date. Repository 'KDE3' is up to date.
Use "force".
real 1m2.752s user 0m23.481s sys 0m2.810s #
I have 21 repos, 13 enabled. I run: Legolas:~ # time zypper --non-interactive ref --force Forcing raw metadata refresh Retrieving repository 'Ext: Packman' metadata ..................................................................[done] Forcing building of repository cache ... Building repository 'Update Repository (Non-Oss)' cache ........................................................[done] Some of the repositories have not been refreshed because of an error. real 1m50.482s user 1m14.634s sys 0m4.399s Legolas:~ # It seems a reasonable time to me, considering it is a small, slow laptop, via wifi, and internet of 100 megs/s. I had to use non interactive to avoid questions about the chrome key and others. No interruptions. And I use "force" so that all active repos are checked, not using cached data from a previous run. -- Cheers / Saludos, Carlos E. R. (from openSUSE 15.3 (Legolas))
participants (3)
-
Carlos E. R. -
Felix Miata -
Stefan Seyfried