[Bug 1190182] New: new media backend - slow download
http://bugzilla.opensuse.org/show_bug.cgi?id=1190182 Bug ID: 1190182 Summary: new media backend - slow download Classification: openSUSE Product: openSUSE Tumbleweed Version: Current Hardware: x86-64 OS: Other Status: NEW Severity: Enhancement Priority: P5 - None Component: libzypp Assignee: zypp-maintainers@suse.de Reporter: bdamasceno@hotmail.com.br QA Contact: qa-bugs@suse.de Found By: --- Blocker: --- Created attachment 852294 --> http://bugzilla.opensuse.org/attachment.cgi?id=852294&action=edit new media backend - slow download - 20210901 Follow up from mailing list discussion: https://lists.opensuse.org/archives/list/factory@lists.opensuse.org/message/... ----------------------------- "regular" dup = zypper dup "super" dup = env ZYPP_SINGLE_RPMTRANS=1 ZYPP_MEDIANETWORK=1 zypper dup test: notebook: super dup to get snapshot 20210831. desktop: regular dup to get snapshot 20210831. The download with super dup was four times slower than the regular dup. The snapshot was fresh so the "additional mirror rating" from the new media backend must have made a poor choice due to the ongoing mirror syncing. ----------------------------- "...might be interesting to see your zypper log for the slow case to check if any timeouts were firing." Couldn't find timeouts on the log from the slow case (notebook). I tried to compare the mirrors used on both cases but the logs are different: while the old media backend logged the mirrors used the new media backend didn�t. libzypp-17.28.1-1.1 -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.opensuse.org/show_bug.cgi?id=1190182 http://bugzilla.opensuse.org/show_bug.cgi?id=1190182#c1 --- Comment #1 from Michael Andres <ma@suse.com> ---
# grep 'providePackage\|main.cc' zypper.log-20210902_desktop_full 2021-09-01 21:11:03 <1> xigmatek(5390) [zypper] main.cc(main):132 ===== Hi, me zypper 1.14.48 2021-09-01 21:11:03 <1> xigmatek(5390) [zypper] main.cc(main):133 ===== 'zypper' 'dup' ===== 2021-09-01 21:13:36 <1> xigmatek(5390) [zypp] PackageProvider.cc(providePackage):412 provide Package (2544)branding-openSUSE-84.87.20200106-4.7.noarch(download.opensuse.org-oss) 2021-09-01 21:13:37 <1> xigmatek(5390) [zypp] PackageProvider.cc(providePackage):513 provided Package (2544)branding-openSUSE-84.87.20200106-4.7.noarch(download.opensuse.org-oss) at /var/cache/zypp/packages/download.opensuse.org-oss/noarch/branding-openSUSE-84.87.202> ... 2021-09-01 21:17:41 <1> xigmatek(6131) [zypper] main.cc(main):132 ===== Hi, me zypper 1.14.48 2021-09-01 21:17:41 <1> xigmatek(6131) [zypper] main.cc(main):133 ===== 'zypper' 'dup' ===== 2021-09-01 21:19:38 <1> xigmatek(6131) [zypp] PackageProvider.cc(providePackage):372 provided Package from cache (2544)branding-openSUSE-84.87.20200106-4.7.noarch(download.opensuse.org-oss) at /var/cache/zypp/packages/download.opensuse.org-oss/noarch/branding-openSUS>
Hi Bruno. If you check the logs (I listed just the 1st file), you find that the 1st (slow) command actually downloads the files and caches them below /var/cache/zypp/packages/. The files stay there until they are consumed. The 2nd (fast) command finds the files in the cache and does not need to the downloads. If you want to enforce download of the packages, call 'zypper clean -a; zypper ref' before your test (cleans packages and metadata; ref restores the metadata again). -- You are receiving this mail because: You are on the CC list for the bug.
http://bugzilla.opensuse.org/show_bug.cgi?id=1190182 http://bugzilla.opensuse.org/show_bug.cgi?id=1190182#c2 --- Comment #2 from Bruno Damasceno Freire <bdamasceno@hotmail.com.br> --- Hi Michael; I did two runs on both, notebook and desktop. The first run started: 2021-09-01_21:10:24 for the notebook 2021-09-01_21:11:03 for the desktop Even starting a little later, the desktop reached the near end of the download much faster. As the snapshot was fresh, I interrupt both runs manually and did a second run on both to reevaluate the mirrors hopping for a changing result due the ongoing mirror syncing. As you pointed out, the second run detected that several files were already in the cache but some files were still missing and were downloaded with a big speed difference again. I remember the last file reached around 70KB/s on the notebook and around 280KB/s on the desktop so a 4x difference with plenty of bandwidth avaialble from my ISP. My suggestion is to compare the sessions highlighted above from laptop and desktop first run because that is the session that got most of the files downloaded on both machines. I did my own comparison using these two files (crafted from the full log) but couldn't find anything useful: zypper.log-20210902_notebook_a_2021-09-01_21:10:24_small-version zypper.log-20210902_desktop_a_2021-09-01_21:11:03_small-version -- You are receiving this mail because: You are on the CC list for the bug.
participants (1)
-
bugzilla_noreply＠suse.com