[Bug 641257] New: Missing/Slow Mirrors - Update required for aria2c for all releases from 1.9.x - 1.10.x
https://bugzilla.novell.com/show_bug.cgi?id=641257 https://bugzilla.novell.com/show_bug.cgi?id=641257#c0 Summary: Missing/Slow Mirrors - Update required for aria2c for all releases from 1.9.x - 1.10.x Classification: openSUSE Product: openSUSE 11.3 Version: Final Platform: Other OS/Version: openSUSE 11.3 Status: NEW Severity: Major Priority: P5 - None Component: YaST2 AssignedTo: bnc-team-screening@forge.provo.novell.com ReportedBy: drankinatty@suddenlinkmail.com QAContact: jsrain@novell.com Found By: --- Blocker: --- Paraphrased from Peter Poeml from "Re: [opensuse] One repo in the pool killing updates - probably utexas.edu - can it be fixed?" Using aria2c directly, we can see what it does with that: % aria2c --log=- --log-level=debug '--user-agent=ZYpp 7.7.5 (aria2 version 1.9.1) openSUSE-11.3-x86_64' --summary-interval=1 --follow-metalink=mem --check-integrity=true --file-allocation=none --server-stat-of=/home/poeml/.aria2/aria2.stats --server-stat-if=/home/poeml/.aria2/aria2.stats --uri-selector=adaptive --use-head=false --max-tries=5 --max-concurrent-downloads=2 --header=Pragma: --connect-timeout=180 'http://download.opensuse.org/repositories/home:/-miska-/openSUSE_11.3/x86_64...' | grep Host Host: download.opensuse.org Host: widehat.opensuse.org Host: ftp.halifax.rwth-aachen.de Host: ftp5.gwdg.de Host: ftp.roedu.net Host: 130.57.19.201 It contacts 5 servers, which is the built-in default for concurrency. The job finishes after 1 or 2 seconds for me, which is about the same time to download the package from a single source in this case. <snip> Sigh. When testing the same as above from the US, aria2c does not contact 5 mirrors; it contacts only one, and if that is utexas.edu, the download takes a minute instead of 2-4 seconds. The log shows that only one server is contacted, and it is reproducible: % aria2c --log=- --log-level=debug '--user-agent=ZYpp 7.7.5 (aria2 version 1.9.1) openSUSE-11.3-x86_64' --summary-interval=1 --follow-metalink=mem --check-integrity=true --file-allocation=none --server-stat-of=/home/poeml/.aria2/aria2.stats --server-stat-if=/home/poeml/.aria2/aria2.stats --uri-selector=adaptive --use-head=false --max-tries=5 --max-concurrent-downloads=2 --header=Pragma: --connect-timeout=180 'http://download.opensuse.org/repositories/home:/-miska-/openSUSE_11.3/x86_64...' | grep Host Host: download.opensuse.org Host: 130.57.19.201 The worst is, I don't know why this differs. Apart from the aria2c version everything should be exactly the same. In the latter case, I used the newest version, 1.10.3. <snip - next reply from Peter> I found http://sourceforge.net/tracker/?func=detail&aid=3043968&group_id=159897&atid=813673 which mentions a changed behaviour in aria2c 1.10.x, compared to 1.9.x. Indeed, when I try the mentioned options "--max-connection-per-server=4 --min-split-size=1M" aria2c behaves again as I would expect it: poeml@download:~/Images> time aria2c --log=- --log-level=debug --summary-interval=1 --follow-metalink=mem --check-integrity=true --file-allocation=none --use-head=false --max-tries=5 --connect-timeout=180 --max-connection-per-server=1 --min-split-size=1M 'http://download.opensuse.org/repositories/home:/-miska-/openSUSE_11.3/x86_64...' | grep Host Host: download.opensuse.org 2010-09-22 11:30:19.744906 DEBUG - UsedHost=1, ftp.utexas.edu 2010-09-22 11:30:19.745048 DEBUG - UsedHost=1, 130.57.19.201 2010-09-22 11:30:19.745057 DEBUG - UsedHost=1, ftp.utexas.edu 2010-09-22 11:30:19.745179 DEBUG - UsedHost=1, 130.57.19.201 2010-09-22 11:30:19.745189 DEBUG - UsedHost=1, ftp.utexas.edu 2010-09-22 11:30:19.745198 DEBUG - UsedHost=1, ftp5.gwdg.de 2010-09-22 11:30:19.745318 DEBUG - UsedHost=1, 130.57.19.201 2010-09-22 11:30:19.745328 DEBUG - UsedHost=1, ftp.utexas.edu 2010-09-22 11:30:19.745337 DEBUG - UsedHost=1, ftp5.gwdg.de 2010-09-22 11:30:19.745345 DEBUG - UsedHost=1, widehat.opensuse.org Host: 130.57.19.201 Host: ftp.halifax.rwth-aachen.de Host: widehat.opensuse.org Host: ftp5.gwdg.de Host: ftp.utexas.edu Host: 130.57.19.201 aria2c --log=- --log-level=debug --summary-interval=1 --follow-metalink=mem 0.00s user 0.24s system 5% cpu 4.089 total grep Host 0.00s user 0.05s system 1% cpu 4.053 total As the log excerpt shows, aria2c contacts not only one server, and it finishes the download in about 4 seconds (instead of one minute) even though the slow utexas.edu mirror was used (among others). That's how it should be. So, if you see the same happening, and if you are indeed using a new aria2c (1.10.x), then one should figure out how zypper/yast can use the right options (or if this is a bug). <snip - next reply from Carlos E.R.> Then I think that aria2c should be upgraded (via update repo, recomended update) on all openSUSE distros. That would reduce the problem of missing mirrors in the US. <me> And backport to all supported releases :p -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=641257 https://bugzilla.novell.com/show_bug.cgi?id=641257#c1 Marcus Meissner <meissner@novell.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |poeml@cmdline.net --- Comment #1 from Marcus Meissner <meissner@novell.com> 2010-09-23 07:16:52 UTC --- i would remove utexas.edu from the list, if it is continuously slow./ -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=641257 https://bugzilla.novell.com/show_bug.cgi?id=641257#c2 --- Comment #2 from Peter Poeml <poeml@cmdline.net> 2010-09-23 08:29:09 UTC --- There is a misundestanding. To make a long story short: David sees very slow downloads. I cannot reproduce them with aria2c 1.9.5. I can reproduce them with aria2c 1.10.3 though. Hence my question whether David uses version 1.10.x. He doesn't. Hence, I cannot reproduce the problem that David is seeing. Hence, there is no conclusion by me that updating aria2c would be of any use. And if aria2c would be updated, version 1.10.x would need to be used with two new options, because otherwise it behaves exactly like what David is experiencing. Which is the reason why I asked for the version he uses. Unfortunately, everybody on the mailing list seems to have understood something else :-) The question is why David's aria2c 1.9.x version doesn't use all mirrors. If it would use all mirrors, it wouldn't get stuck with the single bad mirror. The whole point of using aria2c as download backend is to be less dependent on 100% working mirrors (which can never be achieved anyway). David, maybe you could attach a debug log... using --log=aria2c.log instead of --log=-. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=641257 https://bugzilla.novell.com/show_bug.cgi?id=641257#c wei wang <wewang@novell.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |wewang@novell.com AssignedTo|bnc-team-screening@forge.pr |yast2-maintainers@suse.de |ovo.novell.com | -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=641257 https://bugzilla.novell.com/show_bug.cgi?id=641257#c3 Michal Zugec <mzugec@novell.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |NEEDINFO InfoProvider| |drankinatty@suddenlinkmail. | |com AssignedTo|yast2-maintainers@suse.de |poeml@cmdline.net --- Comment #3 from Michal Zugec <mzugec@novell.com> 2010-10-18 12:48:14 UTC --- David, please attach requested debug log -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=641257 https://bugzilla.novell.com/show_bug.cgi?id=641257#c4 David Rankin <drankinatty@suddenlinkmail.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEEDINFO |CLOSED InfoProvider|drankinatty@suddenlinkmail. | |com | Resolution| |FIXED --- Comment #4 from David Rankin <drankinatty@suddenlinkmail.com> 2014-07-29 06:55:24 UTC --- Bug is ancient (11.3) and is no longer relevant. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
participants (1)
-
bugzilla_noreply＠novell.com