[Bug 385711] New: download smaller packages/ patches parallely when downloading bigger
https://bugzilla.novell.com/show_bug.cgi?id=385711 Summary: download smaller packages/patches parallely when downloading bigger Product: openSUSE 10.3 Version: Final Platform: i686 OS/Version: openSUSE 10.3 Status: NEW Severity: Enhancement Priority: P5 - None Component: YaST2 AssignedTo: bnc-team-screening@forge.provo.novell.com ReportedBy: jakub.rusinek@gmail.com QAContact: jsrain@novell.com Found By: --- to improve time of downloading packages/patches, smaller files should be downloaded parallely to bigger. for example, if you are downloading 100MB file, 10kB will not hurt, but will decrease list of items awaiting download. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=385711 User poeml@novell.com added comment https://bugzilla.novell.com/show_bug.cgi?id=385711#c1 --- Comment #1 from Peter Poeml <poeml@novell.com> 2008-05-02 01:20:19 MST --- I'm almost certain that this won't speed anything up. It makes most sense (in terms of overhead and bandwidth usage) to keep a Keepalive HTTP connection saturated by requesting one file after the other. [This will give the fastest download possible, with the least overhead on client _and_ server. Keeping in mind that load caused on the server will (in the end) affect that same client also, is important.] Whether this is what libzypp is doing is unknown to me. I expect it isn't, because it after downloading one file it usually installs it first, before downloading the next, and Keepalive timeouts are commonly very short on busy servers (like 2-5 seconds). Yum does it that way (downloading all packages over a single connection and installing them after that all at once). I'm not counting methods to open several connections to the same server, which is what you suggest. You basically (could) suggest that the client opens 10 connections for the same 100MB file and requesting it in segments. That _can_ apparently speed up things for the client _if_ server-side bandwidth or server load is the bottleneck, and the client has bandwidth free. However, this goes on the cost of all other clients, and will eventually hurt the client itself. If everybody does it, everybody would have a disadvantage from it (much higher server load, much higher latencies). And we would need to install protection against it. What you _may_ consider is parallel downloads (in segments) from _different_ servers. Which leads to my proposal here http://en.opensuse.org/Libzypp/Failover It is okay (and can be useful) to retrieve several segments of the same big file from several servers. (This must be done in a way that the client bandwidth is not exceeded, because otherwise it would occupy slots on the server longer than necessary.) Metalinks (http://metalinker.org) support this transparently. You could talk to the zypp folks to integrate this in libzypp. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=385711 User jakub.rusinek@gmail.com added comment https://bugzilla.novell.com/show_bug.cgi?id=385711#c2 --- Comment #2 from Jakub Rusinek <jakub.rusinek@gmail.com> 2008-05-02 02:38:01 MST --- I thought small files downloaded in background will not hurt, but I see you proposed better solution. I had problems with downloading packages, because packages existed virtually (they were not available on servers). You can propose Metalinks too :) . -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=385711 User poeml@novell.com added comment https://bugzilla.novell.com/show_bug.cgi?id=385711#c3 --- Comment #3 from Peter Poeml <poeml@novell.com> 2008-05-02 02:43:58 MST --- I'll leave this for consideration by the yast/zypp team. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=385711 Robert Vojcik <rvojcik@novell.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |rvojcik@novell.com AssignedTo|bnc-team-screening@forge.provo.novell.com |yast2-maintainers@suse.de -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=385711 User ma@novell.com added comment https://bugzilla.novell.com/show_bug.cgi?id=385711#c4 Michael Andres <ma@novell.com> changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |ma@novell.com Status|NEW |RESOLVED Resolution| |DUPLICATE --- Comment #4 from Michael Andres <ma@novell.com> 2008-05-08 03:16:29 MST --- Also covered by FATE request #120340 - Run download and install in parallel. *** This bug has been marked as a duplicate of bug 370054 *** https://bugzilla.novell.com/show_bug.cgi?id=370054 -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
participants (1)
-
bugzilla_noreply@novell.com