Mailinglist Archive: opensuse-factory (1233 mails)

< Previous Next >
Re: Better downloading (was: Re: [opensuse-factory] Rediculous bittorrent speed/slowness...)
  • From: Peter Poeml <poeml@xxxxxxx>
  • Date: Fri, 7 Nov 2008 20:28:19 +0100
  • Message-id: <20081107192819.GT15861@xxxxxxx>
On Fri, Nov 07, 2008 at 01:44:33PM -0500, Larry Stotler wrote:
On Fri, Nov 7, 2008 at 1:21 PM, Peter Poeml <poeml@xxxxxxx> wrote:
Which URL were you downloading from?
Directly from a mirror, or were you using the .torrent file?

The ftp5.gwdg.de link that you had listed actually. No torrent.

Failed again at 70% due to timeout.

Yes, if there is only a single download source, there is of course not
much failover that the client can do. So in this case, no Bittorrent was
involved.

I like the minute by minute log. Useful.

For the beta DVDs that we published so far, it's not easy to combine
HTTP/FTP and bittorrent. But once we have the DVDs on
download.opensuse.org (with the next Beta, I hope), aria2c will be able
to use HTTP/FTP and bittorrent in parallel.

So, we will need to have it open a torrent file instead? Or will you
have a special file with both types of into in it that we can use
instead?

The latter - but you won't notice it. The client (aria2c) accesses the
normal HTTP link to the iso image (http://download.opensuse.org/..../*.iso)
which is just the link that you would see / click at in the web browser.
The server notices that the client understands Metalinks, and returns in
fact a Metalink. The Metalink contains both types of download sources,
plus hashes for verification.

This is transparently negotiated by client and server, and you can
simulate it with
curl -H "Accept: application/metalink+xml"
http://download.opensuse.org/distribution/11.1-Beta4/iso/openSUSE-11.1-Beta4-KDE-LiveCD-i686.iso
You'll see the raw Metalink that aria2c gets.

Thus, there is only one (type of) link you need to know, and it'll
transparently work with all possible clients, be it a simple web browser
or aria2c. And metalink clients like aria2c will make use of the full
potential.

Peter
--
Contact: admin@xxxxxxxxxxxx (a.k.a. ftpadmin@xxxxxxxx)
#opensuse-mirrors on freenode.net
Info: http://en.opensuse.org/Mirror_Infrastructure

SUSE LINUX Products GmbH
Research & Development
< Previous Next >