Re: [opensuse] downloading with aria2c problem - checksum error, image destroyed!
Hi,
"Carlos E. R."
12/07/06 7:07 PM >>> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
Hi, I finished downloading the 10.2 with aria2c, and it popped this error: | 3,880,814,592/3,880,814,592 Bytes 100% 00s 24.15 KB/s 1 connections | The download was complete. <./openSUSE-10.2-GM-DVD-i386.iso> | Now verifying checksum. | This may take some time depending on your PC environment and the size of file. | checksum ERROR. This happened to me as well. Although, when I retried it, it worked the second time. I agree that trying a second time shouldn't have overwritten the file, but I like the idea that metalinks can use ftp/http instead of only peers. Anyway, if you do get a corrupted download (which even happens with bittorrent sometimes), you can repair it with rsync, which will only transfer the fixed changes: rsync -IvzP rsync://<name-of-mirror>/<opensuse-directory>/<path-to-iso>/<name-of-ISO> <path-to-your-local-ISO-file> Taken from: http://en.opensuse.org/Download_Instructions Wade -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The Friday 2006-12-08 at 01:10 -0700, Wade Berrier wrote:
| The download was complete. <./openSUSE-10.2-GM-DVD-i386.iso> | Now verifying checksum. | This may take some time depending on your PC environment and the size of file. | checksum ERROR.
This happened to me as well. Although, when I retried it, it worked the second time. I agree that trying a second time shouldn't have overwritten the file, but I like the idea that metalinks can use ftp/http instead of only peers.
It should not happen. Metalink is supposed to use methods to avoid download errors. So they say, at least. I very much doubt I'll ever use it again nor recomend it.
Anyway, if you do get a corrupted download (which even happens with bittorrent sometimes), you can repair it with rsync, which will only transfer the fixed changes:
rsync -IvzP rsync://<name-of-mirror>/<opensuse-directory>/<path-to-iso>/<name-of-ISO> <path-to-your-local-ISO-file>
Ah. Didn't think of that one; my intention was to use the command line torrent client, which is also cabable of repairing a download (I have done that other times), but aria2 destroyed it first.
Taken from:
Interesting. It should be in the "Troubleshooting Downloads" instead of the "Downloading from FTP Servers" section. Unfortunately, I only know of one server that supports rsync, there is no list of mirrors supporting it. - -- Cheers, Carlos E. R. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (GNU/Linux) Comment: Made with pgp4pine 1.76 iD8DBQFFeUXntTMYHG2NR9URAjjYAJ4v8474fmYhYujowGyBsqoTJqywnwCeJHcr YQ4z3YXRWXf6VbcsBxxJZSM= =waBD -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
It should not happen. Metalink is supposed to use methods to avoid download errors. So they say, at least. I very much doubt I'll ever use it again nor recomend it.
Correct me if I'm wrong, but I don't think http provides for the possibility of checksuming individual chunks of a file. Which would explain the unusually high incidence of corrupt downloads I'm seeing among people using metalink enabled clients to download 10.2. If you download chunks from 50 different mirrors and just one of the mirrors has a corrupted copy, then your entire download will be corrupt, downloading from lots of mirrors greatly increases the chance of a corrupt download. So downloading 4gb isos using a metalink enabled client using lots of mirrors does not seem like a good idea, especially as any single mirror will likely max out whatever consumer bandwidth you have. Bittorrent enables downloads from many sources, but with bittorrent each chunk is checked, so you only have a small amount to re-download on corruption. _ Benjamin Weber -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The Friday 2006-12-08 at 13:44 -0000, B.Weber@warwick.ac.uk wrote:
It should not happen. Metalink is supposed to use methods to avoid download errors. So they say, at least. I very much doubt I'll ever use it again nor recomend it.
Correct me if I'm wrong, but I don't think http provides for the possibility of checksuming individual chunks of a file. Which would explain the unusually high incidence of corrupt downloads I'm seeing among people using metalink enabled clients to download 10.2.
If you download chunks from 50 different mirrors and just one of the mirrors has a corrupted copy, then your entire download will be corrupt, downloading from lots of mirrors greatly increases the chance of a corrupt download.
You may be right. :-/ I had a look inside the metalink file, in XML format. It does contain a checksum, but of the whole thing, not the portions. Then it contains a list of servers, with some usefull info like country. I don't see how it can checksum the portions, unless that checksum info is downloaded from somewhere else. However, you can certainly have that chunk checksuming using http or ftp - not because the protocol support it, which it doesn't, but because you can do that on top of it using your own means - that's what I had thought metalink did. It appears it doesn't :-( It simple does a checksum at the end for the whole download.
So downloading 4gb isos using a metalink enabled client using lots of mirrors does not seem like a good idea, especially as any single mirror will likely max out whatever consumer bandwidth you have.
Well, as to speed, it is very fast indeed: almost three times faster than torrent, which is still running and has finished only 44% in over 12 hours - - aria2c had finished yesterday in that time. The idea is good: a mirror may be too busy to give you your full download bandwidth, so the user has to try several measuring the speed and choose the best one. The metalink client does that automatically. So, speed is good, reliability is bad: probably worse than with single ftp or http, certainly worse than torrent.
Bittorrent enables downloads from many sources, but with bittorrent each chunk is checked, so you only have a small amount to re-download on corruption.
I know. I have used it to correct corrupted fpt downloads. - -- Cheers, Carlos E. R. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (GNU/Linux) Comment: Made with pgp4pine 1.76 iD8DBQFFeYWntTMYHG2NR9URAm8cAJ44D8RWVHbV1IdAvRRerfZEqfmQTgCcDIFC rQ1ugzqtVicfo4RLWsS4Ww0= =11uL -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
participants (3)
-
B.Weber@warwick.ac.uk
-
Carlos E. R.
-
Wade Berrier