https://bugzilla.novell.com/show_bug.cgi?id=476430 User poeml@novell.com added comment https://bugzilla.novell.com/show_bug.cgi?id=476430#c1 --- Comment #1 from Peter Poeml 2009-02-17 06:31:50 MST --- I see this for the netbeans request: HTTP/1.0 401 Unauthorized^M Server: squid/2.7.STABLE5^M Date: Tue, 17 Feb 2009 11:42:35 GMT^M Content-Type: text/html^M Content-Length: 1356^M X-Squid-Error: ERR_FTP_FORBIDDEN 0^M X-Cache: MISS from Arbuthnot.plater^M X-Cache-Lookup: MISS from Arbuthnot.plater:3128^M Via: 1.0 Arbuthnot.plater:3128 (squid/2.7.STABLE5)^M Connection: close 2009-02-17 13:42:35.435906 DEBUG - CUID#11 - socket: read:1, write:0, hup:0, err:0 2009-02-17 13:42:35.436223 ERROR - CUID#11 - Download aborted. URI=ftp://ftp.is.co.za/mirror/opensuse/factory/repo/non-oss/suse/x86_64/netbeans-6.0-80.28.x86_64.rpm Exception: Authorization failed. After that, tons of "socket: read:1" log lines. I wonder, what did it download from where? Did it actually download something, or just get stuck in some kind of loop, trying to download from the proxy? 2009-02-17 13:47:13.275462 DEBUG - CUID#6 - socket: read:1, write:0, hup:0, err:0 2009-02-17 13:47:13.309701 DEBUG - CUID#10 - socket: read:1, write:0, hup:0, err:0 2009-02-17 13:47:13.344926 DEBUG - CUID#10 - socket: read:1, write:0, hup:0, err:0 2009-02-17 13:47:13.379168 DEBUG - CUID#6 - socket: read:1, write:0, hup:0, err:0 2009-02-17 13:47:13.413427 DEBUG - CUID#6 - socket: read:1, write:0, hup:0, err:0 2009-02-17 13:47:13.448657 DEBUG - CUID#6 - socket: read:1, write:0, hup:0, err:0 2009-02-17 13:47:13.482899 DEBUG - CUID#6 - socket: read:1, write:0, hup:0, err:0 2009-02-17 13:47:13.517136 DEBUG - CUID#6 - socket: read:1, write:0, hup:0, err:0 2009-02-17 13:47:13.552865 DEBUG - CUID#8 - socket: read:1, write:0, hup:0, err:0 But it seems to download really: 2009-02-17 13:47:13.552962 INFO - CUID#8 - The download for one segment completed successfully. 2009-02-17 13:47:13.553005 DEBUG - usedPieces.size()=4 2009-02-17 13:47:13.553023 DEBUG - Attach segment#65 to CUID#8. 2009-02-17 13:47:13.553037 DEBUG - index=65, length=1048576, segmentLength=1048576, writtenLength=0 And finally: 2009-02-17 13:47:25.961701 INFO - Saving the segment file /var/adm/mount/AP_0x00000004/suse/x86_64/netbeans-6.0-80.28.x86_64.rpm.aria2 2009-02-17 13:47:25.961967 INFO - The segment file was saved successfully. The file is extremely large -- 126MB, so it is at least logical that aria2c is busy with it for quite a while: -rw-r--r-- 2 mirror stage 126M Feb 13 23:10 /srv/ftp/pub/opensuse/factory/repo/non-oss/suse/x86_64/netbeans-6.0-80.28.x86_64.rpm So it looks to me as if - aria2c successfully downloaded the file - the one FTP error was spurious (happened only in one connection / connection attempt) and didn't hinder the download in the end - quitting yast2 didn't quit aria2c What do you think? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=476430 User dave.plater@yahoo.co.uk added comment https://bugzilla.novell.com/show_bug.cgi?id=476430#c3 --- Comment #3 from Dave Plater 2009-02-17 06:57:03 MST --- I searched /var/ and all subdirectories for a file named netb* and found nothing. I don't know the size of the installation but ktraffic analyzer stats say I've downloaded 569 MB today and the installation was the only large download operation. /tmp has nothing bigger than 9.2MB. There is no trace of any file of significant size so it's a mystery where it went. I have 120.6 MB of files in /tmp so maybe they are all segments. I have 427.7 MB of files with todays date in my package cache and subtracted from ktraffic stats it leaves 141.3 MB which is about the right size for netbeans. It must be fragmented in /tmp -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=476430 User poeml@novell.com added comment https://bugzilla.novell.com/show_bug.cgi?id=476430#c5 --- Comment #5 from Peter Poeml 2009-02-17 07:08:07 MST --- I don't expect that aria2c put anything in /tmp. aria2c normally creates an empty file of the size of the intended download, and starts to "fill" it with the downloaded segments. This happens in a temporary directory that yast2/libzypp creates. Once yast2/libzypp are terminated, they clean up this directory for good. This is also what aria2c said in it's logfile (/var/adm/something disappeared). So this is to be expected when yast2/libzypp are terminated, and aria2c with them. It just seems to me as if yast2 should have terminated aria2c, when it was terminated itself (when you quit it while the download happened). -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=476430 User dave.plater@yahoo.co.uk added comment https://bugzilla.novell.com/show_bug.cgi?id=476430#c7 --- Comment #7 from Dave Plater 2009-02-17 07:46:36 MST --- I tried aria2c http://download.opensuse.org/factory/repo/non-oss/suse/x86_64/netbeans-6.0-8... in the same directory as the existing file and in the absence of exceptions the download completed but the file still fails to install so it must have been corrupted at some stage. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=476430 User dave.plater@yahoo.co.uk added comment https://bugzilla.novell.com/show_bug.cgi?id=476430#c9 --- Comment #9 from Dave Plater 2009-02-18 01:27:22 MST --- Created an attachment (id=273467) --> (https://bugzilla.novell.com/attachment.cgi?id=273467) zypper.log, tcpdump.txt, access.log (squid) and aria2c.log I performed a non proxy zypper in netbeans and then a proxy one. This problem doesn't occur with http only ftp, ftp.is.co.za only allows 4 connections from one ip. If I use http://download.opensuse.org the problem doesn't occur due to many mirrors being used. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=476430 User dave.plater@yahoo.co.uk added comment https://bugzilla.novell.com/show_bug.cgi?id=476430#c11 --- Comment #11 from Dave Plater 2009-02-18 02:17:18 MST --- I see aria2c receives a 530 error from ftp.is.co.za without squid and handles it gracefully whereas with squid it receives HTTP/1.0 401 Unauthorized and confuses libzypp. I would think that aria2c should treat any error in one of multiple download threads the same and simply shut down the thread as it does when there is no proxy? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=476430 User dave.plater@yahoo.co.uk added comment https://bugzilla.novell.com/show_bug.cgi?id=476430#c13 --- Comment #13 from Dave Plater 2009-02-20 02:00:34 MST --- *** Bug 476427 has been marked as a duplicate of this bug. *** https://bugzilla.novell.com/show_bug.cgi?id=476427 -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=476430 User dave.plater@yahoo.co.uk added comment https://bugzilla.novell.com/show_bug.cgi?id=476430#c15 --- Comment #15 from Dave Plater 2009-02-20 03:02:17 MST --- The Comment #14 attachment contains logs for the following zypper session which I think reinforces Comment #12 The following is the actual session where aria2c finds no package at one url but switches to a mirror and finds the package but libzypp stops on the first error. Fortunately aria2c had finished downloading by the time I pressed retry and the transaction completed :- Overall download size: 943.0 K. After the operation, additional 2.3 M will be used. Continue? [YES/no]: committing Retrieving package yast2-schema-2.18.0-1.1.noarch (1/3), 64.0 K (794.0 K unpacked) Retrieving: oss [done] Retrieving: media [done] Media source 'http://download.opensuse.org/factory/repo/oss/' does not contain the desired medium Abort, retry, ignore? [A/r/i]: r Retrieving: oss [done] Retrieving: yast2-schema-2.18.0-1.1.noarch.rpm [done] Installing: yast2-schema-2.18.0-1.1 [done] Retrieving package autoyast2-installation-2.18.1-1.1.noarch (2/3), 245.0 K (1.3 M unpacked) Retrieving: oss [done] Retrieving: autoyast2-installation-2.18.1-1.1.noarch.rpm [done] Installing: autoyast2-installation-2.18.1-1.1 [done] Retrieving package autoyast2-2.18.1-1.1.noarch (3/3), 634.0 K (1.5 M unpacked) Retrieving: oss [done] Retrieving: autoyast2-2.18.1-1.1.noarch.rpm [done] Installing: autoyast2-2.18.1-1.1 [done] committingCommitResult 3 (errors 0, remaining 0, srcremaining 0) -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=476430 Michael Andres changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |ma@novell.com AssignedTo|zypp-maintainers@forge.prov |dmacvicar@novell.com |o.novell.com | -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.