[opensuse-buildservice] obs-service-download_files doesn't download files
Hello. Two of my SRs are declined by factory-auto: https://build.opensuse.org/request/show/203318 https://build.opensuse.org/request/show/203319 The errors are: Failed to download. … Source URLs are not valid. Try "osc service localrun download_files" Well, running 'osc service localrun download_files' I see: % osc service localrun download_files HTTP/1.1 404 Not Found Date: Thu, 17 Oct 2013 12:51:50 GMT Server: Apache X-Powered-By: PHP/5.3.18 X-Pingback: http://www.indii.org/wordpress/xmlrpc.php Expires: Wed, 11 Jan 1984 05:00:00 GMT Cache-Control: no-cache, must-revalidate, max-age=0 Pragma: no-cache Content-Encoding: gzip Vary: Accept-Encoding Last-Modified: Thu, 01 Jan 1970 00:00:00 GMT Connection: close Content-Type: text/html; charset=UTF-8 ERROR: Failed to download "http://www.indii.org/files/tint/releases/tintii-2.8.0.tar.gz" Aborting: service call failed: /usr/lib/obs/service/download_files --outdir /tmp/tmpXGx5CM It works running manually: % wget http://www.indii.org/files/tint/releases/tintii-2.8.0.tar.gz asking libproxy about url 'http://www.indii.org/files/tint/releases/tintii-2.8.0.tar.gz' libproxy suggest to use 'direct://' --2013-10-17 16:55:16-- http://www.indii.org/files/tint/releases/tintii-2.8.0.tar.gz Распознаётся www.indii.org... 83.223.119.251 Устанавливается соединение с www.indii.org|83.223.119.251|:80... соединение установлено. Запрос HTTP послан, ожидается ответ... HTTP/1.1 200 OK Date: Thu, 17 Oct 2013 12:54:50 GMT Server: Apache Last-Modified: Sat, 05 Oct 2013 08:05:48 GMT ETag: "165003c-6460c-4e7f9e2fdcf00" Accept-Ranges: bytes Content-Length: 411148 Keep-Alive: timeout=2, max=100 Connection: Keep-Alive Content-Type: application/x-gzip Длина: 411148 (402K) [application/x-gzip] Saving to: «tintii-2.8.0.tar.gz» 100%[====================================================================>] 411 148 473K/s в 0,8s 2013-10-17 16:55:17 (473 KB/s) - «tintii-2.8.0.tar.gz» saved [411148/411148] What is the problem? -- WBR Kyrill
Am Donnerstag, 17. Oktober 2013, 17:00:09 schrieb Kyrill Detinov:
Hello.
Two of my SRs are declined by factory-auto: https://build.opensuse.org/request/show/203318 https://build.opensuse.org/request/show/203319
The errors are: Failed to download. … Source URLs are not valid. Try "osc service localrun download_files"
Well, running 'osc service localrun download_files' I see:
% osc service localrun download_files HTTP/1.1 404 Not Found Date: Thu, 17 Oct 2013 12:51:50 GMT Server: Apache X-Powered-By: PHP/5.3.18 X-Pingback: http://www.indii.org/wordpress/xmlrpc.php Expires: Wed, 11 Jan 1984 05:00:00 GMT Cache-Control: no-cache, must-revalidate, max-age=0 Pragma: no-cache Content-Encoding: gzip Vary: Accept-Encoding Last-Modified: Thu, 01 Jan 1970 00:00:00 GMT Connection: close Content-Type: text/html; charset=UTF-8 ERROR: Failed to download "http://www.indii.org/files/tint/releases/tintii-2.8.0.tar.gz" Aborting: service call failed: /usr/lib/obs/service/download_files --outdir /tmp/tmpXGx5CM
It works running manually:
% wget http://www.indii.org/files/tint/releases/tintii-2.8.0.tar.gz asking libproxy about url 'http://www.indii.org/files/tint/releases/tintii-2.8.0.tar.gz' libproxy suggest to use 'direct://' --2013-10-17 16:55:16-- http://www.indii.org/files/tint/releases/tintii-2.8.0.tar.gz Распознаётся www.indii.org... 83.223.119.251 Устанавливается соединение с www.indii.org|83.223.119.251|:80... соединение установлено. Запрос HTTP послан, ожидается ответ... HTTP/1.1 200 OK Date: Thu, 17 Oct 2013 12:54:50 GMT Server: Apache Last-Modified: Sat, 05 Oct 2013 08:05:48 GMT ETag: "165003c-6460c-4e7f9e2fdcf00" Accept-Ranges: bytes Content-Length: 411148 Keep-Alive: timeout=2, max=100 Connection: Keep-Alive Content-Type: application/x-gzip Длина: 411148 (402K) [application/x-gzip] Saving to: «tintii-2.8.0.tar.gz»
100%[====================================================================>] 411 148 473K/s в 0,8s
2013-10-17 16:55:17 (473 KB/s) - «tintii-2.8.0.tar.gz» saved [411148/411148]
What is the problem?
it looks like they are blocking us ... when I change the user agent name it works. maybe a reason to drop it ? ;) -- Adrian Schroeter email: adrian@suse.de SUSE LINUX GmbH, GF: Jeff Hawn, Jennifer Guild, Felix Imendörffer, HRB 21284 (AG Nürnberg) Maxfeldstraße 5 90409 Nürnberg Germany -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-buildservice+owner@opensuse.org
On 17.10.2013 15:56, Adrian Schröter wrote:
What is the problem?
it looks like they are blocking us ... when I change the user agent name it works.
maybe a reason to drop it ? ;)
The site is completely nuts. It allows user agent 'Wget', which is default user agent of wget, but not 'wget'. Greetings, Stephan -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-buildservice+owner@opensuse.org
Quoting Stephan Kulow
The site is completely nuts. It allows user agent 'Wget', which is default user agent of wget, but not 'wget'.
sounds like a site that is running after 'known' agents and allowing them. Probably after 'extensive' testing that the agent does not cause any harm to the site (well, probably not.. but...) Amazing, what kind of phantasies some have when it comes to 'security' Dominique -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-buildservice+owner@opensuse.org
On Thursday 2013-10-17 16:28, Dominique Leuenberger a.k.a. Dimstar wrote:
Quoting Stephan Kulow
: The site is completely nuts. It allows user agent 'Wget', which is default user agent of wget, but not 'wget'.
sounds like a site that is running after 'known' agents and allowing them. Probably after 'extensive' testing that the agent does not cause any harm to the site (well, probably not.. but...)
Amazing, what kind of phantasies some have when it comes to 'security'
This may not have to do with security at all, but ignoring software that tries to lie (and badly so ;-) about its origins, and to block services (like BS service downloads) that may eat quota in a way not desired by the site. -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-buildservice+owner@opensuse.org
On Fri, 18 Oct 2013 18:36:19 +0200 (CEST) Jan Engelhardt wrote:
On Thursday 2013-10-17 16:28, Dominique Leuenberger a.k.a. Dimstar wrote:
Quoting Stephan Kulow
: The site is completely nuts. It allows user agent 'Wget', which is default user agent of wget, but not 'wget'.
sounds like a site that is running after 'known' agents and allowing them. Probably after 'extensive' testing that the agent does not cause any harm to the site (well, probably not.. but...)
Amazing, what kind of phantasies some have when it comes to 'security'
This may not have to do with security at all, but ignoring software that tries to lie (and badly so ;-) about its origins, and to block services (like BS service downloads) that may eat quota in a way not desired by the site.
I've got a reply from the author. He suggests to use http://cdn.indii.org instead of http://www.indii.org. It works with 'osc service localrun download_files'. -- WBR Kyrill
participants (5)
-
Adrian Schröter
-
Dominique Leuenberger a.k.a. Dimstar
-
Jan Engelhardt
-
Kyrill Detinov
-
Stephan Kulow