[opensuse] making local copy of 13.1 repos
Hello: I would like to download openSUSE 13.1 repos from download.opensuse.org/repositories directory. First I thought I could use wget but it seems it's not that easy. I don't know how I could specify wget to download only "openSUSE_13.1" directories from the tree (without writing every single path after an -I option), if it's possible at all. Any help would be appreciated. Thanks, Istvan -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org
27.01.2016 21:11, Istvan Gabor пишет:
Hello:
I would like to download openSUSE 13.1 repos from download.opensuse.org/repositories directory. First I thought I could use wget but it seems it's not that easy. I don't know how I could specify wget to download only "openSUSE_13.1" directories from the tree (without writing every single path after an -I option), if it's possible at all. Any help would be appreciated.
Thanks,
Istvan
There are rsync mirrors too http://mirrors.opensuse.org/list/13.1.html -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org
Hello, On Wed, 27 Jan 2016, Istvan Gabor wrote:
I would like to download openSUSE 13.1 repos from download.opensuse.org/repositories directory. First I thought I could use wget but it seems it's not that easy. I don't know how I could specify wget to download only "openSUSE_13.1" directories from the tree (without writing every single path after an -I option), if it's possible at all. Any help would be appreciated.
RTF --help: -np, --no-parent don't ascend to the parent directory. e.g. wget -m -np http://download.opensuse.org/repositories/openSUSE:/13.1:/ or whatever. HTH, -dnh -- Bug: An elusive creature living in a program that makes it incorrect. The activity of "debugging," or removing bugs from a program, ends when people get tired of doing it, not when the bugs are removed. -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org
David Haller írta:
Hello,
On Wed, 27 Jan 2016, Istvan Gabor wrote:
I would like to download openSUSE 13.1 repos from download.opensuse.org/repositories directory. First I thought I could use wget but it seems it's not that easy. I don't know how I could specify wget to download only "openSUSE_13.1" directories from the tree (without writing every single path after an -I option), if it's possible at all. Any help would be appreciated.
RTF --help:
-np, --no-parent don't ascend to the parent directory.
e.g.
wget -m -np http://download.opensuse.org/repositories/openSUSE:/13.1:/
or whatever.
It's not that simple. I want to download all openSUSE 13.1 dirs from under all of the following directories in http://download.opensuse.org/repositories/: Apache/ Apache:/ Application:/ Arch:/ Archiving/ Archiving:/ Banshee/ Banshee:/ Base:/ Cloud/ Cloud:/ CrossToolchain:/ DISCONTINUED:/ Documentation/ Documentation:/ Education/ Education:/ Emulators/ Emulators:/ FATE/ FATE:/ Fedora:/ GNOME:/ GPhoto/ GPhoto:/ Java:/ KDE:/ Kernel:/ LCD/ LibreOffice:/ Linux-PAM/ M17N/ M17N:/ Maemo:/ Meego:/ Mono/ Mono:/ Novell:/ OBS:/ OFED:/ OSSP/ Office/ OpenOffice.org:/ Openwsman/ Openwsman:/ Ports:/ Printing/ Printing:/ Publishing/ Publishing:/ SUSE:/ Ubuntu:/ Virtualization/ Virtualization:/ X11:/ XML/ YaST:/ artwork:/ benchmark/ devel:/ driver:/ drivers:/ eID-belgium/ eIDconfig-belgium/ editors/ electronics/ filesharing/ filesystems/ filesystems:/ games/ games:/ graphics/ graphics:/ hamradio/ hamradio:/ hardware/ hardware:/ home:/ isv:/ limal:/ medical/ mobile:/ mozilla/ mozilla:/ multimedia:/ net-snmp/ net-snmp:/ network/ network:/ office:/ openSUSE:/ science/ science:/ security/ security:/ server:/ shells/ shells:/ spins:/ swamp/ system:/ systemsmanagement/ systemsmanagement:/ utilities/ utilities:/ vdr/ vdr:/ windows:/ zypp:/ How I do that, possibly with one command? Not need to be wget. Thanks, Istvan -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org
On Wed, 2016-01-27 at 21:35 +0100, Istvan Gabor wrote:
David Haller írta:
Hello,
On Wed, 27 Jan 2016, Istvan Gabor wrote:
I would like to download openSUSE 13.1 repos from download.opensuse.org/repositories directory. First I thought I could use wget but it seems it's not that easy. I don't know how I could specify wget to download only "openSUSE_13.1" directories from the tree (without writing every single path after an -I option), if it's possible at all. Any help would be appreciated.
RTF --help:
-np, --no-parent don't ascend to the parent directory.
e.g.
wget -m -np http://download.opensuse.org/repositories/openSUSE:/13.1:/
or whatever.
It's not that simple. I want to download all openSUSE 13.1 dirs from under all of the following directories in http://download.opensuse.org/repositories/:
Apache/ Apache:/ Application:/ Arch:/ Archiving/ Archiving:/ Banshee/ Banshee:/ Base:/ Cloud/ Cloud:/ CrossToolchain:/ DISCONTINUED:/ Documentation/ Documentation:/ Education/ Education:/ Emulators/ Emulators:/ FATE/ FATE:/ Fedora:/ GNOME:/ GPhoto/ GPhoto:/ Java:/ KDE:/ Kernel:/ LCD/ LibreOffice:/ Linux-PAM/ M17N/ M17N:/ Maemo:/ Meego:/ Mono/ Mono:/ Novell:/ OBS:/ OFED:/ OSSP/ Office/ OpenOffice.org:/ Openwsman/ Openwsman:/ Ports:/ Printing/ Printing:/ Publishing/ Publishing:/ SUSE:/ Ubuntu:/ Virtualization/ Virtualization:/ X11:/ XML/ YaST:/ artwork:/ benchmark/ devel:/ driver:/ drivers:/ eID-bel elgium/ editors/ electronics/ filesharing/ filesystems/ filesystems:/ games/ games:/ graphics/ graphics:/ hamradio/ hamradio:/ hardware/ hardware:/ home:/ isv:/ limal:/ medical/ mobile:/ mozilla/ mozilla:/ multimedia:/ net-snmp/ net-snmp:/ network/ network:/ office:/ openSUSE:/ science/ science:/ security/ security:/ server:/ shells/ shells:/ spins:/ swamp/ system:/ systemsmanagement/ systemsmanagement:/ utilities/ utilities:/ vdr/ vdr:/ windows:/ zypp:/
How I do that, possibly with one command? Not need to be wget.
With one command will be rather difficult. What you can do however, is making a dry-run rsync (will take several hours) of the whole tree, capture that output to file, grep/filter what you want, and feed that info to a real rsync session. btw, I would recommend ftp5.gwdg.de That site is connected through the inter-university-network, and extremely fast. hw -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org
28.01.2016 02:07, Hans Witvliet пишет:
On Wed, 2016-01-27 at 21:35 +0100, Istvan Gabor wrote:
It's not that simple. I want to download all openSUSE 13.1 dirs from under all of the following directories in http://download.opensuse.org/repositories/:
Apache/ Apache:/ Application:/
... ...
With one command will be rather difficult. What you can do however, is making a dry-run rsync (will take several hours) of the whole tree, capture that output to file, grep/filter what you want, and feed that info to a real rsync session.
rsync can take list of names from a file. Alternatively one could use pattern, like --include **/openSUSE_13.1/ which should catch standard repository naming scheme. -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org
Hans Witvliet
On Wed, 2016-01-27 at 21:35 +0100, Istvan Gabor wrote:
David Haller írta:
Hello,
On Wed, 27 Jan 2016, Istvan Gabor wrote:
I would like to download openSUSE 13.1 repos from download.opensuse.org/repositories directory. First I thought I could use wget but it seems it's not that easy. I don't know how I could specify wget to download only "openSUSE_13.1" directories from the tree (without writing every single path after an -I option), if it's possible at all. Any help would be appreciated.
RTF --help:
-np, --no-parent don't ascend to the parent directory.
e.g.
wget -m -np http://download.opensuse.org/repositories/openSUSE:/13.1:/
or whatever.
It's not that simple. I want to download all openSUSE 13.1 dirs from under all of the following directories in http://download.opensuse.org/repositories/:
[SNIP]
How I do that, possibly with one command? Not need to be wget.
With one command will be rather difficult. What you can do however, is making a dry-run rsync (will take several hours) of the whole tree, capture that output to file, grep/filter what you want, and feed that info to a real rsync session. btw, I would recommend ftp5.gwdg.de That site is connected through the inter-university-network, and extremely fast.
Thank you all. I will try either rsync or put all target dirs in a file and use that file as input for wget. Yes, ftp5.gwdg.de is a good server, it even stores old suse versions too. Istvan -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 On 2016-01-27 19:11, Istvan Gabor wrote:
Hello:
I would like to download openSUSE 13.1 repos from download.opensuse.org/repositories directory. First I thought I could use wget but it seems it's not that easy. I don't know how I could specify wget to download only "openSUSE_13.1" directories from the tree (without writing every single path after an -I option), if it's possible at all. Any help would be appreciated.
Thanks,
Istvan
I'm running this: #!/bin/bash OPCIONES="--limit-rate=250K --no-parent --no-host-directories --timestamping --no-verbose" LOGFILE=wget_1.log echo "non-oss" | tee -a $LOGFILE echo | tee -a $LOGFILE time wget --limit-rate=500K --no-parent --no-host-directories --timestamping -r http://download.opensuse.org/distribution/13.1/repo/non-oss/ --append-output=$LOGFILE echo >> $LOGFILE echo "=====================================" >> $LOGFILE echo >> $LOGFILE echo "oss" | tee -a $LOGFILE echo | tee -a $LOGFILE time wget --limit-rate=500K --no-parent --no-host-directories --timestamping -r http://download.opensuse.org/distribution/13.1/repo/oss/ --append-output=$LOGFILE echo >> $LOGFILE echo "=====================================" >> $LOGFILE echo >> $LOGFILE echo "update" | tee -a $LOGFILE echo | tee -a $LOGFILE time wget --limit-rate=500K --no-parent --no-host-directories --timestamping -r http://download.opensuse.org/update/13.1/ --append-output=$LOGFILE echo >> $LOGFILE echo "=====================================" >> $LOGFILE echo >> $LOGFILE One entry per repository, you see. It could be simplified with function calls, but I didn't bother. Notice that these calls to wget also download some "metadata", which are quite slow to get - the mirrorlist is generated real time, I think: - -rw-r--r-- 1 cer users 216150 Sep 28 2013 gfs2-utils-3.1.6+git.1378394292.fa32906-1.2.x86_64.rpm - -rw-r--r-- 1 cer users 97 Jan 24 16:41 gfs2-utils-3.1.6+git.1378394292.fa32906-1.2.x86_64.rpm.btih - -rw-r--r-- 1 cer users 315 Jan 24 16:41 gfs2-utils-3.1.6+git.1378394292.fa32906-1.2.x86_64.rpm.magnet - -rw-r--r-- 1 cer users 89 Jan 24 16:41 gfs2-utils-3.1.6+git.1378394292.fa32906-1.2.x86_64.rpm.md5 - -rw-r--r-- 1 cer users 18204 Jan 24 16:41 gfs2-utils-3.1.6+git.1378394292.fa32906-1.2.x86_64.rpm.meta4 - -rw-r--r-- 1 cer users 19737 Jan 24 16:41 gfs2-utils-3.1.6+git.1378394292.fa32906-1.2.x86_64.rpm.metalink - -rw-r--r-- 1 cer users 34117 Jan 24 00:47 gfs2-utils-3.1.6+git.1378394292.fa32906-1.2.x86_64.rpm.mirrorlist - -rw-r--r-- 1 cer users 97 Jan 24 16:41 gfs2-utils-3.1.6+git.1378394292.fa32906-1.2.x86_64.rpm.sha1 - -rw-r--r-- 1 cer users 121 Jan 24 16:41 gfs2-utils-3.1.6+git.1378394292.fa32906-1.2.x86_64.rpm.sha256 - -rw-r--r-- 1 cer users 172597 Sep 28 2013 gftp-2.0.19-22.1.3.x86_64.rpm - -rw-r--r-- 1 cer users 72 Jan 24 16:41 gftp-2.0.19-22.1.3.x86_64.rpm.btih - -rw-r--r-- 1 cer users 265 Jan 24 16:41 gftp-2.0.19-22.1.3.x86_64.rpm.magnet - -rw-r--r-- 1 cer users 64 Jan 24 16:41 gftp-2.0.19-22.1.3.x86_64.rpm.md5 - -rw-r--r-- 1 cer users 16075 Jan 24 16:41 gftp-2.0.19-22.1.3.x86_64.rpm.meta4 - -rw-r--r-- 1 cer users 17634 Jan 24 16:41 gftp-2.0.19-22.1.3.x86_64.rpm.metalink - -rw-r--r-- 1 cer users 29555 Jan 24 00:47 gftp-2.0.19-22.1.3.x86_64.rpm.mirrorlist - -rw-r--r-- 1 cer users 72 Jan 24 16:41 gftp-2.0.19-22.1.3.x86_64.rpm.sha1 - -rw-r--r-- 1 cer users 96 Jan 24 16:41 gftp-2.0.19-22.1.3.x86_64.rpm.sha256 Actually, what I want is only one of the checksum types, but I didn't find the right concoction. Try this: wget --limit-rate=500K --no-parent --no-host-directories --timestamping --reject .mirrorlist,.btih,.meta4,.magnet,.metalink -r http://download.opensuse.org/distribution/13.1/repo/non-oss/ It runs much faster, but the result is the rpm alone, without checksum files. I want at least one checksumtype, without the mirrorlist or metalink files. On a second step, I want to verify the checksum of all downloaded rpms. - -- Cheers / Saludos, Carlos E. R. (from 13.1 x86_64 "Bottle" (Minas Tirith)) -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (GNU/Linux) iF4EAREIAAYFAlapYfMACgkQja8UbcUWM1xN0gD9EuHNr2r7E4EhDn1SOZlwE1cu xhHLe84cGsD8zEpBh5AA/3KBbNWjZLSe4fG1AJkXBaMKlWIqFqBcSYgd0iV0C0tV =jEvH -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org
participants (5)
-
Andrei Borzenkov -
Carlos E. R. -
David Haller -
Hans Witvliet -
Istvan Gabor