What are the rsync modules for only mirroring Tumbleweed?
Hello! What are the rsync module(s) for mirroring just the Tumbleweed packages? The wiki mentions opensuse-full and opensuse-full-with-tumbleweed (or similar names) but I'm looking for ONLY tumbleweed distribution - is there an rsync module(s) for that? If not what would be the folders to rsync manually to maintain just a tumbleweed mirror? Do /tumbleweed/ and /updates/tumbleweed/ cover it? Context is that I am looking into setting up a local personal mirror for my home use because of poor internet download speeds and I would like to run tumbleweed on at least 2 computers :-) Additional questions... how much disk space would I need to have for tumbleweed mirror and does it keep growing or is there a cleanup of outdated packages? Thank you, Vishal -- "The World is a book, and those who do not travel read only a page." - St. Augustine.
Hello Vishal, unfortunately there isn't any rsync module for only Tumbleweed packages (https://en.opensuse.org/openSUSE:Mirror_infrastructure#rsync_modules). I also can't point out which folders you should sync to only get Tumbleweed because I'm not aware if there are particular dependecies. Currently the full sync of Opensuse is 1,7TB and tumbleweed only is 141GB. Best regards ------------------- Vincenzo Caracciolo GARR - The Italian Academic and Research Network Mob: +39 333 492 8923 GPG: CB9F41F7864FCDFE (vincenzo.caracciolo@garr.it) Il 11/02/22 12:54, Vishal Rao ha scritto:
Hello!
What are the rsync module(s) for mirroring just the Tumbleweed packages?
The wiki mentions opensuse-full and opensuse-full-with-tumbleweed (or similar names) but I'm looking for ONLY tumbleweed distribution - is there an rsync module(s) for that?
If not what would be the folders to rsync manually to maintain just a tumbleweed mirror? Do /tumbleweed/ and /updates/tumbleweed/ cover it?
Context is that I am looking into setting up a local personal mirror for my home use because of poor internet download speeds and I would like to run tumbleweed on at least 2 computers :-)
Additional questions... how much disk space would I need to have for tumbleweed mirror and does it keep growing or is there a cleanup of outdated packages?
Thank you, Vishal
-- "The World is a book, and those who do not travel read only a page." - St. Augustine.
System-support mailing listsystem-support@garr.it JIRA System Support Customer Portal:https://support.garr.it/jira/servicedesk/customer/portal/46
Fri, 11 Feb 2022 17:24:14 +0530 Vishal Rao <vishalrao@gmail.com>:
What are the rsync module(s) for mirroring just the Tumbleweed packages?
This might be the wrong question. '/tumbleweed' is probably what you are looking for. I'm using the attached script to compensate for inconsistent secondary mirrors. Right now my mirror uses 197G. I think that could be caused by the fact that pruning in the script does not work properly. I remember it started with something like 100G. Olaf
Vishal Rao wrote:
Hello!
What are the rsync module(s) for mirroring just the Tumbleweed packages?
The wiki mentions opensuse-full and opensuse-full-with-tumbleweed (or similar names) but I'm looking for ONLY tumbleweed distribution - is there an rsync module(s) for that?
No, there is no module only for TW - I would use opensuse-full-with-factory and then set excludes for what you don't want.
If not what would be the folders to rsync manually to maintain just a tumbleweed mirror? Do /tumbleweed/ and /updates/tumbleweed/ cover it?
just tumbleweed/
Additional questions... how much disk space would I need to have for tumbleweed mirror and does it keep growing or is there a cleanup of outdated packages?
currently it is 173Gb. -- Per Jessen, Zürich (8.4°C)
I'm trying this suggestion but having trouble with figuring out the right way to only grab the tumbleweed/ dir. The command I'm trying is the following (based on the wiki command example) but getting only 1 matched dir with zero files, any suggestions? rsync -rlpt rsync.opensuse.org::opensuse-full-with-factory . --delete-after --delete-excluded --max-delete=4000 --timeout=1800 -hnvvv --stats --progress --filter="+ /tumbleweed" --filter="+ /tumbleweed/repo" --filter="+ /tumbleweed/repo/oss" --filter="+ /tumbleweed/repo/oss/**" --filter="- *" Thanks, Vishal On Fri, 11 Feb 2022 at 21:16, Per Jessen <per@opensuse.org> wrote:
Vishal Rao wrote:
Hello!
What are the rsync module(s) for mirroring just the Tumbleweed packages?
The wiki mentions opensuse-full and opensuse-full-with-tumbleweed (or similar names) but I'm looking for ONLY tumbleweed distribution - is there an rsync module(s) for that?
No, there is no module only for TW - I would use opensuse-full-with-factory and then set excludes for what you don't want.
If not what would be the folders to rsync manually to maintain just a tumbleweed mirror? Do /tumbleweed/ and /updates/tumbleweed/ cover it?
just tumbleweed/
Additional questions... how much disk space would I need to have for tumbleweed mirror and does it keep growing or is there a cleanup of outdated packages?
currently it is 173Gb.
-- Per Jessen, Zürich (8.4°C)
-- "The World is a book, and those who do not travel read only a page." - St. Augustine.
Vishal Rao wrote:
I'm trying this suggestion but having trouble with figuring out the right way to only grab the tumbleweed/ dir.
The command I'm trying is the following (based on the wiki command example) but getting only 1 matched dir with zero files, any suggestions?
rsync -rlpt rsync.opensuse.org::opensuse-full-with-factory . --delete-after --delete-excluded --max-delete=4000 --timeout=1800 -hnvvv --stats --progress --filter="+ /tumbleweed" --filter="+ /tumbleweed/repo" --filter="+ /tumbleweed/repo/oss" --filter="+ /tumbleweed/repo/oss/**" --filter="- *"
I use "--exclude-from=<somefile>" on my own mirror - when you only want tumbleweed, maybe this will do the trick: /header.html /footer.html /favicon.ico /distribution /debug /update /repositories /history /ports /source -- Per Jessen, Zürich (2.8°C)
Thank you for your help! I actually only needed to prepend /opensuse/ to all the filters because that's what was apparently being sent in the file list paths - I was previously looking at the http folder structure which didn't have that prefix but rsync verbose output did. It appears to be working, I'll only be certain after downloading the entire 120 gb of the OSS folder :-) I prefer to use explicit include lists (filters) instead of exclusions because if in the future a new folder shows up it won't be excluded resulting in unnecessary traffic - I guess. Thanks again, Vishal On Fri, 11 Feb 2022 at 23:59, Per Jessen <per@opensuse.org> wrote:
Vishal Rao wrote:
I'm trying this suggestion but having trouble with figuring out the right way to only grab the tumbleweed/ dir.
The command I'm trying is the following (based on the wiki command example) but getting only 1 matched dir with zero files, any suggestions?
rsync -rlpt rsync.opensuse.org::opensuse-full-with-factory . --delete-after --delete-excluded --max-delete=4000 --timeout=1800 -hnvvv --stats --progress --filter="+ /tumbleweed" --filter="+ /tumbleweed/repo" --filter="+ /tumbleweed/repo/oss" --filter="+ /tumbleweed/repo/oss/**" --filter="- *"
I use "--exclude-from=<somefile>" on my own mirror - when you only want tumbleweed, maybe this will do the trick:
/header.html /footer.html /favicon.ico /distribution /debug /update /repositories /history /ports /source
-- Per Jessen, Zürich (2.8°C)
-- "The World is a book, and those who do not travel read only a page." - St. Augustine.
participants (4)
-
Olaf Hering -
Per Jessen -
Vincenzo Caracciolo -
Vishal Rao