rsync.opensuse.org - Large file count in repodata
Context: <mirror>/update/leap/15.6/sle/repodata/ Recently, when mirroring, our local copy of "/update/leap/15.6/sle/repodata/" is pulling between 9 to 100GB of extra repodata files. For me, it appears to only affect updates/.../sle, with the largest being 15.6. However, repomd.xml as synced, is correct and links to 5 good files within repodata. Question: *Is it normal for a repodata pull to have this large amount of files appear during a sync?* We, of course, have rsync configured to "--delete" whatever it needs to during each synchronization. At this time, I believe we observe that only updates to the "sle" folder have this behavior. Cheers, T. Ryan Nicholson
On 16/10/2024 19.27, Ryan Nicholson wrote:
Context: <mirror>/update/leap/15.6/sle/repodata/
Recently, when mirroring, our local copy of "/update/leap/15.6/sle/ repodata/" is pulling between 9 to 100GB of extra repodata files.
For me, it appears to only affect updates/.../sle, with the largest being 15.6.
However, repomd.xml as synced, is correct and links to 5 good files within repodata.
Question: /Is it normal for a repodata pull to have this large amount of files appear during a sync?/ We, of course, have rsync configured to "-- delete" whatever it needs to during each synchronization.
At this time, I believe we observe that only updates to the "sle" folder have this behavior.
Cheers,
T. Ryan Nicholson
I found out that this happened, because rsync.opensuse.org ran its sync with a --max-delete=4000 that stopped deletions with rsync error: the --max-delete limit stopped deletions (code 25) at main.c(1835) [generator=3.2.3] It was triggered by the deletion of older 15.4 (to keep space usage reasonable now that 16.0 (Pre-Alpha) was added) from stage3.o.o Ciao Bernhard M.
participants (2)
-
Bernhard M. Wiedemann
-
Ryan Nicholson