On 15/10/2021 10.05, Olaf Hering wrote:
While mirroring /tumbleweed/repo/oss from another mirror via rsync it became clear that these secondary mirrors do not provide atomic updates. The files are updated in random order. Most likely rsync was invoked without --delay-updates. Perhaps also without --partial and proper --partial-dir=DIR, in case this actually combines well with --delay-updates, just to avoid errors like rsync: send_files failed to open "/tumbleweed/repo/oss/x86_64/.lazarus-2.0.12-2.1.x86_64.rpm.C11vZI" (in opensuse): Permission denied (13)
I do not know for how long rsync mirrors are offered. Was there any effort to provide mirror admins with instructions about how to mirror a volatile installation repo properly?
I'd recommend at least rsync -ay --delete-delay --delay-updates $source $destination It will use some GB extra diskspace while the transfer is ongoing, so users can still fetch the old versions until all the new ones are there. I guess, we should mention these in https://en.opensuse.org/openSUSE:Mirror_howto I have experienced similar problems when I created the opensuse.zq1.de IPFS mirror that always has consistent snapshots. There I use after rsync https://github.com/bmwiedemann/opensusearchive/blob/master/checkrepo to validate that the sync gave me all files. Otherwise, sync again later. Ciao Bernhard M.