Re: rsync server missing repodata files
Hi Per, On 5/9/22 10:39, Per Jessen wrote:
there will always be some delay between the master (download.o.o) and any mirror - particularly with repositories/ (because of size).
Sure. But what I would expect is, that the whole repodata directory gets updated more or less at once. When synced properly, it contains: - repomd.xml - repomd.xml.asc - repomd.xml.key - (hash)-primary.xml.gz - (hash)-filelists.xml.gz - (hash)-other.xml.gz What I'm seeing is that sometimes the files starting with a hash get deleted, the repomd.xml gets updated and references new hash files. But only after a significant delay (hours/maybe a full day) the new hash files appear. During that time, the repository cannot be used:
# dnf install ... Nightly packages of the Osmocom project (CentOS 8.1 kB/s | 682 B 00:00 Errors during downloading metadata for repository 'network_osmocom_nightly': - Status code: 404 for https://downloads.osmocom.org/obs-mirror/.previous/nightly/CentOS_8/repodata... (IP: ...) - Status code: 404 for https://downloads.osmocom.org/obs-mirror/.previous/nightly/CentOS_8/repodata... (IP: ...) Error: Failed to download metadata for repo 'network_osmocom_nightly': Yum repo downloading error: Downloading error(s):
So I wonder if this can be fixed somehow? Thanks! Best, Oliver
Your post is dated 6 May, but it looks like it was held back for moderation. In the meantime, rsync.o.o is up-to-date, at least for those three files you mentioned.
Beste Grüsse Per Jessen
-- - Oliver Smith <osmith@sysmocom.de> https://www.sysmocom.de/ ======================================================================= * sysmocom - systems for mobile communications GmbH * Alt-Moabit 93 * 10559 Berlin, Germany * Sitz / Registered office: Berlin, HRB 134158 B * Geschaeftsfuehrer / Managing Director: Harald Welte
Right now these hash files are missing from one of the mirrors that http://download.opensuse.org redirects to: https://ftp.gwdg.de/pub/opensuse/repositories/network:/osmocom:/nightly/Cent... On 5/9/22 10:59, Oliver Smith wrote:
Hi Per,
On 5/9/22 10:39, Per Jessen wrote:
there will always be some delay between the master (download.o.o) and any mirror - particularly with repositories/ (because of size).
Sure. But what I would expect is, that the whole repodata directory gets updated more or less at once. When synced properly, it contains:
- repomd.xml - repomd.xml.asc - repomd.xml.key - (hash)-primary.xml.gz - (hash)-filelists.xml.gz - (hash)-other.xml.gz
What I'm seeing is that sometimes the files starting with a hash get deleted, the repomd.xml gets updated and references new hash files. But only after a significant delay (hours/maybe a full day) the new hash files appear.
During that time, the repository cannot be used:
# dnf install ... Nightly packages of the Osmocom project (CentOS 8.1 kB/s | 682 B 00:00 Errors during downloading metadata for repository 'network_osmocom_nightly': - Status code: 404 for https://downloads.osmocom.org/obs-mirror/.previous/nightly/CentOS_8/repodata... (IP: ...) - Status code: 404 for https://downloads.osmocom.org/obs-mirror/.previous/nightly/CentOS_8/repodata... (IP: ...) Error: Failed to download metadata for repo 'network_osmocom_nightly': Yum repo downloading error: Downloading error(s):
So I wonder if this can be fixed somehow?
Thanks!
Best, Oliver
Your post is dated 6 May, but it looks like it was held back for moderation. In the meantime, rsync.o.o is up-to-date, at least for those three files you mentioned.
Beste Grüsse Per Jessen
-- - Oliver Smith <osmith@sysmocom.de> https://www.sysmocom.de/ ======================================================================= * sysmocom - systems for mobile communications GmbH * Alt-Moabit 93 * 10559 Berlin, Germany * Sitz / Registered office: Berlin, HRB 134158 B * Geschaeftsfuehrer / Managing Director: Harald Welte
On 09/05/2022 10.59, Oliver Smith wrote:
So I wonder if this can be fixed somehow?
Yes, mirrors need to use rsync --delay-updates --delete-delay I now added a line about that to https://en.opensuse.org/openSUSE:Mirror_howto Ciao Bernhard M.
participants (2)
-
Bernhard M. Wiedemann -
Oliver Smith