Hi!
In recent days we've seen a many hours of downtime of not only
download.opensuse.org but also mirrors.opensuse.org and
status.opensuse.org I'm not complaining, just stating the facts.
This caused severe downstream problems for e.g. any CI/CD jobs that try
to use the related packages, or builds of Dockerfiles failed, etc.
So I thought, in order to be better prepared for possible future
incidents, I'd want to create a mirror for the network:osmocom project
and it's sub-projects.
According to https://en.opensuse.org/openSUSE:Mirror_infrastructure
the 'buildservice-repos' module on rsync.opensuse.org contains "The
complete content".
However, much to my surprise, when I call
"rsync rsync.opensuse.org::buildservice-repos/network:/osmocom:/nightly/"
I only see some of the distributions (not even all OpenSuSE and
Raspobian_10), but not the majority of them (like all our Debian,
xUbuntu CentOS builds).
This is quite strange, and I'm somewhat surprised given that it's
supposedly "The complete content".
Is this intentional? Then the wiki page with the description should
probably be updated. And in this case: is there some other rsync
module that one can use to mirror all of the content of one's project on
build.opensuse.org?
Or is it a bug? In that case, it would be great if somebody could look
into it.
Thanks to roox I found a wokr-around: rsync from one of the [few]
mirrors that have all of the OBS builds ("repositories") and themselves
offer rsync access. Interestingly, that works. But then why do those
mirrors get "all" of the content, while the official rsync archive
doesn't have it?
Here the respective output:
-----
$ rsync rsync.opensuse.org::buildservice-repos/network:/osmocom:/nightly/
drwxr-xr-x 4,096 2020/10/29 14:50:01 .
drwxr-xr-x 8,192 2020/11/18 11:02:51 Raspbian_10
drwxr-xr-x 121 2020/11/21 02:40:54 openSUSE_Leap_15.1
drwxr-xr-x 141 2020/11/21 04:51:29 openSUSE_Leap_15.1_ARM
drwxr-xr-x 121 2020/11/21 02:40:58 openSUSE_Leap_15.2
drwxr-xr-x 137 2020/11/21 02:41:04 openSUSE_Tumbleweed
-----
vs.
-----
rsync rsync://ftp.gwdg.de/pub/opensuse/repositories/network:/osmocom:/nightly/
drwxr-xr-x 4,096 2020/10/29 14:50:01 .
drwxr-xr-x 134 2020/11/21 04:58:31 CentOS_8_Stream
drwxr-xr-x 8,192 2020/11/21 06:26:01 Debian_10
drwxr-xr-x 8,192 2020/11/21 02:52:28 Debian_8.0
drwxr-xr-x 8,192 2020/11/21 06:27:13 Debian_9.0
drwxr-xr-x 8,192 2020/11/21 05:03:27 Debian_Testing
drwxr-xr-x 8,192 2020/11/21 04:38:53 Debian_Unstable
drwxr-xr-x 12,288 2020/11/18 11:02:51 Raspbian_10
drwxr-xr-x 135 2020/11/20 03:01:23 openSUSE_Factory_ARM
drwxr-xr-x 116 2020/11/21 02:40:54 openSUSE_Leap_15.1
drwxr-xr-x 135 2020/11/21 04:51:29 openSUSE_Leap_15.1_ARM
drwxr-xr-x 116 2020/11/21 02:40:58 openSUSE_Leap_15.2
drwxr-xr-x 131 2020/11/21 02:41:04 openSUSE_Tumbleweed
drwxr-xr-x 8,192 2020/10/29 04:09:53 xUbuntu_16.04
drwxr-xr-x 8,192 2020/11/21 02:57:04 xUbuntu_18.04
drwxr-xr-x 8,192 2020/10/29 04:04:55 xUbuntu_18.10
drwxr-xr-x 8,192 2020/11/21 02:54:52 xUbuntu_19.04
drwxr-xr-x 8,192 2020/11/21 02:59:10 xUbuntu_19.10
drwxr-xr-x 8,192 2020/11/21 03:08:48 xUbuntu_20.04
drwxr-xr-x 8,192 2020/11/21 03:09:06 xUbuntu_20.10
-----
Compare the list of distros at
rsync -av --delete rsync://ftp.gwdg.de/pub/opensuse/repositories/network:/osmocom: /external/packages/repositories/network\:/
Regards,
Harald
--
- Harald Welte