Hi Harald, On Sat, 21 Nov 2020, 13:25:20 +0100, Harald Welte wrote:

Hi!

In recent days we've seen a many hours of downtime of not only download.opensuse.org but also mirrors.opensuse.org and status.opensuse.org I'm not complaining, just stating the facts.

This caused severe downstream problems for e.g. any CI/CD jobs that try to use the related packages, or builds of Dockerfiles failed, etc.

So I thought, in order to be better prepared for possible future incidents, I'd want to create a mirror for the network:osmocom project and it's sub-projects.

According to https://en.opensuse.org/openSUSE:Mirror_infrastructure the 'buildservice-repos' module on rsync.opensuse.org contains "The complete content".

However, much to my surprise, when I call "rsync rsync.opensuse.org::buildservice-repos/network:/osmocom:/nightly/" I only see some of the distributions (not even all OpenSuSE and Raspobian_10), but not the majority of them (like all our Debian, xUbuntu CentOS builds).

This is quite strange, and I'm somewhat surprised given that it's supposedly "The complete content".

Is this intentional? Then the wiki page with the description should probably be updated. And in this case: is there some other rsync module that one can use to mirror all of the content of one's project on build.opensuse.org?

Or is it a bug? In that case, it would be great if somebody could look into it.

Thanks to roox I found a wokr-around: rsync from one of the [few] mirrors that have all of the OBS builds ("repositories") and themselves offer rsync access. Interestingly, that works. But then why do those mirrors get "all" of the content, while the official rsync archive doesn't have it?

Here the respective output:

----- $ rsync rsync.opensuse.org::buildservice-repos/network:/osmocom:/nightly/

drwxr-xr-x 4,096 2020/10/29 14:50:01 . drwxr-xr-x 8,192 2020/11/18 11:02:51 Raspbian_10 drwxr-xr-x 121 2020/11/21 02:40:54 openSUSE_Leap_15.1 drwxr-xr-x 141 2020/11/21 04:51:29 openSUSE_Leap_15.1_ARM drwxr-xr-x 121 2020/11/21 02:40:58 openSUSE_Leap_15.2 drwxr-xr-x 137 2020/11/21 02:41:04 openSUSE_Tumbleweed -----

The mirrors most likely sync from rsync.opensuse.org::opensuse-full-really-everything-including-repositories/: $ rsync rsync.opensuse.org::opensuse-full-really-everything-including-repositories/opensuse/repositories/network:/osmocom:/nightly/ drwxr-xr-x 4,096 2020/10/29 14:50:01 . drwxr-xr-x 140 2020/11/21 04:58:31 CentOS_8_Stream drwxr-xr-x 8,192 2020/11/21 06:26:01 Debian_10 drwxr-xr-x 8,192 2020/11/21 02:52:28 Debian_8.0 drwxr-xr-x 8,192 2020/11/21 06:27:13 Debian_9.0 drwxr-xr-x 8,192 2020/11/21 05:03:27 Debian_Testing drwxr-xr-x 8,192 2020/11/21 04:38:53 Debian_Unstable drwxr-xr-x 8,192 2020/11/18 11:02:51 Raspbian_10 drwxr-xr-x 141 2020/11/20 03:01:23 openSUSE_Factory_ARM drwxr-xr-x 121 2020/11/21 02:40:54 openSUSE_Leap_15.1 drwxr-xr-x 141 2020/11/21 04:51:29 openSUSE_Leap_15.1_ARM drwxr-xr-x 121 2020/11/21 02:40:58 openSUSE_Leap_15.2 drwxr-xr-x 137 2020/11/21 02:41:04 openSUSE_Tumbleweed drwxr-xr-x 8,192 2020/10/29 04:09:53 xUbuntu_16.04 drwxr-xr-x 8,192 2020/11/21 02:57:04 xUbuntu_18.04 drwxr-xr-x 8,192 2020/10/29 04:04:55 xUbuntu_18.10 drwxr-xr-x 8,192 2020/11/21 02:54:52 xUbuntu_19.04 drwxr-xr-x 8,192 2020/11/21 02:59:10 xUbuntu_19.10 drwxr-xr-x 8,192 2020/11/21 03:08:48 xUbuntu_20.04 drwxr-xr-x 8,192 2020/11/21 03:09:06 xUbuntu_20.10

vs.

----- rsync rsync://ftp.gwdg.de/pub/opensuse/repositories/network:/osmocom:/nightly/

drwxr-xr-x 4,096 2020/10/29 14:50:01 . drwxr-xr-x 134 2020/11/21 04:58:31 CentOS_8_Stream drwxr-xr-x 8,192 2020/11/21 06:26:01 Debian_10 drwxr-xr-x 8,192 2020/11/21 02:52:28 Debian_8.0 drwxr-xr-x 8,192 2020/11/21 06:27:13 Debian_9.0 drwxr-xr-x 8,192 2020/11/21 05:03:27 Debian_Testing drwxr-xr-x 8,192 2020/11/21 04:38:53 Debian_Unstable drwxr-xr-x 12,288 2020/11/18 11:02:51 Raspbian_10 drwxr-xr-x 135 2020/11/20 03:01:23 openSUSE_Factory_ARM drwxr-xr-x 116 2020/11/21 02:40:54 openSUSE_Leap_15.1 drwxr-xr-x 135 2020/11/21 04:51:29 openSUSE_Leap_15.1_ARM drwxr-xr-x 116 2020/11/21 02:40:58 openSUSE_Leap_15.2 drwxr-xr-x 131 2020/11/21 02:41:04 openSUSE_Tumbleweed drwxr-xr-x 8,192 2020/10/29 04:09:53 xUbuntu_16.04 drwxr-xr-x 8,192 2020/11/21 02:57:04 xUbuntu_18.04 drwxr-xr-x 8,192 2020/10/29 04:04:55 xUbuntu_18.10 drwxr-xr-x 8,192 2020/11/21 02:54:52 xUbuntu_19.04 drwxr-xr-x 8,192 2020/11/21 02:59:10 xUbuntu_19.10 drwxr-xr-x 8,192 2020/11/21 03:08:48 xUbuntu_20.04 drwxr-xr-x 8,192 2020/11/21 03:09:06 xUbuntu_20.10 -----

Compare the list of distros at rsync -av --delete rsync://ftp.gwdg.de/pub/opensuse/repositories/network:/osmocom: /external/packages/repositories/network\:/

Regards, Harald

Cheers. l8er manfred