Bernhard M. Wiedemann wrote:
I noticed that the excludes in repopush seem to not work.
That sounds odd. I did remove from excludes from e.g. rsync.o.o, so we have a complete copy there.
There are some largish repos that are updated often, but not requested much from mirrors. So we end up spending more traffic on rsyncing them out than would be needed to serve these files directly.
Yes, I'm sure that is correct. I have not gone to the trouble of analysing it in that detail.
So should we push less of /repositories/ out to fewer places?
We are only pushing /repositories/ to six mirrors anyway, two of which are our own. I see no real problem in pushing less, it just needs to be managed.
The other improvement I have in mind is to find some well-connected host with 300-600 TB/month traffic and 3TB SSD that gets /tumbleweed /distribution /updates as soon as possible and to offer that as rsync source to mirror operators. This should take load off task #3 and thus leave more disk-IO and network bandwidth to the other tasks.
In the September meeting, I think it was mentioned that our uplink is going to get upgraded to 10Gbit ? -- Per Jessen, Zürich (18.6°C) Member, openSUSE Heroes (2016 - present) We're hiring - https://en.opensuse.org/openSUSE:Heroes