On Thu, Jul 15, 2021 at 08:27:07PM +0200, Per Jessen wrote:
Maybe it's time to create a successor download.o.o from scratch to get rid of all the inherited burden from the last 15 years? - I vote for this, but I think we should clarify first who takes over the responsibility of this openSUSE core service in the future.
I vote no. Rebuilding from scratch is overkill and I don't know that we have the resources. To build something more sustainable than the current setup needs a bigger team.
I'd go further and suggest that the current mirrors framework is extremely inefficient and major distros like OpenSUSE need to stop relying on it: 1. distros have grown to millions of files, but we're still rsync'ing things around just like it's 1999. It creates crazy IO churn on both the primary server and the replica. 2. every distro implements their own mechanism to monitor which mirrors are out of date and which aren't. This, too, creates crazy churn and wasted bandwidth. Major commercially backed distros should drive innovation and stop relying on the framework of free volunteer replicas. It made sense 20 years ago when Linux was young and new and distros had no infrastructure budgets. However, these days entities like Red Hat, SUSE and Canonical operate with budgets worth {b,m}illions of dollars and are very much capable of using major CDN providers to set up their own network of efficiently synchronizing replicas. -K