Hej Peter, Quantum Mirror wrote:
It's just an idea, but how about doing away with the ssh push sync
Unfortunately I am not ready to discuss push sync yet. In my understanding: (considering amount of traffic and number of mirrors) - we will have to stick with mixture of push/pull mirrors. But current proposal is solely about pull.
The mirrors would query the txt file on the URL generated for them every
So current approach in the project is that sync scripts do query 'last_modified_time' of the 'project' and store it locally before the sync. The api look like:
curl http://download.opensuse.org/rest/project_last_modified?project=15.6+update 1729520040
The valid values for "project" parameter are defined in "name" column at https://download.opensuse.org/app/project So, instead of verifying thousands / millions of files for each project using rsync protocol - the scripts can use single HTTP request per project. This all logic is hidden in the scripts, but of course in can be used in other implementations.
By the way, there is no silver bullet in mirror operation, there will be problems that need to be solved by the admin of the mirror and no
Yeah, the goal is also to provide useful commands to provide a comprehensive overview of the sync status and help dealing with the most typical issues. I believe it is quite possible to have all more or less under control with the proposed tooling. Regards, Andrii Nikitin