Re: [suse-mirror] Opensuse master rsync server performance
On Tue, 2017-02-21 at 15:32 +0000, Tim Bishop wrote:
On Tue, Feb 21, 2017 at 04:15:13PM +0100, Richard Brown wrote:
On Tue, 2017-02-21 at 08:27 -0300, Carlos Carvalho wrote:
Not here (opensuse.c3sl.ufpr.br). Last update took 18h40m with a speed less than 1MB/s. That's not enough for the rate of change of your repository.
Thank you Carlos, very useful to know the issue is more widespread
If it's useful, here on mirrorservice.org our sync times are about an hour for
rsync://stage.opensuse.org/opensuse-full/opensuse/
So that's significantly quicker. Maybe we're mirroring a smaller set of data?
opensuse-full is one of the larger modules, so it's unlikely It's probably a case of poor peering between our current ISP and yourselves Given this will also change with the new 1Gb/4Gb links on the way, I'm hoping we'll find things improve for the people currently finding things so However my QA-tester sense is tingling. To satisfy my curiosity Carlos, can you double check and confirm you're using stage.o.o, and not rsync.o.o? Tim, as everything seems to be fine and fast for you, can you please consider changing your rsync module from opensuse-full to opensuse-full-with-factory? This will give us another Tumbleweed mirror in the UK, which we're quite short on at the moment. Many Thanks, -- Richard Brown Technical Lead - openQA openSUSE Chairman Phone +4991174053-361 SUSE Linux GmbH, Maxfeldstr. 5, D-90409 Nuernberg GF: Felix Imendörffer, Jane Smithard, Graham Norton, HRB 21284 (AG Nürnberg) -- To unsubscribe, e-mail: mirror+unsubscribe@opensuse.org To contact the owner, email: mirror+owner@opensuse.org
Richard Brown (rbrown@suse.de) wrote on Tue, Feb 21, 2017 at 01:28:54PM BRT:
On Tue, 2017-02-21 at 15:32 +0000, Tim Bishop wrote:
On Tue, Feb 21, 2017 at 04:15:13PM +0100, Richard Brown wrote:
On Tue, 2017-02-21 at 08:27 -0300, Carlos Carvalho wrote:
Not here (opensuse.c3sl.ufpr.br). Last update took 18h40m with a speed less than 1MB/s. That's not enough for the rate of change of your repository.
Thank you Carlos, very useful to know the issue is more widespread
If it's useful, here on mirrorservice.org our sync times are about an hour for
rsync://stage.opensuse.org/opensuse-full/opensuse/
So that's significantly quicker. Maybe we're mirroring a smaller set of data?
opensuse-full is one of the larger modules, so it's unlikely
We do opensuse-full-really-everything, every 4h. So it better behave... It's always via IPv6, so the significantly longer rtt is bad. BTW, your IPv6 seems to be bad in other aspects, I've seen complaints here a few times about rsync.opensuse.org losing it.
To satisfy my curiosity Carlos, can you double check and confirm you're using stage.o.o, and not rsync.o.o?
Confirmed right now. Months ago, because of the slowness, I tried to use rsync.o.o until a user complained that our repo was very behind. I switched back to stage.o.o and won't change it anymore. A master repository of a big distro like yours with less than 1Gb/s of bandwidth is substandard :-( This is only feasible if you let only tier 1 mirrors access it!! Note also that increasing bandwidth is only one element of the chain. If the machine doesn't have enough ram to hold the directory info it won't stand the load of all the rsync disk scans. stage.o.o must be beefy, both in ram and disk performance. -- To unsubscribe, e-mail: mirror+unsubscribe@opensuse.org To contact the owner, email: mirror+owner@opensuse.org
Carlos Carvalho wrote:
Richard Brown (rbrown@suse.de) wrote on Tue, Feb 21, 2017 at 01:28:54PM BRT:
On Tue, 2017-02-21 at 15:32 +0000, Tim Bishop wrote:
On Tue, Feb 21, 2017 at 04:15:13PM +0100, Richard Brown wrote:
On Tue, 2017-02-21 at 08:27 -0300, Carlos Carvalho wrote:
Not here (opensuse.c3sl.ufpr.br). Last update took 18h40m with a speed less than 1MB/s. That's not enough for the rate of change of your repository.
Thank you Carlos, very useful to know the issue is more widespread
If it's useful, here on mirrorservice.org our sync times are about an hour for
rsync://stage.opensuse.org/opensuse-full/opensuse/
So that's significantly quicker. Maybe we're mirroring a smaller set of data?
opensuse-full is one of the larger modules, so it's unlikely
We do opensuse-full-really-everything, every 4h. So it better behave...
We do the same, but from rsync.opensuse.org and every hour. (and we omit some of the subdirs).
It's always via IPv6,
Ditto.
so the significantly longer rtt is bad. BTW, your IPv6 seems to be bad in other aspects, I've seen complaints here a few times about rsync.opensuse.org losing it.
Yes, when that server is rebooted, it seems to lose the IPv6 address.
Note also that increasing bandwidth is only one element of the chain. If the machine doesn't have enough ram to hold the directory info it won't stand the load of all the rsync disk scans. stage.o.o must be beefy, both in ram and disk performance.
Just getting the filelist takes quite a while at the moment - 3,592,529 files, 5.54T bytes (rsync.opensuse.org). -- Per Jessen, Zürich (10.3°C) http://www.dns24.ch/ - your free DNS host, made in Switzerland. -- To unsubscribe, e-mail: mirror+unsubscribe@opensuse.org To contact the owner, email: mirror+owner@opensuse.org
participants (3)
-
Carlos Carvalho -
Per Jessen -
Richard Brown