Mailinglist Archive: opensuse-buildservice (239 mails)

< Previous Next >
Re: [opensuse-buildservice] Re: more statistics on repository (space) usage
  • From: Peter Poeml <poeml@xxxxxxx>
  • Date: Thu, 1 May 2008 11:17:46 +0200
  • Message-id: <20080501091746.GG16506@xxxxxxx>
On Thu, Apr 17, 2008 at 03:20:02PM +0200, Dr. Peter Poeml wrote:
On Tue, Apr 15, 2008 at 07:07:37PM +0200, Dr. Peter Poeml wrote:
On Tue, Apr 15, 2008 at 04:31:54PM +0200, Detlef Steuer wrote:
May be it's enough to stop mirroring (but keeping!) end-of-live products
plus introducing some kind of quota system?
[...]
I just gathered some data. What they show is the following:
[...]
- 10.1 BS repositories usage:
The popular repos (KDE:, server:, OpenOffice.org, and others) are all
accessed with about 1 req/s. The overall average traffic generated
looks like only 25 K/s. It should nicely work to exclude all those
from the rsync modules, thereby shrinking them and removing them from
the mirrors, without impact on our download infrastructure.
[Overall request rate for BS repos is 80 req/s, 1 req/s of that is for
10.1 repos if I don't mistake anything.]

I worked on the two build service rsync modules last night, and could
reduce their size by 50%.

buildservice-repos 424G -> 220G
buildservice-repos-main 240G -> 122G

I basically excluded 10.0, 10.1, Factory, Fedora, RHEL and similar
content.

Note:
The excluded software will still be available on download.opensuse.org
as before. It is just not being mirrored anymore, except one or two
mirrors. It'll also be available for rsyncing from our rsync servers.
Thus, the change shouldn't make a substantial difference in regard to
availability.

There is more potential -- like debug* and src packages -- but it'll
also need some more careful work.

I'm still working on cleaning up those mirrors which get a push sync
from us. So just in case you encounter any irregularities, I would be
very interested to hear from you. But you shouldn't notice anything - as
usual.

Peter
--
"WARNING: This bug is visible to non-employees. Please be respectful!"

SUSE LINUX Products GmbH
Research & Development
< Previous Next >
List Navigation
This Thread
  • No further messages