Mailinglist Archive: opensuse-buildservice (213 mails)

< Previous Next >
Re: [opensuse-buildservice] Extreme waste of space by source RPMs
  • From: Adrian Schröter <adrian@xxxxxxx>
  • Date: Sat, 27 Jun 2009 09:36:16 +0200
  • Message-id: <200906270936.17111.adrian@xxxxxxx>
Am Freitag, 26. Juni 2009 15:39:53 schrieb Peter Poeml:
Hi,

we waste extreme amounts of space on our download server (and on the
mirrors) by the way we publish source RPMs.

The source package is published in every repository, so it can be
duplicated considerably.
For instance, an Apache httpd source package is 5.3 MB, but altogether
they occupy more than the ten-fold:

# du -sch
repositories/Apache/openSUSE_11.1/src/apache2-2.2.11-10.1.src.rpm 5.3M
repositories/Apache/openSUSE_11.1/src/apache2-2.2.11-10.1.src.rpm 5.3M
total
# du -sch repositories/Apache/*/src/apache2-*.src.rpm
5.3M repositories/Apache/CentOS_5/src/apache2-2.2.11-10.1.src.rpm
5.3M repositories/Apache/Fedora_10/src/apache2-2.2.11-10.1.src.rpm
5.3M repositories/Apache/Fedora_9/src/apache2-2.2.11-10.1.src.rpm
5.2M repositories/Apache/Mandriva_2008/src/apache2-2.2.11-10.1.src.rpm
5.3M repositories/Apache/openSUSE_10.3/src/apache2-2.2.11-10.1.src.rpm
5.2M repositories/Apache/openSUSE_11.0/src/apache2-2.2.11-10.1.src.rpm
5.3M repositories/Apache/openSUSE_11.1/src/apache2-2.2.11-10.1.src.rpm
5.3M
repositories/Apache/openSUSE_Factory/src/apache2-2.2.11-10.2.src.rpm 5.3M
repositories/Apache/RHEL_5/src/apache2-2.2.11-10.1.src.rpm 5.3M
repositories/Apache/SLE_10_server_database_postgresql/src/apache2-2.2.11-10
.1.src.rpm 5.3M
repositories/Apache/SLE_10/src/apache2-2.2.11-10.1.src.rpm 5.3M
repositories/Apache/SLE_11/src/apache2-2.2.11-10.1.src.rpm 5.3M
repositories/Apache/SLES_9/src/apache2-2.2.11-10.1.src.rpm 68M total

(This probably being a rather harmless example, but illustrative.)

To set this in perspective, I estimate that 25-50% of space might be
wasted. Let's look at some numbers:


98M repositories/Apache/*/src
342M repositories/Apache

9M repositories/home:/poeml/*/src
18M repositories/home:/poeml

22G repositories/games/*/src
50G repositories/games


Wow, it's even worse than I thought...

What can we do about this?

From my understanding, each of the source rpms could be used to achieve
the same build result. (Or isn't that the case?)

The source RPMs should be published once only, if at all. What do you
think?

Actually no, since they differ. OBS is adapting spec files to be usable on
that particular plattform.

But the plan was to move them under /pub/opensuse/source/repositories/...
to be able to exclude them.

Just dropping the source rpms and point people to checkout sources with osc
tool was discarded in earlier discussions, because people wanted to have
source rpms as they are used to.

bye
adrian

--

Adrian Schroeter
SUSE Linux Products GmbH
email: adrian@xxxxxxx

--
To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@xxxxxxxxxxxx
For additional commands, e-mail: opensuse-buildservice+help@xxxxxxxxxxxx

< Previous Next >
References