- openSUSE Mirrors

[suse-mirror] Mirroring buildservice
by Carsten Otto 04 Oct '10

04 Oct '10

Dear all, we (ftp.halifax.rwth-aachen.de) are mirroring quite a bit from the openSUSE project, including the build service (OBS). Due to a fast connection and good hardware, we're set up with a large weight in the mirrorbrain system distributing the download requests to the mirrors. This normally means we are serving a high percentage of all traffic for the files that are requested and also reside on our mirror. Based on the traffic we saw in the last month (and before that) I have doubts that mirroring OBS is a real advantage to the community. I understand that it is nice to have redundancy (e.g. if the servers at openSUSE are down) and to have distributed servers to increase download speed due to latency and routing issues. The following graphs show the traffic we see for OBS at our mirror. The yellow part (rsyncd) shows the (incoming) traffic due to openSUSE syncing new content to our mirror. The blue part (HTTP/Nginx) reflects the downloads from actual users (developers?). http://ftp.halifax.rwth-aachen.de/~cotto/rrd/opensuse-buildservice%23month.… http://ftp.halifax.rwth-aachen.de/~cotto/rrd/opensuse-buildservice%23week.p… http://ftp.halifax.rwth-aachen.de/~cotto/rrd/opensuse-buildservice%23day.png As you can see, there is a fair amount of traffic served to the users, but there is also a large amount of traffic needed to synchronize the data. In total, when subtracting the incoming traffic from the outgoing traffic, this boils down to an average of about 2.3 MBit/sec in the last month. This value is positive, meaning our mirror serves more than what is needed to keep it synchronized - but it is very little traffic. For comparison, the openSUSE part of our mirror (excluding OBS) has a monthly average of 56 MBit/sec and Mozilla leads with 968 MBit/sec on average in the last month. I assume there are more mirrors facing similar traffic (maybe not knowing about it, since you need to analyze the log files). I also guess that the openSUSE server/mirror infrastructure is good enough to handle the requests to OBS content without the help from external mirrors (based on the fact that they are good enough to serve all the mirrors with rsync-pushes). Please think about the following aspects: a) some traffic is wasted and maybe paid for (we do not have to pay, though) b) disk space is used c) administrative work needs to be done I could think of several ways to face the current situation: d) leave it as it is e) remove some mirrors with low weight (in areas with good coverage) f) remove all mirrors Option e) would give the remaining mirrors more meaning, although even tripling the traffic would not really be a great step in my opinion. Option f) would not really change the outgoing traffic served by the openSUSE mirrors, although the traffic is shifted from rsync-pushes to HTTP downloads. Best regards, -- Carsten Otto otto(a)informatik.rwth-aachen.de LuFG Informatik 2 http://verify.rwth-aachen.de/otto/ RWTH Aachen phone: +49 241 80-21211

2 2

[suse-mirror] Milestone2
by Stephan Kulow 01 Oct '10

01 Oct '10

Hi, I'm uploading 11.4-Milestone2 right now, I hope to have it on enough mirrors this afternoon to release. Greetings, Stephan -- To unsubscribe, e-mail: mirror+unsubscribe(a)opensuse.org For additional commands, e-mail: mirror+help(a)opensuse.org

2 2

[suse-mirror] disabled rsync on stage
by Stephan Kulow 22 Sep '10

22 Sep '10

Hi, We have not only one file with corrupt data, but about every 6th file. So I disabled rsync access to avoid spreading this data even more. We will move to a new file sytem before we enable it again. Greetings, Stephan -- To unsubscribe, e-mail: mirror+unsubscribe(a)opensuse.org For additional commands, e-mail: mirror+help(a)opensuse.org

1 0

[suse-mirror] flash-player-10.1.85.3-0.1.1.i586.rpm (11.2) corrupt
by Eberhard Moenkeberg 22 Sep '10

22 Sep '10

Hi, at stage.opensuse.org, it seems to me that update/11.2/rpm/i586/flash-player-10.1.85.3-0.1.1.i586.rpm has correct size, but only null bytes content. Viele Gruesse Eberhard Moenkeberg (emoenke(a)gwdg.de, em(a)kki.org) -- Eberhard Moenkeberg Arbeitsgruppe IT-Infrastruktur E-Mail: emoenke(a)gwdg.de Tel.: +49 (0)551 201-1551 ------------------------------------------------------------------------- Gesellschaft fuer wissenschaftliche Datenverarbeitung mbH Goettingen (GWDG) Am Fassberg 11, 37077 Goettingen URL: http://www.gwdg.de E-Mail: gwdg(a)gwdg.de Tel.: +49 (0)551 201-1510 Fax: +49 (0)551 201-2150 Geschaeftsfuehrer: Prof. Dr. Oswald Haan und Dr. Paul Suren Aufsichtsratsvorsitzender: Dipl.-Kfm. Markus Hoppe Sitz der Gesellschaft: Goettingen Registergericht: Goettingen Handelsregister-Nr. B 598 ------------------------------------------------------------------------- -- To unsubscribe, e-mail: mirror+unsubscribe(a)opensuse.org For additional commands, e-mail: mirror+help(a)opensuse.org

2 1

[suse-mirror] rsync acl change request
by Emil 02 Sep '10

02 Sep '10

Hi staff! We, ftp.sunet.se, are shifting to a new platform for our archive and in this process the address of our mirroring machine has changed. Please change (or add) so that 194.71.11.33 is permitted rsync access to stage.opensuse.org. If it is possible to open for a scope please do so, the entire /24 is assigned the archive. Best regards, Emil -- To unsubscribe, e-mail: mirror+unsubscribe(a)opensuse.org For additional commands, e-mail: mirror+help(a)opensuse.org

1 0

[suse-mirror] 11.4 milestones begin
by Stephan Kulow 01 Sep '10

01 Sep '10

Hi, We'll soonish upload 11.4-Milestone1 to be published tomorrow. Greetings, Stephan -- To unsubscribe, e-mail: mirror+unsubscribe(a)opensuse.org For additional commands, e-mail: mirror+help(a)opensuse.org

1 0

[suse-mirror] Fwd: Access for registered mirrors: stage.opensuse.org
by Lior Kaplan 31 Aug '10

31 Aug '10

I'm forwarding this to the list, as I didn't get any answer at ftpadmin(a)suse.de (and rsync.opensuse.org is full for the 4th day in a row). Thanks ---------- Forwarded message ---------- From: Lior Kaplan <kaplanlior(a)gmail.com> Date: Sat, Aug 28, 2010 at 7:30 PM Subject: Access for registered mirrors: stage.opensuse.org To: ftpadmin(a)suse.de Hello, I'm running the mirror at http://mirror.isoc.org.il/pub/opensuse/ which is a registered mirror (see under Israel). I'd like to start syncing with stage.opensuse.org instead of rsync.opensuse.org Kaplan -- To unsubscribe, e-mail: mirror+unsubscribe(a)opensuse.org For additional commands, e-mail: mirror+help(a)opensuse.org

1 0

[suse-mirror] Firewall stress test
by Carsten Otto 13 Aug '10

13 Aug '10

Dear list, we (ftp.halifax.rwth-aachen.de) are currently stress testing the university firewall, which had problems with 5+ GBit/sec and/or 500+k packets/sec in the past. For this test we need traffic, which is where you can help. Could you download (as fast as you can and want) from our mirror? Our goal is to reach 5 GBit/sec with this machine. You can see the current traffic on http://ftp.halifax.rwth-aachen.de/ To the admins, could you increase our score for mirror brain? Thanks, -- Carsten Otto otto(a)informatik.rwth-aachen.de LuFG Informatik 2 http://verify.rwth-aachen.de/otto/ RWTH Aachen phone: +49 241 80-21211

2 2

[suse-mirror] Blogging about 11.3 launch - THANKS!
by Andreas Jaeger 27 Jul '10

27 Jul '10

I'm blogging about the launch and will publish my article later today. The current version is here: http://pastie.org/private/orcmz76zjcybhy0tdki6ea If you have anything to share regarding bandwidth/download numbers, please tell me. thanks a lot to all of you, this went really smooth! Andreas -- Andreas Jaeger, Program Manager openSUSE, aj(a){novell.com,opensuse.org} Twitter: jaegerandi | Identica: jaegerandi SUSE LINUX Products GmbH, GF: Markus Rex, HRB 16746 (AG Nürnberg) Maxfeldstr. 5, 90409 Nürnberg, Germany GPG fingerprint = 93A3 365E CE47 B889 DF7F FED1 389A 563C C272 A126

10 43

[suse-mirror] size of modules
by Stephan Kulow 19 Jul '10

19 Jul '10

Hi, I just moved the 11.3 repos and isos to the main modules on stage.opensuse.org. So if you're mirroring the 80gb or 160gb module, don't be suprised if you see large traffic now. Greetings, Stephan -- To unsubscribe, e-mail: mirror+unsubscribe(a)opensuse.org For additional commands, e-mail: mirror+help(a)opensuse.org

5 5