Clayton wrote:

When 11.0 was released, the openSUSE servers staggered a bit under the load of so many people hammering away trying to either grab the torrent files or download via ftp. The result was that a large number of us (myself included) waited several days before we were even able to get near the website so that we could download the torrent files and get started with downloading/seeding.

So, my proposal is.... pre-release the Torrent files.

Pre-release ONLY the Torrent files so that those of us who will be Torrenting openSUSE 11.1 can set up our Torrent clients and be ready to go when 11.1 is released and the Torrent tracker is switched "on".

The advantage is that we will not need to join the queue waiting for the website to respond, and we will be able to start helping with distributing this release immediately.

Thoughts? Comments? Is this possible? Reasonable?

I think it's a pretty good idea - I would certainly want to participate. If the torrent files could be distributed by email, those of us with permanent torrent seeders could start a seed very early on. /Per Jessen, Zürich -- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org

Richard (MQ) wrote:

I'd be delighted to take part but with only a standard ADSL connection (supposedly 8Mbps down, in practice ~ 4 Mbps, and < 1 Mbps up) is there any point? I suppose that if there were enough of us low-rate seeders it might be of use?

Definitely - that's the torrent idea in a nut-shell :-) /Per Jessen, Zürich -- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org

On Tuesday 16 December 2008 09:25:17 Clayton wrote:

This is an extension of a tread I started over on the openSUSE user list.

When 11.0 was released, the openSUSE servers staggered a bit under the load of so many people hammering away trying to either grab the torrent files or download via ftp. The result was that a large number of us (myself included) waited several days before we were even able to get near the website so that we could download the torrent files and get started with downloading/seeding.

? software.o.o was the last time quite stable and reachable iirc. The plan is again to have a window of approx. 30h where we don't redirect the requests to the mirrors, instead you can download the iso's from akamai, with full speed. Use software.o.o, don't use torrent or mirrors. Let's try to break the 200TB mark this time :-) http://news.opensuse.org/2008/06/24/numbers/ And yes, i will blog about it later. -- with kind regards, Martin Lasarsch, Core Services SUSE LINUX Products GmbH, Maxfeldstr. 5 90409 Nürnberg GF: Markus Rex, HRB 16746 (AG Nürnberg) martin.lasarsch@suse.de - http://www.opensuse.org -- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org

Hi, On Tue, Dec 16, 2008 at 09:25:17AM +0100, Clayton wrote:

This is an extension of a tread I started over on the openSUSE user list.

When 11.0 was released, the openSUSE servers staggered a bit under the load of so many people hammering away trying to either grab the torrent files or download via ftp.

Uhm, I'm not exactly sure which servers you refer to. While the openSUSE website and wiki was going down for a few hours, software.opensuse.org (the download choosing page) was available. And especially download.opensuse.org was in a cool, smooth state _all_ the time. It has never been under something that you remotely could call load. (Try it out on Thursday!) What you might have been seeing is that some mirrors where suffering from load. They are the ones that need to do the real work. Although you won't see this happen during the first 24 hours after release either, because we send most requests to a commercial Content Delivery Network during that time, which has > 30.000 servers worldwide, and chances are very high that one of their machines is located _right_ in your ISPs building. (My local ISP in Cologne also has a box of them.) If you get redirected to a different mirror, you can see such problems. This is something that doesn't affect the openSUSE servers though, and can't be fixed by us, we can only try to make good choices in mirrors and use mirrors that are stable & fast. To know about mirror quality, we largely depend on your feedback. If you see problems with mirrors please note the address you see in the browser (or other download program) and report issues to admin at opensuse org, or via Bugzilla, product openSUSE.org, component download infrastructure. Now, problems you might have seen during the _first_ week of the 11.0 release could also be attributed to a bug we had in mirror monitoring. Our mirror monitoring had a bug that I fixed very shortly before release, but I accidentally reverted my fix by updating the same component on the mirror database server. This is regrettable and several days passed until I noticed it. The result was that we sent users not only to alive mirrors, but also to some that were dead or too slow. So I think that you might have been affected by that. Which would mean that it should work much better this time. But still, please do report problems. If you report problems, you will help many many users :-)

The result was that a large number of us (myself included) waited several days before we were even able to get near the website so that we could download the torrent files and get started with downloading/seeding.

So, my proposal is.... pre-release the Torrent files.

Pre-release ONLY the Torrent files so that those of us who will be Torrenting openSUSE 11.1 can set up our Torrent clients and be ready to go when 11.1 is released and the Torrent tracker is switched "on".

The advantage is that we will not need to join the queue waiting for the website to respond, and we will be able to start helping with distributing this release immediately.

Thoughts? Comments? Is this possible? Reasonable?

Hm, is the background of your idea that you want to spread the torrent files earlier, simply to work around expected unavailability of them? Or what's the rationale? Well, shouldn't be needed at all. In addition, you can easily avoid all problems, if you use a metalink client to download. Just use a metalink client and download.opensuse.org, and I *guarantuee* you a download which is working, arrives correctly, and that with reasonably fast speed. You can even combine HTTP and Torrent download with a client that supports that simultaneously. I have blogged about this a minute ago, so there's something to link to and to spread the information. Read here: http://lizards.opensuse.org/2008/12/16/best-way-to-download-opensuse/ And please pass it on! Note that you can download .torrent files in the described way at any time, safely, quickly. Should you need it. But a torrent-capable Metalink client will even *use* the Torrent and download the whole thing you are after. And even more, you don't need to download the torrent file at all. Thanks, Peter -- Contact: admin@opensuse.org (a.k.a. ftpadmin@suse.com) #opensuse-mirrors on freenode.net Info: http://en.opensuse.org/Mirror_Infrastructure SUSE LINUX Products GmbH Research & Development

Tirsdag 16 december 2008 16:05:45 skrev Clayton:

...

Hm, is the background of your idea that you want to spread the torrent files earlier, simply to work around expected unavailability of them? Or what's the rationale?

The idea was to have them prepped and ready to go so that we wouldn't have to join the (perceived) flood of people hitting the software.o.o site looking for a Torrent.

It might work as a membership perk too ;-) -- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org

On Tue, Dec 16, 2008 at 04:08:55 +0000, Rob OpenSuSE wrote:

2008/12/16 Peter Poeml :

...

Note that you can download .torrent files in the described way at any time, safely, quickly. Should you need it. But a torrent-capable Metalink client will even *use* the Torrent and download the whole thing you are after.

And even more, you don't need to download the torrent file at all.

You've mentioned aria2 and Firefox "Down them All" extension, but not Kget in KDE4. Was there a particular reason?

Alot of ppl will be all set to go with Kget, without installing anything.

I do hope ppl do mess with the torrent file after in order to seed the DVD torrents once, the 30 hrs are up.

I have not used it, I have seen long-standing bugs in bugzilla about it, and from what I heard its support for metalinks is there, albeit fairly minimal. It doen't have the features that make it real fun. And, it's only in KDE4. So please try it, use it, and let me know about the results! And if it works, yes, then we should definitely propagandize it as well. KGet should be able to work with metalinks that end in ".metalink". It might be useful to ping the KDE developers and ask them to support the transparent negotiation of metalinks, so they would automatically be used without people even needing to be aware of it! Cf. to http://groups.google.com/group/metalink-discussion/web/transparent-metalinks... Thanks, Peter -- "WARNING: This bug is visible to non-employees. Please be respectful!" SUSE LINUX Products GmbH Research & Development

Martin Lasarsch wrote:

Use software.o.o, don't use torrent or mirrors. Let's try to break the 200TB mark this time :-)

When I go to software.o.o, I still end up downloading from download.o.o, which then eventually points me to a mirror. For the moment, I'm downloading from uni-ulm.de at about 5Mb/sec - should be done in about 12-13minutes. /Per Jessen, Zürich -- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org

...

When I go to software.o.o, I still end up downloading from download.o.o, which then eventually points me to a mirror. For the moment, I'm downloading from uni-ulm.de at about 5Mb/sec - should be done in about 12-13minutes.

Are you sure you download the right thing? When I go to software.o,o, I'm offered openSUSE 11.0 (release was said to be at around NOW: 14:00 CET)

Go direct to http://download.opensuse.org/distribution/11.1/iso/ It's up and downloading now :-) I'm using the Metalink client aria2c and it's running at full speed... will get the DVD ISO in about 30 minutes. C. -- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org

Dominique Leuenberger wrote:

Are you sure you download the right thing? When I go to software.o,o, I'm offered openSUSE 11.0 (release was said to be at around NOW: 14:00 CET)

You're right, I was pointed to 11.0 - maybe the link will skip the mirror-redirection when the page has been updated to point to 11.1. Anyway, I'm downloading from the URL Clayton mentioned. In fact, the download was finished in 14:17:08 (according to wget). /Per Jessen, Zürich -- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org

...

...

On 12/18/2008 at 2:23 PM, Per Jessen wrote: Dominique Leuenberger wrote:

...

Are you sure you download the right thing? When I go to software.o,o, I'm offered openSUSE 11.0 (release was said to be at around NOW: 14:00 CET)

You're right, I was pointed to 11.0 - maybe the link will skip the mirror-redirection when the page has been updated to point to 11.1.

Anyway, I'm downloading from the URL Clayton mentioned. In fact, the download was finished in 14:17:08 (according to wget).

I though so ;) I also started my downloads... so far they are running at 1MB/sec, which is max for my link... so in about 1 hour, first iso should be down... and then feed it straight to the torrent ;) Dominique -- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org

Per Jessen writes:

Dominique Leuenberger wrote:

...

I also started my downloads... so far they are running at 1MB/sec, which is max for my link... so in about 1 hour, first iso should be down... and then feed it straight to the torrent ;)

Yep, mine's already running:

btcli list NAME NUM ST HAVE SIZE RATIO openSUSE-11.1-DVD-i586-iso 27 S. 100.0% 4.24G 0.01 openSUSE-11.1-DVD-ppc-iso 28 L. 1.6% 3.84G 0.00 openSUSE-11.1-DVD-x86_64-iso 29 L. 0.2% 4.34G 0.00

My machine is sharing already 1480 MB the last 5 hours since we started the tracker... Thanks everybody for seeding! Andreas -- Andreas Jaeger, Director Platform / openSUSE, aj@suse.de SUSE LINUX Products GmbH, GF: Markus Rex, HRB 16746 (AG Nürnberg) Maxfeldstr. 5, 90409 Nürnberg, Germany GPG fingerprint = 93A3 365E CE47 B889 DF7F FED1 389A 563C C272 A126

Hello, Andreas Jaeger írta:

My machine is sharing already 1480 MB the last 5 hours since we started the tracker...

My machine seeded 80GB+ already before the official release time, and now over 94GB :-) I seed the three DVDs from an old server at the university, /home is now 99% full... :-) Bye, CzP -- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org

"Carlos E. R." writes:

On Thursday, 2008-12-18 at 14:19 +0100, Andreas Jaeger wrote:

...

...

Go direct to http://download.opensuse.org/distribution/11.1/iso/ It's up and downloading now :-) I'm using the Metalink client aria2c and it's running at full speed... will get the DVD ISO in about 30 minutes.

Wow - please share the ISOs so that others have a similar experience,

I'm using aria2c, which has defaulted to torrent download, and is feeding automatically:

aria2c --max-download-limit=85K --max-upload-limit=12K \ http://download.opensuse.org/distribution/11.1/iso/openSUSE-11.1-DVD-i586.is... ... ... *** Download Progress Summary as of Thu Dec 18 14:48:06 2008 *** =============================================================================================== [#3 SIZE:104.4MiB/4,346.7MiB(2%) CN:60 SPD:81.97KiB/s UP:12.32KiB/s(19.0MiB) ETA:14h43m15s] FILE: ./openSUSE-11.1-DVD-i586.iso -----------------------------------------------------------------------------------------------

By the way, the page at "http://software.opensuse.org/" is bad. It still says "11.0", and the "metalinks" link is broken:

Please reload it - it says 11.1 since already before your post.

http://download.opensuse.org/distribution/11.1/iso/dvd/

Are you sure that's still the case? If yes, could you join us on the opensuse-project IRC channel so that it gets fixed, please? Thanks, Andreas -- Andreas Jaeger, Director Platform / openSUSE, aj@suse.de SUSE LINUX Products GmbH, GF: Markus Rex, HRB 16746 (AG Nürnberg) Maxfeldstr. 5, 90409 Nürnberg, Germany GPG fingerprint = 93A3 365E CE47 B889 DF7F FED1 389A 563C C272 A126

On Thu, Dec 18, 2008 at 04:18:56PM +0100, Andreas Jaeger wrote:

"Carlos E. R." writes:

...

On Thursday, 2008-12-18 at 14:19 +0100, Andreas Jaeger wrote:

...

...

Go direct to http://download.opensuse.org/distribution/11.1/iso/ It's up and downloading now :-) I'm using the Metalink client aria2c and it's running at full speed... will get the DVD ISO in about 30 minutes.

Wow - please share the ISOs so that others have a similar experience,

I'm using aria2c, which has defaulted to torrent download, and is feeding automatically:

aria2c --max-download-limit=85K --max-upload-limit=12K \ http://download.opensuse.org/distribution/11.1/iso/openSUSE-11.1-DVD-i586.is... ... ... *** Download Progress Summary as of Thu Dec 18 14:48:06 2008 *** =============================================================================================== [#3 SIZE:104.4MiB/4,346.7MiB(2%) CN:60 SPD:81.97KiB/s UP:12.32KiB/s(19.0MiB) ETA:14h43m15s] FILE: ./openSUSE-11.1-DVD-i586.iso -----------------------------------------------------------------------------------------------

By the way, the page at "http://software.opensuse.org/" is bad. It still says "11.0", and the "metalinks" link is broken:

Please reload it - it says 11.1 since already before your post.

...

http://download.opensuse.org/distribution/11.1/iso/dvd/

Are you sure that's still the case? If yes, could you join us on the opensuse-project IRC channel so that it gets fixed, please?

The link "Metalinks" is indeed wrong so far, it is being fixed while we speak. It's just that link shown on http://software.opensuse.org/ though, everything seems fine. Peter -- Contact: admin@opensuse.org (a.k.a. ftpadmin@suse.com) #opensuse-mirrors on freenode.net Info: http://en.opensuse.org/Mirror_Infrastructure SUSE LINUX Products GmbH Research & Development

2008/12/18 Peter Poeml :

On Thu, Dec 18, 2008 at 04:18:56PM +0100, Andreas Jaeger wrote:

...

"Carlos E. R." writes:

Please reload it - it says 11.1 since already before your post.

...

http://download.opensuse.org/distribution/11.1/iso/dvd/

The DVD files for 11.1 are now in the iso directory with the CD images! Peter's blog entry presumed it'd just be a version change, but actually the images are i586 or x86_amd, and all together, so if you see 404 - not founds, go up a level, and copy the link to the console. -- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org

2008/12/18 Peter Poeml :

Hi,

On Thu, Dec 18, 2008 at 04:44:38PM +0000, Rob OpenSuSE wrote:

...

2008/12/18 Peter Poeml :

...

On Thu, Dec 18, 2008 at 04:18:56PM +0100, Andreas Jaeger wrote:

...

"Carlos E. R." writes:

...

...

...

...

http://download.opensuse.org/distribution/11.1/iso/dvd/

The DVD files for 11.1 are now in the iso directory with the CD images! Peter's blog entry presumed it'd just be a version change, but actually the images are i586 or x86_amd, and all together, so if you see 404 - not founds, go up a level, and copy the link to the console.

Are you sure? I actually changed the links on http://lizards.opensuse.org/2008/12/16/best-way-to-download-opensuse/ before we released, and they work for me.

But hang on, give us a few minutes and we will have metalinks directly on http://software.opensuse.org/, which point directly to the files!

I'm not sure if your other email supercedes this, but I basically used Konqi to find what files to point to, in anticipation of using the command line, or Kget for small files. http://download.opensuse.org/distribution/11.1/iso/ is the URL I based my comments on, not any information on any 'Software Downloading' page. Thanks for the suggestions, I'm done now already with my contribution to the 200 target :) Will sort out a torrent seed in time for the Akamai caching service to go. I don't know if openSUSE are the reason, but my ISP's network suffered badly this afternoon, once the release was available. *grin* -- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org

* Andreas Jaeger [12-18-08 08:24]:

Wow - please share the ISOs so that others have a similar experience,

*** Download Progress Summary as of Thu Dec 18 23:09:10 2008 *** ================================================================= [#3 SEEDING(ratio:0.5) CN:40 UP:49.66KiB/s(2,424.7MiB)] FILE: ./openSUSE-11.1-DVD-x86_64.iso ----------------------------------------------------------------- [#3 SEEDING(ratio:0.5) CN:40 UP:49.71KiB/s(2,425.7MiB)] *** Download Progress Summary as of Thu Dec 18 23:08:57 2008 *** ================================================================= [#3 SEEDING(ratio:0.3) CN:28 UP:43.16KiB/s(253.4MiB)] FILE: ./openSUSE-11.1-Addon-NonOss-BiArch-i586-x86_64.iso ----------------------------------------------------------------- [#3 SEEDING(ratio:0.3) CN:28 UP:43.10KiB/s(256.8MiB)] *** Download Progress Summary as of Thu Dec 18 23:10:12 2008 *** ================================================================= [#3 SEEDING(ratio:0.5) CN:21 UP:47.71KiB/s(373.3MiB)] FILE: ./openSUSE-11.1-KDE4-LiveCD-x86_64.iso ----------------------------------------------------------------- [#3 SEEDING(ratio:0.5) CN:21 UP:50.40KiB/s(375.2MiB)] -- Patrick Shanahan Plainfield, Indiana, USA HOG # US1244711 http://wahoo.no-ip.org Photo Album: http://wahoo.no-ip.org/gallery2 Registered Linux User #207535 @ http://counter.li.org -- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org

Hi, On Thu, Dec 18, 2008 at 07:32:06PM +0000, Rob OpenSuSE wrote:

2008/12/18 Peter Poeml :

...

Hi,

On Thu, Dec 18, 2008 at 04:44:38PM +0000, Rob OpenSuSE wrote:

...

2008/12/18 Peter Poeml :

...

On Thu, Dec 18, 2008 at 04:18:56PM +0100, Andreas Jaeger wrote:

...

"Carlos E. R." writes:

...

...

...

...

http://download.opensuse.org/distribution/11.1/iso/dvd/

^^^^^^^^^^^^^ This is (was, I hope :) the wrong link...

...

...

The DVD files for 11.1 are now in the iso directory with the CD images! Peter's blog entry presumed it'd just be a version change, but actually the images are i586 or x86_amd, and all together, so if you see 404 - not founds, go up a level, and copy the link to the console.

Are you sure? I actually changed the links on http://lizards.opensuse.org/2008/12/16/best-way-to-download-opensuse/ before we released, and they work for me.

But hang on, give us a few minutes and we will have metalinks directly on http://software.opensuse.org/, which point directly to the files!

I'm not sure if your other email supercedes this, but I basically used Konqi to find what files to point to, in anticipation of using the command line, or Kget for small files.

http://download.opensuse.org/distribution/11.1/iso/ is the URL I

^^^^^^^^ ...and that's the good link :-)

based my comments on, not any information on any 'Software Downloading' page.

Thanks for the suggestions, I'm done now already with my contribution to the 200 target :) Will sort out a torrent seed in time for the Akamai caching service to go. I don't know if openSUSE are the reason, but my ISP's network suffered badly this afternoon, once the release was available. *grin*

Thanks, Peter -- Contact: admin@opensuse.org (a.k.a. ftpadmin@suse.com) #opensuse-mirrors on freenode.net Info: http://en.opensuse.org/Mirror_Infrastructure SUSE LINUX Products GmbH Research & Development

Per Jessen wrote:

I'm just now downloading the i586 DVD via cdn.novell.com (via an akamai site in Germany - I've got a fairly steady downstream rate of +400kb/sec, occasionally hitting 500kb/sec, but also with lengthy periods with less than 100kb/sec. I'll let you know what the total time is when it's done in about 4 hours. I think the local Switch mirror would be faster though.

Lucky you! My supposedly 8 Mbps ADSL connection managed 400 kBps (~4Mbps) for an hour or so early yesterday evening before dropping to 100 kBps (~1Mbps) consistently overnight. That's the total link traffic with aria2c simultaneously getting the 3 DVD images, mainly by torrents. This seems fairly good by UK domestic standards though from what I hear... -- Cheers Richard (MQ) -- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org

In addition, you can easily avoid all problems, if you use a metalink client to download. Just use a metalink client and download.opensuse.org, and I *guarantuee* you a download which is working, arrives correctly, and that with reasonably fast speed. You can even combine HTTP and Torrent download with a client that supports that simultaneously.

I have blogged about this a minute ago, so there's something to link to and to spread the information. Read here: http://lizards.opensuse.org/2008/12/16/best-way-to-download-opensuse/ And please pass it on!

Note that you can download .torrent files in the described way at any time, safely, quickly. Should you need it. But a torrent-capable Metalink client will even *use* the Torrent and download the whole thing you are after.

I just want to say... wow, the downloads seem to have gone off smoothly. I had no issues at all with downloading the 11.1 release. It came in very fast using the Metalink thing. I have to tip my hat to the infrastructure guys and say well done! C. -- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org

Per Jessen wrote:

I'm just now downloading the i586 DVD via cdn.novell.com (via an akamai site in Germany - I've got a fairly steady downstream rate of +400kb/sec, occasionally hitting 500kb/sec, but also with lengthy periods with less than 100kb/sec. I'll let you know what the total time is when it's done in about 4 hours. I think the local Switch mirror would be faster though.

The download is finished just now - started at 11:20:11, finished 16:38:13 - according to wget 233.27 KB/s on average. Which is just fine btw. /Per Jessen, Zürich -- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org

Andreas Jaeger írta:

My machine is sharing already 1480 MB the last 5 hours since we started the tracker...

Thanks everybody for seeding!

Any news, if the 200TB was reached? Until now (Saturday, 11:30), I seeded 1.01TB on torrents and had around 1.2TB FTP and HTTP downloads. Bye, CzP -- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org