From jospoortvliet@gmail.com Tue Mar 29 03:19:09 2011 From: Jos Poortvliet To: marketing@lists.opensuse.org Subject: [opensuse-marketing] webpin2 and writing about openSUSE on omgSUSE.com Date: Tue, 29 Mar 2011 00:18:54 -0300 Message-ID: <201103290018.59380.jospoortvliet@gmail.com> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============4581492533789601536==" --===============4581492533789601536== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On IRC I saw Pascal Bleser and master Bryen talk about webpin2... Pretty=20 cool! I wonder if there is any update on it? I think it's worth a nice=20 article on omgsuse.com! If you think so, I attached a start for the webpin2 part which needs the=20 latest status from Pascal and otherwise is just based on Pascal's=20 awesome blogs about it and some searching & contemplating of mine :D Who's up for kicking Pascal to add his latest insights and gving this to=20 Tyler to put on omgSUSE.com? And then continueing on this path, finding another cool openSUSE thing? Love, Jos Find your application or library in a whiff The openSUSE community offers a huge selection updated or special versions of= applications, libraries and tools in a variety of locations. This poses uniq= ue problems for openSUSE: finding the packages can be difficult. Luc= kily, there is a solution: webpin. And a newer, faster version is being developed! openSUSE has been growing a lot recently. The openSUSE Build Service allow anyone with a web browser to use the= beefy openSUSE infrastructure to build packages for a variety of distributio= ns. As you can see in the statistics on build.opensuse.org, the number of repositories and packages is s= taggering with over 120.000 packages in 30.000 repositories. Webpin used to r= ely on MySQL for its database. But with well over 27.000 users and the build = service basically busy 24/7, churning out new packages at an epic rate, MySQL= could not keep up. As was mentioned in an earlier article on OMGSUSE.com, t= he openSUSE mirrors update incredibly fast. Where for other linux distributio= ns, release day is a big day, for the openSUSE server infrastructure it is me= rely a 3-5 requests-per-second blip on the radar - among the 300-500 requests= that come in due to the openSUSE Build Service. New packages are pushed out = more than once per minute, you need something special to keep track= of what is going on. openSUSE developer Pascal Bleser found that something in Apache so= lr. He has been busily writing a REST interface for the command line and graphical version = of webpin and working on an update to the web interface on packages.opensuse-community.org. We had a short chat with him about the latest status of Webpin2. Hi Pascal! It has been a while since you blogged about webpin2= . Any progress since then? So what does this mean, will webpin2 make it in the upcoming version of openS= USE? Where can people get it to test, if anywhere? Will it eat babies? So how can people help get webpin2 moving? blabla git merge request http://gitorious.net/opensuse/webpin2 blabla --===============4581492533789601536== Content-Type: application/pgp-signature Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="signature.asc" MIME-Version: 1.0 LS0tLS1CRUdJTiBQR1AgU0lHTkFUVVJFLS0tLS0KVmVyc2lvbjogR251UEcgdjIuMC4xNiAoR05V L0xpbnV4KQoKaUVZRUFCRUNBQVlGQWsyUlQ2TUFDZ2tRK3dnUTFBRDM1aXlzOWdDY0R6WFptS1c4 eWZlaUJpYTZELzVtdklieApXOGdBbjJHaGJLVUZBWEt6VmZGZDUxVitnVjBQVHFGOQo9SDIyQwot LS0tLUVORCBQR1AgU0lHTkFUVVJFLS0tLS0K --===============4581492533789601536==-- From jospoortvliet@gmail.com Tue Mar 29 03:48:15 2011 From: Jos Poortvliet To: marketing@lists.opensuse.org Subject: [opensuse-marketing] Re: webpin2 and writing about openSUSE on omgSUSE.com Date: Tue, 29 Mar 2011 00:42:30 -0300 Message-ID: <201103290042.30573.jospoortvliet@gmail.com> In-Reply-To: <201103290018.59380.jospoortvliet@gmail.com> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2743137523083054136==" --===============2743137523083054136== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On 2011-03-29 Jos wrote: > On IRC I saw Pascal Bleser and master Bryen talk about webpin2... > Pretty cool! I wonder if there is any update on it? I think it's > worth a nice article on omgsuse.com! > > If you think so, I attached a start for the webpin2 part which needs > the latest status from Pascal and otherwise is just based on > Pascal's awesome blogs about it and some searching & contemplating > of mine :D > > Who's up for kicking Pascal to add his latest insights and gving this > to Tyler to put on omgSUSE.com? > > And then continueing on this path, finding another cool openSUSE > thing? > > > Love, > Jos We really need to keep beating the drum on 11.4, I just saw that in the last week openSUSE has sunk from 5th to 6th place on distrowatch.com :( --===============2743137523083054136== Content-Type: application/pgp-signature Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="signature.asc" MIME-Version: 1.0 LS0tLS1CRUdJTiBQR1AgU0lHTkFUVVJFLS0tLS0KVmVyc2lvbjogR251UEcgdjIuMC4xNiAoR05V L0xpbnV4KQoKaUVZRUFCRUNBQVlGQWsyUlZTWUFDZ2tRK3dnUTFBRDM1aXg1WGdDZ2xqWXpRNi8r bkdtSmRSbEQrdDUydTBpVwo5VklBb0xpQXpJRERmaWlOL1ROQVFNS2F4QnpJdXRFSwo9enhKNgot LS0tLUVORCBQR1AgU0lHTkFUVVJFLS0tLS0K --===============2743137523083054136==-- From warlordfff@gmail.com Tue Mar 29 09:19:39 2011 From: Kostas Koudaras To: marketing@lists.opensuse.org Subject: Re: [opensuse-marketing] Re: webpin2 and writing about openSUSE on omgSUSE.com Date: Tue, 29 Mar 2011 12:19:15 +0300 Message-ID: In-Reply-To: <201103290042.30573.jospoortvliet@gmail.com> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7636425328358754914==" --===============7636425328358754914== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit The calm before the Storm 2011/3/29 Jos Poortvliet : > On 2011-03-29 Jos wrote: >> On IRC I saw Pascal Bleser and master Bryen talk about webpin2... >> Pretty cool! I wonder if there is any update on it? I think it's >> worth a nice article on omgsuse.com! >> >> If you think so, I attached a start for the webpin2 part which needs >> the latest status from Pascal and otherwise is just based on >> Pascal's awesome blogs about it and some searching & contemplating >> of mine :D >> >> Who's up for kicking Pascal to add his latest insights and gving this >> to Tyler to put on omgSUSE.com? >> >> And then continueing on this path, finding another cool openSUSE >> thing? >> >> >> Love, >> Jos > > We really need to keep beating the drum on 11.4, I just saw that in the > last week openSUSE has sunk from 5th to 6th place on distrowatch.com :( The calm before the Second Storm ;-) People now are playing with 11.4 and after so many downloads we had in the start of the release it has a logic. The lizards are still marching... Kostas -- http://opensuse.gr http://amb.opensuse.gr http://own.opensuse.gr http://warlordfff.tk me I am not me ------- Time travel is possible, you just need to know the right aliens -- To unsubscribe, e-mail: opensuse-marketing+unsubscribe(a)opensuse.org For additional commands, e-mail: opensuse-marketing+help(a)opensuse.org --===============7636425328358754914==-- From pascal.bleser@opensuse.org Tue Mar 29 15:38:27 2011 From: Pascal Bleser To: marketing@lists.opensuse.org Subject: [opensuse-marketing] Re: webpin2 and writing about openSUSE on omgSUSE.com Date: Tue, 29 Mar 2011 17:38:19 +0200 Message-ID: <20110329153819.GA10606@hera> In-Reply-To: <201103290018.59380.jospoortvliet@gmail.com> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2728172989417223384==" --===============2728172989417223384== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 2011-03-29 00:18:54 (-0300), Jos Poortvliet wr= ote: > On IRC I saw Pascal Bleser and master Bryen talk about webpin2... Pretty=20 > cool! I wonder if there is any update on it? I think it's worth a nice=20 > article on omgsuse.com! Yes, but only once it's finished IMHO. Given that I am the sole developer on this (and that skills for developing and tuning search engines is very rare in general -- yes, it's a very complex topic, don't think general purpose Google ;)), I really have no idea when it will be ready for public consumption as it simply depends on the amount of free time I'll be able to find (and other things being higher priority or not). I don't have that much left to do, actually, but we'll have to see how it scales, because the number of repositories we have on build.opensuse.org is just plain insane (over 8000 repositories). That's all data that has to be pulled from the internet, parsed (it's XML), and then indexed into the search engine (Apache Solr). I got back to coding on it since a few days, in order to iron out a first stable version that could at least be put for testing, opinions, and to see how well it copes with the sick amount of repositories we have. Note that "webpin2" also provides a REST API that is compatible with the old "webpin1" one, which means that the existing YaST module as well as the existing command-line query tool will continue to work as-is. I will most probably also rewrite the command-line query tool to use more powerful capabilities of webpin2, and someone will have to update the YaST module, but where not there yet, unfortunately. cheers --=20 -o) Pascal Bleser /\\ http://opensuse.org -- we haz green _\_v http://fosdem.org -- we haz conf --===============2728172989417223384== Content-Type: application/pgp-signature Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.sig" MIME-Version: 1.0 LS0tLS1CRUdJTiBQR1AgU0lHTkFUVVJFLS0tLS0KVmVyc2lvbjogR251UEcgdjIuMC4xNSAoR05V L0xpbnV4KQoKaUQ4REJRRk5rZnpycjNOTVdsaUZjWGNSQXA5VEFKOThWeXNRREc5eSt6WHppQ0No VXdCTE9RNEs4QUNncUZMZQpiZThlbzFSUzVTcWxodlB6ZG9kbVljMD0KPXl3TmkKLS0tLS1FTkQg UEdQIFNJR05BVFVSRS0tLS0tCg== --===============2728172989417223384==-- From jospoortvliet@gmail.com Thu Mar 31 23:01:01 2011 From: Jos Poortvliet To: marketing@lists.opensuse.org Subject: Re: [opensuse-marketing] Re: webpin2 and writing about openSUSE on omgSUSE.com Date: Thu, 31 Mar 2011 19:34:27 -0300 Message-ID: <201103311934.27410.jospoortvliet@gmail.com> In-Reply-To: <20110329153819.GA10606@hera> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============4670389047358031562==" --===============4670389047358031562== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On 2011-03-29 Pascal wrote: > On 2011-03-29 00:18:54 (-0300), Jos Poortvliet wrote: > > On IRC I saw Pascal Bleser and master Bryen talk about webpin2... > > Pretty cool! I wonder if there is any update on it? I think it's > > worth a nice article on omgsuse.com! > > Yes, but only once it's finished IMHO. > > Given that I am the sole developer on this (and that skills for > developing and tuning search engines is very rare in general -- > yes, it's a very complex topic, don't think general purpose > Google ;)), I really have no idea when it will be ready for > public consumption as it simply depends on the amount of free > time I'll be able to find (and other things being higher > priority or not). > > I don't have that much left to do, actually, but we'll have to > see how it scales, because the number of repositories we have on > build.opensuse.org is just plain insane (over 8000 > repositories). That's all data that has to be pulled from the > internet, parsed (it's XML), and then indexed into the search > engine (Apache Solr). > > I got back to coding on it since a few days, in order to iron > out a first stable version that could at least be put for > testing, opinions, and to see how well it copes with the sick > amount of repositories we have. > > Note that "webpin2" also provides a REST API that is compatible > with the old "webpin1" one, which means that the existing YaST > module as well as the existing command-line query tool will > continue to work as-is. > I will most probably also rewrite the command-line query tool to > use more powerful capabilities of webpin2, and someone will have > to update the YaST module, but where not there yet, > unfortunately. All this doesn't mean there's no reason to start writing... Getting the word out on new things that are being developed is always cool, even if it might take a while for them to finish. And even if the chance is 1% to get help from someone, every 100 projects we promote, one gets help :D So if someone is looking for a starters job on writing, this is it! So? > cheers --===============4670389047358031562== Content-Type: application/pgp-signature Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="signature.asc" MIME-Version: 1.0 LS0tLS1CRUdJTiBQR1AgU0lHTkFUVVJFLS0tLS0KVmVyc2lvbjogR251UEcgdjIuMC4xNiAoR05V L0xpbnV4KQoKaUVZRUFCRUNBQVlGQWsyVkFYTUFDZ2tRK3dnUTFBRDM1aXdxc3dDZEV2MUsvSFNW bUU3V1RhdWtGTFc0UjkyOApET2NBbjAxMklmZFRZVnlGaGF4QkFzTTk0aW0xaXZhLwo9U0hybgot LS0tLUVORCBQR1AgU0lHTkFUVVJFLS0tLS0K --===============4670389047358031562==--