[opensuse-marketing] webpin2 and writing about openSUSE on omgSUSE.com
On IRC I saw Pascal Bleser and master Bryen talk about webpin2... Pretty cool! I wonder if there is any update on it? I think it's worth a nice article on omgsuse.com! If you think so, I attached a start for the webpin2 part which needs the latest status from Pascal and otherwise is just based on Pascal's awesome blogs about it and some searching & contemplating of mine :D Who's up for kicking Pascal to add his latest insights and gving this to Tyler to put on omgSUSE.com? And then continueing on this path, finding another cool openSUSE thing? Love, Jos Find your application or library in a whiff The openSUSE community offers a huge selection updated or special versions of applications, libraries and tools in a variety of locations. This poses unique problems for openSUSE: <em>finding</em> the packages can be difficult. Luckily, there is a solution: <a href="http://packages.opensuse-community.org/">webpin</a>. And a newer, faster version is being developed! openSUSE has been growing a lot recently. The <a href="http://build.opensuse.org/">openSUSE Build Service</a> allow anyone with a web browser to use the beefy openSUSE infrastructure to build packages for a variety of distributions. As you can see in the statistics on <a href="http://build.opensuse.org/monitor">build.opensuse.org</a>, the number of repositories and packages is staggering with over 120.000 packages in 30.000 repositories. Webpin used to rely on MySQL for its database. But with well over 27.000 users and the build service basically busy 24/7, churning out new packages at an epic rate, MySQL could not keep up. As was mentioned in <a href="http://omgsuse.com/content/sharing-opensuse-world-mirrorbrain">an earlier article on OMGSUSE.com</a>, the openSUSE mirrors update incredibly fast. Where for other linux distributions, release day is a big day, for the openSUSE server infrastructure it is merely a 3-5 requests-per-second blip on the radar - among the 300-500 requests that come in due to the openSUSE Build Service. New packages are pushed out <a href="http://omgsuse.com/content/sharing-opensuse-world-mirrorbrain"><em>more than once per minute</em></a>, you need something special to keep track of what is going on. openSUSE developer Pascal Bleser <a href="http://dev-loki.blogspot.com/2010/08/opensuse-package-index-and-search.html">found that something in Apache solr</a>. He has been busily writing a REST interface for the <a href="http://software.opensuse.org/search?q=webpin">command line and graphical version of webpin</a> and working on an update to the web interface on <a href="http://packages.opensuse-community.org/">packages.opensuse-community.org</a>. We had a short chat with him about the latest status of Webpin2. Hi Pascal! It has been a while since <a href="http://dev-loki.blogspot.com/2010/08/opensuse-package-index-and-search.html">you blogged about webpin2</a>. Any progress since then? So what does this mean, will webpin2 make it in the upcoming version of openSUSE? Where can people get it to test, if anywhere? Will it eat babies? So how can people help get webpin2 moving? blabla git merge request http://gitorious.net/opensuse/webpin2 blabla
On 2011-03-29 Jos wrote:
On IRC I saw Pascal Bleser and master Bryen talk about webpin2... Pretty cool! I wonder if there is any update on it? I think it's worth a nice article on omgsuse.com!
If you think so, I attached a start for the webpin2 part which needs the latest status from Pascal and otherwise is just based on Pascal's awesome blogs about it and some searching & contemplating of mine :D
Who's up for kicking Pascal to add his latest insights and gving this to Tyler to put on omgSUSE.com?
And then continueing on this path, finding another cool openSUSE thing?
Love, Jos
We really need to keep beating the drum on 11.4, I just saw that in the last week openSUSE has sunk from 5th to 6th place on distrowatch.com :(
The calm before the Storm 2011/3/29 Jos Poortvliet <jospoortvliet@gmail.com>:
On 2011-03-29 Jos wrote:
On IRC I saw Pascal Bleser and master Bryen talk about webpin2... Pretty cool! I wonder if there is any update on it? I think it's worth a nice article on omgsuse.com!
If you think so, I attached a start for the webpin2 part which needs the latest status from Pascal and otherwise is just based on Pascal's awesome blogs about it and some searching & contemplating of mine :D
Who's up for kicking Pascal to add his latest insights and gving this to Tyler to put on omgSUSE.com?
And then continueing on this path, finding another cool openSUSE thing?
Love, Jos
We really need to keep beating the drum on 11.4, I just saw that in the last week openSUSE has sunk from 5th to 6th place on distrowatch.com :(
The calm before the Second Storm ;-) People now are playing with 11.4 and after so many downloads we had in the start of the release it has a logic. The lizards are still marching... Kostas -- http://opensuse.gr http://amb.opensuse.gr http://own.opensuse.gr http://warlordfff.tk me I am not me ------- Time travel is possible, you just need to know the right aliens -- To unsubscribe, e-mail: opensuse-marketing+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-marketing+help@opensuse.org
On 2011-03-29 00:18:54 (-0300), Jos Poortvliet <jospoortvliet@gmail.com> wrote:
On IRC I saw Pascal Bleser and master Bryen talk about webpin2... Pretty cool! I wonder if there is any update on it? I think it's worth a nice article on omgsuse.com!
Yes, but only once it's finished IMHO. Given that I am the sole developer on this (and that skills for developing and tuning search engines is very rare in general -- yes, it's a very complex topic, don't think general purpose Google ;)), I really have no idea when it will be ready for public consumption as it simply depends on the amount of free time I'll be able to find (and other things being higher priority or not). I don't have that much left to do, actually, but we'll have to see how it scales, because the number of repositories we have on build.opensuse.org is just plain insane (over 8000 repositories). That's all data that has to be pulled from the internet, parsed (it's XML), and then indexed into the search engine (Apache Solr). I got back to coding on it since a few days, in order to iron out a first stable version that could at least be put for testing, opinions, and to see how well it copes with the sick amount of repositories we have. Note that "webpin2" also provides a REST API that is compatible with the old "webpin1" one, which means that the existing YaST module as well as the existing command-line query tool will continue to work as-is. I will most probably also rewrite the command-line query tool to use more powerful capabilities of webpin2, and someone will have to update the YaST module, but where not there yet, unfortunately. cheers -- -o) Pascal Bleser /\\ http://opensuse.org -- we haz green _\_v http://fosdem.org -- we haz conf
On 2011-03-29 Pascal wrote:
On 2011-03-29 00:18:54 (-0300), Jos Poortvliet <jospoortvliet@gmail.com> wrote:
On IRC I saw Pascal Bleser and master Bryen talk about webpin2... Pretty cool! I wonder if there is any update on it? I think it's worth a nice article on omgsuse.com!
Yes, but only once it's finished IMHO.
Given that I am the sole developer on this (and that skills for developing and tuning search engines is very rare in general -- yes, it's a very complex topic, don't think general purpose Google ;)), I really have no idea when it will be ready for public consumption as it simply depends on the amount of free time I'll be able to find (and other things being higher priority or not).
I don't have that much left to do, actually, but we'll have to see how it scales, because the number of repositories we have on build.opensuse.org is just plain insane (over 8000 repositories). That's all data that has to be pulled from the internet, parsed (it's XML), and then indexed into the search engine (Apache Solr).
I got back to coding on it since a few days, in order to iron out a first stable version that could at least be put for testing, opinions, and to see how well it copes with the sick amount of repositories we have.
Note that "webpin2" also provides a REST API that is compatible with the old "webpin1" one, which means that the existing YaST module as well as the existing command-line query tool will continue to work as-is. I will most probably also rewrite the command-line query tool to use more powerful capabilities of webpin2, and someone will have to update the YaST module, but where not there yet, unfortunately.
All this doesn't mean there's no reason to start writing... Getting the word out on new things that are being developed is always cool, even if it might take a while for them to finish. And even if the chance is 1% to get help from someone, every 100 projects we promote, one gets help :D So if someone is looking for a starters job on writing, this is it! So?
cheers
participants (3)
-
Jos Poortvliet -
Kostas Koudaras -
Pascal Bleser