[opensuse-project] Package Search : Hosting request
Greetings all, For the past few months I have been providing an openSUSE package search at http://benjiweber.co.uk:8080/webpin, It has been providing search for over 100,000 packages and 16,000,000 files (buildservice, factory, official, thirdparty). I had hoped to be able to show off some of the newer features, like the one click install integration but that will have to wait for now. Judging by the fact that it was getting well over a thousand search requests a day I suspect it has not gone unnoticed that it has been unavailable for most of this week. Thanks to all those who e-mailed to ensure that I knew. This is unfortunately out of my control, it was hosted on an aged municipal server with dozens of active users, and now the inevitable has happend and the server has died. It is unlikely to be back within the next week. The system is designed (http://en.opensuse.org/PKGSearch-design) to allow multiple groups to provide search results, as well as multiple uses of the search data. So if legal issues of indexing repositories such as packman are a problem those indexes and web-page frontend can be held elsewhere. It would be nice if Novell/SUSE could provide the facilities for indexing the core repositories and build service, but having spoken to several employees it sounds like they do not have the resources. So if anyone else does have the resources and willingness to do so then please let me know. The requirements at present: - Shell access for running the trawler and maintenance (although someone else could be taught to do this) - mysql (with capability of customising server settings) - A few gigabytes of disk space to store the xml files while indexing, and the database + indexes themselves. - Java 6 - Tomcat 5 or Glassfish for hosting the web service. _ Benjamin Weber --------------------------------------------------------------------- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org
Benjamin, On Thursday 19 April 2007 10:11, Benji Weber wrote:
Greetings all,
...
- Java 6
Out of curiosity, what features of Java 6 not present in Java 5 did you use?
- ...
_ Benjamin Weber
Randall Schulz --------------------------------------------------------------------- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org
On 4/19/07, Randall R Schulz <rschulz@sonic.net> wrote:
Out of curiosity, what features of Java 6 not present in Java 5 did you use?
The new jax-ws features. http://java.sun.com/developer/technicalArticles/J2SE/jax_ws_2/ It might be possible to get it to work with java5, but I gave up after a few hours. Installing java6 is easier. _ Benjamin Weber --------------------------------------------------------------------- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org
On Thursday 19 April 2007 10:22, Benji Weber wrote:
On 4/19/07, Randall R Schulz <rschulz@sonic.net> wrote:
Out of curiosity, what features of Java 6 not present in Java 5 did you use?
The new jax-ws features. http://java.sun.com/developer/technicalArticles/J2SE/jax_ws_2/
Thanks. Java is getting so big, it's hard to keep track of all the goodies they keep adding to each major release.
...
_ Benjamin Weber
Randall Schulz --------------------------------------------------------------------- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org
Benji Weber wrote:
It would be nice if Novell/SUSE could provide the facilities for indexing the core repositories and build service, but having spoken to several employees it sounds like they do not have the resources. So if anyone else does have the resources and willingness to do so then please let me know.
I barely understand this. how the build service can't index itself his packages? when somebody do a so good job, this situation is unbeleivable! keep on and many thanks jdd -- http://www.dodin.net Lucien Dodin, inventeur http://lucien.dodin.net/index.shtml --------------------------------------------------------------------- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org
On Thursday 19 April 2007 20:30:50 jdd sur free wrote:
I barely understand this. how the build service can't index itself his packages?
when somebody do a so good job, this situation is unbeleivable!
keep on and many thanks jdd
I believe its partly due to benji's indexer searching packman and guru repos as well -- therefore indexing legally dubious packages -- Best Regards, David Miller --------------------------------------------------------------------- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org
On 4/19/07, David Miller <djmdave@googlemail.com> wrote:
I believe its partly due to benji's indexer searching packman and guru repos as well -- therefore indexing legally dubious packages
As I mentioned, it's designed so it can be split, one party providing some of the search facilities, and the rest by another party, invisible to the user. _ Benjamin Weber --------------------------------------------------------------------- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org
Hi Benji, On Thursday 19 April 2007 19:11:42 wrote Benji Weber: ...
It would be nice if Novell/SUSE could provide the facilities for indexing the core repositories and build service, but having spoken to several employees it sounds like they do not have the resources. So if anyone else does have the resources and willingness to do so then please let me know.
In general, we are working on an end-user interface for the build service, where have the same search functionalities as in build.opensuse.org. Since the distros go into the build service as well, you can also search via them, including rating or download numbers based sorting. Independent from this, it is no problem to setup a system, where non-SUSE employees get access to. Of course only a smaller number of people, but we create such a system. thanks adrian PS: I have removed the link from software.o.o to your page for now. -- Adrian Schroeter SUSE LINUX Products GmbH, GF: Markus Rex, HRB 16746 (AG Nürnberg) email: adrian@suse.de --------------------------------------------------------------------- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org
On 4/20/07, Adrian Schröter <adrian@suse.de> wrote:
In general, we are working on an end-user interface for the build service, where have the same search functionalities as in build.opensuse.org. Since the distros go into the build service as well, you can also search via them, including rating or download numbers based sorting.
Who is working on this? It would be good to collaborate. I was planning to integrate ratings and download statistics into the search soon, as well as using search statistics to improve results.
Independent from this, it is no problem to setup a system, where non-SUSE employees get access to. Of course only a smaller number of people, but we create such a system.
What exactly are you saying here, that you could host something? _ Benjamin Weber --------------------------------------------------------------------- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org
On Friday 20 April 2007 14:28:57 wrote Benji Weber:
On 4/20/07, Adrian Schröter <adrian@suse.de> wrote:
In general, we are working on an end-user interface for the build service, where have the same search functionalities as in build.opensuse.org. Since the distros go into the build service as well, you can also search via them, including rating or download numbers based sorting.
Who is working on this? It would be good to collaborate. I was planning to integrate ratings and download statistics into the search soon, as well as using search statistics to improve results.
The build service team works in this area, you can see the pages behind the statistics page as very first stub for a "read-only" mode of the web interface, which can become public behind software.opensuse.org.
Independent from this, it is no problem to setup a system, where non-SUSE employees get access to. Of course only a smaller number of people, but we create such a system.
What exactly are you saying here, that you could host something?
Yes, I would need to get some funding for an extra system where trusted non-Novell employees can get a shell login for hosting such services. However, I do see the end user web interface as a solution in first place for this particular task. bye adrian -- Adrian Schroeter SUSE LINUX Products GmbH, GF: Markus Rex, HRB 16746 (AG Nürnberg) email: adrian@suse.de --------------------------------------------------------------------- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org
It is back up, but I don't fancy its chances of staying up. _ Benjamin Weber --------------------------------------------------------------------- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-project+help@opensuse.org
participants (5)
-
Adrian Schröter -
Benji Weber -
David Miller -
jdd sur free -
Randall R Schulz