[opensuse-buildservice] Build Service Project Cleanup Round
Hello, we got more than 6500 projects since the start of the opensuse.org Build Service instance (plus the projects which got removed again by their owners). These projects contain more than 13000 repositories, which get need to get in sync by our service. This takes obviously resources on the server side and quite a number of these projects are not touched since a while. So I assume they are not needed anymore. So I think it is a good idea to free the resources from these projects and give it to us active people :) This will basically affect all projects, where no source changes happened since 1 year or more. We have basically 961 "old projects" and further 2300 empty projects (no packages inside). A FAQ and a full list of "old projects" can be found here. Please speak up, when you think this is no propper approach or if you want to support this :) http://en.opensuse.org/Build_Service/Regular_Cleanup thanks adrian -- Adrian Schroeter SUSE Linux Products GmbH email: adrian@suse.de -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org
On Monday 22 June 2009 11:43:35 Adrian Schröter wrote:
This takes obviously resources on the server side and quite a number of these projects are not touched since a while. So I assume they are not
What about giving https://features.opensuse.org/306529 "Deactivate build if home:user:branch:foo is inactive for 1 or 2 weeksedit" attention/priority? Bye, Steve -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org
On Mon, Jun 22, 2009 at 5:43 AM, Adrian Schröter
Hello,
we got more than 6500 projects since the start of the opensuse.org Build Service instance (plus the projects which got removed again by their owners). These projects contain more than 13000 repositories, which get need to get in sync by our service.
This takes obviously resources on the server side and quite a number of these projects are not touched since a while. So I assume they are not needed anymore.
So I think it is a good idea to free the resources from these projects and give it to us active people :)
This will basically affect all projects, where no source changes happened since 1 year or more.
I'm afraid that seems too aggressive. As an example I needed a little used package called open2300 for opensuse 10.3 a few months ago. It was last fully released in 2005. I doubt the source has been edited in a long time. It links to MySQL so I think that means it should be rebuilt from time to time? I found it on that build service at https://build.opensuse.org/package/show?package=open2300&project=home%3Afseidel And as you can see the 10.3 version still builds. On the other hand the 11.0 and 11.1 versions do not. Certainly if you totally dropped it because it had not seen any activity in a while I would have not found it. Or are you just proposing leaving it published in its last built state? Possibly even more important, I assume if you dropped it I would not have even found the package when doing a search. Even if the builds are broken, currently I can search for a package, grab the specfile, etc. and create my own project with that as a starting point. Otherwise I would have to start from scratch on the specfile. In fact, in this case I pulled open2300 from svn and built my own set of projects. Having the several year old version around to leverage simplified things somewhat. Thus if I understand your proposal, I don't care for it. I would prefer: If a package builds, keep building it regardless. If a package fails to build, only try again if there has been a source change. If a package fails, have a new search option that allows me to search for them so I can evaluate using that package as a launch point for creating a new subproject. Thanks Greg -- Greg Freemyer Head of EDD Tape Extraction and Processing team Litigation Triage Solutions Specialist http://www.linkedin.com/in/gregfreemyer First 99 Days Litigation White Paper - http://www.norcrossgroup.com/forms/whitepapers/99%20Days%20whitepaper.pdf The Norcross Group The Intersection of Evidence & Technology http://www.norcrossgroup.com -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org
Hi, Adrian Schröter schrieb:
Hello,
we got more than 6500 projects since the start of the opensuse.org Build Service instance (plus the projects which got removed again by their owners). These projects contain more than 13000 repositories, which get need to get in sync by our service.
This takes obviously resources on the server side and quite a number of these projects are not touched since a while. So I assume they are not needed anymore.
not touching, does not mean not using/needed in any case. I have a "frozen" project where no changes are allowed. It is use as a base. And deleting it would be a pain. For you it would look like an orphaned prj, but it isn't.
So I think it is a good idea to free the resources from these projects and give it to us active people :)
This will basically affect all projects, where no source changes happened since 1 year or more.
see above.
We have basically 961 "old projects" and further 2300 empty projects (no packages inside).
I would agree to remove "empty projects", but would disagree to delete orphaned projects.
A FAQ and a full list of "old projects" can be found here. Please speak up, when you think this is no propper approach or if you want to support this :)
http://en.opensuse.org/Build_Service/Regular_Cleanup
thanks adrian
Chris -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org
On Monday 22 June 2009, Adrian Schröter wrote:
we got more than 6500 projects since the start of the opensuse.org Build Service instance (plus the projects which got removed again by their owners). These projects contain more than 13000 repositories, which get need to get in sync by our service.
I think some parts can obviously be cleaned up, like removing repositories of discontinued products or duplicate ones (at least one big repository builds SUSE_Linux_Factory and openSUSE_Factory for example). Unfortunately I can not delete those repositories myself because there is at least one home:*:branch:* project building against it :(
This takes obviously resources on the server side and quite a number of these projects are not touched since a while. So I assume they are not needed anymore.
did we analyze which ones are still frequently accessed (downloaded)?
We have basically 961 "old projects" and further 2300 empty projects (no packages inside).
most of them appear to be home projects which are probably simply not used. do they have repositories if they don't have packages? those could easily be removed then, right? Greetings, Dirk -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org
Am Montag, 22. Juni 2009 23:05:12 schrieb Dirk Müller:
On Monday 22 June 2009, Adrian Schröter wrote:
we got more than 6500 projects since the start of the opensuse.org Build Service instance (plus the projects which got removed again by their owners). These projects contain more than 13000 repositories, which get need to get in sync by our service.
I think some parts can obviously be cleaned up, like removing repositories of discontinued products
this happens usually, when I move a base distro to DISCONTINUED space.
or duplicate ones (at least one big repository builds SUSE_Linux_Factory and openSUSE_Factory for example).
erm, which one ?
Unfortunately I can not delete those repositories myself because there is at least one home:*:branch:* project building against it :(
yes, we need a force option for this ...
This takes obviously resources on the server side and quite a number of these projects are not touched since a while. So I assume they are not needed anymore.
did we analyze which ones are still frequently accessed (downloaded)?
No, I didn't. In fact I think even when they are frequently downloaded, they should get resetled somewhere else, by someone who cares about. It just increases the risk of not seen security holes or different problems, when they are not maintained.
We have basically 961 "old projects" and further 2300 empty projects (no packages inside).
most of them appear to be home projects which are probably simply not used. do they have repositories if they don't have packages? those could easily be removed then, right?
Right, these are around 900 from 2300 empty projects again, which I will remove today. (If no one objects right now). -- Adrian Schroeter SUSE Linux Products GmbH email: adrian@suse.de -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org
Am Montag, 22. Juni 2009 22:49:01 schrieb Christian:
Hi,
Adrian Schröter schrieb:
Hello,
we got more than 6500 projects since the start of the opensuse.org Build Service instance (plus the projects which got removed again by their owners). These projects contain more than 13000 repositories, which get need to get in sync by our service.
This takes obviously resources on the server side and quite a number of these projects are not touched since a while. So I assume they are not needed anymore.
not touching, does not mean not using/needed in any case. I have a "frozen" project where no changes are allowed. It is use as a base. And deleting it would be a pain. For you it would look like an orphaned prj, but it isn't.
Hm, okay, but keeping >1000 project and its repositories because one of it is used ? Note, I do not speak about remove any project, just disabling it and later removing the repos. But it can get restored easily by the project owner. What is your project ? So I can whitelist it ... bye adrian -- Adrian Schroeter SUSE Linux Products GmbH email: adrian@suse.de -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org
I could assist with adding new versions of pike to devel:languages:pike
but I do not have access to the project. This will only be as time
permits.
--
Boyd Gerber
Adrian Schröter wrote:
This will basically affect all projects, where no source changes happened since 1 year or more.
Better metrics would be: "no source changes happened since 1 year" AND "project is not enabled for the latest openSUSE release" (or no metadata change in last 1 year). See Emulators:Oldies. I enabled it for openSUSE 11.1 after the release, but the change did not protect me from becoming "old".
We have basically 961 "old projects" and further 2300 empty projects (no packages inside).
A FAQ and a full list of "old projects" can be found here. Please speak up, when you think this is no propper approach or if you want to support this :)
FAQ is missing answer to "I am still interested in the project, but there are no planned changes just now. How I can prevent disabling of the project?" -- Best Regards / S pozdravem, Stanislav Brabec software developer --------------------------------------------------------------------- SUSE LINUX, s. r. o. e-mail: sbrabec@suse.cz Lihovarská 1060/12 tel: +420 284 028 966, +49 911 740538747 190 00 Praha 9 fax: +420 284 028 951 Czech Republic http://www.suse.cz/ -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org
HI Adrian
Hm, okay, but keeping >1000 project and its repositories because one of it is used ?
Note, I do not speak about remove any project, just disabling it and later removing the repos. But it can get restored easily by the project owner.
What is your project ? So I can whitelist it ... home:sitnet (is the base) home:sitnet:php home:sitnet:Update
bye Chris -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org
On 2009-06-23 07:57:16 -0600, Boyd Lynn Gerber wrote:
I could assist with adding new versions of pike to devel:languages:pike but I do not have access to the project. This will only be as time permits.
submitrequests are your friend. darix -- openSUSE - SUSE Linux is my linux openSUSE is good for you www.opensuse.org -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org
Adrian Schröter napsal(a):
A FAQ and a full list of "old projects" can be found here. Please speak up, when you think this is no propper approach or if you want to support this :)
Could you add a list of project maintainers next to each project in the table, so that one can easily find his projects? And/or send a mail to the maintainers with "do not reply unless you want to preserve your project" for each project that is about to be disabled? Michal -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org
Small top-post heads up. Since we were not able to agree how to deal with removing the repositories, I will just disable build for the projects this week. This can get reverted in any case, nothing gets lost. (except for the projects where people wrote me not do it of course) But I really would like also free our stage server and the mirrors with not used packages also later .... I think this is acceptable so far for everybody. bye adrian Am Montag, 22. Juni 2009 17:11:48 schrieb Greg Freemyer:
On Mon, Jun 22, 2009 at 5:43 AM, Adrian Schröter
wrote: Hello,
we got more than 6500 projects since the start of the opensuse.org Build Service instance (plus the projects which got removed again by their owners). These projects contain more than 13000 repositories, which get need to get in sync by our service.
This takes obviously resources on the server side and quite a number of these projects are not touched since a while. So I assume they are not needed anymore.
So I think it is a good idea to free the resources from these projects and give it to us active people :)
This will basically affect all projects, where no source changes happened since 1 year or more.
I'm afraid that seems too aggressive.
As an example I needed a little used package called open2300 for opensuse 10.3 a few months ago. It was last fully released in 2005. I doubt the source has been edited in a long time. It links to MySQL so I think that means it should be rebuilt from time to time?
I found it on that build service at https://build.opensuse.org/package/show?package=open2300&project=home%3Afse idel
And as you can see the 10.3 version still builds. On the other hand the 11.0 and 11.1 versions do not.
Certainly if you totally dropped it because it had not seen any activity in a while I would have not found it. Or are you just proposing leaving it published in its last built state?
Possibly even more important, I assume if you dropped it I would not have even found the package when doing a search. Even if the builds are broken, currently I can search for a package, grab the specfile, etc. and create my own project with that as a starting point. Otherwise I would have to start from scratch on the specfile.
In fact, in this case I pulled open2300 from svn and built my own set of projects. Having the several year old version around to leverage simplified things somewhat.
Thus if I understand your proposal, I don't care for it.
I would prefer:
If a package builds, keep building it regardless.
If a package fails to build, only try again if there has been a source change.
If a package fails, have a new search option that allows me to search for them so I can evaluate using that package as a launch point for creating a new subproject.
Thanks Greg
-- Adrian Schroeter SUSE Linux Products GmbH email: adrian@suse.de -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org
participants (9)
-
Adrian Schröter
-
Boyd Lynn Gerber
-
Christian
-
Dirk Müller
-
Greg Freemyer
-
Marcus Rueckert
-
Michal Marek
-
Stanislav Brabec
-
Stephan Binner