[opensuse-buildservice] OBS cleanup -> removal of outdated repositories

older
[opensuse-buildservice] project...

Adrian Schröter

23 Nov 2010 23 Nov '10

16:45

Hi, Please excuse the cross post. You may have noticed that we have higher and higher build load on build.o.o. While the new dispatcher algorithms are still good to prefer the "right" jobs, it is still a sign that we may should cleanup. My current plan is to remove all repositories in home projects, which have not been touched this year. Not touched means, no source submission and no meta data has been altered at all. Additionally also all non-home projects, which have not been touch in last two years. This will affect 5668 out of 15668 projects. Why remove repos and not just disable the build ? This will free disk space on our servers and also on all mirrors. As result we can be mirrored more easily. Will any source get lost ? No. How to enable it again ? Just add the wanted repos again. Which projects will get affected exactly ? Find a full list here: http://www.suse.de/~adrian/OBS-remove-list-candidates There is a project which has not been touched, but the repos are still anyway important ! Just drop me a mail .... Why not drop the entire project now that we have an undelete function ? I thought about that, but currently the webui just says that the project does not exist. It does not offer to undelete it, so that might be too agressive for now. Why not drop people a mail and ask them to remove it ? Way to many accounts have no valid email adress and past experience showed that people are often not react when they lost interesst in their project. May plan is to do the removal end of this week, except more discussion about this is needed. Just tell me your opinion, also when you support this ;) thanks adrian -- Adrian Schroeter SUSE Linux Products GmbH email: adrian@suse.de -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org

Show replies by date

Greg Freemyer

23 Nov 23 Nov

16:56

On Tue, Nov 23, 2010 at 11:45 AM, Adrian Schröter wrote:

...

<snip>

...

May plan is to do the removal end of this week, except more discussion about this is needed.

Just tell me your opinion, also when you support this ;)

thanks adrian

Adrian, I'm surprised you have so many untouched projects. I assume anyone that has added a recent distro repo will not see their packages deleted? Or does that happen at the project level, and thus even maintainers that have been adding new distros to their repo list will see packages deleted? I consider that a bad thing. Also, just a comment that this is a major holiday week in the US and lots of people are offline already. And starting Wed. COB, many will not touch a computer again before Monday AM. I don't know if that impacts the timing of your process or not. Greg -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org

Adrian Schröter

16:59

Am Dienstag, 23. November 2010, 17:56:39 schrieb Greg Freemyer:

...

On Tue, Nov 23, 2010 at 11:45 AM, Adrian Schröter wrote:

...
<snip>

...
May plan is to do the removal end of this week, except more discussion about this is needed.

Just tell me your opinion, also when you support this ;)

thanks adrian

Adrian,

I'm surprised you have so many untouched projects. I assume anyone that has added a recent distro repo will not see their packages deleted? Or does that happen at the project level, and thus even maintainers that have been adding new distros to their repo list will see packages deleted?

No, who ever touch any package source or touch project meta data (by adding a repo) should not be affected. The list may contain quite some projects, where never a real package have been built. Just people who clicked wildly in the webui ;) bye adrian -- Adrian Schroeter SUSE Linux Products GmbH email: adrian@suse.de -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org

Patrick Shanahan

22:16

New subject: [opensuse-buildservice] Re: [opensuse-packaging] OBS cleanup -> removal of outdated repositories

* Adrian Schröter [11-23-10 11:47]: ...

...

May plan is to do the removal end of this week, except more discussion about this is needed.

Does the ability exist to determine usage (download) of a repo? Changes/reguilds may have not been necessary.

...

Just tell me your opinion, also when you support this ;)

absolutely. -- Patrick Shanahan Plainfield, Indiana, USA HOG # US1244711 http://wahoo.no-ip.org Photo Album: http://wahoo.no-ip.org/gallery2 Registered Linux User #207535 @ http://counter.li.org -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org

Adrian Schröter

24 Nov 24 Nov

07:05

New subject: [opensuse-buildservice] Re: [opensuse-packaging] OBS cleanup -> removal of outdated repositories

Am Dienstag, 23. November 2010, 23:16:14 schrieb Patrick Shanahan:

...

* Adrian Schröter [11-23-10 11:47]: ...

...
May plan is to do the removal end of this week, except more discussion about this is needed.

Does the ability exist to determine usage (download) of a repo? Changes/reguilds may have not been necessary.

In theorie, we collect the data and have an implementation to find out download numbers. But the code is complete unmaintainer and not runable (due to performance problems) atm.

...

...
Just tell me your opinion, also when you support this ;)

absolutely.

-- Adrian Schroeter SUSE Linux Products GmbH email: adrian@suse.de -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org

Sebastian Siebert

01:23

Hi, Am 23.11.2010 17:45, schrieb Adrian Schröter: [...]

...

My current plan is to remove all repositories in home projects, which have not been touched this year. Not touched means, no source submission and no meta data has been altered at all. Additionally also all non-home projects, which have not been touch in last two years.

I am agree with this solution, but ... [...]

...

Which projects will get affected exactly ? Find a full list here: http://www.suse.de/~adrian/OBS-remove-list-candidates

There is a project which has not been touched, but the repos are still anyway important ! Just drop me a mail ....

I'm a little bit confused. My repo is listed in your list as home:Freespacer.pkg 2008 But this repo is work in progress. I create some branches and submit this package to the openSUSE Factory. My repo helps me to experiment with some packages and I organize some packages as an own subproject. My home main repository is always empty, but in your listing will this repo removed. The repo is for me very important. Please take me out from the list. Every now and then, I remove myself unneeded projects or packages. On the other hand, I have linked some package or a part of the home repo in my blog and should not be removed.

...

Why not drop people a mail and ask them to remove it ? Way to many accounts have no valid email adress and past experience showed that people are often not react when they lost interesst in their project.

My opinion is that is not good, the people do not ask for the removal of the repositories. If someone has left a bad email address, then it should be deleted. No question, because they had the chance to change their email address. What speaks against sending an email with a confirmation link to confirm the preservation of the repo. Once after a specified time received no response, the repo will be deleted. It is easier to implement and with little effort. Everyone gets a chance to react onto the mail Some people have not even subscribed in the mailing list. They have no chance to appeal their objection.

...

May plan is to do the removal end of this week, except more discussion about this is needed.

Just tell me your opinion, also when you support this ;)

-- Kind regards, Sebastian - openSUSE Member (Freespacer) Website/Blog: http://www.sebastian-siebert.de Important notes on openSUSE Mailing List: http://en.opensuse.org/OpenSUSE_mailing_list_netiquette -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org

Jon Nelson

25 Nov 25 Nov

14:33

New subject: [opensuse-buildservice] Re: [opensuse-packaging] OBS cleanup -> removal of outdated repositories

On Tue, Nov 23, 2010 at 10:45 AM, Adrian Schröter wrote:

...

Hi,

Please excuse the cross post. You may have noticed that we have higher and higher build load on build.o.o. While the new dispatcher algorithms are still good to prefer the "right" jobs, it is still a sign that we may should cleanup.

My current plan is to remove all repositories in home projects, which have not been touched this year. Not touched means, no source submission and no meta data has been altered at all. Additionally also all non-home projects, which have not been touch in last two years.

What about built binaries for projects that no longer exist? I branched a few things over the last year or two, and eventually deleted those projects. However, the build results for those projects still exist. Perhaps you could wipe build results (and directories) for projects which don't exist anymore? -- Jon -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org

Adrian Schröter

5 Dec 5 Dec

15:30

New subject: [opensuse-buildservice] Re: [opensuse-packaging] OBS cleanup -> removal of outdated repositories

JFYI, the cleanup script is running now. The schedulers will be busy in next hours to cleanup the removed repos (and open build jobs). I should have a backup for some days of the removed data in worst case. bye adrian On Thursday 25 November 2010 08:33:00 Jon Nelson wrote:

...

On Tue, Nov 23, 2010 at 10:45 AM, Adrian Schröter wrote:

...
Hi,

Please excuse the cross post. You may have noticed that we have higher and higher build load on build.o.o. While the new dispatcher algorithms are still good to prefer the "right" jobs, it is still a sign that we may should cleanup.

My current plan is to remove all repositories in home projects, which have not been touched this year. Not touched means, no source submission and no meta data has been altered at all. Additionally also all non-home projects, which have not been touch in last two years.

Greg Freemyer

19:17

New subject: [opensuse-buildservice] Re: [opensuse-packaging] OBS cleanup -> removal of outdated repositories

On Sun, Dec 5, 2010 at 10:30 AM, Adrian Schröter wrote:

...

JFYI, the cleanup script is running now. The schedulers will be busy in next hours to cleanup the removed repos (and open build jobs).

I should have a backup for some days of the removed data in worst case.

bye adrian

With the assumption that most if not all packages in OBS link to openSUSE packages, it would seem logical to do this again shortly after 11.2 goes out of support. (ie. June 2011) And one criteria I did not see you have is if the package has no supported repos due to EOL of repos. Seems like a natural addition. Greg -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org

Adrian Schröter

6 Dec 6 Dec

07:49

New subject: [opensuse-buildservice] Re: [opensuse-packaging] OBS cleanup -> removal of outdated repositories

The cleanup is done now. Affected projects got a note in their description. Please speak up if you see any problems. On Sunday 05 December 2010 14:17:27 Greg Freemyer wrote:

...

On Sun, Dec 5, 2010 at 10:30 AM, Adrian Schröter wrote:

...
JFYI, the cleanup script is running now. The schedulers will be busy in next hours to cleanup the removed repos (and open build jobs).

I should have a backup for some days of the removed data in worst case.

bye adrian

With the assumption that most if not all packages in OBS link to openSUSE packages, it would seem logical to do this again shortly after 11.2 goes out of support. (ie. June 2011)

Actually, 11.1 is next. And we do this, we move EOL base distributions below DISCONTINUED: and remove after some time all repos building against the original project. This cleanup action was in first place targeting Factory repos, because Factory is always active, but not all projects building against it anymore .. bye adrian

...

And one criteria I did not see you have is if the package has no supported repos due to EOL of repos. Seems like a natural addition.

Greg -- Adrian Schroeter SUSE Linux Products GmbH email: adrian@suse.de

-- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org

4894

Age (days ago)

4907

Last active (days ago)

List overview

Download

9 comments

5 participants

participants (5)

Adrian Schröter
Greg Freemyer
Jon Nelson
Patrick Shanahan
Sebastian Siebert

[opensuse-buildservice] OBS cleanup -> removal of outdated repositories

tags

participants (5)