[opensuse-buildservice] disable parallel builds via meta data
Hi, Parallel building seems to be enabled for Ubuntu / Debian. Debian itself doesn't use parallel building afaik and I do experience some problems with it on obs. Wouldn't it be possible to add a feature which allows to disable parallel builds via packages meta data so one doesn´t have to change any broken packages imported from debian or buntu but can simply fix it by modifying the meta data? Thanks in advance, ~P -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org
Am Montag, 21. März 2011, 20:13:15 schrieb peer:
Hi,
Parallel building seems to be enabled for Ubuntu / Debian. Debian itself doesn't use parallel building afaik and I do experience some problems with it on obs.
Wouldn't it be possible to add a feature which allows to disable parallel builds via packages meta data so one doesn´t have to change any broken packages imported from debian or buntu but can simply fix it by modifying the meta data?
We can go back to use only -j1 for debian builds, but there will be not a good way to increase it again atm. (would come with some more sophisticated workers later one). The only technical clean solution is to fix the debian packages, I think. However, when really the mass of them are broken, we may should consider to got back. Do you have a feeling how many of them are affected ? -- Adrian Schroeter SUSE Linux Products GmbH email: adrian@suse.de -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org
On 03/22/2011 09:14 AM, Adrian Schröter wrote:
Am Montag, 21. März 2011, 20:13:15 schrieb peer:
Hi,
Parallel building seems to be enabled for Ubuntu / Debian. Debian itself doesn't use parallel building afaik and I do experience some problems with it on obs.
Wouldn't it be possible to add a feature which allows to disable parallel builds via packages meta data so one doesn´t have to change any broken packages imported from debian or buntu but can simply fix it by modifying the meta data?
However, when really the mass of them are broken, we may should consider to got back. Do you have a feeling how many of them are affected ?
I have not a good picture of the amount of broken packages atm. Maybe others can jump in ... ~P -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org
On Tuesday March 22 2011 09:14:09 Adrian Schröter wrote:
Am Montag, 21. März 2011, 20:13:15 schrieb peer:
Hi,
Parallel building seems to be enabled for Ubuntu / Debian. Debian itself doesn't use parallel building afaik and I do experience some problems with it on obs.
Wouldn't it be possible to add a feature which allows to disable parallel builds via packages meta data so one doesn´t have to change any broken packages imported from debian or buntu but can simply fix it by modifying the meta data?
We can go back to use only -j1 for debian builds, but there will be not a good way to increase it again atm. (would come with some more sophisticated workers later one).
The only technical clean solution is to fix the debian packages, I think.
However, when really the mass of them are broken, we may should consider to got back. Do you have a feeling how many of them are affected ?
The packages only break is upstreams source is broken - which hopefully should be the minority (for me it was one package). Still, since debian doesn´t have something like %_smp_mflags some setting in pkgs meta would be the easiest since one then doesn´t have to modify the original package (if one imports a debian / buntu package). Please add something like this and leave parallel builds enabled. regards, Stephan -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org
On Tuesday March 22 2011 09:14:09 Adrian Schröter wrote:
The only technical clean solution is to fix the debian packages, I think.
In an ideal world, yes. In real life it is very common that tools have to cope with broken software. Fixing race conditions a large package's makefile is not trivial, especially for somebody who basically doesn't know the package. On Tue, 22 Mar 2011 21:22:01 +0100 Stephan Kleine wrote:
Still, since debian doesn´t have something like %_smp_mflags some setting in pkgs meta would be the easiest since one then doesn´t have to modify the original package (if one imports a debian / buntu package).
A correct Debian package will check for the environment variable DEB_BUILD_OPTIONS and one can disable parallel make by setting it like this: DEB_BUILD_OPTIONS=parallel=1 I'm not sure how commonly Debian packages implement this correctly, but even if some package would fail to do so fixing that is trivial even for somebody not familiar with the package.
Please add something like this
Just supporting setting environment variables from metadata would solve the parallel builds issue and might have other useful use cases. Well, OBS is open source so just asking for more features might not be the fastest approach to get it done. Unfortunately I have no clue, which parts of the not so small source to look at. If somebody could give a hint.
and leave parallel builds enabled.
votes++ Regards, Uwe Uwe Geuder Nomovok Ltd. Tampere, Finland uwe.gXuder@nomovok.com (bot check: correct 1 obvious spelling error) -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org
Am Mittwoch, 23. März 2011, 07:59:54 schrieb Uwe Geuder:
On Tuesday March 22 2011 09:14:09 Adrian Schröter wrote: ... On Tue, 22 Mar 2011 21:22:01 +0100 Stephan Kleine wrote:
Still, since debian doesn´t have something like %_smp_mflags some setting in pkgs meta would be the easiest since one then doesn´t have to modify the original package (if one imports a debian / buntu package).
A correct Debian package will check for the environment variable DEB_BUILD_OPTIONS and one can disable parallel make by setting it like this:
DEB_BUILD_OPTIONS=parallel=1
I'm not sure how commonly Debian packages implement this correctly, but even if some package would fail to do so fixing that is trivial even for somebody not familiar with the package.
Please add something like this
Just supporting setting environment variables from metadata would solve the parallel builds issue and might have other useful use cases. Well, OBS is open source so just asking for more features might not be the fastest approach to get it done. Unfortunately I have no clue, which parts of the not so small source to look at. If somebody could give a hint.
I would implement this via a prjconf feature. Something like ParrallelBuildJobs: 1 Support for such a keyword would be needed to get added to the build script: git clone git@gitorious.org:opensuse/build.git Have also a look at the commit which introduced parrallel build for debian: cd8192f0e9cf89e76e9f3dca6d6400018f7028f4
and leave parallel builds enabled.
votes++
Regards,
Uwe
Uwe Geuder Nomovok Ltd. Tampere, Finland uwe.gXuder@nomovok.com (bot check: correct 1 obvious spelling error)
-- Adrian Schroeter SUSE Linux Products GmbH email: adrian@suse.de -- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org
On Wednesday March 23 2011 07:57:49 Adrian Schröter wrote:
Am Mittwoch, 23. März 2011, 07:59:54 schrieb Uwe Geuder:
On Tuesday March 22 2011 09:14:09 Adrian Schröter wrote: ...
On Tue, 22 Mar 2011 21:22:01 +0100 Stephan Kleine wrote:
Still, since debian doesn´t have something like %_smp_mflags some setting in pkgs meta would be the easiest since one then doesn´t have to modify the original package (if one imports a debian / buntu package).
A correct Debian package will check for the environment variable DEB_BUILD_OPTIONS and one can disable parallel make by setting it like this:
DEB_BUILD_OPTIONS=parallel=1
I'm not sure how commonly Debian packages implement this correctly, but even if some package would fail to do so fixing that is trivial even for somebody not familiar with the package.
Please add something like this
Just supporting setting environment variables from metadata would solve the parallel builds issue and might have other useful use cases. Well, OBS is open source so just asking for more features might not be the fastest approach to get it done. Unfortunately I have no clue, which parts of the not so small source to look at. If somebody could give a hint.
I would implement this via a prjconf feature. Something like
IMHO prjconf is the wrong place since that would be all or nothing for the whole project. It should be in the packages meta so parallel builds can be disabled just for a single package while building all others still in parallel.
ParrallelBuildJobs: 1
Support for such a keyword would be needed to get added to the build script:
git clone git@gitorious.org:opensuse/build.git
Have also a look at the commit which introduced parrallel build for debian:
cd8192f0e9cf89e76e9f3dca6d6400018f7028f4
and leave parallel builds enabled.
votes++
Regards,
Uwe
Uwe Geuder Nomovok Ltd. Tampere, Finland uwe.gXuder@nomovok.com (bot check: correct 1 obvious spelling error)
-- To unsubscribe, e-mail: opensuse-buildservice+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-buildservice+help@opensuse.org
participants (4)
-
Adrian Schröter -
peer -
Stephan Kleine -
Uwe Geuder