[opensuse-packaging] Parallel automake
For those that like to experiment I have a hint. From automake.info: If the environment variable `AUTOMAKE_JOBS' contains a positive number, it is taken as the maximum number of Perl threads to use in `automake' for generating multiple `Makefile.in' files concurrently. This is an experimental feature. This is in automake since 1.11 and given perls rather high thread spawning overhead only shows real speed-ups in large projects (report was significant savings in a project with 150 Makefiles). Philipp -- To unsubscribe, e-mail: opensuse-packaging+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-packaging+help@opensuse.org
On Mon, Nov 02, 2009 at 02:14:43PM +0100, Philipp Thomas wrote:
For those that like to experiment I have a hint. From automake.info:
If the environment variable `AUTOMAKE_JOBS' contains a positive number, it is taken as the maximum number of Perl threads to use in `automake' for generating multiple `Makefile.in' files concurrently. This is an experimental feature.
This is in automake since 1.11 and given perls rather high thread spawning overhead only shows real speed-ups in large projects (report was significant savings in a project with 150 Makefiles).
yast2-core: 138*Makefile.am, 18s -> 7s Another interesting feature is AM_SILENT_RULES: http://mvidner.blogspot.com/2009/06/cool-features-in-automake-111.html -- Martin Vidner, YaST developer http://en.opensuse.org/User:Mvidner Kuracke oddeleni v restauraci je jako fekalni oddeleni v bazenu
On 02/11/09 10:14, Philipp Thomas wrote:
For those that like to experiment I have a hint. From automake.info:
If the environment variable `AUTOMAKE_JOBS' contains a positive
Do you have suggestions for a sane AUTOMAKE_JOBS value ? -- To unsubscribe, e-mail: opensuse-packaging+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-packaging+help@opensuse.org
* Cristian Rodríguez (crrodriguez@opensuse.org) [20091109 02:44]:
Do you have suggestions for a sane AUTOMAKE_JOBS value ?
I haven't yet used that feature, so I can't recommend anything. Philipp -- To unsubscribe, e-mail: opensuse-packaging+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-packaging+help@opensuse.org
On Mon, Nov 09, 2009 at 05:35:33PM +0100, Philipp Thomas wrote:
* Cristian Rodríguez (crrodriguez@opensuse.org) [20091109 02:44]:
Do you have suggestions for a sane AUTOMAKE_JOBS value ?
I haven't yet used that feature, so I can't recommend anything.
I did not save the benchmarks, but I ended up using the number of processors, which was not optimal, but good enough: export AUTOMAKE_JOBS=$(grep '^processor' /proc/cpuinfo | wc -l) For "osc build", there is a --jobs=N option, so you can probably use an analogy of make %{?jobs:-j%jobs} (not tested by me) -- Martin Vidner, YaST developer http://en.opensuse.org/User:Mvidner Kuracke oddeleni v restauraci je jako fekalni oddeleni v bazenu
participants (3)
-
Cristian Rodríguez
-
Martin Vidner
-
Philipp Thomas