develooper Front page | perl.module.build | Postings from May 2013

Re: running Build... how to run parallel?

Thread Previous
From:
Linda W
Date:
May 24, 2013 21:59
Subject:
Re: running Build... how to run parallel?
Message ID:
519D63B7.1010108@tlinx.org



Leon Timmermans wrote:
>
> Module::Build does not have a feature. This is generally considered
> unfortunate, but can not be changed anymore. A future replacement of
> Module::Build might support it though. Though to be honest, MakeMaker
> write out makefiles that are not particularly parallelizable, and even
> if it did most build-times aren't long enough to benefit much from
> them.
----

 It was only because I was having to build and rebuild a long-taking
module with many single unit C compiles (Wx), that it came up.

        Usually not so much an issue, due to short time, but on that one and
with the number of times till got it right... Ug...

>
> Actually, «./Build test»/«make test» does support parallelization
> using the HARNESS_OPTIONS environmental variable, though this an
> undocumented (AFAIK) implementation detail.

Yeah... have noticed / tried it -- didn't add as much speed as parallel
building -- I think the tests are more often built in a layered fashion,
where it doesn't make sense to test "paragraph reading", if "letter
recognition" or "file read" hasn't been tested yet.  Not too many
modules have so many parallel components that so separate as to benefit
from parallel testing, but most of the larger ones can benefit from
parallel builds.

Perl can benefit from parallel testing to an extent -- but I don't think
it gives even a 2x speed boost w/12cpus... vs. building... the unicode
tests are really LONG... (not that unicode isn't worth it or
complicated, just that they stand out in length!)...



>  I would rather like to add a more comprehensive option for this TBH.
----

So many dreams, so little of one's self to 'go around'...

Thanks for the reply... I was thinking it not likely, but I
didn't want to make "assumptions", and feel dumb later ... ;-)




Thread Previous


nntp.perl.org: Perl Programming lists via nntp and http.
Comments to Ask Bjørn Hansen at ask@perl.org | Group listing | About