develooper Front page | perl.perl5.porters | Postings from January 2008

RE: [perl #50352] Perl 5.10 Storable extremely slow for large trees of data

Thread Previous | Thread Next
Steve Hay
January 30, 2008 02:56
RE: [perl #50352] Perl 5.10 Storable extremely slow for large trees of data
Message ID:
Nicholas Clark wrote:
> On Wed, Jan 30, 2008 at 09:59:05AM -0000, Steve Hay wrote:
>> OK, that gets it building and it passed all tests still.
>> Unfortunately, it's no quicker than 2.18 was with my
>> 5.10/system-malloc build (about 2.3 secs with either version). (I
>> had to manually delete the 2.18 version that ships with 5.10 from
>> the lib/ folder, because 
>> 1.0.14 installed into site/lib/.)
> So is this Storable speed difference solely the difference between
> system malloc and Perl's malloc?

It's the only significant difference that I've found.

To summarize:
There's not much difference between 2.18 and 1.0.14 (2.7s and 2.3s
respectively with 5.10).
There's also not much difference between 2.18 and 2.12 (0.9s (with
5.6.2) and 0.7s (with 5.6.0) respectively).
There was more of a difference between 5.10.0 and 5.6.2 (2.7s and 0.9s
respectively with 2.18), but Clinton suggested having seen a much bigger

The only real big difference that I've seen is switching to perl's
malloc, which drops the time down to hundredths of a second with
whatever perl or Storable, but Clinton's old 5.6.0 wasn't using perl's
malloc, so I don't know what the cause is in his case.

Clinton, what times do you actually get from your 5.6.0 vs 5.10.0
set-ups (I've been using Time::HiRes to time just the freeze() call
itself)? Are they both running on the same machine? I assume that you're
using the Storable that ships with 5.10.0, but where did that in your
5.6.0 build come from? Your perl -V showed that you were using
ActivePerl Build 623, but that doesn't have Storable in it. Did you
build it yourself? If so, which compiler did you use?

Thread Previous | Thread Next Perl Programming lists via nntp and http.
Comments to Ask Bjørn Hansen at | Group listing | About