Nicholas Clark <nick@ccl4.org> writes: > On Wed, Nov 16, 2011 at 11:56:53PM -0800, Michael G Schwern wrote: >> On 2011.11.16 11:16 PM, H.Merijn Brand wrote: >> >> * Make a realistic benchmark suite of both performance and memory [4] >> >> * Set up a smoker to the benchmarks and report significant differences >> >> and performance creeps to p5p, like with tests > > I think that at least part of this is what Steffen Schwigon is trying to > do with Benchmark::Perl::Formance > > https://metacpan.org/module/Benchmark::Perl::Formance Indeed. And I even have the whole infrastructure available[1], currently just polishing on minor-minor detail struggles before it continuously runs against Perl's git repo: http://speed.perlformance.net/ http://perlformance.net/ (both currently only contain just example runs). It doesn't work with 5.6, but from 5.8.x+. So whoever wants to have code benchmarked only needs to put the micro snippets into a plugin like http://search.cpan.org/~schwigon/Benchmark-Perl-Formance/lib/Benchmark/Perl/Formance/Plugin/Skeleton.pm and I will take care of all the other stuff. I had it nearly finished on the last QA hackathon and took the last weeks to re-setup after my server crashed before YAPC::EU. I'm out for a long weekend, but it will continuously run from next week, really. :-) Kind regards, Steffen Footnotes: [1] consisting of one server with webseite, result db, evaluation api, and graph render gui and another server dedicated only for nothing else than running benchmarks without disturbance by web, email & friends. -- Steffen Schwigon <ss5@renormalist.net> Dresden Perl Mongers <http://dresden-pm.org/>