On 08/13/2011 06:23 PM, Chip Salzenberg wrote: > On Sat, Aug 13, 2011 at 8:00 AM, Nicholas Clark<nick@ccl4.org> wrote: >> I'd feel a lot calmer if someone were able to test build CPAN (ie as much >> of it as possible for their OS etc) and compare this branch to blead > > That's a test I had planned anyway. It's been done before; is there a > test harness already, or did everyone make it up as they went? I did it for ExtUtils::ParseXS. It was done the silly, manual way because I underestimated the amount of work involved. 1) I asked for somebody with the appropriate tools set up to run a CPAN smoke with my branch. Steven Schubiger volunteered to help with that. 2) As reports came in, I reran all non-obvious FAILs manually once with blead and once with my branch and checked the result. This was a lot of work and I would rather not do that again. If I had to, I'd most certainly try to automate more. One obvious way to try to improve the process would be to have the same machine smoke both branches and then look at only the dists where the result is different. --SteffenThread Previous | Thread Next