Some of the tests in our test suite are based on timing, and timing,
certainly when used with parallel testing, is kinda awkward.
If someone feels up to it to make these tests less vulnerable to small
timing glitches, I/we would probably get a lot more white/green smoke
reports.
Some FAIL excepts from recent smokes for Linux and HP-UX, clearly
showing the randomness in configurations:
Failures: (common-args) none
[perlio/univ.utf8] -DDEBUGGING
[perlio] -Duse64bitall
[univ.utf8] -DDEBUGGING -Duseithreads
../cpan/Time-HiRes/t/HiRes.t................................FAILED
46-47
Failures: (common-args) -Dcc=gcc
[perlio] -DDEBUGGING -Duse64bitall
[univ.utf8] -Duseithreads
[perlio] -DDEBUGGING -Duseithreads -Duse64bitall
../cpan/Time-HiRes/t/HiRes.t................................FAILED
46-47
Failures: (common-args) -Dcc=gcc
[perlio] -DDEBUGGING -Duseithreads
../dist/threads-shared/t/waithires.t........................FAILED
Non-zero exit status: 1
Bad plan. You planned 57 tests but ran 14.
Failures: (common-args) none
[perlio] -DDEBUGGING -Duseithreads
../cpan/Time-HiRes/t/HiRes.t................................FAILED
42-43
Failures: (common-args) -Dcc=g++
[perlio] -DDEBUGGING -Duseithreads -Duse64bitall
../dist/threads-shared/t/waithires.t........................FAILED
Non-zero exit status: 1
Bad plan. You planned 57 tests but ran 32.
Failures: (common-args) -Dcc=gcc
[stdio]
../t/op/alarm.t.............................................FAILED
2
[univ.utf8] -DDEBUGGING
../cpan/Time-HiRes/t/HiRes.t................................FAILED
46-47
Failures: (common-args) -Dcc=g++
[perlio] -DDEBUGGING -Duse64bitall
../t/op/sselect.t...........................................FAILED
10
Failures: (common-args) none
[perlio] -DDEBUGGING
[univ.utf8] -DDEBUGGING -Duseithreads -Duse64bitall
../cpan/Time-HiRes/t/HiRes.t................................FAILED
46-47
Failures: (common-args) none
[perlio] -Dmad -Duselongdouble
../t/op/sselect.t...........................................FAILED
10
Failures: (common-args) -Dcc=gcc
[stdio] -DDEBUGGING -Duseithreads
../dist/threads-shared/t/waithires.t........................FAILED
Non-zero exit status: 1
Bad plan. You planned 57 tests but ran 32.
[stdio] -DDEBUGGING -Duseithreads -Duse64bitall
../dist/threads-shared/t/waithires.t........................FAILED
Non-zero exit status: 1
Bad plan. You planned 57 tests but ran 14.
Failures: (common-args) -Dcc=gcc
[perlio]
../cpan/Time-HiRes/t/HiRes.t................................FAILED
42-43, 46-47
Failures: (common-args) -Dcc=gcc
[univ.utf8] -DDEBUGGING -Duse64bitall
../t/op/alarm.t.............................................FAILED
2
[perlio] -DDEBUGGING -Duseithreads
../cpan/Time-HiRes/t/HiRes.t................................FAILED
46-47
--
H.Merijn Brand http://tux.nl Perl Monger http://amsterdam.pm.org/
using 5.00307 through 5.12 and porting perl5.13.x on HP-UX 10.20, 11.00,
11.11, 11.23 and 11.31, OpenSuSE 10.1, 11.0 .. 11.3 and AIX 5.2 and 5.3.
http://mirrors.develooper.com/hpux/ http://www.test-smoke.org/
http://qa.perl.org http://www.goldmark.org/jeff/stupid-disclaimers/