Silently failing tests

In a prelude to junking vms/test.com in favor of t/TEST I ran "perl
harness" for laughs.  Well, it works all too well.  test.com was
shielding against a bunch of problems.

base/lex..............................ok 11/54                               
%DCL-W-UNDSYM, undefined symbol - check validity and spelling
base/lex..............................ok 13/54Test output counter mismatch [test 13]
base/lex..............................FAILED test 12                         
        Failed 1/54 tests, 98.15% okay
base/term.............................ok 1/7                                 
%DCL-W-UNDSYM, undefined symbol - check validity and spelling
base/term.............................FAILED test 2                          
        Failed 1/7 tests, 85.71% okay

The use `echo`, nothing that can't be cleaned up.


io/open...............................ok 64/70                               
%DCL-W-INSFPRM, missing command parameters - supply all required parameters
io/open...............................ok 65/70                               
%DCL-W-INSFPRM, missing command parameters - supply all required parameters

This too is an echo issue, I think.


op/magic..............................ok 15/44                               
op/magic..............................ok, 6/44 skipped: various reasons, 1/44 un
expectedly succeeded

That's actually *good*!  Means something that was busted has been
fixed.  Its the test that makes sure $! = undef doesn't throw a
warning.


op/stat...............................FAILED tests 1, 48                     
        Failed 2/73 tests, 97.26% okay (-24 skipped tests: 47 okay, 64.38%)

Test #1 is the nlink problem noted eariler.  Known issue.  #48 is
checking of STDIN is a TTY.  This works on Unix in the harness but not
here.  Ideas?


[-.lib]ExtUtils.......................
                                      Can't pipe "$1$dkb300:[schwern.src.bleadpe
rl.000000]perl.exe;1 -x "-I../../lib" Makefile.PL PERL_CORE=1": no such device a
[-.lib]ExtUtils.......................NOK 1                                  
[-.lib]ExtUtils.......................dubious                                
        Test returned status 44 (wstat 1024, 0x400)
                (VMS status is 44)
DIED. FAILED tests 1-27
        Failed 27/27 tests, 0.00% okay

Kablam.  vms/test.com is not running this test at all for some reason.
I don't think it expects to find a .t file in lib/.

File::Spec->rel2abs apears to be doing the wrong thing with $^X.

$ perl -wle "print $^X;  use File::Spec;  print File::Spec->rel2abs($^X)"
$1$dkb300:[schwern.src.bleadperl.][000000]perl.exe;1
$1$dkb300:[schwern.src.bleadperl.000000]perl.exe;1


Here's the real verdict:

Failed Test       Stat Wstat Total Fail  Failed  List of Failed
-------------------------------------------------------------------------------
[-.lib]ExtUtils.t   44  1024    27   27 100.00%  1-27
base/lex.t                      54    1   1.85%  12
base/term.t                      7    1  14.29%  2
op/stat.t                       73    2   2.74%  1 48
run/switches.t                  14   12  85.71%  1-6 8-12 14
 (1 subtest UNEXPECTEDLY SUCCEEDED), 47 tests and 245 subtests skipped.
Failed 5/530 test scripts, 99.06% okay. 43/33405 subtests failed, 99.87% okay.
%SYSTEM-F-ABORT, abort


-- 

Michael G. Schwern   <schwern@pobox.com>    http://www.pobox.com/~schwern/
Perl Quality Assurance	    <perl-qa@perl.org>	       Kwalitee Is Job One
come sing my fun song
my bologna has a first name
p a s t e
	-- Fmh

• Silently failing tests by Michael G Schwern
• Re: Silently failing tests by PPrymmer
• Re: Silently failing tests by Michael G Schwern
• Re: Silently failing tests by Craig A. Berry
• Re: Silently failing tests by Michael G Schwern