develooper Front page | perl.perl5.porters | Postings from July 2001

[ID 20010722.001] test harness testing a wrong executable

Thread Next
From:
ilya
Date:
July 22, 2001 13:23
Subject:
[ID 20010722.001] test harness testing a wrong executable
Message ID:
200107222023.f6MKNjF14918@math.ohio-state.edu
This is a bug report for perl from ilya@math.math.ohio-state.edu,
generated with the help of perlbug 1.33 running under perl v5.7.2.

---
Flags:
    category=install
    severity=medium
---

Reproduce as:

  make test
  cp perl perl-t
  cd t
  mv perl perl-t
  env PERL=./perl ./perl-t harness

This emulates the newer test harness which links a flavor of perl to
a similar-named file in ./t.  This is a good thing.  The only drawback
is that a lot of test files test './perl' instead of $ENV{PERL} || './perl'.

The only difference of this try and of the test engine is that we
*remove* ./perl, so are able to see which tests are using a wrong
executable.  Note that with TEST instead of harness the test won't
even start.

Here are the results:

Failed 21/427 test scripts, 95.08% okay. 734/24167 subtests failed, 96.96% okay.
Failed Test                  Stat Wstat Total Fail  Failed  List of Failed
-------------------------------------------------------------------------------
../ext/IO/lib/IO/t/io_pipe.t               10    2  20.00%  1 3
../lib/IPC/Open2.t                          7    2  28.57%  3 7
../lib/strict.t                            93   63  67.74%  2-10 15-17 20-21
                                                            23-25 27-29 33-36
                                                            38-45 48-49 51-53
                                                            55-58 64-68 71-73
                                                            75-77 79-82 87-93
../lib/subs.t                               9    9 100.00%  1-9
../lib/warnings.t                         438  366  83.56%  2-4 6 8-11 13-16
                                                            18-19 24-31 34-35
                                                            37-39 41-43 45-47
                                                            49-54 57-58 62-63
                                                            65-66 69-70 72-74
                                                            76-92 111 113-116
                                                            118-119 122-127
                                                            130-211 213-219 221
                                                            223-224 227 229-233
                                                            235-265 267-278
                                                            280-284 286-287
                                                            289-299 301 303
                                                            305-314 316 318-325
                                                            327-355 357 359-398
                                                            400 402 404-405
                                                            407-438
comp/cpp.t                                 ??   ??       %  ??
comp/script.t                               3    3 100.00%  1-3
io/argv.t                                  21    3  14.29%  1-3
io/open.t                                  70   10  14.29%  25-26 28-30 57-58
                                                            60-62
op/anonsub.t                                4    4 100.00%  1-4
op/closure.t                    0    13   171  150  87.72%  22-171
op/fork.t                                  18   18 100.00%  1-18
op/goto.t                                  22    1   4.55%  3
op/magic.t                                 41    5  12.20%  3-4 15 23-24
op/misc.t                                  83   61  73.49%  2-4 7 10 14-16 19-
                                                            22 25-40 42-43 46-
                                                            57 59-69 71-72 77-
                                                            82
op/rand.t                       1   256    11    1   9.09%  11
op/runlevel.t                              21   20  95.24%  1-14 16-21
op/split.t                                 45    1   2.22%  11
op/stat.t                                  58    1   1.72%  43
op/taint.t                                174    4   2.30%  1 3 31 37
run/runenv.t                               10   10 100.00%  1-10
 (3 subtests UNEXPECTEDLY SUCCEEDED), 8 tests and 86 subtests skipped.

Note also how bad is the formatting with the new Test::Harness, which
grabs a lot of space for the test name, leaving too little space for
the list of failing subtests.

Yours,
Ilya

---
Site configuration information for perl v5.7.2:

Configured by ilya at Sun Jul 22 15:40:38 EDT 2001.

Summary of my perl5 (revision 5.0 version 7 subversion 2) configuration:
  Platform:
    osname=solaris, osvers=2.8, archname=sun4-solaris
    uname='sunos math 5.8 generic_108528-08 sun4u sparc '
    config_args=''
    hint=recommended, useposix=true, d_sigaction=define
    usethreads=undef use5005threads=undef useithreads=undef usemultiplicity=undef
    useperlio=define d_sfio=undef uselargefiles=define usesocks=undef
    use64bitint=undef use64bitall=undef uselongdouble=undef
  Compiler:
    cc='cc', ccflags ='-I/usr/local/include -I/opt/local/include -I/opt/gnu/include -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64',
    optimize='-O',
    cppflags='-I/usr/local/include -I/opt/local/include -I/opt/gnu/include'
    ccversion='Sun WorkShop 6 update 1 C 5.2 2000/09/11', gccversion='', gccosandvers=''
    intsize=4, longsize=4, ptrsize=4, doublesize=8, byteorder=4321
    d_longlong=define, longlongsize=8, d_longdbl=define, longdblsize=16
    ivtype='long', ivsize=4, nvtype='double', nvsize=8, Off_t='off_t', lseeksize=8
    alignbytes=8, usemymalloc=n, prototype=define, bincompat5005=define
  Linker and Libraries:
    ld='cc', ldflags =' -L/usr/local/lib -L/opt/local/lib -L/opt/gnu/lib -L/opt/SUNWspro/WS6U1/lib '
    libpth=/usr/local/lib /opt/local/lib /opt/gnu/lib /opt/SUNWspro/WS6U1/lib /usr/lib /usr/ccs/lib
    libs=-lsocket -lnsl -lgdbm -ldl -lm -lc
    perllibs=-lsocket -lnsl -ldl -lm -lc
    libc=/lib/libc.so, so=so, useshrplib=false, libperl=libperl.a
  Dynamic Linking:
    dlsrc=dl_dlopen.xs, dlext=so, d_dlsymun=undef, ccdlflags=' '
    cccdlflags='-KPIC', lddlflags='-G -L/usr/local/lib -L/opt/local/lib -L/opt/gnu/lib -L/opt/SUNWspro/WS6U1/lib'

Locally applied patches:
    

---
@INC for perl v5.7.2:
    lib
    /home/ilya/perl
    /home/ilya/perl/lib/perl5/site_perl/5.005
    /home/ilya/perl/lib/perl5
    /home/ilya/perl/lib/perl5/site_perl
    /home/ilya/perl/lib/perl5/site_perl/sun4-solaris
    /home/ilya/perl/lib/perl5/site_perl/5.005/sun4-solaris
    /home/ilya/perl/lib/perl5/5.00503/
    /usr/local/lib/perl5/5.7.2/sun4-solaris
    /usr/local/lib/perl5/5.7.2
    /usr/local/lib/perl5/site_perl/5.7.2/sun4-solaris
    /usr/local/lib/perl5/site_perl/5.7.2
    /usr/local/lib/perl5/site_perl/5.6.0/sun4-solaris
    /usr/local/lib/perl5/site_perl/5.6.0
    /usr/local/lib/perl5/site_perl/5.005/sun4-solaris
    /usr/local/lib/perl5/site_perl/5.005
    /usr/local/lib/perl5/site_perl
    .

---
Environment for perl v5.7.2:
    HOME=/home/ilya
    LANG (unset)
    LANGUAGE (unset)
    LD_LIBRARY_PATH=/opt/X11/lib:/usr/local/lib:/opt/gnome/lib
    LOGDIR (unset)
    PATH=/home/ilya/bin:/opt/netscape:/opt/gnu/bin:/usr/local/bin:/opt/X11/bin:/usr/bin:/home/tex/bin:/opt/SUNWspro/bin:/usr/dt/bin:/usr/ccs/bin:/usr/java/bin:/opt/microsoft/bin:/usr/openwin/bin:/opt/ncar/bin/:/opt/gnome/bin:.:/opt/unsup/ilya/bin/
    PERLLIB=/home/ilya/perl:/home/ilya/perl/lib/perl5/site_perl/5.005:/home/ilya/perl/lib/perl5:/home/ilya/perl/lib/perl5/site_perl:/home/ilya/perl/lib/perl5/site_perl/sun4-solaris:/home/ilya/perl/lib/perl5/site_perl/5.005/sun4-solaris:/home/ilya/perl/lib/perl5/5.00503/
    PERL_BADLANG (unset)
    SHELL=/bin/tcsh


Thread Next


nntp.perl.org: Perl Programming lists via nntp and http.
Comments to Ask Bjørn Hansen at ask@perl.org | Group listing | About