develooper Front page | perl.perl5.porters | Postings from February 2013

[perl #7315] test harness testing a wrong executable

Thread Previous
From:
James E Keenan via RT
Date:
February 24, 2013 23:42
Subject:
[perl #7315] test harness testing a wrong executable
Message ID:
rt-3.6.HEAD-31961-1361749364-291.7315-15-0@perl.org
On Sun Jul 22 06:23:50 2001, ilya@math.ohio-state.edu wrote:
> This is a bug report for perl from ilya@math.math.ohio-state.edu,
> generated with the help of perlbug 1.33 running under perl v5.7.2.
> 
> ---
> Flags:
>     category=install
>     severity=medium
> ---
> 
> Reproduce as:
> 
>   make test
>   cp perl perl-t
>   cd t
>   mv perl perl-t
>   env PERL=./perl ./perl-t harness
> 
> This emulates the newer test harness which links a flavor of perl to
> a similar-named file in ./t.  This is a good thing.  The only drawback
> is that a lot of test files test './perl' instead of $ENV{PERL} ||
>    './perl'.
> 
> The only difference of this try and of the test engine is that we
> *remove* ./perl, so are able to see which tests are using a wrong
> executable.  Note that with TEST instead of harness the test won't
> even start.
> 
> Here are the results:
> 
> Failed 21/427 test scripts, 95.08% okay. 734/24167 subtests failed,
>    96.96% okay.
> Failed Test                  Stat Wstat Total Fail  Failed  List of
>    Failed
>
-------------------------------------------------------------------------------
> ../ext/IO/lib/IO/t/io_pipe.t               10    2  20.00%  1 3
> ../lib/IPC/Open2.t                          7    2  28.57%  3 7
> ../lib/strict.t                            93   63  67.74%  2-10 15-17
>    20-21
>                                                             23-25 27-
>    29 33-36
>                                                             38-45 48-
>    49 51-53
>                                                             55-58 64-
>    68 71-73
>                                                             75-77 79-
>    82 87-93
> ../lib/subs.t                               9    9 100.00%  1-9
> ../lib/warnings.t                         438  366  83.56%  2-4 6 8-11
>    13-16
>                                                             18-19 24-
>    31 34-35
>                                                             37-39 41-
>    43 45-47
>                                                             49-54 57-
>    58 62-63
>                                                             65-66 69-
>    70 72-74
>                                                             76-92 111
>    113-116
>                                                             118-119
>    122-127
>                                                             130-211
>    213-219 221
>                                                             223-224
>    227 229-233
>                                                             235-265
>    267-278
>                                                             280-284
>    286-287
>                                                             289-299
>    301 303
>                                                             305-314
>    316 318-325
>                                                             327-355
>    357 359-398
>                                                             400 402
>    404-405
>                                                             407-438
> comp/cpp.t                                 ??   ??       %  ??
> comp/script.t                               3    3 100.00%  1-3
> io/argv.t                                  21    3  14.29%  1-3
> io/open.t                                  70   10  14.29%  25-26 28-
>    30 57-58
>                                                             60-62
> op/anonsub.t                                4    4 100.00%  1-4
> op/closure.t                    0    13   171  150  87.72%  22-171
> op/fork.t                                  18   18 100.00%  1-18
> op/goto.t                                  22    1   4.55%  3
> op/magic.t                                 41    5  12.20%  3-4 15 23-
>    24
> op/misc.t                                  83   61  73.49%  2-4 7 10
>    14-16 19-
>                                                             22 25-40
>    42-43 46-
>                                                             57 59-69
>    71-72 77-
>                                                             82
> op/rand.t                       1   256    11    1   9.09%  11
> op/runlevel.t                              21   20  95.24%  1-14 16-21
> op/split.t                                 45    1   2.22%  11
> op/stat.t                                  58    1   1.72%  43
> op/taint.t                                174    4   2.30%  1 3 31 37
> run/runenv.t                               10   10 100.00%  1-10
>  (3 subtests UNEXPECTEDLY SUCCEEDED), 8 tests and 86 subtests skipped.
> 
> Note also how bad is the formatting with the new Test::Harness, which
> grabs a lot of space for the test name, leaving too little space for
> the list of failing subtests.
> 
> Yours,
> Ilya
> 
> ---
> Site configuration information for perl v5.7.2:
> 
> Configured by ilya at Sun Jul 22 15:40:38 EDT 2001.
> 
> Summary of my perl5 (revision 5.0 version 7 subversion 2)
>    configuration:

This ticket was filed more than 11-1/2 years ago, but no one has
supported the thrust of the original complaint in all that time.

If someone has complaints about the test harnesses we use in the core
distribution, it would probably be better to open a new ticket.

I recommend this ticket be closed.

Thank you very much.
Jim Keenan

---
via perlbug:  queue: perl5 status: open
https://rt.perl.org:443/rt3/Ticket/Display.html?id=7315

Thread Previous


nntp.perl.org: Perl Programming lists via nntp and http.
Comments to Ask Bjørn Hansen at ask@perl.org | Group listing | About