develooper Front page | perl.perl6.internals | Postings from January 2008

[perl #50380] [TODO]: override Test::Harness summary method to provide better-looking test result summary

Thread Previous
From:
Jerry Gay
Date:
January 29, 2008 11:27
Subject:
[perl #50380] [TODO]: override Test::Harness summary method to provide better-looking test result summary
# New Ticket Created by  Jerry Gay 
# Please include the string:  [perl #50380]
# in the subject line of all future correspondence about this issue. 
# <URL: http://rt.perl.org/rt3/Ticket/Display.html?id=50380 >


test::harness 3 is wonderful, except where it's rough around the
edges. in particular, the test summary report is much noisier than
that of it's predecessor. it'd be great if the test names were
visually separated from the summary info, so they could be easily
selected from the console in order to fix the tests.

you may be on a platform that supports color in consoles, where this
isn't so much of an issue, but i'm not. where we now have a report
like:

Test Summary Report
-------------------
t\spec\S02-literals\radix.rakudo    (Wstat: 256 Tests: 86 Failed: 6)
  Failed tests:  47-48, 76-79
  Non-zero exit status: 1
t\spec\S03-operators\autoincrement.t (Wstat: 0 Tests: 42 Failed: 12)
  Failed tests:  31-42
t\spec\S04-statements\while.rakudo  (Wstat: 256 Tests: 10 Failed: 0)
  Non-zero exit status: 1
t\spec\S29-array\kv.rakudo          (Wstat: 256 Tests: 9 Failed: 0)
  Non-zero exit status: 1
t\spec\S29-array\pairs.rakudo       (Wstat: 256 Tests: 10 Failed: 0)
  Non-zero exit status: 1
t\spec\S29-array\pop.rakudo         (Wstat: 256 Tests: 1 Failed: 0)
  Non-zero exit status: 1
  Parse errors: Bad plan.  You planned 27 tests but ran 1.
t\spec\S29-array\push.rakudo        (Wstat: 256 Tests: 1 Failed: 0)
  Non-zero exit status: 1
  Parse errors: Bad plan.  You planned 42 tests but ran 1.

i want to see something more like:

Test Summary Report
-------------------
t\spec\S02-literals\radix.rakudo    (Wstat: 256 Tests: 86 Failed: 6)
                                    Failed tests:  47-48, 76-79
                                    Non-zero exit status: 1
t\spec\S03-operators\autoincrement.t (Wstat: 0 Tests: 42 Failed: 12)
                                    Failed tests:  31-42
t\spec\S04-statements\while.rakudo  (Wstat: 256 Tests: 10 Failed: 0)
                                    Non-zero exit status: 1
t\spec\S29-array\kv.rakudo          (Wstat: 256 Tests: 9 Failed: 0)
                                    Non-zero exit status: 1
t\spec\S29-array\pairs.rakudo       (Wstat: 256 Tests: 10 Failed: 0)
                                    Non-zero exit status: 1
t\spec\S29-array\pop.rakudo         (Wstat: 256 Tests: 1 Failed: 0)
                                    Non-zero exit status: 1
                                    Parse errors: Bad plan.
                                    You planned 27 tests but ran 1.
t\spec\S29-array\push.rakudo        (Wstat: 256 Tests: 1 Failed: 0)
                                    Non-zero exit status: 1
                                    Parse errors: Bad plan.
                                    You planned 42 tests but ran 1.

chromatic has even given us a hint on how to do it. see
http://www.oreillynet.com/onlamp/blog/2007/03/cpan_module_review_tapparser.html

~jerry

Thread Previous


Comments to Ask Bjørn Hansen at ask@perl.org | Group listing | About