develooper Front page | perl.perl5.porters | Postings from November 2017

[perl #132457] Time::HiRes t/alarm.t has a flapping test

Thread Previous | Thread Next
From:
James E Keenan via RT
Date:
November 20, 2017 14:56
Subject:
[perl #132457] Time::HiRes t/alarm.t has a flapping test
Message ID:
rt-4.0.24-6198-1511189782-1785.132457-15-0@perl.org
On Thu, 16 Nov 2017 20:14:32 GMT, atoomic@cpan.org wrote:
> This needs investigation, unfortunately, I do not have more details
> than this at this time.
> I hope to be able to track it pretty soon.
> 
> This is coming from a Travis CI run: https://travis-
> ci.org/p5h/perl5demo/jobs/302868505
> 
> HEAD is blead + a minor commit which does not seem related to it, and
> the test is passing on other macosx builds, view https://travis-
> ci.org/p5h/perl5demo/builds/302868502
> 
> I assume that the server was running with a high load, and everything
> was slow down...
> 
> HEAD was here
> https://github.com/p5h/perl5demo/commit/c4a18419443322ee737a9f018d43a4469dc8fa3f
> which is blead=4af7d876a8f36e9eda38116fb0b3d5e3fde025f8 +
> e1f53cba21c7687c50d535433ea1afc8b78259dd
> 
> I suggest to identify the test and skip it when ENV{CI} is set, same
> as done in cd2a978d2293dbb03a031e76b83063ff03d6a04b ( view PACKAGING
> for CI option ).
> 
> Relevant output from the travis CI log.
> 
> ____________________________________
> # Looks like you failed 1 test of 10.
>  ../dist/Time-HiRes/t/alarm.t .......................................
> Dubious, test returned 1 (wstat 256, 0x100)
> 
> Test Summary Report
> -------------------
> ../dist/Time-HiRes/t/alarm.t
> (Wstat: 256 Tests: 10 Failed: 1)
>   Failed test:  2
>   Non-zero exit status: 1
> Files=2627, Tests=1143283, 590 wallclock secs (135.12 usr 16.35 sys +
> 696.97 cusr 123.73 csys = 972.17 CPU)
> Result: FAIL
> make: *** [test_harness_notty] Error 1

I don't think this warrants any changes in our source code.  dist/Time-HiRes/t/alarm.t is a test that not infrequently fails in resource-constrained environments.

For example, it fails from time to time in the FreeBSD-10.3 VM I maintain on my laptop -- often enough that it's one of four resource-related test failures I cite in a note when I run smoke tests.  (See, e.g., http://perl5.test-smoke.org/report/59803.)

While we may want to have some discussion (on p5p list rather than in RT) of how we handle resource-constrained tests in general, I don't see a need at this time to change this particular test.

Thank you very much.
-- 
James E Keenan (jkeenan@cpan.org)

---
via perlbug:  queue: perl5 status: new
https://rt.perl.org/Ticket/Display.html?id=132457

Thread Previous | Thread Next


nntp.perl.org: Perl Programming lists via nntp and http.
Comments to Ask Bjørn Hansen at ask@perl.org | Group listing | About