develooper Front page | perl.perl5.porters | Postings from February 2019

CPAN river 3000: status as of perl-5.29.8 release

From:
James E Keenan
Date:
February 24, 2019 15:47
Subject:
CPAN river 3000: status as of perl-5.29.8 release
Message ID:
20190224154721.13465.qmail@lists-nntp.develooper.com
You can find data from a test run of the "CPAN-river-3000"
against all releases in the current (perl-5.29) development
cycle here:

#####
http://thenceforward.net/perl/misc/cpan-river-3000.perl-5.29.master.psv.gz
#####

In addition, please find attached a file in CSV format
holding data about those CPAN distributions which received a
grade other than 'PASS' during the most recent monthly run
or whose grade changed between the two most recent runs.

#####
changes-5.29.7-to-5.29.8.csv
#####

I. General Comments

The data in these files are intended to be used in the
assessment of the impact which Perl 5 development is having
on the installability of an important set of CPAN
distributions.  These are not the only data which can be
used or which ought to be used in that assessment.

The following items should be noted:

1. During the current 5.29 development cycle we are testing
3000 CPAN distributions.

2. The analysis is being conducted on FreeBSD:

#####
$ uname -mrs
FreeBSD 11.1-RELEASE amd64
$ clang --version
FreeBSD clang version 4.0.0 (tags/RELEASE_400/final 297347) (based on 
LLVM 4.0.0)
Target: x86_64-unknown-freebsd11.1
Thread model: posix
InstalledDir: /usr/bin
######

By doing so, we hope to avoid a monoculture of operating
systems and call attention to the fact that the impact of
blead on CPAN can differ across platforms.

3. The list of modules selected is curated so that the
automated test-against-dev program can run smoothly over its
more-than-six-hours length.  That means excluding modules
that require interactive configuration, modules that make
excessive demands with respect to external prerequisites,
modules that require too much network access, modules that
are subject to timeouts, and so forth.

4. On the other hand, the list of modules selected has not
been filtered to exclude modules which, notwithstanding the
fact that other CPAN distributions depend on them, have been
failing tests for years.

5. The test-against-dev process is built on top of
Miyagawa's 'cpanm' and Breno G. de Oliveira's CPAN library
App::cpanminus::reporter.  It therefore benefits from the
strengths, and suffers from the flaws, of those two
excellent libraries.  In particular, if distribution XYZ has
a dependency on distribution ABC and if, earlier in the
process, ABC has failed, the test-against-dev process will
steer clear of attempting to fully test XYZ and will fail to
write a report for it.  So some modules will "not be
reached" and will not show up in the output data until such
time as their upstream dependencies are fixed.

6. There are certain CPAN distributions whose prerequisites
I have not yet figured out how to install on the platform
being used.  Those distributions are likely to have a grade
of UNKNOWN and their reverse dependencies will not be
reached.  The most important case of this: Tk.

If you would like further information about this project or
to help it along, please contact me off-list.

II. Specific Comments

1. If a distribution PASSed when run against perl-5.29.7
last month and then received a grade other than PASS when
run against perl-5.29.8 this month, then none of its reverse
dependencies would have been reached in the perl-5.29.8
process run this month.  Those reverse dependencies have
therefore been graded 'x' for 'perl-5.29.8-grade' even if
they got a 'PASS' for 'perl-5.29.7-grade'.

a. As already reported to this list
(https://www.nntp.perl.org/group/perl.perl5.porters/2019/02/msg253766.html),
intermittent failures in CPAN distribution
IPC-Server-Simple's test suite prevented that module from
being installed, which in turn prevented all of its reverse
dependencies from being reached for testing.  That meant
that most of the DateTime/DistZilla/RoseDB sub-universe of
distributions got a grade of 'x' this month.

b. In contrast, Chase Whitener's work on File-Slurp means
that that distribution is now perl-5.30-compliant.  That it
turn meant that its many revdeps within the cpan-river-3000
were reached for testing this month and graded accordingly.
Thanks again, genio!  Along the same line, thanks to CPAN
authors JHTHORSEN (Mojolicious-Plugin-OpenAPI); GFUJI
(MouseX-Getopt); and GUGOD (invoker) for new CPAN releases
which responded to bug tickets I and others have filed and
which enable those distributions to PASS once again.

2. Changes in the Perl 5 core distribution during the past
month caused failures in certain CPAN River 3000
distributions.

a. Of these, so far there is only one attributable to
changes in the part of the core under the supervision of
Perl 5 Porters:  the failures in Net::IDN::Encode already
reported in
https://rt.perl.org/Ticket/Display.html?id=133860.

b. Certain CPAN River 3000 distributions FAILed this month
because of changes in modules which ship with the Perl 5
core but are maintained upstream on CPAN.  These include:

i. Data-Recursive-Encode.  Failure likely due to change in
Encode-2.99.  See:
https://rt.cpan.org/Ticket/Display.html?id=128601.

ii.  Test-Kwalitee-Extra.  Failure possibly due to changes
in the Test-Simple distribution.  See:
https://rt.cpan.org/Ticket/Display.html?id=128602.

iii.  Test-PerlTidy.  Failure possible due to changes in the
Test-Simple distribution.  See:
https://rt.cpan.org/Ticket/Display.html?id=128603.

c. IPC-ShareLite.  I don't fully understand this failure so
I have filed
https://rt.cpan.org/Ticket/Display.html?id=128599.

III.  Acknowledgements

This project benefited from discussion at the Perl 5 Core
Hackathon held in Amsterdam in October 2017, so thanks to
participants in that event and to the organizations which
sponsored it.

This project also benefits from the generous donation of a
server by the New York City BSD Users Group (NYCBUG) and the
system administration expertise of Mark Saad and George
Rosamond.

This project also benefitted from assistance in reviewing
test failure reports by three members of Philadelphia
Perlmongers: John Karr, Walt Mankowski and Thomas McKernan.

This project also benefits from the system administration
expertise of Andrew Villano of New York Perlmongers.  Andrew
Villano and I made a presentation on this project at a joint
meeting of NYCBUG and New York Perlmongers (ny.pm) on
November 7.  See below for links.

IV. References

See my presentation at the North American Perl Conference held in
Salt Lake City in June 2018:
http://thenceforward.net/perl/tpc/TPC-NA-2018/test-against-dev.pdf

Text of the Nov 07 2018 NYCBUG/ny.pm presentation can be found at
http://thenceforward.net/perl/talks/nycbug-presentation-20181107.html;
slides at
http://thenceforward.net/perl/talks/nycbug-presentation-20181107.odp
(LibreOffice Impress).

Thank you very much.
Jim Keenan



nntp.perl.org: Perl Programming lists via nntp and http.
Comments to Ask Bjørn Hansen at ask@perl.org | Group listing | About