develooper Front page | perl.cpan.testers | Postings from May 2003

FAIL Scraper-3.02 i586-linux 2.2.16c32_iii

From:
cpantester
Date:
May 11, 2003 07:31
Subject:
FAIL Scraper-3.02 i586-linux 2.2.16c32_iii
This distribution has been tested as part of the cpan-testers
effort to test as many new uploads to CPAN as possible.  See
http://testers.cpan.org/

Please cc any replies to cpan-testers@perl.org to keep other
test volunteers informed and to prevent any duplicate effort.
	
--
This is an error report generated automatically by CPANPLUS,
version 0.042.

Below is the error stack during 'make test':

PERL_DL_NONLAZY=1 /home/local/bin/perl5.8.0 "-MExtUtils::Command::MM" "-e" "test_harness(0, 'blib/lib', 'blib/arch')" t/*.t
t/t....ok
All tests successful.
Files=1, Tests=1,  0 wallclock secs ( 0.01 cusr +  0.02 csys =  0.03 CPU)
PERL_DL_NONLAZY=1 /home/local/bin/perl5.8.0 "-Iblib/lib" "-Iblib/arch" test.pl
# VERSIONS OF MODULES ON WHICH SCRAPER DEPENDS
#     using HTML::Form(1.00);
#     using HTML::TreeBuilder(3.13);
#     using HTTP::Cookies(1.30);
#     using HTTP::Request(1.30);
#     using HTTP::Response(1.36);
#     using HTTP::Status(1.26);
#     using LWP(5.69);
#     using LWP::RobotUA(1.19);
#     using LWP::UserAgent(2.003);
#     using Storable(2.06);
#     using Text::ParseWords(3.21);
#     using Tie::Persistent(1.00);
#     using URI(1.23);
#     using URI::Escape(3.21);
#     using URI::URL(5.03);
#     using URI::http();
#     using User(1.6);
#     using WWW::Search(2.39);
#     using XML::XPath(1.13);
1..11
ok 1 - 9 Scraper modules listed in MANIFEST (4,1,4)
ok 2 - WWW::Scraper loaded
ok 3 # skip This Scraper engine requires 'HTML Tidy' to scrub HTML before parsing.
Get this program from 'http://tidy.sourceforge.net/docs/Overview.html#Download'
Make sure it is in your execution search path.

ok 4 - CraigsList
ok 5 # skip This Scraper engine requires 'HTML Tidy' to scrub HTML before parsing.
Get this program from 'http://tidy.sourceforge.net/docs/Overview.html#Download'
Make sure it is in your execution search path.

ok 6 - Google
not ok 7 - Lycos # TODO Lycos is not quite right . . .
#     Failed (TODO) test (test.pl at line 129)
# This Scraper engine requires 'Tidy' to scrub HTML before parsing.
# Get this program from 'http://tidy.sourceforge.net/docs/Overview.html#Download'
not ok 8 - NorthernLight
#     Failed test (test.pl at line 129)
ok 9 # skip Sherlock.pm is not working today; many changes out on the frontier that I haven't caught up with yet
ok 10 # skip WSDL is still in a primitive experimental state.
not ok 11 - ZIPplus4
#     Failed test (test.pl at line 129)
# Can't use string ("firm") as an ARRAY ref while "strict refs" in use at blib/lib/WWW/Scraper.pm line 961.
# 4 tests had problems. See file 'test.trace' for details.
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
Operating system: linux
Perl version: 5.008
VERSIONS OF MODULES ON WHICH SCRAPER DEPENDS
    using HTML::Form(1.00);
    using HTML::TreeBuilder(3.13);
    using HTTP::Cookies(1.30);
    using HTTP::Request(1.30);
    using HTTP::Response(1.36);
    using HTTP::Status(1.26);
    using LWP(5.69);
    using LWP::RobotUA(1.19);
    using LWP::UserAgent(2.003);
    using Storable(2.06);
    using Text::ParseWords(3.21);
    using Tie::Persistent(1.00);
    using URI(1.23);
    using URI::Escape(3.21);
    using URI::URL(5.03);
    using URI::http();
    using User(1.6);
    using WWW::Search(2.39);
    using XML::XPath(1.13);
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
LIST SCRAPER SUB-CLASSES, FROM THE MANIFEST
    + Beaucoup(1.00)
    + CraigsList(1.00)
    + Dogpile(1.00)
    - FieldTranslation will not be tested: it is not a Scraper sub-class.
    + Google(1.00)
    - Grub will not be tested: it is not a Scraper sub-class.
    + Lycos(1.00)
    + NorthernLight(1.00)
    + Sherlock(1.00)
    - Response will not be tested: it is not a Scraper sub-class.
    - Request will not be tested: it is not a Scraper sub-class.
    - TidyXML will not be tested: it is not a Scraper sub-class.
    + WSDL(1.00)
    + ZIPplus4(1.00)
    - Opcode will not be tested: it is not a Scraper sub-class.
    - ScraperDiscovery will not be tested: it is not a Scraper sub-class.
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
Test #0: CraigsList
Test #1: CraigsList 'bogus' search
Test #2: CraigsList one-page search
 + got 50 results for 'Honda'
Test #3: CraigsList multi-page search
 + got 100 multi-page results for 'Honda'
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
Test #0: Google
Test #1: Google 'bogus' search
 --- got 259 'bogus' results, expected 1
Test #2: Google one-page search
 + got 9 results for 'search scraper'
Test #3: Google multi-page search
 + got 41 multi-page results for 'search scraper'
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
Test #0: Lycos
Test #1: Lycos 'bogus' search
Scraper engine Lycos failed once: This Scraper engine requires 'Tidy' to scrub HTML before parsing.
Get this program from 'http://tidy.sourceforge.net/docs/Overview.html#Download'

Test #0: Lycos
Test #1: Lycos 'bogus' search
Scraper engine Lycos failed twice: This Scraper engine requires 'Tidy' to scrub HTML before parsing.
Get this program from 'http://tidy.sourceforge.net/docs/Overview.html#Download'

##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
Test #0: NorthernLight
Test #1: NorthernLight 'bogus' search
Test #2: NorthernLight one-page search
 + got 0 results for 'search scraper'
 --- got 0 results for NorthernLight 'search scraper', but expected 9
 --- base URL: http://www.northernlight.com/nlquery.fcg?dx=1004&cb=0&si=SOURCE%5E%3D1&qp=not%2Bauthoraffiliat%3Alynch%2Bnot%2Bauthoraffiliat%3A%2522FIRST%2BANALYSIS%2BCORPORATION%2522&search.x=1&search.y=1&qr=search+scraper&qt=&pu=&la=All&us=10&rv=1&d1=&d2=
 --- first URL: http://www.northernlight.com/nlquery.fcg?dx=1004&cb=0&si=SOURCE%5E%3D1&qp=not%2Bauthoraffiliat%3Alynch%2Bnot%2Bauthoraffiliat%3A%2522FIRST%2BANALYSIS%2BCORPORATION%2522&search.x=1&search.y=1&qr=search+scraper&qt=&pu=&la=All&us=10&rv=1&d1=&d2=
 --- last URL: http://www.northernlight.com/nlquery.fcg?dx=1004&cb=0&si=SOURCE%5E%3D1&qp=not%2Bauthoraffiliat%3Alynch%2Bnot%2Bauthoraffiliat%3A%2522FIRST%2BANALYSIS%2BCORPORATION%2522&search.x=1&search.y=1&qr=search+scraper&qt=&pu=&la=All&us=10&rv=1&d1=&d2=
 --- next URL: 
 --- response message: 500 Internal Server Error
 --- content size (bytes): 1453
 --- ERRNO: 
 --- Extended OS error: 
Scraper engine NorthernLight failed once: 
Test #0: NorthernLight
Test #1: NorthernLight 'bogus' search
Test #2: NorthernLight one-page search
 + got 0 results for 'search scraper'
 --- got 0 results for NorthernLight 'search scraper', but expected 9
 --- base URL: http://www.northernlight.com/nlquery.fcg?dx=1004&cb=0&si=SOURCE%5E%3D1&qp=not%2Bauthoraffiliat%3Alynch%2Bnot%2Bauthoraffiliat%3A%2522FIRST%2BANALYSIS%2BCORPORATION%2522&search.x=1&search.y=1&qr=search+scraper&qt=&pu=&la=All&us=10&rv=1&d1=&d2=
 --- first URL: http://www.northernlight.com/nlquery.fcg?dx=1004&cb=0&si=SOURCE%5E%3D1&qp=not%2Bauthoraffiliat%3Alynch%2Bnot%2Bauthoraffiliat%3A%2522FIRST%2BANALYSIS%2BCORPORATION%2522&search.x=1&search.y=1&qr=search+scraper&qt=&pu=&la=All&us=10&rv=1&d1=&d2=
 --- last URL: http://www.northernlight.com/nlquery.fcg?dx=1004&cb=0&si=SOURCE%5E%3D1&qp=not%2Bauthoraffiliat%3Alynch%2Bnot%2Bauthoraffiliat%3A%2522FIRST%2BANALYSIS%2BCORPORATION%2522&search.x=1&search.y=1&qr=search+scraper&qt=&pu=&la=All&us=10&rv=1&d1=&d2=
 --- next URL: 
 --- response message: 500 Internal Server Error
 --- content size (bytes): 1453
 --- ERRNO: 
 --- Extended OS error: 
Scraper engine NorthernLight failed twice: 
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
##_##_##_##_##_##_##_##_##_##_##_##_##_##_##
Test #0: ZIPplus4
Test #1: ZIPplus4 'bogus' search
Scraper engine ZIPplus4 failed once: Can't use string ("firm") as an ARRAY ref while "strict refs" in use at blib/lib/WWW/Scraper.pm line 961.

Test #0: ZIPplus4
Test #1: ZIPplus4 'bogus' search
Scraper engine ZIPplus4 failed twice: Can't use string ("firm") as an ARRAY ref while "strict refs" in use at blib/lib/WWW/Scraper.pm line 961.

# Looks like you failed 2 tests of 11.
make: *** [test_dynamic] Error 2


Additional comments:

--

Summary of my perl5 (revision 5.0 version 8 subversion 0) configuration:
  Platform:
    osname=linux, osvers=2.2.16c32_iii, archname=i586-linux
    uname='linux www.arens.nl 2.2.16c32_iii #1 fri nov 9 21:54:54 pst 2001 i586 unknown '
    config_args='-Uinstallusrbinperl -ds'
    hint=recommended, useposix=true, d_sigaction=define
    usethreads=undef use5005threads=undef useithreads=undef usemultiplicity=undef
    useperlio=define d_sfio=undef uselargefiles=define usesocks=undef
    use64bitint=undef use64bitall=undef uselongdouble=undef
    usemymalloc=n, bincompat5005=undef
  Compiler:
    cc='cc', ccflags ='-fno-strict-aliasing -I/usr/local/include -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -I/usr/include/gdbm',
    optimize='-O3',
    cppflags='-fno-strict-aliasing -I/usr/local/include -I/usr/include/gdbm'
    ccversion='', gccversion='2.95.3 20010315 (release)', gccosandvers=''
    intsize=4, longsize=4, ptrsize=4, doublesize=8, byteorder=1234
    d_longlong=define, longlongsize=8, d_longdbl=define, longdblsize=12
    ivtype='long', ivsize=4, nvtype='double', nvsize=8, Off_t='off_t', lseeksize=8
    alignbytes=4, prototype=define
  Linker and Libraries:
    ld='cc', ldflags =' -L/usr/local/lib'
    libpth=/usr/local/lib /lib /usr/lib
    libs=-lnsl -lndbm -lgdbm -ldb -ldl -lm -lc -lposix -lcrypt -lutil
    perllibs=-lnsl -ldl -lm -lc -lposix -lcrypt -lutil
    libc=/lib/libc-2.1.3.so, so=so, useshrplib=false, libperl=libperl.a
    gnulibc_version='2.1.3'
  Dynamic Linking:
    dlsrc=dl_dlopen.xs, dlext=so, d_dlsymun=undef, ccdlflags='-rdynamic'
    cccdlflags='-fpic', lddlflags='-shared -L/usr/local/lib'



Comments to Ask Bjørn Hansen at ask@perl.org | Group listing | About