develooper Front page | perl.beginners | Postings from January 2002

RE: WWW:Robot speed..

From:
Lorne Easton
Date:
January 8, 2002 18:20
Subject:
RE: WWW:Robot speed..
Message ID:
20020109021732.10332.qmail@onion.perl.org
Hi there..

I am using the WWW:Robot module to iterate over some internal sites, so
complying with the guidelines for robots is not really an issue.

Anyone have any experience modifying the module so that the delay between
requests is less?

Regards,
Lorne





nntp.perl.org: Perl Programming lists via nntp and http.
Comments to Ask Bjørn Hansen at ask@perl.org | Group listing | About