develooper Front page | perl.cpan.workers | Postings from March 2010

Re: Trimming the CPAN - "Automatic Purging"

Thread Previous | Thread Next
From:
Jarkko Hietaniemi
Date:
March 26, 2010 15:43
Subject:
Re: Trimming the CPAN - "Automatic Purging"
Message ID:
4BAD3878.3010102@iki.fi
On Friday-201003-26 13:20, Arthur Corliss wrote:
> On Fri, 26 Mar 2010, Andy Lester wrote:
>
>> Absolutely.  This factual info would ideally look like this:
>>
>> "Of the 17,000 distros on CPAN, there are 8,000 that have versions more than a year older than the most recent one.  If those distros with versions more than a year out of date were purged, the number of files would decrease from 200,000 to 120,000.  This would save 7GB out of the 12GB that a full CPAN mirror takes now.  Removing that 7GB would mean Benefit X to mirror owners."
>>
>> Without that, how can module authors be bothered to care?
>
> If you don't mind me interjecting, I still can't be bothered to care.  We
> have basically a 12GB data set, and we're worried about that?  I see that a
> small barrier to bringing on new mirrors on constrained pipes, but
> ultimately that's not that big a deal.  Hell, there's single versions of
> some Linux distros that are bigger than that.

The total size is not the problem.  The number of files is.  Vanilla
rsync is horribly inefficient (not the protocol, which is genius, mind)
because a client coming by and asking for updates basically ends up
requiring the moral equivalent of
"find . -type f -print".  Let me repeat that: each client.  Not fun.


Thread Previous | Thread Next


nntp.perl.org: Perl Programming lists via nntp and http.
Comments to Ask Bjørn Hansen at ask@perl.org | Group listing | About