develooper Front page | perl.module-authors | Postings from November 2010

Re: Reducing rsync cost (was: Re: Using a better compression than .gzfor one's CPAN modules)

Thread Previous | Thread Next
From:
David Nicol
Date:
November 22, 2010 06:18
Subject:
Re: Reducing rsync cost (was: Re: Using a better compression than .gzfor one's CPAN modules)
Message ID:
AANLkTimWH818-kx9atGXCydSgTTWt6BQ1bSs_si70vJj@mail.gmail.com
On Mon, Nov 22, 2010 at 4:37 AM, David Landgren <david@landgren.net> wrote:
> Yeah, this is the killer. In an ideal world, we would kill the symlinks such
> as authors/id/*, modules/by-category/*, modules/by-module/* and so on. These
> could be recreated via shell scripts locally on mirrors for people who wish
> to maintain these legacies. Cutting that out would diminish the rsync burden
> considerably.
>
> David

or re-engineer CPAN as a sqlite+FTSE database, and re-engineer the
mirroring process as a database mirror via a TBD compact database diff
protocol (I have no intention of doing any of this myself; good
morning)

-- 
"It is merely a matter of persistence." -- Albert Camus
Thread Previous | Thread Next

nntp.perl.org: Perl Programming lists via nntp and http.
Comments to Ask Bjørn Hansen at ask@perl.org | Group listing | About