public inbox for gentoo-dev@lists.gentoo.org
 help / color / mirror / Atom feed
Search results ordered by [date|relevance]  view[summary|nested|Atom feed]
thread overview below | download: 
* Re: [gentoo-dev] Having fun with compression
  @ 2006-05-01 12:11 99% ` Chris Bainbridge
  0 siblings, 0 replies; 1+ results
From: Chris Bainbridge @ 2006-05-01 12:11 UTC (permalink / raw
  To: gentoo-dev

On 30/04/06, Patrick Lauer <patrick@gentoo.org> wrote:
> Hi all,
>
> I had this random idea that many of our distfiles are .tar.gz while more
> efficient compression methods exist. So I did some testing for fun:

If you already have an old copy of the distfile it's much more
bandwidth efficient to transfer deltas. Many Gentoo users rarely clean
out /usr/portage/distfiles so it could be quite a bandwidth saving to
use something like zsync http://zsync.moria.org.uk/ .

I did some tests a long time ago and found that a version bump of a
package like kdegraphics produced a 300k uncompressed diff, which was
25x more bandwidth efficient to transfer with rsync than to download
the full bz2 file. I haven't played with zsync yet, but the technical
paper suggests it is close to 'rsync -z' in terms of bandwidth
efficiency, and it removes some of the drawbacks of rsync, such as
high server load and the requirement to run a special daemon.

-- 
gentoo-dev@gentoo.org mailing list



^ permalink raw reply	[relevance 99%]

Results 1-1 of 1 | reverse | options above
-- pct% links below jump to the message on this page, permalinks otherwise --
2006-04-30 16:30     [gentoo-dev] Having fun with compression Patrick Lauer
2006-05-01 12:11 99% ` Chris Bainbridge

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox