public inbox for gentoo-dev@lists.gentoo.org
 help / color / mirror / Atom feed
From: Nick Rout <nick@rout.co.nz>
To: gentoo-dev@robin.gentoo.org
Subject: Re: [gentoo-dev] Proposal for an alternative portage tree sync method
Date: Thu, 24 Mar 2005 10:15:42 +1200	[thread overview]
Message-ID: <20050324101350.CC09.NICK@rout.co.nz> (raw)
In-Reply-To: <200503222358.19166.gentoo-dev@wizy.org>

It sounds interesting Ricardo. May I suggest that if you have the
resources you set it up on your own LAN or something, then compare the
results with rsync. 

You may need to get a few friends to do it over the net too, in order to try it on something less traffic friendly than your LAN.


On Tue, 22 Mar 2005 23:58:19 +0000
Ricardo Correia wrote:

> On Tuesday 22 March 2005 13:55, Patrick Lauer wrote:
> >
> > A few problems:
> > - that .iso and the .zsync metadata need to be generated. More load on
> > master server
> > - isos don't allow easy access, e.g. writing a few bytes for a tricial
> > bugfix
> > - mkisofs might shuffle the data so that transferring one large file
> > might cause more traffic than rsync does now
> >
> > I don't see the advantages over tar + binary diffs.
> >
> 
> You make valid points, but notice:
> - The .zsync metadata doesn't have to be generated on the master server. 
> Anyone can do it right now.
> - ISO's would have to be regenerated periodically. This could vary from every 
> 30 minutes to only once per day, we'd have to see how it works.
> Personally I think every 30 minutes would be viable, but it's not really 
> necessary. Once per day would be enough and better than emerge-webrsync..
> 
> The advantage over tar + binary diffs:
> - Client doesn't have to remove entire portage tree and extract the tar file 
> every sync. 
> - I think xdelta might be possible, but bsdiff would be impossible due to the 
> memory requirements for a tar this large. I don't really know how xdelta 
> performs CPU-wise and memory-wise..
> - It's simpler (only 2 files on the server and very few commands 
> necessary) :-)
> --
> gentoo-dev@gentoo.org mailing list

-- 
Nick Rout
Barrister & Solicitor
Christchurch
<http://www.rout.co.nz>
<nick@rout.co.nz>

--
gentoo-dev@gentoo.org mailing list


  reply	other threads:[~2005-03-23 22:15 UTC|newest]

Thread overview: 20+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2005-03-22  7:15 [gentoo-dev] Proposal for an alternative portage tree sync method Ricardo Correia
2005-03-22 12:45 ` Daniel Drake
2005-03-22 12:59   ` Paul Waring
2005-03-22 13:22   ` Francesco Riosa
2005-03-22 15:03     ` Simon Stelling
2005-03-22 14:39       ` Stroller
2005-03-22 23:58       ` Ricardo Correia
2005-03-22 23:58   ` Ricardo Correia
2005-03-23 11:15     ` Fabian Zeindl
2005-03-23 18:03       ` Marius Mauch
2005-03-22 13:55 ` Patrick Lauer
2005-03-22 15:19   ` Simon Stelling
2005-03-22 23:58   ` Ricardo Correia
2005-03-23 22:15     ` Nick Rout [this message]
2005-03-23 22:49       ` Ricardo Correia
2005-03-24 14:11 ` Karl Trygve Kalleberg
2005-03-25  7:57   ` Brian Harring
2005-03-26 12:45     ` Karl Trygve Kalleberg
2005-03-27 19:03       ` Brian Harring
2005-03-28 13:04 ` Petteri Räty

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20050324101350.CC09.NICK@rout.co.nz \
    --to=nick@rout.co.nz \
    --cc=gentoo-dev@gentoo.org \
    --cc=gentoo-dev@robin.gentoo.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox