public inbox for gentoo-portage-dev@lists.gentoo.org
 help / color / mirror / Atom feed
From: Gregorio Guidi <g.guidi@sns.it>
To: gentoo-portage-dev@lists.gentoo.org
Subject: Re: [gentoo-portage-dev] Current portage well designed, but badly used
Date: Wed, 1 Dec 2004 12:25:27 +0100	[thread overview]
Message-ID: <200412011225.27593.g.guidi@sns.it> (raw)
In-Reply-To: <1101898798.32056.124.camel@localhost.localdomain>

On Wednesday 01 December 2004 11:59, Brian Harring wrote:
> On Wed, 2004-12-01 at 01:37, Gregorio Guidi wrote:
> > On Tue, 30 Nov 2004 06:22:07 -0800, Brian Harring <ferringb@gentoo.org>
>
> 1) don't modify $portdir/metadata/cache.  Modifying the rsync'd cache
> directly results in more to rsync for the next sync.  Going that route
> would result in a lot of dial up users out for blood.
> 2) the user may not be using the same cache backend as the distributed
> cache- the rsync'd cache is portage_db_flat, while the user may be using
> a custom sqlite backend.  I suspect this will be come more common place
> whenever cvs becomes stabled- the cache backend is being refactored
> currently.
> 3) cleanse stale entries from the cache, so you don't end up w/ a couple
> thousand extra files sitting in your local cache.  Stable portage
> accomplishes this by wiping *all* local cache entries, and transferring
> the *entire* rsync'd cache over.  Cvs is smarter, transfers only what
> has changed, and removes the stale entries (this is why it's faster).

I was interested exactly in points 1 and 3 (and I'm glad to hear there's even
a sqlite backend).
With respect to point 3, the solution you imlpemented is surely the right 
thing to do.
With respect to point 1, maybe a good solution could be to just check cache 
validity in $portdir/metadata when the cache is needed, and write a new cache 
in /var/cache/edb if it is not valid.

But since either a solution to point 3 or to point 1 would resolve the basic 
speed problem, the cvs implementation should be nearly optimal.

> So... that's why portage basically copies the cache to a different
> location.  If the tree were treated as readonly, and it was enforced in
> some manner, that transfer wouldn't be needed.  This is something that's
> being batted around also- the code for making the cache readonly is
> already done fex.
> ~brian
>
>
> --
> gentoo-portage-dev@gentoo.org mailing list

Thanks a lot for your answer!
Gregorio

--
gentoo-portage-dev@gentoo.org mailing list


  reply	other threads:[~2004-12-01 11:25 UTC|newest]

Thread overview: 25+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2004-11-27 23:10 [gentoo-portage-dev] Current portage well designed, but badly used Gustavo Barbieri
2004-11-27 23:48 ` Michael Tindal
2004-11-28 17:08   ` Gustavo Barbieri
2004-11-28 17:31     ` Andrew Gaffney
2004-11-28 17:56       ` Gustavo Barbieri
2004-11-30 14:22     ` Brian Harring
2004-11-30 14:53       ` Jason Stubbs
2004-12-01  4:13         ` Gustavo Barbieri
2004-12-01  8:41           ` Brian Harring
2004-12-01 13:41             ` Gustavo Barbieri
2004-12-01  3:55       ` Gustavo Barbieri
2004-12-01  9:37         ` Gregorio Guidi
2004-12-01 10:59           ` Brian Harring
2004-12-01 11:25             ` Gregorio Guidi [this message]
2004-12-01 12:08               ` Brian Harring
2004-12-01 13:25                 ` Gregorio Guidi
2004-12-01 13:38                   ` Jason Stubbs
2004-11-28  3:41 ` Luke-Jr
2004-11-28 17:19   ` Gustavo Barbieri
2004-11-28  5:44 ` Ed Grimm
2004-11-28  6:18   ` John Nilsson
2004-11-28 15:58     ` Allen Parker
2004-11-28 17:22   ` Gustavo Barbieri
2004-11-29  0:39     ` Gustavo Barbieri
2004-11-28 19:37 ` Paul de Vrieze

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=200412011225.27593.g.guidi@sns.it \
    --to=g.guidi@sns.it \
    --cc=gentoo-portage-dev@lists.gentoo.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox