From mboxrd@z Thu Jan  1 00:00:00 1970
Received: from pigeon.gentoo.org ([208.92.234.80] helo=lists.gentoo.org)
	by finch.gentoo.org with esmtp (Exim 4.60)
	(envelope-from <gentoo-dev+bounces-52137-garchives=archives.gentoo.org@lists.gentoo.org>)
	id 1Sacb6-0007Ns-65
	for garchives@archives.gentoo.org; Sat, 02 Jun 2012 00:53:40 +0000
Received: from pigeon.gentoo.org (localhost [127.0.0.1])
	by pigeon.gentoo.org (Postfix) with SMTP id 6820AE062D;
	Sat,  2 Jun 2012 00:53:26 +0000 (UTC)
Received: from mail-bk0-f53.google.com (mail-bk0-f53.google.com [209.85.214.53])
	by pigeon.gentoo.org (Postfix) with ESMTP id CBFEBE052E
	for <gentoo-dev@lists.gentoo.org>; Sat,  2 Jun 2012 00:52:43 +0000 (UTC)
Received: by bkcjk13 with SMTP id jk13so2687080bkc.40
        for <gentoo-dev@lists.gentoo.org>; Fri, 01 Jun 2012 17:52:43 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:sender:in-reply-to:references:date
         :x-google-sender-auth:message-id:subject:from:to:content-type;
        bh=kB1iL0lBvfpAzfCWdbuR1ebDMdzWc8KmEP36iFXzvi4=;
        b=cwO+t0Cqor6TQymkZeM8cUEsyAOmwjMX/luvLfDGe+1A5JQKCNyHMRsXcUisTp8/gz
         C2pwmPbXWf3ITTUuEU/KgMMGHQdSZzqnd2c0vJhRIh1dJs7dQSSWtsBu2fAXpNCMtxr9
         FrVT7cMLxDqMmMOvfoFNoBgRo/pOThaR6Uu/CMJ2hOUFYZr2dDM+iGJdbsMXyLoFxK9F
         tdk7Nyb8shTe9Ag5Z7ziOxRKzlsh2O2RPcuqvUeRHiNlOFIvOa7CWd+aowBK0NWPjFlr
         obux17llg7FN3+R870QYMk93KYkmJkHlh7LewZQ65T8Con9iOh8WRAKmfblVxIrQKbix
         EMQQ==
Precedence: bulk
List-Post: <mailto:gentoo-dev@lists.gentoo.org>
List-Help: <mailto:gentoo-dev+help@lists.gentoo.org>
List-Unsubscribe: <mailto:gentoo-dev+unsubscribe@lists.gentoo.org>
List-Subscribe: <mailto:gentoo-dev+subscribe@lists.gentoo.org>
List-Id: Gentoo Linux mail <gentoo-dev.gentoo.org>
X-BeenThere: gentoo-dev@lists.gentoo.org
Reply-to: gentoo-dev@lists.gentoo.org
MIME-Version: 1.0
Received: by 10.204.141.9 with SMTP id k9mr2877185bku.138.1338598362925; Fri,
 01 Jun 2012 17:52:42 -0700 (PDT)
Sender: freemanrich@gmail.com
Received: by 10.204.149.211 with HTTP; Fri, 1 Jun 2012 17:52:42 -0700 (PDT)
In-Reply-To: <4FC92AE7.3030404@gentoo.org>
References: <4FBCDB3D.1070009@gentoo.org>
	<ddd8ff651a1f5d00ea13fbd9e105ddfa@omrb.pnpi.spb.ru>
	<CAGfcS_kOCDZ6Ur37+YYx4DR+1b3c-VWE6eNiefS7HJbqtuKKJA@mail.gmail.com>
	<pan.2012.05.30.09.38.51@cox.net>
	<CAKmKYaCgdi8uFssF=7rMhAunAs4=qRPgycT0uJYLVGQOhXkuLA@mail.gmail.com>
	<CAGfcS_kezhc3ZyfU6Kt1kXCDZqd3VydTjF3BeSt2moEDkbaOSA@mail.gmail.com>
	<pan.2012.05.30.13.06.45@cox.net>
	<robbat2-20120530T183226-760252197Z@orbis-terrarum.net>
	<CAKmKYaBPFXtgPVtY4UQvnD1AjN0oYRz0cDLmZuGzPNNSGnS9YQ@mail.gmail.com>
	<4FC75E3A.4000903@gentoo.org>
	<4FC92AE7.3030404@gentoo.org>
Date: Fri, 1 Jun 2012 20:52:42 -0400
X-Google-Sender-Auth: -ra7Nu8lto9EwdHkQisJspR3j9U
Message-ID: <CAGfcS_kn7hPixtkSgpY17tdW1V0m5j2+QHyRwLp63v1odVzOJg@mail.gmail.com>
Subject: Re: [gentoo-dev] Re: Portage Git migration - clean cut or git-cvsserver
From: Rich Freeman <rich0@gentoo.org>
To: gentoo-dev@lists.gentoo.org
Content-Type: text/plain; charset=ISO-8859-1
X-Archives-Salt: efa22011-b358-444d-9bf2-5582a9f0070e
X-Archives-Hash: 5faf4f53962689937150d9f2a61e184e

On Fri, Jun 1, 2012 at 4:49 PM, Michael Weber <xmw@gentoo.org> wrote:
>
> Cloning the repo [1] takes 200seconds on 8cores (it's 2GB of data and
> 22 minutes of 3.4GHz cpus).
>

As others have pointed out, probably the best way to bootstrap this is
to offer tarballs of a shallow repository and a full repository.
Perhaps we'd offer the latter as a torrent.  The shallow repository
should be light on the CPU too.

This would be a lot easier on the server than having everybody and
their uncle doing a full 2GB clone.

Devs could then do a pull to get the latest and greatest, and that
would only transfer the delta.

I imagine our mirror network can handle the bandwidth compared to what
we're already doing with distfiles.  Worst case we could take a
one-time hit and use S3 or whatever to do the distribution (they even
support bittorrent to cut down on the bill).

Rich