From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from pigeon.gentoo.org ([208.92.234.80] helo=lists.gentoo.org) by finch.gentoo.org with esmtp (Exim 4.60) (envelope-from <gentoo-dev+bounces-52137-garchives=archives.gentoo.org@lists.gentoo.org>) id 1Sacb6-0007Ns-65 for garchives@archives.gentoo.org; Sat, 02 Jun 2012 00:53:40 +0000 Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 6820AE062D; Sat, 2 Jun 2012 00:53:26 +0000 (UTC) Received: from mail-bk0-f53.google.com (mail-bk0-f53.google.com [209.85.214.53]) by pigeon.gentoo.org (Postfix) with ESMTP id CBFEBE052E for <gentoo-dev@lists.gentoo.org>; Sat, 2 Jun 2012 00:52:43 +0000 (UTC) Received: by bkcjk13 with SMTP id jk13so2687080bkc.40 for <gentoo-dev@lists.gentoo.org>; Fri, 01 Jun 2012 17:52:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type; bh=kB1iL0lBvfpAzfCWdbuR1ebDMdzWc8KmEP36iFXzvi4=; b=cwO+t0Cqor6TQymkZeM8cUEsyAOmwjMX/luvLfDGe+1A5JQKCNyHMRsXcUisTp8/gz C2pwmPbXWf3ITTUuEU/KgMMGHQdSZzqnd2c0vJhRIh1dJs7dQSSWtsBu2fAXpNCMtxr9 FrVT7cMLxDqMmMOvfoFNoBgRo/pOThaR6Uu/CMJ2hOUFYZr2dDM+iGJdbsMXyLoFxK9F tdk7Nyb8shTe9Ag5Z7ziOxRKzlsh2O2RPcuqvUeRHiNlOFIvOa7CWd+aowBK0NWPjFlr obux17llg7FN3+R870QYMk93KYkmJkHlh7LewZQ65T8Con9iOh8WRAKmfblVxIrQKbix EMQQ== Precedence: bulk List-Post: <mailto:gentoo-dev@lists.gentoo.org> List-Help: <mailto:gentoo-dev+help@lists.gentoo.org> List-Unsubscribe: <mailto:gentoo-dev+unsubscribe@lists.gentoo.org> List-Subscribe: <mailto:gentoo-dev+subscribe@lists.gentoo.org> List-Id: Gentoo Linux mail <gentoo-dev.gentoo.org> X-BeenThere: gentoo-dev@lists.gentoo.org Reply-to: gentoo-dev@lists.gentoo.org MIME-Version: 1.0 Received: by 10.204.141.9 with SMTP id k9mr2877185bku.138.1338598362925; Fri, 01 Jun 2012 17:52:42 -0700 (PDT) Sender: freemanrich@gmail.com Received: by 10.204.149.211 with HTTP; Fri, 1 Jun 2012 17:52:42 -0700 (PDT) In-Reply-To: <4FC92AE7.3030404@gentoo.org> References: <4FBCDB3D.1070009@gentoo.org> <ddd8ff651a1f5d00ea13fbd9e105ddfa@omrb.pnpi.spb.ru> <CAGfcS_kOCDZ6Ur37+YYx4DR+1b3c-VWE6eNiefS7HJbqtuKKJA@mail.gmail.com> <pan.2012.05.30.09.38.51@cox.net> <CAKmKYaCgdi8uFssF=7rMhAunAs4=qRPgycT0uJYLVGQOhXkuLA@mail.gmail.com> <CAGfcS_kezhc3ZyfU6Kt1kXCDZqd3VydTjF3BeSt2moEDkbaOSA@mail.gmail.com> <pan.2012.05.30.13.06.45@cox.net> <robbat2-20120530T183226-760252197Z@orbis-terrarum.net> <CAKmKYaBPFXtgPVtY4UQvnD1AjN0oYRz0cDLmZuGzPNNSGnS9YQ@mail.gmail.com> <4FC75E3A.4000903@gentoo.org> <4FC92AE7.3030404@gentoo.org> Date: Fri, 1 Jun 2012 20:52:42 -0400 X-Google-Sender-Auth: -ra7Nu8lto9EwdHkQisJspR3j9U Message-ID: <CAGfcS_kn7hPixtkSgpY17tdW1V0m5j2+QHyRwLp63v1odVzOJg@mail.gmail.com> Subject: Re: [gentoo-dev] Re: Portage Git migration - clean cut or git-cvsserver From: Rich Freeman <rich0@gentoo.org> To: gentoo-dev@lists.gentoo.org Content-Type: text/plain; charset=ISO-8859-1 X-Archives-Salt: efa22011-b358-444d-9bf2-5582a9f0070e X-Archives-Hash: 5faf4f53962689937150d9f2a61e184e On Fri, Jun 1, 2012 at 4:49 PM, Michael Weber <xmw@gentoo.org> wrote: > > Cloning the repo [1] takes 200seconds on 8cores (it's 2GB of data and > 22 minutes of 3.4GHz cpus). > As others have pointed out, probably the best way to bootstrap this is to offer tarballs of a shallow repository and a full repository. Perhaps we'd offer the latter as a torrent. The shallow repository should be light on the CPU too. This would be a lot easier on the server than having everybody and their uncle doing a full 2GB clone. Devs could then do a pull to get the latest and greatest, and that would only transfer the delta. I imagine our mirror network can handle the bandwidth compared to what we're already doing with distfiles. Worst case we could take a one-time hit and use S3 or whatever to do the distribution (they even support bittorrent to cut down on the bill). Rich