From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from pigeon.gentoo.org ([208.92.234.80] helo=lists.gentoo.org) by finch.gentoo.org with esmtp (Exim 4.60) (envelope-from ) id 1NVaMu-00089q-3p for garchives@archives.gentoo.org; Fri, 15 Jan 2010 00:48:52 +0000 Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 332F3E0766; Fri, 15 Jan 2010 00:48:05 +0000 (UTC) Received: from smtp.gentoo.org (smtp.gentoo.org [140.211.166.183]) by pigeon.gentoo.org (Postfix) with ESMTP id E4347E0766 for ; Fri, 15 Jan 2010 00:48:04 +0000 (UTC) Received: from mail.isohunt.com (b01.ext.isohunt.com [208.71.112.51]) by smtp.gentoo.org (Postfix) with ESMTP id 63B8F67F32 for ; Fri, 15 Jan 2010 00:48:04 +0000 (UTC) Received: (qmail 11525 invoked from network); 15 Jan 2010 00:48:00 -0000 Received: from tsi-static.orbis-terrarum.net (HELO grubbs.orbis-terrarum.net) (76.10.188.108) by mail.isohunt.com (qpsmtpd/0.33-dev on beta01) with (CAMELLIA256-SHA encrypted) ESMTPS; Fri, 15 Jan 2010 00:48:00 +0000 Received: (qmail 11760 invoked by uid 10000); 15 Jan 2010 00:47:57 -0000 Date: Fri, 15 Jan 2010 00:47:57 +0000 From: "Robin H. Johnson" To: gentoo-dev@lists.gentoo.org Subject: Re: [gentoo-dev] Re: proxy maintainership and gentoo-x86 scm Message-ID: <20100115004757.GG16921@orbis-terrarum.net> References: <201001112305.16532.hwoarang@gentoo.org> <201001122149.11091.hwoarang@gentoo.org> <201001131054.03953.vapier@gentoo.org> <8b4c83ad1001140449k49995e0ra01eeca16167735a@mail.gmail.com> Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-dev@lists.gentoo.org Reply-to: gentoo-dev@lists.gentoo.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="5FFaGRZUwcpbKFrw" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.20 (2009-06-14) X-Archives-Salt: bb69118c-14ab-421b-a75e-0e58a6da8ac7 X-Archives-Hash: 2802abb574e034b5505565d99e5abeba --5FFaGRZUwcpbKFrw Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Jan 14, 2010 at 07:07:01PM -0500, Paul Arthur wrote: > On 2010-01-14, Nirbheek Chauhan wrote: > > On Wed, Jan 13, 2010 at 9:24 PM, Mike Frysinger wro= te: > >> i think our current work flows also significantly impede the smooth ru= nning of > >> this. =C2=A0if we had were using a dscm (git) on gentoo-x86, i feel li= ke it'd be a > >> much smoother ride for Gentoo devs to pull from a proxy maintainer and= push on > >> their behalf. > > > > In theory, yes. In practice, git is too slow to handle 30,000 files. > > Even simple operations like git add become painful even if you put the > > whole of portage on tmpfs since git does a stat() on every single file > > in the repository with every operation. > > > > Simple test: do a git init followed by git add && git commit -m > > "Initial commit" in your portage dir (.gitignore packages/ and > > distfiles/) > > > > Once this is done, you can test how it'll feel like to use a DSCM on > > portage (without history). Unless you have a really fast SSD and > > processor, you'll want to go back to the good old days of CVS with its > > network-bound latencies on just 5-6 files in the current dir. >=20 > Ouch. I wanted to test this in a fairly bad scenario, so I gave it a > try on my old, low-spec fileserver. You didn't repack or at least run git-gc between the huge add and your everyday operations. Do that, and then measure the ops with both cold and hot cache.=20 The initial packing and adding are very intensive, even on fast machines, but that's because they are dealing with a lot of small pieces of data. Packing has benefited immensely from being fully multi-threaded in Git. I'd love somebody to do the SoC stats again: http://www.gentoo.org/proj/en/infrastructure/cvs-migration.xml?style=3Dprin= table Using the git repo conversion I did: http://git-exp.overlays.gentoo.org/gitweb/?p=3Dexp/gentoo-x86.git;a=3Dsumma= ry --=20 Robin Hugh Johnson Gentoo Linux: Developer, Trustee & Infrastructure Lead E-Mail : robbat2@gentoo.org GnuPG FP : 11AC BA4F 4778 E3F6 E4ED F38E B27B 944E 3488 4E85 --5FFaGRZUwcpbKFrw Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.14 (GNU/Linux) Comment: Robbat2 @ Orbis-Terrarum Networks - The text below is a digital signature. If it doesn't make any sense to you, ignore it. iEYEARECAAYFAktPuz0ACgkQPpIsIjIzwixJPACfd/HiN2QEuJd7sz8KeWfeVexk xsAAoKIV3BK9E1KgSDo07nCGwZYnEpAk =RYLZ -----END PGP SIGNATURE----- --5FFaGRZUwcpbKFrw--