From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from pigeon.gentoo.org ([208.92.234.80] helo=lists.gentoo.org) by finch.gentoo.org with esmtp (Exim 4.60) (envelope-from ) id 1NVY4f-0008WD-W0 for garchives@archives.gentoo.org; Thu, 14 Jan 2010 22:21:54 +0000 Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id ADD75E0BB3; Thu, 14 Jan 2010 22:21:32 +0000 (UTC) Received: from mail-px0-f174.google.com (mail-px0-f174.google.com [209.85.216.174]) by pigeon.gentoo.org (Postfix) with ESMTP id 770B7E0BB3 for ; Thu, 14 Jan 2010 22:21:32 +0000 (UTC) Received: by pxi4 with SMTP id 4so25460pxi.32 for ; Thu, 14 Jan 2010 14:21:32 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:received:in-reply-to :references:date:x-google-sender-auth:message-id:subject:from:to :content-type; bh=pxiFgPG1BaKwzG2ZtZs1aOuHu/i/HBksTC2gHzTmQBA=; b=WcqNPqOZ82YWbM+OeVGYAzo73ML135GvITuN2JFSEFdKvFu9C1aaTlyMaICsu2nHUp TLKdsyu2Wx64Xur65K1PPBu6Ux8Mzvc1j0+xwEYjmc4lyggYtmIs2CbBPfG7QoJOfAja n6SABRZJ/GPj9dK+6hTv9eGgI4DT7siVZ7NSY= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type; b=aTrU30VG6yPe5IpQKuIesWTQadw8gEGgFhdAdPjmN+x+Y0zg6PCWpBWlltm15pFbkQ bu+TQ0JBCpobDZcnP4IBfpJ3OmLbQ01HazzW1jKvEIUqux0edH0WVgIq4vrwQuXyVO+q LWRJ51w45gR1krCXyJ5peESh3QGmi1MjsdWeM= Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-dev@lists.gentoo.org Reply-to: gentoo-dev@lists.gentoo.org MIME-Version: 1.0 Sender: nirbheek.chauhan@gmail.com Received: by 10.115.117.5 with SMTP id u5mr967216wam.111.1263507691969; Thu, 14 Jan 2010 14:21:31 -0800 (PST) In-Reply-To: <4B4F7F1B.4080902@the-cell.co.uk> References: <201001112305.16532.hwoarang@gentoo.org> <201001122149.11091.hwoarang@gentoo.org> <201001131054.03953.vapier@gentoo.org> <8b4c83ad1001140449k49995e0ra01eeca16167735a@mail.gmail.com> <4B4F7F1B.4080902@the-cell.co.uk> Date: Fri, 15 Jan 2010 03:51:31 +0530 X-Google-Sender-Auth: c0c90a639f702027 Message-ID: <8b4c83ad1001141421y22e416b8q4e5e4c9d47f4821f@mail.gmail.com> Subject: Re: [gentoo-dev] proxy maintainership and gentoo-x86 scm From: Nirbheek Chauhan To: gentoo-dev@lists.gentoo.org Content-Type: text/plain; charset=UTF-8 X-Archives-Salt: 54f7e465-e932-49f9-af0e-c15d1b32c8b8 X-Archives-Hash: 3fa1690fff35d58eddc7fae02dff4eae On Fri, Jan 15, 2010 at 2:01 AM, Daniel Bradshaw wrote: > On 01/14/2010 12:49 PM, Nirbheek Chauhan wrote: >> >> In theory, yes. In practice, git is too slow to handle 30,000 files. >> Even simple operations like git add become painful even if you put the >> whole of portage on tmpfs since git does a stat() on every single file >> in the repository with every operation. >> > > My understanding is that git was developed as the SCM for the kernel > project. > A quick check in an arbitary untouched kernel in /usr/src/ suggests a file > [1] count of 25300. > > Assuming that my figure isn't out by an order of magnitude, how does the > kernel team get along with git and 25k files but it is deathly slow for our > 30k? > Or, to phrase the question better... what are they doing that allows them to > manage? > My bad. I did the tests a while back, and the number "30,000" is actually for the no. of ebuilds in portage. The no. of files is actually ~113,000 (difference comes because every package has a manifest+changelog+metadata.xml+patches). OTOH, the no. of directories is "just" ~20,000, so if git would only do a stat() on directories, it would get into the "usable" circle. Also, since git does a stat on directories as well as files, you can say that every command has to do ~133,000 stats, which is damn slow even when cached. -- ~Nirbheek Chauhan Gentoo GNOME+Mozilla Team