From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from pigeon.gentoo.org ([69.77.167.62] helo=lists.gentoo.org) by finch.gentoo.org with esmtp (Exim 4.60) (envelope-from ) id 1Jcgdf-0006EO-Ry for garchives@archives.gentoo.org; Fri, 21 Mar 2008 12:46:28 +0000 Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 26F8BE0772; Fri, 21 Mar 2008 12:46:26 +0000 (UTC) Received: from smtp.gentoo.org (smtp.gentoo.org [140.211.166.183]) by pigeon.gentoo.org (Postfix) with ESMTP id 00BB3E0772 for ; Fri, 21 Mar 2008 12:46:26 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by smtp.gentoo.org (Postfix) with ESMTP id 2CC0166B1A for ; Fri, 21 Mar 2008 12:46:25 +0000 (UTC) X-Virus-Scanned: amavisd-new at gentoo.org X-Spam-Score: -0.032 X-Spam-Level: X-Spam-Status: No, score=-0.032 required=5.5 tests=[AWL=0.500, BAYES_00=-2.599, RCVD_NUMERIC_HELO=2.067] Received: from smtp.gentoo.org ([127.0.0.1]) by localhost (smtp.gentoo.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id PTSbiOgXuIir for ; Fri, 21 Mar 2008 12:46:19 +0000 (UTC) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (No client certificate requested) by smtp.gentoo.org (Postfix) with ESMTP id 006DC651C3 for ; Fri, 21 Mar 2008 12:46:15 +0000 (UTC) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1JcgdN-0000QC-Oz for gentoo-dev@gentoo.org; Fri, 21 Mar 2008 12:46:09 +0000 Received: from 82.153.76.211 ([82.153.76.211]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Fri, 21 Mar 2008 12:46:09 +0000 Received: from slong by 82.153.76.211 with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Fri, 21 Mar 2008 12:46:09 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: gentoo-dev@lists.gentoo.org From: Steve Long Subject: [gentoo-dev] Re: Re: Re: RFC: New build types Date: Fri, 21 Mar 2008 12:52:28 +0000 Message-ID: References: <47DF954A.3000808@gentoo.org> <47E1F263.3010508@gentoo.org> <20080320071510.GA4539@seldon.hsd1.ca.comcast.net> Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-dev@lists.gentoo.org Reply-to: gentoo-dev@lists.gentoo.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7Bit X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: 82.153.76.211 User-Agent: KNode/0.10.5 Sender: news X-Archives-Salt: 792b5507-8263-4978-b43f-4b7d873202b9 X-Archives-Hash: c90052bf07ca974f714d3a2bd75c594d Brian Harring wrote: > On Thu, Mar 20, 2008 at 06:51:13AM +0000, Steve Long wrote: >> I don't have figures, but my understanding is that one of the major >> factors in pkgcore's speed (which *is* impressive, even if the UI isn't >> quite there yet) is that it doesn't reload bash for every phase. (The >> whole ebuild "daemon" or ebd thing.) > > From a speed standpoint, EBD is only relevant if we're talking about > metadata regeneration- > http://gentooexperimental.org/~ferringb/blog/archives/2005-03.html#e2005-03-05T16_59_39.txt > Ah OK; thanks, very interesting post. > Generally speaking, if you're sourcing to get metadata (regardless of > the underlying format), you're already screwed- cache exists for a > reason and is massively faster to rely on. Pkgcore's speed comes > about from careful design + a massive amount of JIT, EBD is faster > then the alternatives but that's *only* relevant for metadata > regeneration. > Would the metadata regen be quicker if the relevant file were in python rather than bash? > Finally, bear in mind we're talking about build phase here- even if > the pkg is just a straight unpack/copy, the bottleneck there isn't > going to be the bash bits for setting up the env, it's going to be the > unpack, copy, multiple QA checks that do repeated find's across ${D}, > multiple file invocations for same file, etc. Seriously- profile a > merge sometime, even on non-compilations the large time slices are > never bash. Understood; thanks for discussing. I was under the impression that implicit in the design of portage/pkgcore, was that build scripts wouldn't necessarily be in bash, and that ebuild was simply the bash format. Other formats in scripting languages seemed a no-brainer; sorry if it was off-base. -- gentoo-dev@lists.gentoo.org mailing list