From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from pigeon.gentoo.org ([208.92.234.80] helo=lists.gentoo.org) by finch.gentoo.org with esmtp (Exim 4.60) (envelope-from ) id 1PiZwg-0005w8-A7 for garchives@archives.gentoo.org; Thu, 27 Jan 2011 22:04:03 +0000 Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 419ADE0B38; Thu, 27 Jan 2011 22:02:39 +0000 (UTC) Received: from smtpq3.tb.mail.iss.as9143.net (smtpq3.tb.mail.iss.as9143.net [212.54.42.166]) by pigeon.gentoo.org (Postfix) with ESMTP id 08549E0B38 for ; Thu, 27 Jan 2011 22:02:38 +0000 (UTC) Received: from [212.54.42.143] (helo=smtp12.tb.mail.iss.as9143.net) by smtpq3.tb.mail.iss.as9143.net with esmtp (Exim 4.71) (envelope-from ) id 1PiZvK-0004Wr-Fg for gentoo-user@lists.gentoo.org; Thu, 27 Jan 2011 23:02:38 +0100 Received: from 5ed3454e.cm-7-4b.dynamic.ziggo.nl ([94.211.69.78] helo=data.antarean.org) by smtp12.tb.mail.iss.as9143.net with esmtp (Exim 4.71) (envelope-from ) id 1PiZvF-0002Gv-7K for gentoo-user@lists.gentoo.org; Thu, 27 Jan 2011 23:02:33 +0100 Received: from localhost (localhost [127.0.0.1]) by data.antarean.org (Postfix) with ESMTP id 13E1927CA for ; Thu, 27 Jan 2011 23:04:34 +0100 (CET) X-Virus-Scanned: amavisd-new at antarean.org Received: from data.antarean.org ([127.0.0.1]) by localhost (data.antarean.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 9OsPWyaLHQHn for ; Thu, 27 Jan 2011 23:04:33 +0100 (CET) Received: from eve.localnet (eve.lan.antarean.org [10.20.13.50]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by data.antarean.org (Postfix) with ESMTPS id 7D3FD27C9 for ; Thu, 27 Jan 2011 23:04:33 +0100 (CET) From: "J. Roeleveld" To: gentoo-user@lists.gentoo.org Subject: Re: [gentoo-user] Re: Simultaneously emerging multiple packages with same dependencies Date: Thu, 27 Jan 2011 23:02:31 +0100 User-Agent: KMail/1.13.5 (Linux/2.6.30-gentoo-r5; KDE/4.4.5; x86_64; ; ) References: <201101272018.35143.joost@antarean.org> <20110127210629.GB22926@ksp.sk> In-Reply-To: <20110127210629.GB22926@ksp.sk> Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org MIME-Version: 1.0 Content-Type: Text/Plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Message-Id: <201101272302.31293.joost@antarean.org> X-ZiggoSMTP-MailScanner-Information: Please contact the ISP for more information X-ZiggoSMTP-MailScanner-ID: 1PiZvF-0002Gv-7K X-ZiggoSMTP-MailScanner: Found to be clean X-ZiggoSMTP-MailScanner-SpamCheck: geen spam, SpamAssassin (niet cached, score=-0.928, vereist 5, BAYES_00 -1.90, RDNS_DYNAMIC 0.98, T_RP_MATCHES_RCVD -0.01) X-ZiggoSMTP-MailScanner-From: joost@antarean.org X-Spam-Status: No X-Archives-Salt: X-Archives-Hash: 476d300f26799c1c3188badc195e4ca7 On Thursday 27 January 2011 22:06:30 YoYo Siska wrote: > On Thu, Jan 27, 2011 at 08:18:34PM +0100, J. Roeleveld wrote: > > On Thursday 27 January 2011 19:56:23 Allan Gottlieb wrote: > > > On Thu, Jan 27 2011, Neil Bothwick wrote: > > > > On Thu, 27 Jan 2011 17:09:27 +0200, Nikos Chantziaras wrote: > > > >> > So on a 20 package world update, only 19 are faster while the 20th > > > >> > runs at the same speed? Where's the loss there? Even if the last > > > >> > were slower, it would be worth it. > > > >> > > > >> Given the amount of time unpack/configure/install of most packages > > > >> needs (very short), my observation is that it would not be worth it. > > > > > > > > Even if that were true, how much time would you have to save to > > > > justify adding -j 2 to EMERGE_DEFAULTS in make.conf? > > > > > > > > But it's not true, large packages spend a lot of time on these phases > > > > of the install. > > > > > > OK I'm convinced since I know that those phases do take noticeable > > > time. > > > > > > I have a "4" processor i7 model 620 (2 cores, doubled for > > > hyperthreading) and have set MAKEOPTS="-j5". > > > If I add -jobs=2 to EMERGE_DEFAULT_OPTS, should I lower > > > MAKEOPTS to 3 (to 4)? > > > > > > thanks, > > > allan > > > > You could, as if you leave it at -j5, you can end up with 2 * 5 = 10 > > processed, eg: similar as if running with MAKEOPTS="-j10" > > > > I think the option that YoYo came with is a good compromise: > > # MAKEOPTS="-j -l5" emerge -j --load-average=5 > > > > Next time I am doing a big upgrade, I'm going to test that to see how it > > behaves. > > I was just building the whole system for my notebook in a chroot on my > desktop machine ( I use FEATURES=buildpkg to build binary packages in > the chroot on a fast desktop machine and then upgrade the notebook with > the binary packages) and I used exactly that (-j -l5 for bot make and > emerge). Can't say if it really is better or not ;) but most of the time > all four cores were busy, though sometimes I saw even 6 or 7 gcc-s > simultaneously in top ;) > emerge was running 3 to 4 jobs most of the time, sometimes dropping to 1 > and once I saw it emerging about 10 parallel packages ;) (mostly small > things, which I guess were doing a lot of > unpacking/configuring/installing but almost nothing of compiling ;) > > > btw, just now I got this error from dev-lang/v8: > > SCons error: option -j: invalid integer value: '-l4' > > seems scons honors MAKEOPTS, but doesn't understand the "loadaverage" > version (-j -l4) You might be able to avoid this by using the "long" version in the MAKEOPTS for "-l"? Eg: MAKEOPTS="-j --load-average=5" emerge -j --load-average=5 -- Joost