From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: <gentoo-user+bounces-180844-garchives=archives.gentoo.org@lists.gentoo.org> Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 9F833139083 for <garchives@archives.gentoo.org>; Wed, 22 Nov 2017 07:21:15 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id CAF7EE0DEE; Wed, 22 Nov 2017 07:21:09 +0000 (UTC) Received: from mail-yw0-x243.google.com (mail-yw0-x243.google.com [IPv6:2607:f8b0:4002:c05::243]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 71A97E0D47 for <gentoo-user@lists.gentoo.org>; Wed, 22 Nov 2017 07:21:09 +0000 (UTC) Received: by mail-yw0-x243.google.com with SMTP id d2so6782963ywb.11 for <gentoo-user@lists.gentoo.org>; Tue, 21 Nov 2017 23:21:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=Q0JqdKBKUWyVmd2KlowVVzMllz45zwXUouRqnNogL/I=; b=Vx/REoRh5CKwLLOlflRShL4UJclsypHF1W/mHa8Ui5wdWb4ckI1Pbzi2Aoa+BrJoZd 2lTeJDRznUDTq4ECi4WHum4W6EZiy4hDyRoIMXcHIRkk7/0YU3MuhzssLEP9eF/dX2Ax gMcUP4UBWf0Utd7hksd3IhXxEKBUhlQvUfGrSbGugxFXDLrGEn3khPmOWodh30L+dFEG 4O80PhB3bDLRumMNCac16DvRMcaBq/YeQei4Lg2sy/0vQYRdulc00qbPcH5h4iXCSx7/ d0rPJ4Kgy1xlcDN/SYdFeeb44WOSzffGoMIMt6r6J214RrCT8eG2emIemK4jLd+xzITY BzsA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=Q0JqdKBKUWyVmd2KlowVVzMllz45zwXUouRqnNogL/I=; b=gOcpvDFVnPQnsvckpe2ZOtnvjS7716bqUheHdSiQKyiwrDDJmfxcojU1gTkQ4f8DyC pZt9z2ZycgStgXf4oDhAG9snZTx17w8jb0+X7/h5fC7a3WDDH4W/hvjstti+T4FMQj3V 99UDpv4YNG92LG0h5TDiEm47DrdeeZVGfubwvxj6/Irr1B5ZsPazYswe/aripHSBCbxa rS2WRyJik9NP0Msf2tGaBdVufkhjmkWP12Af0zKb/BVlRTnDgwijgG2dbVE2/RXyNIqN kX7n8Znq9zYs1x4ZhtmiuXNd7G2LZ5YASxR6khoucQF9JoCIxbIZjO8rDRWP03stlJzv gEAg== X-Gm-Message-State: AJaThX6fBltH8btf/BSeWKdKxFti6vlQQgHFGXJQg9e7Dr5PAdZj/6lr y7nDoBPhTKlUS50cprvSi/BHnMo2CKn86ZWJpOY= X-Google-Smtp-Source: AGs4zMYoj4T8CXI1/42+WlJkMHxEyeuqeljiwnj2SmPN2ZwFRo5LYE4p7+l81BlOAY1BS7NpvKesTYiViIKGVsMp0cE= X-Received: by 10.129.2.215 with SMTP id 206mr13166317ywc.404.1511335268204; Tue, 21 Nov 2017 23:21:08 -0800 (PST) Precedence: bulk List-Post: <mailto:gentoo-user@lists.gentoo.org> List-Help: <mailto:gentoo-user+help@lists.gentoo.org> List-Unsubscribe: <mailto:gentoo-user+unsubscribe@lists.gentoo.org> List-Subscribe: <mailto:gentoo-user+subscribe@lists.gentoo.org> List-Id: Gentoo Linux mail <gentoo-user.gentoo.org> X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org MIME-Version: 1.0 Received: by 10.13.246.132 with HTTP; Tue, 21 Nov 2017 23:21:07 -0800 (PST) In-Reply-To: <6b5fbeca-453c-f103-5e4e-a8db83a6dabf@st.com> References: <6b5fbeca-453c-f103-5e4e-a8db83a6dabf@st.com> From: R0b0t1 <r030t1@gmail.com> Date: Wed, 22 Nov 2017 01:21:07 -0600 Message-ID: <CAAD4mYjgrXLLMR7D-XLHkWqOCOR2Y1GDVpnvO3NjKobzUhzSrw@mail.gmail.com> Subject: Re: [gentoo-user] is multi-core really worth it? To: gentoo-user@lists.gentoo.org Content-Type: text/plain; charset="UTF-8" X-Archives-Salt: 60eea342-8170-4cfa-baa4-fc8c47bf9b40 X-Archives-Hash: f8591da382ccca46fecd1a105833fc8d Hello, On Wed, Nov 22, 2017 at 12:52 AM, Raffaele Belardi <raffaele.belardi@st.com> wrote: > Hi, > > rebuilding system and world with gcc-7.2.0 on a 6-core AMD CPU I have the impression that > most of the ebuilds limit parallel builds to 1, 2 or 3 threads. I'm aware it is only an > impression, I did not spend the night monitoring the process, but nevertheless every time > I checked the load was very low. > Assuming all of your compilation is on a RAM disk, there are two main bottlenecks that are easy to spot: network access (downloading new packages) and dependency chokepoints (packages must be compiled in a chain). Other potential chokepoints like disk access are negligible in my experience, though for one merge I did have two or three ebuilds fighting for disk IO "lock up" a system. If all dependencies have been satisfied on your system I invite you to merge a bunch of packages at once (@world?), you should notice greater parallelism. > Does anyone have real-world statistics of CPU usage based on gentoo world build? > I've considered ways to gather these statistics off and on over the years, but it is easy to start sinking a lot of time into it. It is possible the data you want exists, but I have not found any extant solution involving portage that provides that detail of logging.* Cheers, R0b0t1 * Someone will prove me wrong in 3... 2... 1...