From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) by finch.gentoo.org (Postfix) with ESMTP id BD5FF13800E for ; Fri, 31 Jan 2014 21:19:03 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id BB883E0B6A; Fri, 31 Jan 2014 21:18:56 +0000 (UTC) Received: from mail-la0-f44.google.com (mail-la0-f44.google.com [209.85.215.44]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 6A0ADE0AD8 for ; Fri, 31 Jan 2014 21:18:55 +0000 (UTC) Received: by mail-la0-f44.google.com with SMTP id hr13so206376lab.31 for ; Fri, 31 Jan 2014 13:18:53 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=date:from:to:cc:subject:message-id:in-reply-to:references :mime-version:content-type; bh=zUWkkwAmJ6IzyFCQh+35WlYFNs8eghmLUyVJo+1KrMI=; b=gt5dBq0K/SzUB7yphZzbIi51BXshmZzlL+V9yr9Gv8t9FlJMLiVcbQVF8UNjALahre sxX7FHZLJlZ42PZ4B72oJFljSP2lR4IFHBz2TBQtWdeSuC2ppHBexbOg2qYAsiHsOzQw SKL2aNsQytFIpxioPRJb9zeIFetnLVifE2UGQvxCADuthF2lO61xHjfoVIKuWnPYtzv1 X5/FKhifkCJbStmaNsmCH1lUT5HZ7MlDvkUemVcpRRmtaIFHV8vVNehmgLhwfPrReY5E 8m61OAbbSgAh0AmU/FKQ9a+K282WzX/U7G5vxI+2E9Z/0/oq2LQ4wTMw8FTSl4PF6aDw UYiw== X-Received: by 10.112.164.35 with SMTP id yn3mr2758865lbb.45.1391203133494; Fri, 31 Jan 2014 13:18:53 -0800 (PST) Received: from localhost ([198.46.152.80]) by mx.google.com with ESMTPSA id dm8sm15965115lad.7.2014.01.31.13.18.49 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 31 Jan 2014 13:18:52 -0800 (PST) Date: Sat, 1 Feb 2014 01:18:21 +0400 From: Andrew Savchenko To: gentoo-user@lists.gentoo.org Cc: Mick Subject: Re: [gentoo-user] Re: Portage performance dropped considerably Message-Id: <20140201011821.5d386f29024e40bd6bcc4ed5@gmail.com> In-Reply-To: <201401311913.45133.michaelkintzios@gmail.com> References: <52E5543B.4070808@gmail.com> <20140131230305.1b4ee153af223fd43f541fac@gmail.com> <201401311913.45133.michaelkintzios@gmail.com> X-Mailer: Sylpheed 3.3.0 (GTK+ 2.24.22; i686-pc-linux-gnu) Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org Mime-Version: 1.0 Content-Type: multipart/signed; protocol="application/pgp-signature"; micalg="PGP-SHA512"; boundary="Signature=_Sat__1_Feb_2014_01_18_21_+0400_g9IoP2vOE29se39P" X-Archives-Salt: 7ee6816a-f56d-4a38-9d39-57b5f3775d3a X-Archives-Hash: 3add1aa21b4e4beafa2c0e917aa7905b --Signature=_Sat__1_Feb_2014_01_18_21_+0400_g9IoP2vOE29se39P Content-Type: text/plain; charset=US-ASCII Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, 31 Jan 2014 19:13:21 +0000 Mick wrote: > On Friday 31 Jan 2014 19:03:05 Andrew Savchenko wrote: > > On Sun, 26 Jan 2014 20:30:19 +0200 Alan McKinnon wrote: [...] > > > I'm willing to give up 4 minutes while emerge runs so I don't have to > > > spend many more minutes right afterwards doing manually the very shit > > > that software is very good at. Whether portage is a complete pile of > > > dogshit software or not is beside the point. Even if it is, my 4 minu= tes > > > still buys me lots > >=20 > > 4 minutes are expendable but... on Atom N270 (my laptop) emerge > > -DNuav world takes 40 (yes, forty) minutes to build dependency tree > > with sqlite cache enabled and 60 minutes without sqlite. System was > > pretty old (not updated aside from GLSA updates for a year). And this > > 40 minutes repeated many times since USE flag clashes and dependency > > resolution failures. So I spent may day, damn whole day(!) for the > > sake to just start compiling (distcc is my friend here). >=20 > Out of interest what fs are you running portage on? I changed an old box= from=20 > reiserfs to ext4 and couldn't believe the speed up I got. I use ext4. In my case the problem is in CPU usage and Atom N270 is pretty weak these days. On this box HDD is fast and NCQ capable, memory is enough (2GB for 32bit setup). During dependencies calculation all 100% of time is spent in the python process. CPU is slightly overclocked (as much as SHE allows). There is nothing more that I can do here as an admin of this host. (Gentoo setup itself is complicated with >2200 packages.) IMO the only way to improve this issue (without throwing good working hardware in the window) is to rewrite dependency resolution code in some highly optimized pure C library (probably with some asm code) and to use this library via some python binding from portage. But I suppose algorithm itself should be reviewed first. Best regards, Andrew Savchenko --Signature=_Sat__1_Feb_2014_01_18_21_+0400_g9IoP2vOE29se39P Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (GNU/Linux) iQIcBAEBCgAGBQJS7BM1AAoJEFZZU7lTcnVsnXcQAKRF33HYlrFwKoyEnH7EpPHh EZoQdu8lcLmGXL/vHV+bqS3CqqilT5EPDfiDk9jN6d98FovYW3vv4oC7L1DPqJ4s L8gPhFcYkPNQNmbkfmCGOhax1qVfTMwdBr3OzBIUECwIPbmk7W1JbR3f2xK8ykY+ pVac7wGIvrmxu6ljbY3yUbv2VPY9YTASFamzRqOJroi5xgMeBwflnWBeFobvzgBz nq2O7J3hGtkjkMt+MSU97bVbyQsGH6JYJ1DTzf48zZhdU9u5ijLQLWYDMNMrrAG0 DSU/zpjT5+iQpMOOK9catzQB+qgxWe38Aa5DI0bg0Q75kBEQGyJb2tqSlGgVS+EA izpO6VFaQ0KHtQ3mG/KPfa7UWPP2ENb0gXdUhZy83WMSHIG6fcF4+LX3BK5aXgoJ /bvXqf5vRiiubjARtqx/6y2HUKam92mKwbh66dXxheCLSlMS/zIqUcbVCQ8AsLDD YDOogsa+36o0ZFsSyynZd9wCsH+Zfk8+cGHExAl4i5+um1H0RfG+OWpLUEUpAceG pzAB1DeJVCNu/EDNLPx6Hup9h7yv6Stlha7hF3lmaCQgNgh9E0clmzzLQ+EImxsf c7Y1lj8nKM81KQAvAAPS+PewKUQ5GfRcDtP+9VXBuug8oK4aJ17b2x1elFhUgX/j hi4t3Lxg3h84m8snJzSS =jrnj -----END PGP SIGNATURE----- --Signature=_Sat__1_Feb_2014_01_18_21_+0400_g9IoP2vOE29se39P--