From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) by finch.gentoo.org (Postfix) with ESMTP id 2C67F138BD3 for ; Tue, 4 Nov 2014 09:19:32 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id E0E12E0835; Tue, 4 Nov 2014 09:19:30 +0000 (UTC) Received: from smtp.gentoo.org (smtp.gentoo.org [140.211.166.183]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 588F7E0833 for ; Tue, 4 Nov 2014 09:19:30 +0000 (UTC) Received: from [192.168.1.7] (ip70-181-96-121.oc.oc.cox.net [70.181.96.121]) (using TLSv1 with cipher ECDHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: zmedico) by smtp.gentoo.org (Postfix) with ESMTPSA id 55A5F34041B for ; Tue, 4 Nov 2014 09:19:29 +0000 (UTC) Message-ID: <54589A1F.1010006@gentoo.org> Date: Tue, 04 Nov 2014 01:19:27 -0800 From: Zac Medico User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.8.1 Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-portage-dev@lists.gentoo.org Reply-to: gentoo-portage-dev@lists.gentoo.org MIME-Version: 1.0 To: gentoo-portage-dev@lists.gentoo.org Subject: Re: [gentoo-portage-dev] References: <5441DE73.3090601@gentoo.org> <1414881983-19877-1-git-send-email-zmedico@gentoo.org> <20141103134211.6a613c27.dolsen@gentoo.org> In-Reply-To: <20141103134211.6a613c27.dolsen@gentoo.org> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit X-Archives-Salt: b88de102-e32d-4495-bece-acf61dca9cde X-Archives-Hash: 0ffa3cc996cbd06d9da7bcd674ad95d6 On 11/03/2014 01:42 PM, Brian Dolbec wrote: > I know the above times are probably slowed by not having overlays indexed, but it is still a significant speedup. > esearch is only marginally slower doing a -S search than a regular pkg-name search, typically just over 0.2 seconds > > > The above was done with only the gentoo repo indexed, plus I need to clean out some old ebuilds in overlays. > But I was shocked to see the normal -s searches going from 3.4s to 5.5s with your new index. If you update now, performance should be much better. Specifically: 1) pkg_desc_index_line_read has been optimized to skip validation (biggest performance problem). 2) IndexedPortdb has been optimized to use a single portdbapi.cp_all call that covers all of the unindexed repositories. > Also I did not see a way to specify all repos to be index updated. It is I believe a requirement of this new system. > Re-running is for each repo installed individually is something to be reserved for the new postsync() to do when it > lands in master. Yeah, I guess we may as well wait for the plugin-sync branch to get merged first. -- Thanks, Zac