From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from pigeon.gentoo.org ([69.77.167.62] helo=lists.gentoo.org) by finch.gentoo.org with esmtp (Exim 4.60) (envelope-from ) id 1L4GNr-0003yd-1C for garchives@archives.gentoo.org; Sun, 23 Nov 2008 14:56:23 +0000 Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 2504AE049D; Sun, 23 Nov 2008 14:56:23 +0000 (UTC) Received: from qw-out-1920.google.com (qw-out-1920.google.com [74.125.92.146]) by pigeon.gentoo.org (Postfix) with ESMTP id DF65DE049D for ; Sun, 23 Nov 2008 14:56:22 +0000 (UTC) Received: by qw-out-1920.google.com with SMTP id 5so379002qwc.10 for ; Sun, 23 Nov 2008 06:56:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:in-reply-to:mime-version:content-type:references; bh=SgyuLEIEUu1cBatCZzGAlAaBpxiXQoKTM6cu0PLNuYg=; b=iyYtu+odj3hKcQdPCQC1WCmcXRbldkNltdF5JNn5VO0fSVb+NX11lEt7c/l6jd15O2 8aruEZTidVBbTrwMTK2IVtjhaYPimX1BSNHVurp8Qf9X6sOGSpEiFO2Tpf9ws83AeP5O ivORBF5oArrOhxTKqlxl0BXJvLKWLpa8ifzlw= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:in-reply-to:mime-version :content-type:references; b=d1ff/6hgJCaHGhoTP+i5egqRSWFJVS+SFOeS5trobadpTr7fF7kuoq+0Eu8e9d8NVv 3laJ22Q4AQqxqgufkL8ouNampf2pMqX4SZZUv+LGakjDWIrmd2ANv7E5Y0/X2/4orVjG T8dLYQEDfFxi+5EtFx0RS9uw9AYyrL/9j302Y= Received: by 10.214.43.11 with SMTP id q11mr1451363qaq.132.1227452180303; Sun, 23 Nov 2008 06:56:20 -0800 (PST) Received: by 10.214.242.9 with HTTP; Sun, 23 Nov 2008 06:56:20 -0800 (PST) Message-ID: <4511e6e80811230656w528284b0r5df94b32aca55175@mail.gmail.com> Date: Sun, 23 Nov 2008 23:56:20 +0900 From: "Douglas Anderson" To: gentoo-portage-dev@lists.gentoo.org Subject: Re: [gentoo-portage-dev] search functionality in emerge In-Reply-To: <1227450820.27501.0.camel@localhost> Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-portage-dev@lists.gentoo.org Reply-to: gentoo-portage-dev@lists.gentoo.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_52369_10626615.1227452180303" References: <5a8c638a0811230417r5bcf912fka14a18edc9c711b6@mail.gmail.com> <1227450820.27501.0.camel@localhost> X-Archives-Salt: 33139d4f-7327-42f4-ad16-d9ba4d30ae43 X-Archives-Hash: 63514a247cbf5033b392ccacbd414361 ------=_Part_52369_10626615.1227452180303 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Emma, It would be great it you could speed search up a bit! As these other guys have pointed out, we do have some indexing tools in Gentoo already. Most users don't understand why that kind of functionality isn't built directly into Portage, but IIRC it has something to do with the fact that these fast search indexes aren't able to be written to by more than one process at the same time, so for example if you had two emerges finishing at the same time, Portage's current flat hash file can handle that, but the faster db-based indexes can't. Anyways, that's the way I, as a curious user, understood the problem. You might be interested in reading this, very old forum thread about a previous attempt: http://forums.gentoo.org/viewtopic-t-261580-postdays-0-postorder-asc-start-= 0.html On Sun, Nov 23, 2008 at 11:33 PM, Pacho Ramos < pacho@condmat1.ciencias.uniovi.es> wrote: > El dom, 23-11-2008 a las 16:01 +0200, tvali escribi=F3: > > Try esearch. > > > > emerge esearch > > esearch ... > > > > 2008/11/23 Emma Strubell > > Hi everyone. My name is Emma, and I am completely new to this > > list. I've been using Gentoo since 2004, including Portage of > > course, and before I say anything else I'd like to say thanks > > to everyone for such a kickass package management system!! > > > > Anyway, for my final project in my Data Structures & > > Algorithms class this semester, I would like to modify the > > search functionality in emerge. Something I've always noticed > > about 'emerge -s' or '-S' is that, in general, it takes a very > > long time to perform the searches. (Although, lately it does > > seem to be running faster, specifically on my laptop as > > opposed to my desktop. Strangely, though, it seems that when I > > do a simple 'emerge -av whatever' on my laptop it takes a very > > long time for emerge to find the package and/or determine the > > dependecies - whatever it's doing behind that spinner. I can > > definitely go into more detail about this if anyone's > > interested. It's really been puzzling me!) So, as my final > > project I've proposed to improve the time it takes to perform > > a search using emerge. My professor suggested that I look into > > implementing indexing. > > > > However, I've started looking at the code, and I must admit > > I'm pretty overwhelmed! I don't know where to start. I was > > wondering if anyone on here could give me a quick overview of > > how the search function currently works, an idea as to what > > could be modified or implemented in order to improve the > > running time of this code, or any tip really as to where I > > should start or what I should start looking at. I'd really > > appreciate any help or advice!! > > > > Thanks a lot, and keep on making my Debian-using professor > > jealous :] > > Emma > > > > > > > > -- > > tvali > > > > Kuskilt foorumist: http://www.cooltests.com - kui inglise keelt oskad. > > Muide, =FCle 120 oled v=E4ga tark, =FCle 140 oled geenius, mingi 170 ol= ed ju > > mingi t=E4ica pea nagu pr=FCgikast... > > I use eix: > emerge eix > > ;-) > > > ------=_Part_52369_10626615.1227452180303 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Emma,

It would be great it you could speed search up a bit!

= As these other guys have pointed out, we do have some indexing tools in Gen= too already. Most users don't understand why that kind of functionality= isn't built directly into Portage, but IIRC it has something to do wit= h the fact that these fast search indexes aren't able to be written to = by more than one process at the same time, so for example if you had two em= erges finishing at the same time, Portage's current flat hash file can = handle that, but the faster db-based indexes can't.

Anyways, that's the way I, as a curious user, understood the proble= m.

You might be interested in reading this, very old forum thread ab= out a previous attempt:
http://forums.gentoo.org/view= topic-t-261580-postdays-0-postorder-asc-start-0.html

On Sun, Nov 23, 2008 at 11:33 PM, Pacho Ramo= s <pacho@condmat1.ciencias.uniovi.es> wrote:
El dom, 23-11-2008 a las 16:01 +0200, tvali escribi=F3:
> Try esearch.
>
> emerge esearch
> esearch ...
>
> 2008/11/23 Emma Strubell <emma.strubell@gmail.com>
>         Hi everyone. My name is Emma, and I am com= pletely new to this
>         list. I've been using Gentoo since 200= 4, including Portage of
>         course, and before I say anything else I&#= 39;d like to say thanks
>         to everyone for such a kickass package man= agement system!!
>
>         Anyway, for my final project in my Data St= ructures &
>         Algorithms class this semester, I would li= ke to modify the
>         search functionality in emerge. Something = I've always noticed
>         about 'emerge -s' or '-S' = is that, in general, it takes a very
>         long time to perform the searches. (Althou= gh, lately it does
>         seem to be running faster, specifically on= my laptop as
>         opposed to my desktop. Strangely, though, = it seems that when I
>         do a simple 'emerge -av whatever' = on my laptop it takes a very
>         long time for emerge to find the package a= nd/or determine the
>         dependecies -  whatever it's doin= g behind that spinner. I can
>         definitely go into more detail about this = if anyone's
>         interested. It's really been puzzling = me!) So, as my final
>         project I've proposed to improve the t= ime it takes to perform
>         a search using emerge. My professor sugges= ted that I look into
>         implementing indexing.
>
>         However, I've started looking at the c= ode, and I must admit
>         I'm pretty overwhelmed! I don't kn= ow where to start. I was
>         wondering if anyone on here could give me = a quick overview of
>         how the search function currently works, a= n idea as to what
>         could be modified or implemented in order = to improve the
>         running time of this code, or any tip real= ly as to where I
>         should start or what I should start lookin= g at. I'd really
>         appreciate any help or advice!!
>
>         Thanks a lot, and keep on making my Debian= -using professor
>         jealous :]
>         Emma
>
>
>
> --
> tvali
>
> Kuskilt foorumist: http://www.cooltests.com - kui inglise keelt oskad.
> Muide, =FCle 120 oled v=E4ga tark, =FCle 140 oled geenius, mingi 170 o= led ju
> mingi t=E4ica pea nagu pr=FCgikast...

I use eix:
emerge eix

;-)



------=_Part_52369_10626615.1227452180303--