From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from pigeon.gentoo.org ([208.92.234.80] helo=lists.gentoo.org) by finch.gentoo.org with esmtp (Exim 4.60) (envelope-from ) id 1MF3TW-0008BW-WB for garchives@archives.gentoo.org; Fri, 12 Jun 2009 09:55:07 +0000 Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id E261EE053D; Fri, 12 Jun 2009 09:55:00 +0000 (UTC) Received: from smtprelay09.ispgateway.de (smtprelay09.ispgateway.de [80.67.31.32]) by pigeon.gentoo.org (Postfix) with ESMTP id 9D75EE053D for ; Fri, 12 Jun 2009 09:55:00 +0000 (UTC) Received: from [85.179.23.141] (helo=[192.168.0.3]) by smtprelay09.ispgateway.de with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.68) (envelope-from ) id 1MF3U0-0007Ai-0d; Fri, 12 Jun 2009 11:55:36 +0200 Message-ID: <4A3225F0.6070800@hartwork.org> Date: Fri, 12 Jun 2009 11:54:56 +0200 From: Sebastian Pipping User-Agent: Thunderbird 2.0.0.21 (X11/20090502) Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-dev@lists.gentoo.org Reply-to: gentoo-dev@lists.gentoo.org MIME-Version: 1.0 To: PackageKit users and developers list CC: gentoo-dev@lists.gentoo.org Subject: [gentoo-dev] Re: [packagekit] Inviting you to project "PackageMap" References: <4A3206DA.3090907@hartwork.org> <15e53e180906120130md68cd94nba61fa5560c73eb4@mail.gmail.com> In-Reply-To: <15e53e180906120130md68cd94nba61fa5560c73eb4@mail.gmail.com> Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 7bit X-Df-Sender: 874396 X-Archives-Salt: aaf0aad0-ff36-4b6f-8026-dffdceb1b19d X-Archives-Hash: 3c341b87f8000546f0771d9daee9f709 Richard Hughes wrote: > I'm slightly worried about it being called a service. Is it going to > be a new process that just does the mapping or is this a bad choice of > words? If it is a new process then I'm not sure such a thing will > catch on. I'm not yet sure about how a mapper will keep it's data fresh as the use of it is dependent on that. Ignore my "service" for now. > I'm also worried that a package manager has to read in and parse > thousands of small files. While you mention "package manager" - with the current concept the data will not be precise enough for use with a package manager. > Why did you decide to write each project as > a single xml file? - The other 99% of the database stay valid XML if a single file is invalid - To better fit the version controlled environment > Parsing and reading 10,000 files (in multiple directories) might take > a few seconds, and would have to be copied into memory (few Mb) to > query quickly. Correct. > Which has to be invalidated if any of the files or > directories change. Why didn't you just put them in a sqlite database > that can be queried in a few ms, without dragging in an xml parser? > Also 10,000 files take up way more space (and takes longer to install > and update) than a single database file. I like your idea about sqlite. Maybe keeping the data to edit XML and query and sqlite export snapshot is something to try. > XML might be > useful for storing the data, but not for querying. Good point. Sebastian