From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) by finch.gentoo.org (Postfix) with ESMTP id 61CE11389E2 for ; Wed, 24 Dec 2014 08:14:04 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 0757FE08E9; Wed, 24 Dec 2014 08:14:02 +0000 (UTC) Received: from smtp.gentoo.org (smtp.gentoo.org [140.211.166.183]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 76110E08D5 for ; Wed, 24 Dec 2014 08:14:01 +0000 (UTC) Received: from [192.168.100.192] (67-203-132-147.static-ip.telepacific.net [67.203.132.147]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) (Authenticated sender: zmedico) by smtp.gentoo.org (Postfix) with ESMTPSA id 814D334054D for ; Wed, 24 Dec 2014 08:14:00 +0000 (UTC) Message-ID: <549A75C5.70600@gentoo.org> Date: Wed, 24 Dec 2014 00:13:57 -0800 From: Zac Medico User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-portage-dev@lists.gentoo.org Reply-to: gentoo-portage-dev@lists.gentoo.org MIME-Version: 1.0 To: gentoo-portage-dev@lists.gentoo.org Subject: Re: [gentoo-portage-dev] [RFC] New file layout for PKGDIR and binhosts References: <549A1C31.8040500@gentoo.org> <549A4C25.9050000@gentoo.org> In-Reply-To: <549A4C25.9050000@gentoo.org> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Archives-Salt: b771670b-5d10-4326-96e5-df205c2aa08f X-Archives-Hash: c2229f7f80481fc90f8baf3facfe3af2 On 12/23/2014 09:16 PM, Matthew Thode wrote: > I like this (and it has been a long time coming). What format are we > going to store the metadata of the use flag combinations and the rest? The current approach is to store the data in an xpak segment that is appended to the end of the tbz2 file. The $PKGDIR/Packages files serves as a cache for the essential parts of the xpak data that are used in dependency calculations. > I guess that's already stored since portage knows not to use binpkgs if > those change. > > Also, would this change be a good time to change to store that metadata > externally? That's why we have the $PKGDIR/Packages cache, which is validated using stat.st_size and stat.st_mtime > Running portage over NFS with binpkgs takes forever, I It's probably all of the readdir and stat calls. If we simply assumed that $PKGDIR/Packages was valid, we could eliminate the readdir and stat calls. Binhost clients operate under this assumption. > don't think a binhost makes it faster either. If there were some way to > get all the info for the binpkgs into one file (so it could be run on > cron or something), this could mean that I'd only have to do one file > request for all that metadata and would be much quicker than inspecting > all those files. That's what $PKGDIR/Packages is. -- Thanks, Zac