From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from pigeon.gentoo.org ([208.92.234.80] helo=lists.gentoo.org) by finch.gentoo.org with esmtp (Exim 4.60) (envelope-from ) id 1OJXev-0006HX-Fx for garchives@archives.gentoo.org; Tue, 01 Jun 2010 20:01:57 +0000 Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id E3EC5E0BD5; Tue, 1 Jun 2010 20:01:11 +0000 (UTC) Received: from smtp.gentoo.org (smtp.gentoo.org [140.211.166.183]) by pigeon.gentoo.org (Postfix) with ESMTP id BBB4BE0BD5 for ; Tue, 1 Jun 2010 20:01:11 +0000 (UTC) Received: from [172.17.185.127] (ip-216-36-74-3.sjc.megapath.net [216.36.74.3]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by smtp.gentoo.org (Postfix) with ESMTP id 4C7DA1B4023 for ; Tue, 1 Jun 2010 20:01:11 +0000 (UTC) Subject: Re: [gentoo-portage-dev] Package compression header for binhosts From: Ned Ludd To: gentoo-portage-dev@lists.gentoo.org In-Reply-To: <20100601051608.GD19306@hrair> References: <4C047F52.30209@gentoo.org> <20100601051608.GD19306@hrair> Content-Type: text/plain; charset="us-ascii" Organization: Gentoo Linux Date: Tue, 01 Jun 2010 13:01:05 -0700 Message-ID: <1275422465.24611.9.camel@hangover> Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-portage-dev@lists.gentoo.org Reply-to: gentoo-portage-dev@lists.gentoo.org Mime-Version: 1.0 X-Mailer: Evolution 2.28.3.1 Content-Transfer-Encoding: 7bit X-Archives-Salt: b4c14f32-f727-43e0-bfa1-2a6c9fec74f7 X-Archives-Hash: 4fcdded23945251e3157960f80b7765d On Mon, 2010-05-31 at 22:16 -0700, Brian Harring wrote: > On Mon, May 31, 2010 at 08:32:34PM -0700, Zac Medico wrote: > > Hi, > > > > In order to support alternative compression types for binhost > > packages, I was thinking about adding support for a header field in > > the Packages index file. For example, a header line like > > "PACKAGE_EXTENSION: txz" could be used to indicate that clients > > should download files with txz extensions instead of tbz2 > > extensions. I'm planning to add support for both tgz [1] and txz > > extensions. > > > > [1] http://bugs.gentoo.org/show_bug.cgi?id=142579 > > 1) requires a version header bump Agreed. But there were some other pending changes for "VERSION: 1" Any planned changes to the format should be documented on https://bugs.gentoo.org/show_bug.cgi?id=263994 > 2) a header alone isn't useful unless it's specifiable per cpv entry; > thus it must be inheritable Per CPV entries is going to bloat the format and make me carry around a more data on a per pkg basis then I'd want to. How about we run with zac's idea but use tools to convert a full repo over to $EXTENTION This should keep the portage code fast as well as it checks for invalid binpkgs all the time. Having to have portage process a ton of ever growing extentions is just going to be slow. > 3) PACKAGE_EXTENSION is overly verbose and unclear it's specifying > the compressor too; it's intention is for compression, state it as > such (I mention this in light of URI's existance where > PACKAGE_EXTENSION would only be a hint of compressor) > > Re: #1, there is a decent set of optimizations I'm kicking around in > pkgcore for the next version- a discussion should probably be started > there. > > Offhand, having a compression specific header (a simple enumeration > of known compressors) and a DEFAULT_URI that is python string No go bro. The 'Packages' format should be independent of python. > interpolation assembled (for example, > DEFAULT_URI="%(host)s/%(category)s/%(pf)s.txz") seems wiser. Via > doing what I'm suggesting, it would be possible to do binpkg > repository 'views' w/out having to map each binpkg into the url space > for it. > > ~harring -- Ned Ludd Gentoo Linux