From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id ED857138334 for ; Wed, 23 Oct 2019 05:17:00 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 29EC0E09FA; Wed, 23 Oct 2019 05:16:56 +0000 (UTC) Received: from smtp.gentoo.org (woodpecker.gentoo.org [IPv6:2001:470:ea4a:1:5054:ff:fec7:86e4]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id A5C4FE09F3 for ; Wed, 23 Oct 2019 05:16:54 +0000 (UTC) Received: from [192.168.1.13] (c-76-114-240-162.hsd1.md.comcast.net [76.114.240.162]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) (Authenticated sender: kumba) by smtp.gentoo.org (Postfix) with ESMTPSA id 9FC6634C22F for ; Wed, 23 Oct 2019 05:16:53 +0000 (UTC) Subject: Re: [gentoo-dev] New distfile mirror layout To: gentoo-dev@lists.gentoo.org References: <4c7465824f1fb69924c826f6bbe3ee73afa08ec8.camel@gentoo.org> <2d15507e-98ad-9466-75b7-7e8268ef2eb9@gentoo.org> <752be6c75f337df8ee8124a804247d2fb27e73b4.camel@gentoo.org> <100ae6ba-fdd3-b697-0ccc-860c9b8e4521@gentoo.org> <01086c53bfbf7702dac10b75a25927b62ef90b53.camel@gentoo.org> <20191021231324.7c9d05d9@katipo2.lan> From: Joshua Kinard Openpgp: preference=signencrypt Message-ID: <79d2c3f3-9c9a-4247-205a-b929ee0a582c@gentoo.org> Date: Wed, 23 Oct 2019 01:16:51 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:60.0) Gecko/20100101 Thunderbird/60.9.0 Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-dev@lists.gentoo.org Reply-to: gentoo-dev@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 In-Reply-To: <20191021231324.7c9d05d9@katipo2.lan> Content-Type: text/plain; charset=UTF-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-Archives-Salt: 275c1fbf-9a9c-4135-959e-1470dbde19d8 X-Archives-Hash: 7ac7a422fd3ba49411caf48210da9373 On 10/21/2019 06:13, Kent Fredric wrote: > On Sun, 20 Oct 2019 16:57:54 -0400 > Joshua Kinard wrote: > >> I know we've got a ton of Perl packages for the core set of Perl modules, >> but doesn't the CPAN eclass also have the capability to auto-generate an >> ebuild package for virtually any Perl package distributed via CPAN? Can >> that logic be used with the CTAN system in its own eclass and then we remove >> the 16k+ texlive modules off of our mirrors completely? Or at the worst, we >> might just have to generate ebuilds for texlive modules and treat them as >> discrete, installed packages. > > - Perl packages never have more than 1:1 source archives per ebuild > - Perl upstream naming doesn't habitually use "perl-" as an archive prefix > - Everything that is packaged for Perl in Gentoo is mirrored to the > Gentoo distfiles mirror, and this causes no issues. > > So I don't think any comparison here makes sense. I have to disagree on the "doesn't make sense" bit. Regardless of what it is that TexLive is packaging, the problem that I feel exists is storing these macro packages on our mirrors is what is responsible for 20% of *all* distfiles that we store. That's lopsided that a small collection of ebuilds, due to the way their build logic is architected, has that many distfiles on the mirrors. It's scenarios like that which led to Michał developing the GLEP the way he did. His approach is more broad, seeking to future-proof the mirroring issue regardless of package mirroring decisions, whereas I'm more curious why texlive needs all of those packages on our mirrors when it appears to have a fairly comprehensive mirroring system of its own. Why reinvent the wheel? Since CTAN exists as a worldwide mirroring system, I think at a minimum, we should try to fetch from that directly instead of mirroring them on our own systems and partner mirrors. Or we could go the other way and become an official CTAN mirror ourselves. After all, if we're going to reinvent the wheel, do all four instead of just one. And for Perl or Python, I think we should be making an effort to leverage their respective mirroring systems first before putting their distfiles onto our mirrors. Perl's got CPAN, and Python has pypi. For things that don't exist on those systems, then we use our mirrors. -- Joshua Kinard Gentoo/MIPS kumba@gentoo.org rsa6144/5C63F4E3F5C6C943 2015-04-27 177C 1972 1FB8 F254 BAD0 3E72 5C63 F4E3 F5C6 C943 "The past tempts us, the present confuses us, the future frightens us. And our lives slip away, moment by moment, lost in that vast, terrible in-between." --Emperor Turhan, Centauri Republic