From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 556C3158042 for ; Sat, 26 Oct 2024 05:03:28 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 1AA3BE09EC; Sat, 26 Oct 2024 05:03:19 +0000 (UTC) Received: from smtp.gentoo.org (dev.gentoo.org [IPv6:2001:470:ea4a:1:5054:ff:fec7:86e4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 4FE2FE09D8 for ; Sat, 26 Oct 2024 05:03:18 +0000 (UTC) Received: from grubbs.orbis-terrarum.net (localhost [127.0.0.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by smtp.gentoo.org (Postfix) with ESMTPS id 7B1FA3430FB for ; Sat, 26 Oct 2024 05:03:17 +0000 (UTC) Received: from grubbs.orbis-terrarum.net (localhost [127.0.0.1]) by grubbs.orbis-terrarum.net (Postfix) with ESMTP id B488B2601A2 for ; Sat, 26 Oct 2024 05:03:15 +0000 (UTC) Received: (qmail 358907 invoked by uid 10000); 26 Oct 2024 05:03:15 -0000 Date: Sat, 26 Oct 2024 05:03:15 +0000 From: "Robin H. Johnson" To: gentoo-dev@lists.gentoo.org Subject: Re: [gentoo-dev] [PATCH] profiles/thirdpartymirrors: add final fallback for apache Message-ID: References: <20241023032429.1874420-1-eschwartz@gentoo.org> Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-dev@lists.gentoo.org Reply-to: gentoo-dev@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="6MbuW/buUXnoNl78" Content-Disposition: inline In-Reply-To: <20241023032429.1874420-1-eschwartz@gentoo.org> X-Archives-Salt: d2f9d736-ab33-482f-855f-38d03dd158db X-Archives-Hash: 021ed8159cf98a2d47e3335ddcfe804e --6MbuW/buUXnoNl78 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Oct 22, 2024 at 11:24:29PM -0400, Eli Schwartz wrote: > Apache has a mirror network, which only covers the most recent release > of any given package. They also have an additional site which does not > appear to be a CDN, and is throttled and can maybe ban you if you use it > too much. Unfortunately, it is also the ONLY way to actually get > historic releases of many packages. >=20 > Use it, and use it last -- after every other mirror has been tried, > which should handle latest releases. In combination with GENTOO_MIRRORS > this should ensure that users can actually download software when > needed, without running afoul of throttling. This does not actually do it "last" as you claim. Portage shuffles the list of thirdpartymirrors: https://gitweb.gentoo.org/proj/portage.git/tree/lib/portage/package/ebuild/= fetch.py#n1140 While it increases mirror burden; this should likely be done as a distinct thirdpartymirror: apache-historical https://archive.apache.org/dist/ And that gets used in ebuilds when distfiles fall off the main mirrors [until such time as strictly ordered behavior is available]. In likelihood, unless the ebuild has RESTRICT=3Dmirror, I'd hope that that the primary request is made to Gentoo's mirrors before the upstreams: so that we are better open-source participants. Users who are also trying to use old ebuilds, where the distfile is no longer on the Gentoo mirrors should also consider thirdpartymirrors in their profiles, in which case inserting this entry locally would be appropriate. --=20 Robin Hugh Johnson Gentoo Linux: Dev, Infra Lead, Foundation Treasurer E-Mail : robbat2@gentoo.org GnuPG FP : 11ACBA4F 4778E3F6 E4EDF38E B27B944E 34884E85 GnuPG FP : 7D0B3CEB E9B85B1F 825BCECF EE05E6F6 A48F6136 --6MbuW/buUXnoNl78 Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 Comment: Robbat2 @ Orbis-Terrarum Networks - The text below is a digital signature. If it doesn't make any sense to you, ignore it. iQKTBAABCgB9FiEEveu2pS8Vb98xaNkRGTlfI8WIJsQFAmcceBFfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEJE RUJCNkE1MkYxNTZGREYzMTY4RDkxMTE5Mzk1RjIzQzU4ODI2QzQACgkQGTlfI8WI JsTDARAAhpOmbZ+u3fVJQVhCjS8gIliZPqfeBbqB9uFWf3yzFv5nbCvjn4cFdhRF 9tOZBe3oUr+niqMiMg6lsWCW4pzR7ntMui6kpX7j85uYyEA9JcsoFc3TsEk8fx6e ce3yLcsmZB5DbRbmeuMamsLjScbxhXFOaAPbvfHqVPpea2Uj6XpcosoMSoJqymRJ Xxl39GDNuS/jbh2vMk3qTPS7WP3KJv/GfiOcdgq6om5kewVhDlkwHcirhSO4Wo/7 +uaHEsm449fOFMtMA33CoIcF2dri9/WrX4L/zr4G7QJfdVBTDRhv6HZ44d0/090l MakfAo3DWd/ni63O/m5frdtlSTcZoQtuh5QRHsvrcnyfUEB3O5HjgNdL0MmIayhw o98hZOW5IObYL/WGCZT1lmzolxX/toiNHD1JIbe49SXargTMCqEv7bqq9lVmcp5f QaVkWQlTDoD7NnqB7Ff1wPFFrUWRHPCqmYY5+P9DtleqEMu/naixw+1sRDqPKYtx u3cnuuT567mTlv2cph+1L/GJzaHnuQnNs9lsAk+Oezvb/XvrTAK14MHwaNuosUTI GWTPtRZlVdtfQjVss6gBcItXnGFBbrWuxBpEzrtDrXX2F3P1bpn3j0NzwhiqSZcw YJmLSFezsLCj8ojJAIpIHgYb5J5Lew59CfPsA9sEWe+s7J6Dh3g= =/DG0 -----END PGP SIGNATURE----- --6MbuW/buUXnoNl78--