From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 82175138334 for ; Fri, 18 Oct 2019 13:41:43 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 305BBE093D; Fri, 18 Oct 2019 13:41:39 +0000 (UTC) Received: from smtp.gentoo.org (woodpecker.gentoo.org [IPv6:2001:470:ea4a:1:5054:ff:fec7:86e4]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id C8641E0930; Fri, 18 Oct 2019 13:41:38 +0000 (UTC) Received: from pomiot (c134-66.icpnet.pl [85.221.134.66]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) (Authenticated sender: mgorny) by smtp.gentoo.org (Postfix) with ESMTPSA id EF06F34C010; Fri, 18 Oct 2019 13:41:36 +0000 (UTC) Message-ID: <4c7465824f1fb69924c826f6bbe3ee73afa08ec8.camel@gentoo.org> Subject: [gentoo-dev] New distfile mirror layout From: =?UTF-8?Q?Micha=C5=82_G=C3=B3rny?= To: gentoo-dev-announce Cc: gentoo-dev Date: Fri, 18 Oct 2019 15:41:32 +0200 Organization: Gentoo Content-Type: multipart/signed; micalg="pgp-sha512"; protocol="application/pgp-signature"; boundary="=-lVarMST3TGcPY0tjn7MC" User-Agent: Evolution 3.32.4 Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-dev@lists.gentoo.org Reply-to: gentoo-dev@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 X-Archives-Salt: 1ef43e17-cde1-416f-971b-036f92fa45fc X-Archives-Hash: fb8b2dd311816dae972f71ef264beea5 --=-lVarMST3TGcPY0tjn7MC Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi, everybody. It is my pleasure to announce that yesterday (EU) evening we've switched to a new distfile mirror layout. Users will be switching to the new layout either as they upgrade Portage to 2.3.77 or -- if they upgraded already -- as their caches expire (24hrs). The new layout is mostly a bow towards mirror admins, for some of whom having a 60000+ files in a single directory have been a problem.=20 However, I suppose some of you also found e.g. the directory index hardly usable due to its size. Throughout a transitional period (whose exact length hasn't been decided yet), both layouts will be available. Afterwards, the old layout will be removed from mirrors. This has a few implications: 1. Users who don't upgrade their package managers in time will lose the ability of fetching from Gentoo mirrors. This shouldn't be that much of a problem given that the core software needed to upgrade Portage should all have reliable upstream SRC_URIs. 2. mirror://gentoo/file URIs will stop working. While technically you could use mirror://gentoo/XX/file, I'd rather recommend finally discarding its usage and moving distfiles to devspace. 3. Directly fetching files from distfiles.gentoo.org will become a little harder. To fetch a distfile named 'foo-1.tar.gz', you'd have to use something like: $ printf '%s' foo-1.tar.gz | b2sum | cut -c1-2 1b $ wget http://distfiles.gentoo.org/distfiles/1b/foo-1.tar.gz ... Alternatively, you can: $ wget http://distfiles.gentoo.org/distfiles/INDEX and grep for the right path there. This INDEX is also a more lightweight alternative to HTML indexes generated by the servers. If you're interested in more background details and some plots, see [1]. [1] https://dev.gentoo.org/~mgorny/articles/improving-distfile-mirror-struc= ture.html --=20 Best regards, Micha=C5=82 G=C3=B3rny --=-lVarMST3TGcPY0tjn7MC Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNATURE----- iQGTBAABCgB9FiEEx2qEUJQJjSjMiybFY5ra4jKeJA4FAl2pwQxfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEM3 NkE4NDUwOTQwOThEMjhDQzhCMjZDNTYzOUFEQUUyMzI5RTI0MEUACgkQY5ra4jKe JA7lRgf+JJvDiGR/NTApZNYJrF554DuR40DoeKxeHaxlg0Nk5EgDTG6rbjgrrlm9 lAyyU84pnFuLxkEmwlvI2FnneqB1dHz5LIWbm1LB27eEyJzo3psFwOgvD6QYMULG SuaJnbnfMEQQnum3hgwfGzbAmRxfV6hKezrMb++5gqIt45e52E2A/R/SLuy1e8lT GRKYEUE0glmz37KA5SnBWJmoDlbR83JUZ7XxctJXQFQDm52RCZZK+lRaAPMZHBLi nU4HaHTPomcr63Gfb7rRZyQc5wzYc5CCDLdsvRm14l4nJy9dM3MBI2Lo4Pi5fDOD sMq7Nrd5vS8V0s6ER3vVwoeiF5XnIw== =hbs+ -----END PGP SIGNATURE----- --=-lVarMST3TGcPY0tjn7MC--