From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id C8AF4138334 for ; Tue, 29 Oct 2019 14:33:14 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 6D4E6E093A; Tue, 29 Oct 2019 14:33:11 +0000 (UTC) Received: from smtp.gentoo.org (smtp.gentoo.org [140.211.166.183]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id D965BE092E for ; Tue, 29 Oct 2019 14:33:10 +0000 (UTC) Received: from gentoo.org (unknown [IPv6:2001:980:3ff0:64:5054:ff:fe0b:7015]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) (Authenticated sender: grobian) by smtp.gentoo.org (Postfix) with ESMTPSA id C689534C52E for ; Tue, 29 Oct 2019 14:33:08 +0000 (UTC) Date: Tue, 29 Oct 2019 15:33:04 +0100 From: Fabian Groffen To: gentoo-dev@lists.gentoo.org Subject: Re: [gentoo-dev] New distfile mirror layout Message-ID: <20191029143304.GC22441@gentoo.org> Mail-Followup-To: gentoo-dev@lists.gentoo.org References: <20191029093401.GB22441@gentoo.org> <839D1F8E-35EE-43C9-B513-9895F087D77A@gentoo.org> <13d97d150c38407525e3461e8560ce7f6ed92f14.camel@gentoo.org> Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-dev@lists.gentoo.org Reply-to: gentoo-dev@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="1SQmhf2mF2YjsYvc" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.12.2 (SunOS 5.11, VIM - Vi IMproved 8.1) Organization: Gentoo Foundation, Inc. X-Archives-Salt: 5fa51d76-50e9-4819-91cc-bcb2226419bb X-Archives-Hash: a70281410fc11d5c1201627b7d620848 --1SQmhf2mF2YjsYvc Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 29-10-2019 15:17:38 +0100, Ulrich Mueller wrote: > >>>>> On Tue, 29 Oct 2019, Micha=C5=82 G=C3=B3rny wrote: >=20 > > On Tue, 2019-10-29 at 14:09 +0100, Ulrich Mueller wrote: > >> > What if the file is hosted at a non-standard tcp port upstream > >> > (like http://example.org:8080/)? The devmanual says that it _must_ > >> > be manually uploaded to /space/distfiles-local/ in such cases. >=20 > >> Or another example, app-emacs/vhdl-mode-3.38.1, where (incompetent, > >> or nasty?) upstream blocks wget for some reason, but other methods > >> (e.g., curl, firefox) work? How would I get the file onto the mirrors > >> there? >=20 > > If I were you, I would've explicitly mirrored the file anyway. > > If upstream blocks wget, then users who do not use GENTOO_MIRRORS will > > also suffer due to it. >=20 > All what I'm saying is that there can be unusual circumstances where > manual uploading of a file is useful. So please don't take that > possibility away. In addition, there are currently files there that aren't referenced from ebuilds. Prefix uses these files during bootstrap, local mirrors are often much faster than dev.g.o. If the files don't get mirrored anymore, I guess I can create a dummy ebuild that has the files in SRC_URI. If the files get mirrored, but put in a subdir based on the filename hash, the original query endpoint on distfiles.g.o changes, much like the SRC_URI approach. Now I can use distfiles.prefix.b.n which redirects to the distfiles.g.o URL with subdir for most part I think, but it's sub-optimal from my point of view. Calculating the hash is not always feasible due to the lack of b2sum or other means. Hence my earlier request to have such official translation service on Gentoo hardware. (I just wrote a small wsgi script that calculates the hash and generates the redirect from Python, served via uwsgi/nginx, but there should be many ways to achieve the same goals, if and only if a blake2b implementation were available for it.) Thanks, Fabian --=20 Fabian Groffen Gentoo on a different level --1SQmhf2mF2YjsYvc Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQEzBAABCgAdFiEELUvHd/Gtp7LaU1vuzpXahU5EQpMFAl24TaAACgkQzpXahU5E QpN+pQf/becafw/5znYNGz031ZFTRRFoL80YyuL9ynKACD6ao7GpRMkrGPwb51Vn FfEQQV3xtWya1SM11WYBCAS8r9yLDJp+FlYtVxNkFXv8G1L7ltZgjLZSQLDQuZ0y BVwwBCzKAgCVv4KiOYAyLhl9+9e90pRhETSVz0RBLGcXLbU/gxParSMtZphlxINQ SWk4Oqf7ozOb2rJmqQjGCnR1dlPawpZyiqHFarKsqWiXKs9vuq+1DlnkjAkVhpjg sRkdttIJa1gxEvEblxKICpyp18M+TBD3XzL9a/UUtv/IjQvDo44JvdQjy4veHTpb FTVrQ0L5RIZJvfW7iiGrB72Zx47AHQ== =3wa/ -----END PGP SIGNATURE----- --1SQmhf2mF2YjsYvc--