From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 3EA0E158089 for ; Mon, 4 Sep 2023 18:26:49 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 53F992BC024; Mon, 4 Sep 2023 18:26:44 +0000 (UTC) Received: from mail.digimed.co.uk (mail.digimed.co.uk [82.69.83.178]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id F21062BC018 for ; Mon, 4 Sep 2023 18:26:43 +0000 (UTC) Received: from digimed.co.uk (shooty.digimed.co.uk [192.168.1.4]) by mail.digimed.co.uk (Postfix) with ESMTPA id DE20B69F69 for ; Mon, 4 Sep 2023 19:26:42 +0100 (BST) Date: Mon, 4 Sep 2023 19:26:37 +0100 From: Neil Bothwick To: gentoo-user@lists.gentoo.org Subject: Re: [gentoo-user] Is distfile partial mirror with failover possible? Message-ID: <20230904192637.03ce8c6f@digimed.co.uk> In-Reply-To: References: <2900905.e9J7NaK4W3@rogueboard> <20230904182127.47147c1a@digimed.co.uk> Organization: Digital Media Production X-Mailer: Claws Mail 4.1.1 (GTK 3.24.38; x86_64-pc-linux-gnu) X-GPG-Fingerprint: 7260 0F33 97EC 2F1E 7667 FE37 BA6E 1A97 4375 1903 Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 Content-Type: multipart/signed; boundary="Sig_//n2n7bABV8pAq3x54ldG9re"; protocol="application/pgp-signature"; micalg=pgp-sha256 X-Archives-Salt: 18793b22-4465-459d-9fe3-7226d17d09dd X-Archives-Hash: 4170e424b82866aa3872933a0b8ebebc --Sig_//n2n7bABV8pAq3x54ldG9re Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On Mon, 4 Sep 2023 19:49:56 +0200, Alan McKinnon wrote: > Quick n dirty solution: >=20 > put all distfiles on a central server > FS mount that remote dir to /var/cache/distfiles on all hosts That's what I used to do, but had problems when downloading the same file from to clients at once. BTW Welcome back Alan, but leave your dirty top-posting in Archland :P >=20 > Alan >=20 > On Mon, Sep 4, 2023 at 7:21=E2=80=AFPM Neil Bothwick = wrote: >=20 > > On Mon, 04 Sep 2023 14:04:53 +0100, Michael wrote: > > =20 > > > On Monday, 4 September 2023 11:12:51 BST Walter Dnes wrote: =20 > > > > I may be misunderstanding, but it seems to me that local > > > > mirrors are all-or-nothing. In the interests of saving > > > > bandwidth, I'd like to have a client first check the host's > > > > /var/cache/distfiles directory for a source tarball file. If not > > > > found, then fail over to another mirror as per GENTOO_MIRRORS in > > > > /etc/portage/make.conf. This would require emerge doing the > > > > lookup and potential failover for each file. Is this possible? =20 > > > > > > Unless I misunderstand what you're asking, isn't this what takes > > > place anyway? =20 > > > > The reference to a host makes me think Walter wants one machne to hold > > the distfiles for all on the network. > > =20 > > > PS. Is http_replicator still available/maintained? I see the wiki > > > mentions apt-cacher-ng for local distfiles cache. =20 > > > > I use apt-cacher-ng for this and it does what you are looking for. > > > > > > -- > > Neil Bothwick > > > > The facts, although interesting, are usually irrelevant. > > =20 >=20 >=20 --=20 Neil Bothwick Not one shred of evidence supports the notion that life is serious. --Sig_//n2n7bABV8pAq3x54ldG9re Content-Type: application/pgp-signature Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEGfLZTV7dXdQXh/dDdCdyyQfftocFAmT2IV0ACgkQdCdyyQff toc+URAAkmfjishuZH5vQIfSNE5TfIk7tMJfADrcUL/WrWEukARzLGrN4xzPZzlh I/Ml4FAuDNY9Hst4+XX42lUkT6QpfYXx76l1GI4+W+hqg/1DVvj7nJBfORllgMDZ lM4OruQLQrbq+l3tBp4hMC0wvlZIyxGJ0De+rVmcbje9EZXr0xZ2XbFIVv4NjrrZ 0crwrZTAq6ORnv2gOfRJ+tyDdkGg8ZsaL8EB7/74RCycIC9qYi8BB8l53920Dw3g S+mPuCJ+cDziBpxcRksRLMmEGSyuSVZy5zNgZ/mKjLzojI/bk6Nn3trmn/Xbk1IL gIY60e+kW5PaYHL13PRBCv8YgwyYIVb1plYnFIeyr4fFHOwn5VxHiDjGaly/UlIZ ke2fIKPajlQyYPES7pyJZw5OQky34znBNCGfGpBGRrrrf5wssswZLJz0ie07vr1j AQQs0LBMGdgIbnxSZ2m0x1d666Rbx3bOGmF0oCN41uff9HaTB26XxvohceZn1ymq XrUUTMwHnlBhhPHnTSGDZvtlnBi9PWlcuj4ZOiCIGBj+spSczJ8Zm//9yja+Of4+ OMFuQw8f7Wqi6UyPankVQqPTv/7csn9BU6MXR+wZjYRol0GG03K5vUhVC7/tJg9X dCOKHpI2J/Dk4TwnVxTxeC8sOxQ+BIf70Z4jyRUpOuv47LH0BYY= =vFXo -----END PGP SIGNATURE----- --Sig_//n2n7bABV8pAq3x54ldG9re--