public inbox for gentoo-user@lists.gentoo.org
 help / color / mirror / Atom feed
From: Michael <confabulate@kintzios.com>
To: gentoo-user@lists.gentoo.org
Subject: Re: [gentoo-user] Is distfile partial mirror with failover possible?
Date: Tue, 05 Sep 2023 16:05:53 +0100	[thread overview]
Message-ID: <10335588.nUPlyArG6x@rogueboard> (raw)
In-Reply-To: <6022cb09-a115-85c2-fa17-2661a5ae7d0e@konstantinhansen.de>

[-- Attachment #1: Type: text/plain, Size: 1406 bytes --]

On Tuesday, 5 September 2023 10:06:42 BST hitachi303 wrote:
> Am 04.09.23 um 15:04 schrieb Michael:
> > PS. Is http_replicator still available/maintained?  I see the wiki
> > mentions
> > apt-cacher-ng for local distfiles cache.
> 
> IIRC it died when python or perl 2.x was no longer available.

It's worth mentioning another option, not involving a full caching proxy as 
such.  It may suit Walter's workflow so I mention it here for completeness.  A 
lightweight browser can serve files directly from the local mirror's own /var/
cache/distfiles.

Unlike a caching proxy, files not already downloaded/needed by the local 
mirror won't be available locally, so the clients will download these from 
external mirrors.  The local server will need to be updated first, to fetch 
all the latest source file versions.  If there is a large difference in 
package requirements between different clients and the server, then only a 
partial bandwidth efficiency will be achieved this way.  Also if all the 
clients require the same packages not available on the server, then these will 
be downloaded by each client separately from external mirrors, further eroding 
any savings in overall bandwidth.

Setting up a small footprint browser like gatling, or just a couple of lines 
of python http.server, will allow any light on resources gentoo machine to 
become a useful local mirror with minimal configuration.

[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

      reply	other threads:[~2023-09-05 15:06 UTC|newest]

Thread overview: 19+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2023-09-04 10:12 [gentoo-user] Is distfile partial mirror with failover possible? Walter Dnes
2023-09-04 13:04 ` Michael
2023-09-04 17:21   ` Neil Bothwick
2023-09-04 17:49     ` Alan McKinnon
2023-09-04 18:26       ` Neil Bothwick
2023-09-04 19:37         ` Alan McKinnon
2023-09-04 20:02           ` Mark Knecht
2023-09-04 21:20             ` Arve Barsnes
2023-09-05 16:34           ` Laurence Perkins
2023-09-05  2:54     ` Walter Dnes
2023-09-05  7:04       ` Neil Bothwick
2023-09-05 14:58         ` Walter Dnes
2023-09-05 15:07           ` Michael
2023-09-05 15:26             ` Neil Bothwick
2023-09-05 15:33             ` Walter Dnes
2023-09-05 18:28               ` Michael
2023-09-06  1:52           ` William Kenworthy
2023-09-05  9:06   ` hitachi303
2023-09-05 15:05     ` Michael [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=10335588.nUPlyArG6x@rogueboard \
    --to=confabulate@kintzios.com \
    --cc=gentoo-user@lists.gentoo.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox