From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 2AC41158089 for ; Wed, 6 Sep 2023 02:03:10 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 09DC32BC029; Wed, 6 Sep 2023 02:03:04 +0000 (UTC) Received: from icp-osb-irony-out6.external.iinet.net.au (icp-osb-irony-out6.external.iinet.net.au [203.59.1.106]) by pigeon.gentoo.org (Postfix) with ESMTP id 233052BC019 for ; Wed, 6 Sep 2023 02:03:02 +0000 (UTC) X-SMTP-MATCH: 0 X-IPAS-Result: =?us-ascii?q?A2DmBABa3fdk//1869xagRKEc4YtsV0PAQEBAQEBAQEBC?= =?us-ascii?q?UQEAQGFBgKGbyY4EwEGAQEBAQMCAwEBAQEBAQMBAQEFAgEBAQEGAwGBHYUvR?= =?us-ascii?q?oYFAQUjDwEFUQsSBgICJgICSQ4TCAEBF4JjAYJeqmeBMoEBtQ+BF4YLgioBi?= =?us-ascii?q?kGCDYE8DAOCRDE+iB+CRSKJUYVEBzKGBYkpKoEICF+Baj0CDVQLC12BFYJHA?= =?us-ascii?q?gIRJxITBUJxGwMHA4ECECsHBDIbBwYJFxgVJQZRAgItJAkTEj4EgWmBUwqBB?= =?us-ascii?q?j8RDhGCRys2NhlLgmMJFQw1TnYQKwQUGIETBGofFR42ERIZDQMIdh0CMjwDB?= =?us-ascii?q?QMENgoVDQshBRRDA0gGTAsDAhwFAwMEgTYFDx8CEBoGDi0DAxoWBA4DGSsdQ?= =?us-ascii?q?AIBC209NQkLG0YCJ6VfgU57kmwBkTmgPoQVoQkGDwQvlyMIkjSYLKhFgUE5g?= =?us-ascii?q?X5NHxmDdBkPoh2BPQmLSAEB?= IronPort-Data: A9a23:s9J7eaPSQy2wrYPvrR3OlsFynXyQoLVcMsEvi/4bfWQNrUon0zFUx 2tLXzzSPauMMDSnfttzadzl8xlSvMTQyoVnHgds+CBmFX5D95PIX9rGcBb8MXiccMHOFhM3t chDY4idcJlkH3TRjyn2P+m6pxGQ900oqpkQqQLgEnosLeOxYH550XqPo8Zg3sgyx4LR7zql4 bvau9fYNEKuxwl6O2cV77PrgB50tZweghtB1rAFTa4N5AW2e0U9VspFfvngdyagHuG4I8bjL wr95ODhlo/m10p1Yj+Vuu6TWlEHRLfUIT+PhhJ+M0R1qkEfzsCa+v9T2Ms0MS+7uR3Q9zxC4 IwlWaiLdOscFvakdNLx8vVvO3oW0aVuoNcrKFDj6pbLlxWun3HEm52CB2luVWEU0rosWzkWr ZT0JRhVBi1vid5az5qYFrFm2f4yD/Lgf4QTuXU+4TLUB64PFMWrr6Xivbe03R81j8FKW/fYa dAQLz5oZx3EbxpKM1YRYH48tL3y3j+lKGAe8QjJ4/BquAA/zyQouFTpGNDUftiJbcRUmEuE4 GTL4yLwH3n2MfTDkGTUrCv8376ncSXTVoA7FYyxysFQgQep2UkaBSETdmmlrqzs4qK5c5cFQ 6AOwQIhoK4u80vuU8LwRTW8oWWYpVgTVtxMFOp87xuCopc4+C7DXDBBFGUcLYV86IpsGGds2 k6P2dLoAzFz9ruYVTSU6994sA+PBMTcFkdaDQdscOfPy4W8+dBbYs7nJjq7LJOIsw== IronPort-HdrOrdr: A9a23:Wqv/Eqn9KnGdm88T7btGzUzOX+fpDfIe3DAbv31ZSRFFG/Fw9v re/sjzsCWetN9/YhwdcLy7VJVoOEmsjaKdgrNhXotKPjOGhILAFugLh7cKpQeOJ8SUzI5gPM lbHZSWR+eAaWSSyfyKhjVRLr4bsby6GJ/Bv5am859OJTsaDJ1d0w== X-Talos-CUID: =?us-ascii?q?9a23=3AwvkJm2lBND8vB5iF34yD9kzsCMHXOV6BlH2PGV6?= =?us-ascii?q?bMm0qT7GWTQG8+65uy+M7zg=3D=3D?= X-Talos-MUID: =?us-ascii?q?9a23=3AbfpP2g3+4h/UaMmZTD6R+dHJNTUj7aaHCXEErao?= =?us-ascii?q?8upO+Kgl5NguYrwapTdpy?= X-IronPort-Anti-Spam-Filtered: true X-IronPort-AV: E=Sophos;i="6.02,230,1688400000"; d="scan'208";a="416961819" Received: from 220-235-124-253.dyn.iinet.net.au (HELO mail.infra.localdomain) ([220.235.124.253]) by icp-osb-irony-out6.iinet.net.au with ESMTP; 06 Sep 2023 09:52:16 +0800 Received: from localhost (mail.infra.localdomain [127.0.0.1]) by mail.infra.localdomain (Postfix) with ESMTP id 5F31ECA91088C for ; Wed, 6 Sep 2023 09:52:16 +0800 (AWST) X-Virus-Scanned: amavisd-new at localdomain Received: from mail.infra.localdomain ([127.0.0.1]) by localhost (mail.infra.localdomain [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id zwTPwxRV4Mee for ; Wed, 6 Sep 2023 09:52:12 +0800 (AWST) Message-ID: <11e91796-7806-0b6f-35d9-1ec1a6dee509@iinet.net.au> Date: Wed, 6 Sep 2023 09:52:11 +0800 Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.13.0 Subject: Re: [gentoo-user] Is distfile partial mirror with failover possible? Content-Language: en-AU To: gentoo-user@lists.gentoo.org References: <2900905.e9J7NaK4W3@rogueboard> <20230904182127.47147c1a@digimed.co.uk> <20230905080350.3feba5a5@digimed.co.uk> From: William Kenworthy In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Archives-Salt: edefb1a4-8b52-47a7-b41d-c315afeda779 X-Archives-Hash: 1622a49d10e4f7b1bd45e21f4202ae05 On 5/9/23 22:58, Walter Dnes wrote: > On Tue, Sep 05, 2023 at 08:04:19AM +0100, Neil Bothwick wrote >> On Mon, 4 Sep 2023 22:54:38 -0400, Walter Dnes wrote: >> >>> It looks like remote-mounting /var/cache/distfiles might be the >>> quick-n-dirty solution like Alan suggested. And I never have a need to >>> have emerge run simultaneously on more than one machine. >> It seems the simplest suitable solution for your needs. > And while we're at it, howsabout "emerge --sync" on one host, and then > remote-mounting /var/db/repos/gentoo ? > Similarly - I was mounting a single location on moosefs (network filesystem) for ~15 hosts.  One host updates using --sync.  One buildhost for each architecture building packages.  Distfiles are handled the same way. Then "emerge -k" on the remainder checking for packages that needed an actual build.  If none, parallel merge (via ansible) or else single builds.  Resulting packages are also stored remotely per arch (various amd64, arm32, arm64 etc.) Working well for a few years, but I am in the process of converting to nfs with a similar structure as I have decommissioned the moosefs system and many machines that are no longer needed.  A single machine will handle built packages, distfiles and repos which are mounted on the other systems via nfs. I will look into apt-cacher-ng as I was a fan of http-replicator until it was deprecated. BillK