From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 10446 invoked by uid 1002); 23 Jul 2003 19:50:53 -0000 Mailing-List: contact gentoo-dev-help@gentoo.org; run by ezmlm Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-dev@gentoo.org Received: (qmail 26822 invoked from network); 23 Jul 2003 19:50:53 -0000 Date: Wed, 23 Jul 2003 15:48:26 -0400 From: Kurt Lieber To: gentoo-dev@gentoo.org Message-ID: <20030723194823.GJ9959@mail.lieber.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="wjoFZxbW4tu+iR6v" Content-Disposition: inline X-GPG-Key: http://www.lieber.org/kurtl.pub.gpg User-Agent: Mutt/1.5.4i Subject: [gentoo-dev] The release of 1.4 and its impact on our mirrors X-Archives-Salt: 7b884221-ca1f-4095-9c38-ae54b18a0f98 X-Archives-Hash: eb222c13b54dfa7198320cf7effc0be4 --wjoFZxbW4tu+iR6v Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Folks -- One issue that came out of today's manager meeting was the amount of space that GRP and some of the new livecds will require for 1.4_release. As I understand it, that number hovers right around 10GB at the moment. We have already received numerous complaints from our mirror admins about the amount of disk space we chew up now. For reference, here is a break down: 9.7G ./releases 139M ./snapshots 17G ./distfiles 6.6G ./experimental We can clean out some space in the /releases directory by deleting some of the old 1.4_rc* stuff, but we will still have a significant overall size increase as a part of 1.4_final. We will be working on reducing the size of /distfiles as well, but this will be nothing more than a temporary, tactical fix. We still need a longer term strategic fix. I'd like to come up with a solution that allows each arch the flexibility it requires to create new livecds, GRP packages, etc. But I'd also like to be mindful and respectful of our mirrors. =20 I'd like to hear suggestions from you all on the best way to achieve this. Some ideas that I've heard so far include: * creating separate directories that are optional for our mirrors to=20 support. GRP would be a prime candidate for this given the space it requires. Mirrors short on disk space could choose not to mirror these files. * assigning each arch a quota for the files it may use outside of /distfiles. This quota would apply to liveCDs, things in /experimental as well as everything within /releases (as well as /grp if we make that a separate top level directory) To be effective, this quota would need to be around the ~3GB level given the number of arches we support. Those are simply two ideas that have been proposed so far. I'm sure you guys will have more. The only requirements at this point are: * We cannot expect our system of mirrors to give us an unlimited amount of disk space. (they've already started to complain) * We cannot afford to lose many mirrors. Especially in North America, source mirrors are in short supply. * We must expect /distfiles to continue growing as we continue to add new ebuilds. So solutions involving "reducing the size of /distfiles" will not be feasible except as a short-term, stop-gap measure. Thoughts? Ideas? --kurt --wjoFZxbW4tu+iR6v Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.2 (GNU/Linux) iD8DBQE/HuaGJPpRNiftIEYRAmlwAJ44E1DfPMzwyfmk4XU5FdZ1EHfb5ACeL/lE JM+D73fEin/ite2R3Idk9po= =s+hN -----END PGP SIGNATURE----- --wjoFZxbW4tu+iR6v--