From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 23541 invoked by uid 1002); 21 Aug 2003 09:17:35 -0000 Mailing-List: contact gentoo-dev-help@gentoo.org; run by ezmlm Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-dev@gentoo.org Received: (qmail 20706 invoked from network); 21 Aug 2003 09:17:35 -0000 From: Chris Gianelloni To: Stewart Honsberger Cc: Zack Gilburd , gentoo-dev@gentoo.org In-Reply-To: <3F444E21.6060306@gentoo.org> References: <1061113519.8012.9.camel@biproc> <200308170406.53791.klasikahl@gentoo.org> <3F444E21.6060306@gentoo.org> Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="=-TtAm3q8OKJ0/um/W+6UR" Message-Id: <1061457591.412.108.camel@vertigo> Mime-Version: 1.0 X-Mailer: Ximian Evolution 1.4.3 Date: 21 Aug 2003 05:19:51 -0400 Subject: Re: [gentoo-dev] New feature proposition (make.conf) X-Archives-Salt: 1ecee213-929e-4f06-baef-5103b5938078 X-Archives-Hash: 6dd4e790aeb0a34cf34cdb792a8a04d7 --=-TtAm3q8OKJ0/um/W+6UR Content-Type: text/plain Content-Transfer-Encoding: quoted-printable On Thu, 2003-08-21 at 00:44, Stewart Honsberger wrote: > Zack Gilburd wrote: >=20 > > One of the problems that plagues Gentoo is that the distro's growth is = leading=20 > > to an insane amount of distfiles downloads (and even excessive download= s)=20 > > along with excessive rsync'ing. Automatic removal of distfiles would=20 > > substancially increase the amount of distfiles downloads due to the fac= t that=20 > > packages often have revisions made to them and revisions mean that the=20 > > software has to be recompiled -- thus the distfile would have to be=20 > > redownloaded of already removed. > >=20 > > Until the general downloading (and rsyncing) etiqutte improves, I don't= see=20 > > how this could be The Right Thing(TM) to do. >=20 > I've been thinking along the lines of a cronjob being pulled in with,=20 > say, Portage. Said cron job would, on a daily/weekly basis remove old=20 > distfiles based upon age, and perhaps even have a setting to consider=20 > size. (Eg; always/never remove files greater/less than a certain size). >=20 > That's where it gets tricky. OpenOffice, Mozilla et al. are two great=20 > examples of packages whose source tarballs are *LARGE*. On one hand,=20 > those would, in one fell swoop, free up the most HDD space =3D most=20 > benefeit. On the other hand, they'd also cost more bandwidth to=20 > re-download =3D most detrimental. >=20 > Operating on a strictly age-based system based around file access time=20 > could potentially work, except that Gentoo's install defaults and/or=20 > suggests strongly the notion of 'noatime' in fstab entries. >=20 > The script for the cronjob is easy, especially if it's only date-based.=20 > The politics involved in implementing it, however, could be hairy. I'll=20 > throw my script out there for review if it interests anybody and let=20 > someone who's more proficient in Bash scripting add in the filesize detai= ls. I use a script which deletes any files in distfiles which do not belong to an installed package. This keeps old packages out of my distfiles, but also allows me to keep enough distfiles locally to keep from hammering the mirrors constantly. I think possibly a combination of the two should be in order? Maybe remove all non-installed distfiles on a weekly basis and also remove all distfiles that have not been accessed in something like 90 days? This would keep things around long enough to probably make it through any revision changes but also manage to clear up room for the people that are complaining about space. --=20 Chris Gianelloni Developer, Gentoo Linux --=-TtAm3q8OKJ0/um/W+6UR Content-Type: application/pgp-signature; name=signature.asc Content-Description: This is a digitally signed message part -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.2 (GNU/Linux) iD8DBQA/RI63kT4lNIS36YERArKjAJ9jLMi51QO4HtrIVbF/aL8GZozPCwCeImJY 38gblZtSjw0uuEZ/SZ6+3c0= =yDob -----END PGP SIGNATURE----- --=-TtAm3q8OKJ0/um/W+6UR--