From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from lists.gentoo.org ([140.105.134.102] helo=robin.gentoo.org) by nuthatch.gentoo.org with esmtp (Exim 4.50) id 1ENbCB-0004ro-0B for garchives@archives.gentoo.org; Thu, 06 Oct 2005 19:14:23 +0000 Received: from robin.gentoo.org (localhost [127.0.0.1]) by robin.gentoo.org (8.13.5/8.13.5) with SMTP id j96J4skv000321; Thu, 6 Oct 2005 19:04:54 GMT Received: from smtp.gentoo.org (smtp.gentoo.org [134.68.220.30]) by robin.gentoo.org (8.13.5/8.13.5) with ESMTP id j96J0ePn006547 for ; Thu, 6 Oct 2005 19:00:41 GMT Received: from main.gmane.org ([80.91.229.2] helo=ciao.gmane.org) by smtp.gentoo.org with esmtp (Exim 4.43) id 1ENb7G-0003bg-Ev for gentoo-user@lists.gentoo.org; Thu, 06 Oct 2005 19:09:18 +0000 Received: from list by ciao.gmane.org with local (Exim 4.43) id 1ENb4k-0005hW-8m for gentoo-user@gentoo.org; Thu, 06 Oct 2005 21:06:42 +0200 Received: from www.buffer.net ([24.73.161.102]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Thu, 06 Oct 2005 21:06:42 +0200 Received: from wireless by www.buffer.net with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Thu, 06 Oct 2005 21:06:42 +0200 X-Injected-Via-Gmane: http://gmane.org/ To: gentoo-user@lists.gentoo.org From: James Subject: [gentoo-user] Re: Personal Gentoo mirror Date: Thu, 6 Oct 2005 19:02:05 +0000 (UTC) Message-ID: References: <43448A1C.7060409@eternitytechnologies.com> <20051006160600.2C14.NICK@rout.co.nz> <1128590373.16504.63.camel@rattus> Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@gentoo.org Reply-to: gentoo-user@lists.gentoo.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Complaints-To: usenet@sea.gmane.org X-Gmane-NNTP-Posting-Host: main.gmane.org User-Agent: Loom/3.14 (http://gmane.org/) X-Loom-IP: 24.73.161.102 (Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.7.11) Gecko/20050916) Sender: news X-Archives-Salt: 5df48716-8303-4f72-860b-8099dbec2b6d X-Archives-Hash: 57818e88c85997c6cdb3cba64d3f4f5f William Kenworthy iinet.net.au> writes: > I'll also jump on board this - http-replicator works great. You build > it from your existing distfile cache. You do not need the large mirror > files as many, or rather most are unlikely ever to be accessed. Build > it with what you already have, and just top it up as you go - if the > file isnt already in your cache, its added when you download it. > > http://gentoo-wiki.com/HOWTO_Download_Cache_for_LAN-Http-Replicator What mechanisms can you employ to either limit the size of the stored files or prune out the oldest files or the files that are completely obsolete as new sources files exist in the distfile cache? Is the distfile cache the same this as the CCACHE cache in the make.conf file? If so then, CCACHE_SIZE="3G" could be used to limit the cache size to 3 gigs, but, what mechanisms, short of a script can be used to prune out old duplicate sources? I guess the download cache is the complemetary companion to setting up your own rsync mirror, as both allow for multiple systems to be updated and synced off of an internal system and only one system syncs or downloads new ebuilds/distfiles)? I set this up both before, but I recall having to use aspects of several documents. In the end, I abandoned syncing off of a single system, as syncing update were sporadically successful, and the scripts and cron entries were not amicable. I meant to get back to this problem to sort it all out. It'd be much simpler if a single document explained all the methods and options and scripts, in a clear, consise manner to use a single system for syncing,cache-ing, updateding, and pruning of disk space. tmpwatch, distcleaner, distclean, yacleaner, repcacheman, dailysync.sh just to mention a few script possibilities . and the 4 basic URLs I looked at to try and sort things out: http://www.gentoo.org/doc/en/rsync.xml?style=printable http://gentoo-wiki.com/HOWTO_Local_Rsync_Mirror. http://gentoo-wiki.com/Http_proxy http://gentoo-wiki.com/HOWTO_Download_Cache_for_LAN-Http-Replicator USE this URL to automate the updating of Gentoo workstations: http://www.panhorst.com/glcu/ was yet another approach. Any comments or suggestions as to the development of a single, concise document, would be appreciated. James -- gentoo-user@gentoo.org mailing list