From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from lists.gentoo.org ([140.105.134.102] helo=robin.gentoo.org) by nuthatch.gentoo.org with esmtp (Exim 4.43) id 1Ds1WR-0008Rc-1R for garchives@archives.gentoo.org; Mon, 11 Jul 2005 16:52:47 +0000 Received: from robin.gentoo.org (localhost [127.0.0.1]) by robin.gentoo.org (8.13.4/8.13.4) with SMTP id j6BGofLh005590; Mon, 11 Jul 2005 16:50:41 GMT Received: from vms044pub.verizon.net (vms044pub.verizon.net [206.46.252.44]) by robin.gentoo.org (8.13.4/8.13.4) with ESMTP id j6BGfaT0018870 for ; Mon, 11 Jul 2005 16:41:37 GMT Received: from mail.joat.com ([71.114.133.177]) by vms044.mailsrvcs.net (Sun Java System Messaging Server 6.2 HotFix 0.04 (built Dec 24 2004)) with ESMTPA id <0IJH00HIE2EEB98G@vms044.mailsrvcs.net> for gentoo-user@lists.gentoo.org; Mon, 11 Jul 2005 11:42:15 -0500 (CDT) Received: from localhost (localhost [127.0.0.1]) by mail.joat.com (Postfix) with ESMTP id 2BB406AB4; Mon, 11 Jul 2005 12:43:06 -0400 (EDT) Received: from mail.joat.com ([127.0.0.1]) by localhost (cornholio [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 07074-10; Mon, 11 Jul 2005 12:42:50 -0400 (EDT) Received: from cdnebinge (jnet.state.pa.us [206.224.31.162]) by mail.joat.com (Postfix) with ESMTP; Mon, 11 Jul 2005 12:42:50 -0400 (EDT) Date: Mon, 11 Jul 2005 12:42:43 -0400 From: "Dave Nebinger" Subject: RE: [gentoo-user] GENTOO_MIRRORS In-reply-to: To: Cc: Message-id: <000201c58637$8fdee540$5f01010a@jnetlab.lcl> Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@gentoo.org Reply-to: gentoo-user@lists.gentoo.org MIME-version: 1.0 X-MIMEOLE: Produced By Microsoft MimeOLE V6.00.2900.2527 X-Mailer: Microsoft Outlook, Build 10.0.6626 Content-type: text/plain; charset=us-ascii Importance: Normal X-Priority: 3 (Normal) X-MSMail-priority: Normal DomainKey-Signature: a=rsa-sha1; h=Received:Received:From:To:Cc:Subject:Date:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding:X-Priority:X-MSMail-Priority:X-Mailer:In-Reply-To:Importance:X-MimeOLE:X-Virus-Scanned; b=ApUMhFNuC70ClCYIntH/Su04CP35RJvtgWurhuv35IE9SDj+Xgln4F6r0t9NBzudv83Ft++RL45nxgHzTQ6NUeFtOTTkkBvsZXHmss40NI51VaxFfoT5Qk7mfMe/a3MPYIk/Pc+7A4zbAkXSks/Dhgute4jeo/KTxxiiQ6ooBaw=; c=nofws; d=joat.com; q=dns; s=selector1 X-Virus-Scanned: amavisd-new 2.3.1 (20050509) at joat.com Content-Transfer-Encoding: 8bit X-MIME-Autoconverted: from quoted-printable to 8bit by robin.gentoo.org id j6BGfaT0018870 X-Archives-Salt: 8c0b666e-254d-4188-ac1c-a4544391896a X-Archives-Hash: b2d34c354baa7c69502686d58fb01b91 > Noodling around I found a gentoo server at: > http://open-systems.ufl.edu/mirrors/gentoo/ > > I'm not sure if I can use this in my make.conf file? If it's complete you should be able to use it. If it's not a publicized mirror then there could be many reasons why. For example, they might not sync the mirror as frequently as other sites or have a limitation on the number of concurrent users. Could also be meant only as an internal sync mirror (I use an internal mirror to sync my internal gentoo systems against). > If so, what would the setting look like? Add the URL for everything up to the "distfiles" directory. If distfiles is in the /mirrors/gentoo directory, then you can add the URL as you've listed above to GENTOO_MIRRORS line. > Hopes are that is closer than my current mirrors. > > Is there an a method/software to test which mirrors > are the fastest? The handbook recommends using mirrorselect. Use that to identify your closest mirrors. As a word of advice I would try to time the mirrorselect run with when you plan on actually syncing the system; a mirror may appear to be slow during the day when you run mirrorselect but actually be faster when syncing at 3am. > I have this setting on some gentoo systems: > SYNC="rsync://rsync.namerica.gentoo.org/gentoo-portage" > > Should it be added to all my gentoo systems and how does > the 'SYNC' setting affect/interact with specific > GENTOO_MIRRORS settings? SYNC is used to define the rsync server to get the portage mirror from. You probably do not want to use any value in there (portage will pick the appropriate one at runtime). The sync mirror and the gentoo mirrors serve different things, namely the portage data versus the distfiles. > 'mirrorselect' detail documentation seems to elude me, > and I'm not even sure this tools is useful to evaluate > the closest/fastest mirror or rsync host. Hell, I'm > not even sure what the main/functional difference is > between a mirror and a rsync host? Rsync is used to remotely sync a filesystem. The portage tree, for example, is not a single file to be downloaded but a remote filesystem that needs to be copied to your system. Rsync is optimized to only pull remote files that are different from those in your local /usr/portage directory. Mirrorselect is used to find the closest/fastest distfiles mirror. The distfiles are the actual source package files that are downloaded to build the packages on your system. > confused on optimizing gentoo downloads.... The first thing you can do to significantly optimize internal gentoo downloads is to set up your own mirror system. I use that for my systems and it's pretty easy to set up. The gentoo wiki has all of the details. Basically I've got a server system that: a) at 1am runs emerge --sync to sync portage against the public mirrors. b) runs rsyncd to make the server's portage tree available to the internal gentoo systems. c) runs http-replicator as a download proxy. All internal gentoo systems use the server as the proxy - actual internet downloads occur only once, after that the cached copy is returned. There is only a delay for the initial download, the rest are almost instantaneous. I'm sure you'll get recommendations for using NFS as the portage tree, synced by a primary system and exported to the other internal systems. While this will work, I personally don't like it because a) NFS is a huge network hog and b) if the serving system is not available the remote gentoo systems don't have the portage tree available. However, if disk space is an issue for you this might be the way to go. -- gentoo-user@gentoo.org mailing list