From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (qmail 19604 invoked from network); 11 Oct 2004 14:16:23 +0000 Received: from smtp.gentoo.org (156.56.111.197) by lists.gentoo.org with AES256-SHA encrypted SMTP; 11 Oct 2004 14:16:23 +0000 Received: from lists.gentoo.org ([156.56.111.196] helo=parrot.gentoo.org) by smtp.gentoo.org with esmtp (Exim 4.41) id 1CH0yM-0002CJ-Hg for arch-gentoo-dev@lists.gentoo.org; Mon, 11 Oct 2004 14:16:22 +0000 Received: (qmail 8783 invoked by uid 89); 11 Oct 2004 14:16:21 +0000 Mailing-List: contact gentoo-dev-help@gentoo.org; run by ezmlm Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-dev@gentoo.org Received: (qmail 11525 invoked from network); 11 Oct 2004 14:16:21 +0000 Message-ID: <416A95B3.3070506@gentoo.org> Date: Mon, 11 Oct 2004 16:16:19 +0200 From: Xavier Neys User-Agent: Mozilla Thunderbird 0.8 (X11/20040916) X-Accept-Language: en-us, en MIME-Version: 1.0 To: wolf31o2@gentoo.org CC: gentoo-dev@lists.gentoo.org References: <921ad39e04101013412a7d7f47@mail.gmail.com> <20041010234356.4d4a151a@andy.genone.homeip.net> <9f27901604101016497d40b0a@mail.gmail.com> <1097493430.30674.3.camel@localhost> In-Reply-To: <1097493430.30674.3.camel@localhost> X-Enigmail-Version: 0.86.0.0 X-Enigmail-Supports: pgp-inline, pgp-mime Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig09A1F617BAFB12FB4A631BBB" Subject: Re: [gentoo-dev] rsync speed and space taken X-Archives-Salt: 2dc19c41-bfff-4b5c-80a0-9745b4f65beb X-Archives-Hash: 6536ec84abccbdb9c04e1338fa7f41c2 --------------enig09A1F617BAFB12FB4A631BBB Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Chris Gianelloni wrote: > On Sun, 2004-10-10 at 15:49 -0800, Allen Parker wrote: > >> >>why don't we put more stuff in mirror://gentoo/ ?? ${FILESDIR} has too >>much SHIT in it... i appreciate that patches, etc have been placed >>there... but we REALLY need to find a better place. I don't need my >>emerge sync's taking 45 minutes on average on a 5Mbit line in >>france... *45 minutes* ...just PLEASE keep the SHIT out of the portage >>tree. > > > While I completely agree that things need to be taken out of > ${FILESDIR}, I have a question for you. Could you give the specs of > your machine? I have several machines and even on my oldest machine > with an ATA33 drive and 128MB of RAM, it takes nowhere near 45 minutes > to rsync the tree. Are you using your geographic rsync mirror? Do you > have any other I/O bound processes running at the same time? I'm not > trying to do anything other than point out that your times seem awfully > long in my experience and there is a distinct possibility that something > else is causing the slowdown to such extremes on your system. > I also have an old box (P100 w/ 128MB of RAM, 2 ATA33 disks at ~6MB/sec, udma not available) and it takes ~45 minutes to run emerge --sync. Bandwidth is not the bottleneck because its mirror is sitting next to it. The bottleneck is the sheer number of files to check. FYI: /usr/portage : 16276 - directories 83779 - files including L_ 24820 files under /files/ L_ 19118 files under /metadata/cache/ 16314 - Digest 16284 - .ebuild 7816 - Manifest 7812 - ChangeLog 6726 - metadata.xml 5100 - .patch / .diff 223 - Archive (gz/bz2/tar/...) 89 - make.defaults 78 - virtuals 67 - parent 61 - use.mask 49 - use.defaults 4042 - Uncategorized My 2/100 of your currency, -- / Xavier Neys \_ Gentoo Documentation Project / French & Internationalisation Lead \ http://www.gentoo.org/doc/en /\ --------------enig09A1F617BAFB12FB4A631BBB Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.6 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFBapWzbRzXDXoJCQIRAoTeAJ0XhWAh1ducTkv2IOlfYShGSpLpcACgqDFe 9iqmom+bUPCRNFrl5/Fdjo4= =aCeX -----END PGP SIGNATURE----- --------------enig09A1F617BAFB12FB4A631BBB--