From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from lists.gentoo.org ([140.105.134.102] helo=robin.gentoo.org) by nuthatch.gentoo.org with esmtp (Exim 4.62) (envelope-from ) id 1Hdc5h-0001QM-Ly for garchives@archives.gentoo.org; Tue, 17 Apr 2007 01:02:42 +0000 Received: from robin.gentoo.org (localhost [127.0.0.1]) by robin.gentoo.org (8.14.0/8.14.0) with SMTP id l3H115GE012191; Tue, 17 Apr 2007 01:01:05 GMT Received: from smtp.gentoo.org (smtp.gentoo.org [140.211.166.183]) by robin.gentoo.org (8.14.0/8.14.0) with ESMTP id l3H0vYF3005714 for ; Tue, 17 Apr 2007 00:57:35 GMT Received: from localhost (localhost [127.0.0.1]) by smtp.gentoo.org (Postfix) with ESMTP id 9CCFD64E80 for ; Tue, 17 Apr 2007 00:57:34 +0000 (UTC) X-Virus-Scanned: amavisd-new at gentoo.org X-Spam-Score: -0.913 X-Spam-Level: X-Spam-Status: No, score=-0.913 required=5.5 tests=[AWL=-0.913] Received: from smtp.gentoo.org ([127.0.0.1]) by localhost (smtp.gentoo.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id d0LfO15n0G8u for ; Tue, 17 Apr 2007 00:57:28 +0000 (UTC) Received: from mail.isohunt.com (b01.ext.isohunt.com [208.71.112.51]) by smtp.gentoo.org (Postfix) with ESMTP id D713164E12 for ; Tue, 17 Apr 2007 00:57:27 +0000 (UTC) Received: (qmail 26048 invoked from network); 17 Apr 2007 00:57:26 -0000 Received: from Unknown (HELO curie.orbis-terrarum.net) (24.81.201.182) (smtp-auth username robbat2@isohunt.com, mechanism login) by mail.isohunt.com (qpsmtpd/0.33-dev on beta01) with (AES256-SHA encrypted) ESMTPSA; Tue, 17 Apr 2007 00:57:26 +0000 Received: (qmail 15888 invoked by uid 10000); 16 Apr 2007 17:57:49 -0700 Date: Mon, 16 Apr 2007 17:57:49 -0700 From: "Robin H. Johnson" To: gentoo-dev@lists.gentoo.org, Gentoo Developers Subject: Re: [gentoo-dev] Re: [GLEP] RFC - Keywording scheme Message-ID: <20070417005749.GE1562@curie-int.orbis-terrarum.net> Mail-Followup-To: gentoo-dev@lists.gentoo.org, Gentoo Developers References: <20070413172503.GA3320@gentoo.org> <20070416120341.GC1562@curie-int.orbis-terrarum.net> <1176729020.12458.1.camel@inertia.twi-31o2.org> <200704171119.24933.csawtell@paradise.net.nz> Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-dev@gentoo.org Reply-to: gentoo-dev@lists.gentoo.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="hwvH6HDNit2nSK4j" Content-Disposition: inline In-Reply-To: <200704171119.24933.csawtell@paradise.net.nz> User-Agent: Mutt/1.5.15 (2007-04-06) X-Archives-Salt: 46cba8c0-41a7-46e7-87e6-e079013f3ec8 X-Archives-Hash: 31235150d0ffe8372fcc9460fcc7628b --hwvH6HDNit2nSK4j Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Apr 17, 2007 at 11:19:24AM +1200, Christopher Sawtell wrote: > > Yeah, ulimit won't do it. We hit this issue with mimedefang, actually. > > Our problem is that the kernel is doing the limiting. We ended up > > having to split things up a good bit into multiple processes to get > > everything working. We also added another machine to the cluster to try > > to reduce the load on any one server at a time. Nothing we did with > > ulimit made a bit of difference. > http://www.cyberciti.biz/faq/linux-increase-the-maximum-number-of-open-fi= les/ # sysctl fs.file-max fs.file-max =3D 206524 And tracking fs.file-nr indicates that the total number of files open in the entire system barely exceeds 2000 when the lists are flying. --=20 Robin Hugh Johnson Gentoo Linux Developer & Council Member E-Mail : robbat2@gentoo.org GnuPG FP : 11AC BA4F 4778 E3F6 E4ED F38E B27B 944E 3488 4E85 --hwvH6HDNit2nSK4j Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.2 (GNU/Linux) Comment: Robbat2 @ Orbis-Terrarum Networks - The text below is a digital signature. If it doesn't make any sense to you, ignore it. iD8DBQFGJBuNPpIsIjIzwiwRAtwWAJ9O6hWkVb2NjG+PGUTACtrsuptDTACfcZkO ylvBL/IECkESVaDFbm1sPUI= =2ZYj -----END PGP SIGNATURE----- --hwvH6HDNit2nSK4j-- -- gentoo-dev@gentoo.org mailing list From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from lists.gentoo.org ([140.105.134.102] helo=robin.gentoo.org) by nuthatch.gentoo.org with esmtp (Exim 4.62) (envelope-from ) id 1Hdc5B-0007Gb-9c for garchives@archives.gentoo.org; Tue, 17 Apr 2007 01:02:09 +0000 Received: from robin.gentoo.org (localhost [127.0.0.1]) by robin.gentoo.org (8.14.0/8.14.0) with SMTP id l3H10LX7011209; Tue, 17 Apr 2007 01:00:21 GMT Received: from mail.isohunt.com (b01.ext.isohunt.com [208.71.112.51]) by robin.gentoo.org (8.14.0/8.14.0) with ESMTP id l3H0vQC0005676 for ; Tue, 17 Apr 2007 00:57:27 GMT Received: (qmail 26047 invoked from network); 17 Apr 2007 00:57:26 -0000 Received: from Unknown (HELO curie.orbis-terrarum.net) (24.81.201.182) (smtp-auth username robbat2@isohunt.com, mechanism login) by mail.isohunt.com (qpsmtpd/0.33-dev on beta01) with (AES256-SHA encrypted) ESMTPSA; Tue, 17 Apr 2007 00:57:26 +0000 Received: (qmail 15888 invoked by uid 10000); 16 Apr 2007 17:57:49 -0700 Date: Mon, 16 Apr 2007 17:57:49 -0700 From: "Robin H. Johnson" To: gentoo-dev@lists.gentoo.org, Gentoo Developers Subject: Re: [gentoo-dev] Re: [GLEP] RFC - Keywording scheme Message-ID: <20070417005749.GE1562@curie-int.orbis-terrarum.net> Mail-Followup-To: gentoo-dev@lists.gentoo.org, Gentoo Developers References: <20070413172503.GA3320@gentoo.org> <20070416120341.GC1562@curie-int.orbis-terrarum.net> <1176729020.12458.1.camel@inertia.twi-31o2.org> <200704171119.24933.csawtell@paradise.net.nz> Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-dev@gentoo.org Reply-to: gentoo-dev@lists.gentoo.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="hwvH6HDNit2nSK4j" Content-Disposition: inline In-Reply-To: <200704171119.24933.csawtell@paradise.net.nz> User-Agent: Mutt/1.5.15 (2007-04-06) X-Archives-Salt: 361da23e-82b0-4d80-a56f-3230c4c62e07 X-Archives-Hash: 14d8d7e46c33050357af444c9da1b4d1 Message-ID: <20070417005749.WKYT6DQOw6U-toT7mrrHqsmc3mUyzU8Gq5YfcIvUFR4@z> --hwvH6HDNit2nSK4j Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Apr 17, 2007 at 11:19:24AM +1200, Christopher Sawtell wrote: > > Yeah, ulimit won't do it. We hit this issue with mimedefang, actually. > > Our problem is that the kernel is doing the limiting. We ended up > > having to split things up a good bit into multiple processes to get > > everything working. We also added another machine to the cluster to try > > to reduce the load on any one server at a time. Nothing we did with > > ulimit made a bit of difference. > http://www.cyberciti.biz/faq/linux-increase-the-maximum-number-of-open-fi= les/ # sysctl fs.file-max fs.file-max =3D 206524 And tracking fs.file-nr indicates that the total number of files open in the entire system barely exceeds 2000 when the lists are flying. --=20 Robin Hugh Johnson Gentoo Linux Developer & Council Member E-Mail : robbat2@gentoo.org GnuPG FP : 11AC BA4F 4778 E3F6 E4ED F38E B27B 944E 3488 4E85 --hwvH6HDNit2nSK4j Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.2 (GNU/Linux) Comment: Robbat2 @ Orbis-Terrarum Networks - The text below is a digital signature. If it doesn't make any sense to you, ignore it. iD8DBQFGJBuNPpIsIjIzwiwRAtwWAJ9O6hWkVb2NjG+PGUTACtrsuptDTACfcZkO ylvBL/IECkESVaDFbm1sPUI= =2ZYj -----END PGP SIGNATURE----- --hwvH6HDNit2nSK4j-- -- gentoo-dev@gentoo.org mailing list