From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) by finch.gentoo.org (Postfix) with ESMTP id 470161381F4 for ; Mon, 13 Aug 2012 15:00:46 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id AE0D621C035; Mon, 13 Aug 2012 14:59:41 +0000 (UTC) Received: from mail-wi0-f181.google.com (mail-wi0-f181.google.com [209.85.212.181]) by pigeon.gentoo.org (Postfix) with ESMTP id 2CE16E07D5 for ; Mon, 13 Aug 2012 14:53:26 +0000 (UTC) Received: by wibhm2 with SMTP id hm2so2642405wib.10 for ; Mon, 13 Aug 2012 07:53:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=ZjR5K27+vgm525oVUDgAji2e0yDldoKIc5UC7U8ltHU=; b=KgJdr/YVq6wpUYQRd/j/jJmtF2FzJy0ei4rqMXyx2MqvDFtq1JuC/nsLFvY/HELK5V fT/Ch9ARmCk1a16Dp0R/L7jmW/G2kZWPY6jQDfadLBp5TI7rZwW0D6HiE26GeJ6tTOx9 /2jHRwbj3p1BkgHTnUz9quKTSufoAy26FkkoZEyFfy2JgcFPULCcxEWQpq5i5wE9NGWr OFR1tCjkVXGlrmNuOeGewMejmmhZEqydjJqVol/h3+7i46LbEe8o7HWERm1wlVTkJIcE EySQKFL4k8i+pXNz8c8ELbA64vo38EU0EkM7Xpqls4LO1aKDKJPbDgjXG6EWJSISdQhX /TVg== Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org MIME-Version: 1.0 Received: by 10.50.173.39 with SMTP id bh7mr5718096igc.44.1344869605989; Mon, 13 Aug 2012 07:53:25 -0700 (PDT) Received: by 10.42.155.70 with HTTP; Mon, 13 Aug 2012 07:53:25 -0700 (PDT) In-Reply-To: <5029114E.8070402@admin-box.com> References: <5029114E.8070402@admin-box.com> Date: Mon, 13 Aug 2012 16:53:25 +0200 Message-ID: Subject: Re: [gentoo-user] Fast file system for cache directory with lot's of files From: Michael Hampicke To: gentoo-user@lists.gentoo.org Content-Type: multipart/alternative; boundary=e89a8f5036dc225e0804c726db06 X-Archives-Salt: 0d69656c-e862-4a19-a1a1-24afdb4b1a20 X-Archives-Hash: 31a1a062fe8038a09dcfb54e275d2ad5 --e89a8f5036dc225e0804c726db06 Content-Type: text/plain; charset=ISO-8859-1 2012/8/13 Daniel Troeder > On 13.08.2012 15:16, Michael Hampicke wrote: > > - about 20GB > > - 100.000 directories > > - about 2 million files > > > > The system has 2x Intel Xon Quad-cores (Nehalem), 16GB of RAM and two > > 10.000rpm hard drives running a RAID1. > 1st thought: switch to SSDs > 2nd thought: maybe lots of writes? -> get a SSD for the fs metadata > 3rd thought: purging old files with "find"? your cache system should > have some kind of DB that holds that information. > > 1: SSDs are not possible atm. The machine is in a data center abroad. 2: Writes are not that much of a problem at this time. 3: Well, it's a 3rd party application that - in theory - should take care of removing old files. Sadly, it does not work as it's supposed to be, While time passes the number of orphans grow :( --e89a8f5036dc225e0804c726db06 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable

2012/8/13 Daniel Troeder <daniel@adm= in-box.com>
On 13.08.2012 15:16, Michael Hampicke wrote:
> - about 20GB
> - 100.000 directories
> - about 2 million files
>
> The system has 2x Intel Xon Quad-cores (Nehalem), 16GB of RAM and two<= br> > 10.000rpm hard drives running a RAID1.
1st thought: switch to SSDs
2nd thought: maybe lots of writes? -> get a SSD for the fs metadata
3rd thought: purging old files with "find"? your cache system sho= uld
have some kind of DB that holds that information.


1: SSDs are not possible atm. The machine is in= a data center abroad.
2: Writes are not that much of a problem a= t this time.
3: Well, it's a 3rd party application that - in = theory - should take care of removing old files. Sadly, it does not work as= it's supposed to be, While time passes the number of orphans grow :( --e89a8f5036dc225e0804c726db06--