From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) by finch.gentoo.org (Postfix) with ESMTP id 673D01381F4 for ; Mon, 13 Aug 2012 13:28:08 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 0496DE07B4; Mon, 13 Aug 2012 13:27:12 +0000 (UTC) Received: from mail-yx0-f181.google.com (mail-yx0-f181.google.com [209.85.213.181]) by pigeon.gentoo.org (Postfix) with ESMTP id 53B4A21C00C for ; Mon, 13 Aug 2012 13:22:46 +0000 (UTC) Received: by yenq13 with SMTP id q13so3441856yen.40 for ; Mon, 13 Aug 2012 06:22:45 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=sender:message-id:date:from:user-agent:mime-version:to:subject :references:in-reply-to:content-type:content-transfer-encoding :x-gm-message-state; bh=gBEVoFe8a2n81omoMhDkB4UH//WLeq69QLCVtgsK2R4=; b=Op0eLYkEaRJvmh/0SDVun5Zz2v0h0K6hD6qrepLbqUPunG0Wf/xVC5SGzpuUnAzrey GCFgG65bT4AZT+nNBixl4av1nj/4X4ic5OdorkQR/m71cc1EGP4DTU6mX2tlv+xfLTcz tROj4x0BFIKq2cgHCs8yelF/sw6jucyRUMzd+H/8zXuqmmKaefIoHweDj6Rmwu79cNMH oH6Fkq7cc/h9Qr3GI4M6b4jn2qUHBhLO/CQG9XfKa5mO9uCoC8EnIXBtJx94jTLlxKL8 EIeBg+zA8Do0QP+ViBQs/RLKkE0LDEjledTNvev0BVRfQzAvNwRif6aJYiRgvUNDbC7E 2cDA== Received: by 10.68.138.234 with SMTP id qt10mr18826853pbb.26.1344864165443; Mon, 13 Aug 2012 06:22:45 -0700 (PDT) Received: from [192.168.0.45] ([121.246.205.20]) by mx.google.com with ESMTPS id oq8sm5319434pbb.13.2012.08.13.06.22.43 (version=SSLv3 cipher=OTHER); Mon, 13 Aug 2012 06:22:44 -0700 (PDT) Sender: Nilesh Govindrajan Message-ID: <5028FF82.7020908@nileshgr.com> Date: Mon, 13 Aug 2012 18:52:10 +0530 From: Nilesh Govindrajan User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:14.0) Gecko/20120728 Thunderbird/14.0 Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org MIME-Version: 1.0 To: gentoo-user@lists.gentoo.org Subject: Re: [gentoo-user] Fast file system for cache directory with lot's of files References: In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Gm-Message-State: ALoCoQmdeWS5f0UaefefcnqZIOkSqMKGP0c/zEZDbm0mYziKcKtvRlO9h3dqyWLgiW70J97ylm7a X-Archives-Salt: 8116b59d-78c3-41f4-9768-921c69920343 X-Archives-Hash: bb72750de7e2f8c5ec3a952cba99a010 On Mon 13 Aug 2012 06:46:53 PM IST, Michael Hampicke wrote: > Howdy gentooers, > > I am looking for a filesystem that perfomes well for a cache > directory. Here's some data on that dir: > - cache for prescaled images files + metadata files > - nested directory structure ( 20/2022/202231/*files* ) > - about 20GB > - 100.000 directories > - about 2 million files > > The system has 2x Intel Xon Quad-cores (Nehalem), 16GB of RAM and two > 10.000rpm hard drives running a RAID1. > > Up until now I was using ext4 with noatime, but I am not happy with > it's performence. Finding and deleting old files with 'find' is > incredible slow, so I am looking for a filesystem that performs > better. First candiate that came to mind was reiserfs, but last time I > tried it, it became slower over time (fragmentation?). > Currently I am running a test with btrfs and so far I am quiet happy > with it as it is much faster in my use case. > > Do you guys have any other suggestions? How about JFS? I used that on > my old NAS box because of it's low cpu usage. Should I give reiser4 a > try, or better leave it be given Hans Reiser's current status? > > Thx in advance, > Mike You should have a look at xfs. I used to use ext4 earlier, traversing through /usr/portage used to be very slow. When I switched xfs, speed increased drastically. This might be kind of unrelated, but makes sense. -- Nilesh Govindrajan http://nileshgr.com