From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) by finch.gentoo.org (Postfix) with ESMTP id 0EC1F1381F4 for ; Mon, 13 Aug 2012 17:16:46 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 618C621C025; Mon, 13 Aug 2012 17:16:17 +0000 (UTC) Received: from out5-smtp.messagingengine.com (out5-smtp.messagingengine.com [66.111.4.29]) by pigeon.gentoo.org (Postfix) with ESMTP id 580F0E07DD for ; Mon, 13 Aug 2012 17:14:13 +0000 (UTC) Received: from compute3.internal (compute3.nyi.mail.srv.osa [10.202.2.43]) by gateway1.nyi.mail.srv.osa (Postfix) with ESMTP id 13377202D0 for ; Mon, 13 Aug 2012 13:14:13 -0400 (EDT) Received: from frontend1.nyi.mail.srv.osa ([10.202.2.160]) by compute3.internal (MEProxy); Mon, 13 Aug 2012 13:14:13 -0400 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=binarywings.net; h=message-id:date:from:mime-version:to:subject:references :in-reply-to:content-type; s=mesmtp; bh=NUSLKX6mY8g1S8lvJQCLTfrX ib0=; b=phF7t83IDsc3O9ZSeOPO5QzfsK5f0MoQGckY7DLdboB36YSp4YTz3xlo vQ2qMfov5O4bLKKUs6rB6lGl6pscPnD5OJumtKQcocsZH5aGYBTDP+RDLwbXN25+ 53h9eM4Qw3glkD2YbPl99WT3AY+v6wb2YEMUmuFBCZcAtvkdyrU= DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d= messagingengine.com; h=message-id:date:from:mime-version:to :subject:references:in-reply-to:content-type; s=smtpout; bh=NUSL KX6mY8g1S8lvJQCLTfrXib0=; b=HQHf3qxUG8UZttERFpsU9rU4Cqq8fsoQ2RLi qyj7QQQaaHdbFZQNHmI9IrkmtDZUETVIvcADthjuXhbDXuGPEsv2mO2GjSVSBKv/ Ez3lJ8EILviYhs6hX8ZRaKLqTdkaYdrGGmRxl+YBgo9TL58HIi6inZq6qrgiBNSS sRKWesg= X-Sasl-enc: TwI8I+ko/hi0qkjzedR26akDD3rtCqJhzoA4WiGVD24A 1344878052 Received: from [10.208.151.61] (unknown [176.3.151.61]) by mail.messagingengine.com (Postfix) with ESMTPA id CE4CC8E029C for ; Mon, 13 Aug 2012 13:14:11 -0400 (EDT) Message-ID: <502935D8.9080803@binarywings.net> Date: Mon, 13 Aug 2012 19:14:00 +0200 From: Florian Philipp User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:10.0.6esrpre) Gecko/20120804 Thunderbird/10.0.6 Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org MIME-Version: 1.0 To: gentoo-user@lists.gentoo.org Subject: Re: [gentoo-user] Fast file system for cache directory with lot's of files References: <5028FF82.7020908@nileshgr.com> In-Reply-To: X-Enigmail-Version: 1.3.5 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig0B60C3575CE06FA86BEFA69B" X-Archives-Salt: 3a1105cf-e4ed-4259-ad86-c11bd1ab3a08 X-Archives-Hash: c94cb8f365105473fabcaa32780952ca This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig0B60C3575CE06FA86BEFA69B Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Am 13.08.2012 16:52, schrieb Michael Mol: > On Mon, Aug 13, 2012 at 10:42 AM, Michael Hampicke > > wrote: >=20 > Have you indexed your ext4 partition? >=20 > # tune2fs -O dir_index /dev/your_partition > # e2fsck -D /dev/your_partition >=20 > Hi, the dir_index is active. I guess that's why delete operations > take as long as they take (index has to be updated every time)=20 >=20 >=20 > 1) Scan for files to remove > 2) disable index > 3) Remove files > 4) enable index >=20 > ? >=20 > --=20 > :wq Other things to think about: 1. Play around with data=3Djournal/writeback/ordered. IIRC, data=3Djourna= l actually used to improve performance depending on the workload as it delays random IO in favor of sequential IO (when updating the journal). 2. Increase the journal size. 3. Take a look at `man 1 chattr`. Especially the 'T' attribute. Of course this only helps after re-allocating everything. 4. Try parallelizing. Ext4 requires relatively few locks nowadays (since 2.6.39 IIRC). For example: find $TOP_DIR -mindepth 1 -maxdepth 1 -print0 | \ xargs -0 -n 1 -r -P 4 -I '{}' find '{}' -type f 5. Use a separate device for the journal. 6. Temporarily deactivate the journal with tune2fs similar to MM's idea. Regards, Florian Philipp --------------enig0B60C3575CE06FA86BEFA69B Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.19 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAlApNeAACgkQqs4uOUlOuU8xiQCeL0Jp4wH0rl9IMDhmS/QOtiWV knQAn0rcP2LkDxCfC1NuxmAT5ZC5/Vwi =3K2m -----END PGP SIGNATURE----- --------------enig0B60C3575CE06FA86BEFA69B--