From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) by finch.gentoo.org (Postfix) with ESMTP id 7A9D3138824 for ; Thu, 23 Oct 2014 13:49:45 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id ADF27E0848; Thu, 23 Oct 2014 13:49:36 +0000 (UTC) Received: from mail-lb0-f181.google.com (mail-lb0-f181.google.com [209.85.217.181]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 624ADE0830 for ; Thu, 23 Oct 2014 13:49:35 +0000 (UTC) Received: by mail-lb0-f181.google.com with SMTP id l4so876770lbv.12 for ; Thu, 23 Oct 2014 06:49:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=date:from:to:subject:message-id:in-reply-to:references:mime-version :content-type; bh=LgpauxsunM7UXgGYJOISfTM1nqQlHzvCYr+MZTKWQSU=; b=LLgXFAqT8FRFm+pSRm19t4n1Ik2afQUOzn63oscDsxGqUKqqc2wNoYBtT8UWkj18gi XaQTZ2r7mo4a8b09GO1IQgUsfOc1euTXQSmPrpNddd6/2vIkbBZV+hUHinZGlbsp+qmb yIQGUZUspuq1RraANmTu8Bj8xtJlzrdAtkDynBkpu9IZYTAeannLQ0kel63wa847MqJ8 M/lsF3ERiJjQz+0/+rvXuQLiHH4zYrrRnQd8ur6DCbvFKeDMbwSNyqIYDeWOmCy/HJSP 69ExkcFcgD1WvlY1myS+cIYW4OlDJ1Ng469z1PqpeQ+YNyQnPrsrp/IbByPyQGWeWd+0 uPIg== X-Received: by 10.152.23.3 with SMTP id i3mr5237360laf.53.1414072173377; Thu, 23 Oct 2014 06:49:33 -0700 (PDT) Received: from localhost ([198.46.152.80]) by mx.google.com with ESMTPSA id mn4sm781438lbb.4.2014.10.23.06.49.30 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 23 Oct 2014 06:49:31 -0700 (PDT) Date: Thu, 23 Oct 2014 17:49:03 +0400 From: Andrew Savchenko To: gentoo-user@lists.gentoo.org Subject: Re: [gentoo-user] ceph on btrfs Message-Id: <20141023174903.dfc6e5be9f0213c4cd884101@gmail.com> In-Reply-To: References: X-Mailer: Sylpheed 3.4.1 (GTK+ 2.24.23; i686-pc-linux-gnu) Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org Mime-Version: 1.0 Content-Type: multipart/signed; protocol="application/pgp-signature"; micalg="PGP-SHA512"; boundary="Signature=_Thu__23_Oct_2014_17_49_03_+0400_=UWm3xLLSuxNpO6a" X-Archives-Salt: b5c3811e-cff9-4d9e-906e-71f4d3b1336c X-Archives-Hash: ad8628de7c7ce5a58104bae1b8e2de5b --Signature=_Thu__23_Oct_2014_17_49_03_+0400_=UWm3xLLSuxNpO6a Content-Type: text/plain; charset=US-ASCII Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi, On Wed, 22 Oct 2014 20:05:48 +0000 (UTC) James wrote: > Hello, >=20 > So looking at the package sys-cluster/ceph, I see these flags: > cryptopp debug fuse gtk +libaio libatomic +nss radosgw static-libs tcmall= oc > xfs zfs No specific flags for btrfs? Ceph is optimized for btrfs by design, it has no configure options to enable or disable btrfs-related stuff: https://github.com/ceph/ceph/blob/master/configure.ac No configure option =3D> no use flag. =20 > ceph-0.67.9 is marked stable, while 0.67.10 and 0.80.5 are marked > (yellow) testing and *9999 is marked (red) masked. So what version > would anyone recommend, with what flags? [1] Just use the latest (0.80.7 ATM). You may just nerame and rehash 0.80.5 ebuild (usually this works fine). Or you may stay with 0.80.5, but with fewer bug fixes. =20 > Ceph will be the DFS on top of a (3) node mesos+spark cluster.=20 > btrfs is being set up with 2 disks in raid 1 on each system. Btrfs > seems to be keenly compatible with ceph [2]. If raid is supposed to be read more frequently than written to, then my favourite solution is raid-10-f2 (2 far copies, perfectly fine for 2 disks). This will give you read performance of raid-0 and robustness of raid-1. Though write i/o will be somewhat slower due to more seeks. Also it depends on workload: if you'll have a lot of independent read requests, raid-1 will be fine too. But for large read i/o from a single or few clients raid-10-f2 is the best imo. > Guidance and comments, warmly requested, > James >=20 >=20 > [1]=20 > http://ceph.com/docs/v0.78/rados/configuration/filesystem-recommendations/ >=20 > [2] http://ceph.com/docs/master/release-notes/#v0-80-firefly Best regards, Andrew Savchenko --Signature=_Thu__23_Oct_2014_17_49_03_+0400_=UWm3xLLSuxNpO6a Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIcBAEBCgAGBQJUSQdlAAoJEFZZU7lTcnVsWZgP/3g/9+Pu/LS6M4w9U/vw1+l6 2j7imD3vRzjppO/wWNZOOuYSehEO2hX5S5SDjRK0iFIFW0jvu1e3jKOQLlYT0cjn 38YurkJoq3Z36vWKZTcx4A5WRwbWAtn7/DaD6k5o/yFmRrfr1f4Koz2b4OEx90af QOI3r1FgJVEvKtQ74rNWjQSclBbYPWo8hyfhyqhF9BjplkH1Q6a0zyLbr4sLxLms 5YeoUKQWaSNZ9rAto5mCsd6jJek+E7RBiWAGOnAuCQEPufEE23rcO6q7sJcr5J5s FZGiCN1zSy/1H+J0BSAU9RNTls22biuy75WPo1W0yc+0k+vT8P1wmXsei/Lua/Kp 2uQ0s6AQCeLKIgDKx4jE39UDDftG+RBc8NfdHO50EKDfxMuzAnLixkTYaPUDG76u x+lPPsxrpxEukGmLoCnv/zboTMbwoZIQRmSv20dS/GFARsUumVXQIaBHwKsDna5z Z9XPlVD/yKhAWclCD6akn2CUYXa5tYmHdd0dETEv84QkTDlZFoxrS6ZS+MY3XiPF sdCqhD5/y/ftP3FVR4G49MDFg64Q8OwkKzri2yWQ0VqYjtx9csfx97Yf8Ai2tLFb TERKmplTKlP7kRGRQCqoolf0VPMsBmb5Oj07xt1fJcK096WiaT9JD7+lBtd0/IJ5 V6FGw54buy5aaaZTcU4y =jnbm -----END PGP SIGNATURE----- --Signature=_Thu__23_Oct_2014_17_49_03_+0400_=UWm3xLLSuxNpO6a--