From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id D0C1C139083 for ; Mon, 11 Dec 2017 23:21:20 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 58226E0F31; Mon, 11 Dec 2017 23:21:13 +0000 (UTC) Received: from mout.gmx.net (mout.gmx.net [212.227.17.20]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 9E671E0F05 for ; Mon, 11 Dec 2017 23:21:12 +0000 (UTC) Received: from tp ([88.75.173.172]) by mail.gmx.com (mrgmx102 [212.227.17.168]) with ESMTPSA (Nemesis) id 0M1RHp-1fD4fF1YHh-00tR9y for ; Tue, 12 Dec 2017 00:21:00 +0100 Date: Tue, 12 Dec 2017 00:20:48 +0100 From: Frank Steinmetzger To: gentoo-user@lists.gentoo.org Subject: Re: [gentoo-user] OT: btrfs raid 5/6 Message-ID: <20171211232048.GA18223@tp> Mail-Followup-To: gentoo-user@lists.gentoo.org References: <5A218A49.3050004@youngman.org.uk> <20171206232829.GA5249@tp> <20171207001328.GC5249@tp> <20171207213755.GB18433@tp> <5A29B769.7030400@youngman.org.uk> Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="DocE+STaALJfprDB" Content-Disposition: inline In-Reply-To: <5A29B769.7030400@youngman.org.uk> User-Agent: Mutt 1.7.2; VIM - Vi IMproved 8.0 X-Provags-ID: V03:K0:otJSQsVKOX6bN4bkayDPa9zWm3mzgUEVQK3XQVuhBZZSdjwBjzc hE2RQnrDOKk75xBq20Hcghcd+n+SuavXD3tf+uA+4b8HbWIZCFzXboFGV6lm34CNY788xH2 r/mFwtWmoDw31SS/IiuYoc4zrP8pOIxU+D6QwElLNEYYUSx4LL/R+K33CBIB7rTDUK6knKU 58+yn0fGEK880Cjev3o3Q== X-UI-Out-Filterresults: notjunk:1;V01:K0:QAQs2EI7Ssw=:HgJRGZwmf08PAvbMZ1PHyO cjznLcmVx03jo4zyFC1vWhLpOi30xPkMhvUKF8eedZKIRP1IDL3lpUiGIFygi+PJolvUtw3nJ 5pVd21kY04n6AAmzHeV9ydvVSrjuDoIyVvPUn3VPwBEaLGCr5sPRivdpeh1nDpQzotwpcLzWE 876OaILWqD+BhOvU5h5Zewvqg+ntNpYy/GklfahFkZShRmARsvQaLwFNkH5YuUgjMa8fKT7vA ZQbT3XxJxkqDPS12/IjFqkGTGOdHe/cn65VGsfEwI2kIVBO5XiCD3UCKVkSp8LCfPbvEeQKHt QMxLxUg2u4q3Hq7uZdXWqoWOjoI6Hi/9X8ccqung8K0jLK3XN4fZDQI62VuL7DrROVm+6UJUF 3SJKk17DwWcWbM6KYJI8yzzd+4MIAYCKkRvGDSDM0e5UBQM5JFCvLzY9TXgg7mJ93zMjoCzjt 38SR0QIDned2IfkMBzQJHU0t7iJ+yrACgXh7k9aLyJ2U2rjwKB/RY6BZrvN6+DUxsjjj36i7v YgvKijYCts+GsJ1XL1WBNQ3znQFYOFU6H2DiilSPM+Y8eoJE+EQlKNNnPQbdePAKpustaS0wI X7yK9Yb9fl1nk2/dClHPgcoOvZB1+gUTOoO3muOR9hq1iESi2Q2XdAjFnWJL8AIdbhElMfufr 5aPLWSKLxTOWoJkonhofa2i+8m05AI6P0jou8gwTePtja6ItO1T1ab0uJxkNO1H8Omls7Zvyh 3BxqjtiOvlfHoFnch4GZWZqerShImUMB0w2MW/hjFQFYc8ZHWbDing/jarBKOvOlckf7M7RDq IehDr5U8uPdR9UbYjW+UcH6oqOEn+DeG6ka9LzY6cEpqbBldTk= X-Archives-Salt: 33f72a80-fa65-4ced-b926-462cd4912cc1 X-Archives-Hash: c3c5dfaf0cf307502f337bc875d71653 --DocE+STaALJfprDB Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Dec 07, 2017 at 09:49:29PM +0000, Wols Lists wrote: > On 07/12/17 21:37, Frank Steinmetzger wrote: > > Ooooh, I just came up with another good reason for raidz over mirror: > > I don't encrypt my drives because it doesn't hold sensitive stuff. (AFA= IK > > native ZFS encryption is available in Oracle ZFS, so it might eventually > > come to the Linux world). > > > > So in case I ever need to send in a drive for repair/replacement, noone= can > > read from it (or only in tiny bits'n'pieces from a hexdump), because ea= ch > > disk contains a mix of data and parity blocks. > > > > I think I'm finally sold. :) > > And with that, good night. > > So you've never heard of LUKS? > > GPT > LUKS > MD-RAID > Filesystem My new drives are finally here. One of them turned out to be an OEM. -_- The shop says it will cover any warranty claims and it=E2=80=99s not a back= yard seller either, so methinks I=E2=80=99ll keep it. To evaluate LUKS, I created the following setup (I just love ASCII-painting in vim ^^): =E2=94=8F=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =93 =E2=94=83 tmpfs = =E2=94=83 =E2=94=83 =E2=94=8C=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80= =E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=90 = =E2=94=8C=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2= =94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=90 =E2=94=8C=E2= =94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94= =80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=90 =E2=94=8C=E2=94=80=E2=94= =80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80= =E2=94=80=E2=94=80=E2=94=80=E2=94=90 =E2=94=83 =E2=94=83 =E2=94=82 1 GB file =E2=94=82 =E2=94=82 1 GB file =E2=94=82 = =E2=94=82 1 GB file =E2=94=82 =E2=94=82 1 GB file =E2=94=82 =E2=94=83 =E2=94=83 =E2=94=94=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80= =E2=94=AC=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=98 = =E2=94=94=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=AC=E2= =94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=98 =E2=94=94=E2= =94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=AC=E2=94=80=E2=94= =80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=98 =E2=94=94=E2=94=80=E2=94= =80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=AC=E2=94=80=E2=94=80=E2=94=80= =E2=94=80=E2=94=80=E2=94=80=E2=94=98 =E2=94=83 =E2=94=83 V V V V = =E2=94=83 =E2=94=83 =E2=94=8C=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80= =E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=90 = =E2=94=8C=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2= =94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=90 =E2=94=8C=E2= =94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94= =80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=90 =E2=94=8C=E2=94=80=E2=94= =80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80= =E2=94=80=E2=94=80=E2=94=80=E2=94=90 =E2=94=83 =E2=94=83 =E2=94=82 LUKS device =E2=94=82 =E2=94=82 LUKS device =E2=94=82 = =E2=94=82 LUKS device =E2=94=82 =E2=94=82 LUKS device =E2=94=82 =E2=94=83 =E2=94=83 =E2=94=94=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80= =E2=94=AC=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=98 = =E2=94=94=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=AC=E2= =94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=98 =E2=94=94=E2= =94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=AC=E2=94=80=E2=94= =80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=98 =E2=94=94=E2=94=80=E2=94= =80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=AC=E2=94=80=E2=94=80=E2=94=80= =E2=94=80=E2=94=80=E2=94=80=E2=94=98 =E2=94=83 =E2=94=83 V V V V = =E2=94=83 =E2=94=83 =E2=94=8C=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80= =E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2= =94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94= =80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80= =E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2= =94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94= =80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80= =E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=90 =E2=94=83 =E2=94=83 =E2=94=82 RaidZ2 = =E2=94=82 =E2=94=83 =E2=94=83 =E2=94=94=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80= =E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2= =94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94= =80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80= =E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2= =94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94= =80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80= =E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=98 =E2=94=83 =E2=94=97=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81= =E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2= =94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94=81=E2=94= =9B While dd'ing a 1500 MB file from and to the pool, my NAS Celeron achieved (with the given number of vdevs out of all 4 being encrypted): non-encrypted 2 encrypted 4 encrypted =E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2= =94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94= =80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80= =E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2= =94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94= =80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80=E2=94=80= =E2=94=80=E2=94=80 read 1600 MB/s 465 MB/s 290 MB/s write ~600 MB/s ~200 MB/s ~135 MB/s scrub time 10 s (~ 100 MB/s) So performance would be juuuust enough to satisfy GBE. I wonder though how long a real scrub/resilver would take. The last scrub of my mirror, which has 3.8 TB allocated, took 9=C2=BC hours. Once the z2 pool is created and t= he data migrated, I *will* have to do a resilver in any case, because I only have four drives and they will all go into the pool, but two of which currently make up the mirror. I see myself bying an i3 before too long. Talk about first-world problems. --=20 Gru=C3=9F | Greetings | Qapla=E2=80=99 Please do not share anything from, with or about me on any social network. When you are fine, don=E2=80=99t worry. It will pass. --DocE+STaALJfprDB Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Digital signature -----BEGIN PGP SIGNATURE----- iQIzBAEBCgAdFiEEVbE9o2D2lE5fhoVsizG+tUDUMMoFAlovEtAACgkQizG+tUDU MMrFkQ//arBe5hNQ92r1zNRePNgH79iDmSJceIxtJuaH05dprt30XRXYYNq7mMNC FmKuVATZ+87X04L04LstBmdnAOD2yLheaRJTxOj/JjuX7Fbd/zmvLV/XqzVF2Y8K 1cTh7Cm0HY3Y0jQpAi7FwIunbfcN4Z5DbY5sb6hLoPlYROHpFy2t7A1ru9Zd4eC8 GF0rA0TRiAOvT0IXee+/s6KrXVS19TppzeBkkhrlTSXCfMYronBQGy7eJJ6wQw2N eqwZWApHXhEYISs4/kjhX9rp5dmju4+ZMdtRXiV97mmRyzYGGJhbKciOwfi9u8gB uVa4Nv0/lY0hPL5nta80nWAPbok8h61lkriuhNoa7rY34g3xUNmo6Htd8MaHzRMA IHrilW15NaO8h85YZCE/k2c/SePHc2gFLE1agszwJC9uOwdBX+z+xcQGa6vv73Nw /RXJGLQ9ygnQrTOwuk9s5gljJbq077ji3VnAG4tshGdh7gdsSv9HFL7vYCL/eImu LHbiw+/ie1dwVQ9r+M194vFc1+gvHpBIZ45Pgl2yosiIXq0HABNzs2RmDrvIiWXx vHm1M9QiiBkrO+i+57klV/UZwby9iI4IBsAfXO2hEDB7cYPvDp6aBnkoJFl5ci2v Nn+a4Z7PVVNSnhxeLoOq7X/eUGLtE/X59VBaSf5v9DEggGWI7/I= =pT/z -----END PGP SIGNATURE----- --DocE+STaALJfprDB--