From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 8D336158020 for ; Sun, 11 Dec 2022 23:43:46 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id E91EFE084A; Sun, 11 Dec 2022 23:43:39 +0000 (UTC) Received: from mout.gmx.net (mout.gmx.net [212.227.17.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 0F76FE0817 for ; Sun, 11 Dec 2022 23:43:38 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.de; s=s31663417; t=1670802212; bh=6VO6Dq7h8OqV3+gT+UQdDReoFie3sg4jpx+Xp68QJRg=; h=X-UI-Sender-Class:Date:From:To:Subject:References:In-Reply-To; b=nx0S4AfAmnOMLljWMxztH6D02jEpSQmi3vbEzXV2ukQpi/iAkJ/RN04S3c3BJQlZS W6a6A/II2FCJsaPtwE94zUeMg7ZxwOuTlP6mXT9KR2Iu/LcHkE4rIeKNInLOeywEY3 Ko4Ueu6MVcAkQHNF8KIa2KZ1oPYNoHMqi+Ld8dacWr6aCnm745J0iWOksC3Fio7ZT9 LmmYkYIaa0R7XAneGDrgtS/36BlaLya/iH5ju7pDexMr7yfT5BarRVmkXOkiY3LKnC x0zohxGel5LP/G+oSLK+DRT57op4VRqEwdrqA71lIsGXGJVzTT2Ljx/8bBJbLiurJP dIh6Lipx/xc7Q== X-UI-Sender-Class: 724b4f7f-cbec-4199-ad4e-598c01a50d3a Received: from schatulle ([92.117.62.205]) by mail.gmx.net (mrgmx105 [212.227.17.168]) with ESMTPSA (Nemesis) id 1MhU5b-1oQnJf1aKp-00efjq for ; Mon, 12 Dec 2022 00:43:32 +0100 Date: Mon, 12 Dec 2022 00:43:30 +0100 From: Frank Steinmetzger To: gentoo-user@lists.gentoo.org Subject: Re: [gentoo-user] NAS and replacing with larger drives Message-ID: Mail-Followup-To: gentoo-user@lists.gentoo.org References: <9407e524-2226-6ba9-dd7f-bac635d083e3@gmail.com> <9cbb275e-8b55-6544-dad8-e8f03d114205@gmail.com> <000bc7fe-92ad-86d0-3688-17da2c978e91@gmail.com> Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="rdF1+wqQqJO0U6pO" Content-Disposition: inline In-Reply-To: User-Agent: Mutt 2.2.9; VIM - Vi IMproved 9.0 X-Provags-ID: V03:K1:DNYhA1LsEjp7OYaqJLOpHqyZUXhjoPX4fNZSxjIboQ49v2CH6xg /U2pkjjMOjiJQljSN4iPwt4hsfRr3vue4ZpQnNAYPuX5qJPiBxN/wXYSvoHQ4sTErmU4ce8 V4knd1eB7S1TptcA8TWrEwfBkiXf8Y5w0ttwGEmYHAz+zIThAI9XTVyYJGQ3uXba7f86RD3 sJEZGsqrC05x4UUCY3Bhg== X-Spam-Flag: NO UI-OutboundReport: notjunk:1;M01:P0:tQXwxvwxYQo=;HxqIzuyRneuDM4kPXFxFgwjtHxZ 5WG6cbNFxra99d7iUhtDtNGAEWtPdnlHmZEPkbBCtLoCv6Bi1Vp34FEkc4J8YtRvgT0ZGybog g/K8qh7l2wFjh3GJgmOUPc/o8uoqOFcvCrh5WqfWanE2Z9Xjr0GMbOPAZeyRBn8nrZOnXsNcD qP9dgkqFp1D+6seQ8EJZLOunVV7WN0ecxOfqJz03HrcUX2CzKY8m3c7zgWMAEp/yWM0o9b7PM K6NRkmcmT2j+Ah018OZiFiY0cVOVxW4mUT4tWqtTr3/zaYowjX0Rjlj6IPUz6lhYF8gebEWY7 OOVuWhv3ln8I3MPZ64nNb/jW1AAi4CaKW54EtkBEDvDdtWE4zonYY/wrZ7Nhp9xrXgtWUtAaq uLqTxjan1aqoM64jn55L3224HQq6hsg322DjcAAjSIlnYnsJejVe7RSadY8a/pxzIYZiS0EVw 9W2V8gEwz49PBMpmw03dhTWvgutCrEhWcMoPiLGfRDVMErvjd+sEtPdMN9DM5LQpu0KyyMbC8 hshspPH60c/p6oWA5NLBrYrP3MeCTa28LhBm5/Z2Op3m2G/jHuISZJ8LyO2X31fL9Sm++uTZY JGG7hzvjWIIoHHXAHian/2akl+l9YqMbT52nHnolQmpAES0cMuTo/HxpgTGFcmeIKV+8Z9dGZ 1BsBGFP9ZoWagDVw2mPwuFUMowuyNtnmtwdTef32REN72ywkczncys7S0fN4hQdBVVHgr8xFN CsIifw42aqW+umqu2OY3oKQlft9T1LOovEX+s1nXcAzXoQuiVY21qMFv6X3q2IJhVwQEVut5Q FxxnABAlGF/QYYIMZQDCm0LE/XpBRk9TaZzYF5E7iQ0I1c7wCTKYeyt4R2hnCh1Li+Sx+NLD6 WU7I6v2mD2lTBiRC6j6H99gCT+APLEpSEwWBrFno4ryhFwrCwmSWjLmej3z8sOnoowa++vETi v2+fZQ== X-Archives-Salt: 8b49c865-0ae5-462a-822b-ea1c43dd05eb X-Archives-Hash: c1e493e960c441fbd3ed1d22a719dab5 --rdF1+wqQqJO0U6pO Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Am Sun, Dec 11, 2022 at 08:44:42AM -0700 schrieb Mark Knecht: > Also, I think there are ways for you to build complex pools like a RAID0 > from your 6TB and 8TB drives, and then a RAID1 using the RAID0 and your > 14TB drive but I've never tried it because mine don't have enough drive > slots for that. After a longer fruitless search on the interwebs (I ddidn=E2=80=99t want to= start up my NAS just to check this) I finally found the right search keywords and found a reddit thread about that. And it even throws LVM into the discussion. ^^ https://www.reddit.com/r/zfs/comments/fitc73/raidz_with_nested_vdevs/ Also : =E2=80=9CHere's a definitive answer from the man page for zpool. Virtual devices cannot be nested, so a mirror or raidz virtual device can only contain files or disks. Mirrors of mirrors (or other combinations) are not allowed.=E2=80=9D I would advise against a JBOD pool anyways. Because if one drive dies, the whole JBOD is gone. That goes for ZFS and probably for LVM, too (though I am not sure how writes are distributed across JBOD disks). If the goal is redundancy, you could buy a second drive to match the size of an existing one and build a mirror. If redundancy is not a goal, then use the drives separately like you do now. If one fails, then only its content is gone (or even just the files sitting on the broken sector). > Also, turn on compression. It saves me between 15-20% so 14TB becomes 16TB > storage. YMMV. Video files don't compress, at least not much. Data files > generally do. It doesn=E2=80=99t hurt to switch it on, especially with lzo. But with vide= o, the benefit will be negligible. When storing a block of data (a =E2=80=9Crecord= =E2=80=9D in ZFS speak), it is passed through the compressor and only if the compression gain is above a given threshold (10 % methinks), the block is written to disk with compression. What is more relevant in filesystems for big files (i.e. videos): set the record size to 1 MB. The default is 64 kB, IIRC. Each record requires one block of metadata (which includes the record checksum). So bigger records = =E2=86=92 fewer meta blocks =E2=86=92 better storage efficiency. If you use big records for small files, then efficiency goes down a little. It=E2=80=99s a similar (but a little more complicated) principle as when yo= u write a 100 byte text file to a file system that uses 4 kB clusters. That file will still use up 4 kB on disk. The record size can be set per-dataset. So in your pool you could create a dataset with a smaller record size for office documents, images and music, and another dataset just for videos. > Hope this helps. I think you'll find TrueNAS fun actually but there is a > learning curve. I've used it for about a year and barely scratched the > surface. The main reason for me why I would wanna use it as opposed to a standard Gentoo install: the OOTB web interface to manage all sorts of accounts, access and permissions under one nice hood. --=20 Gr=C3=BC=C3=9Fe | Greetings | Salut | Qapla=E2=80=99 Please do not share anything from, with or about me on any social network. A fermata comes to the doctor: =E2=80=9CI can=E2=80=99t hold it any longer.= =2E.=E2=80=9D --rdF1+wqQqJO0U6pO Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCgAdFiEEVbE9o2D2lE5fhoVsizG+tUDUMMoFAmOWax4ACgkQizG+tUDU MMrBfA//VUN9wlprzPqklcxQsCnircMADRSAhcvFTL+1JtaVivhuaO9v8cPTj5xx mmcUO1j3naOZClBnljezIKgc3b4ZM1jZZYYifoMYZrQ6MsWCT50p1zBERpFebqUx sMyVyrbatNsXvy18Cs1yxrVIBBzWIap7nTpzE3ervHo/Kxn0Ot5FkcbgVQRNbiTX lavSmeHjAbtHPloQSRG/w/n+uHvYOA0Bcj96e49IREjgZ7NcbawvKJMLRJga75WF 0V+w9r31XTtVLu8uQhWw7AHr/+S4SY96f+dZV/XtnpQzblQA5zVa5dR+gbLJTXgu tsB2hhoj5/xBcWHeQF++TzblYS2EXOEJ9Eps4WCkRqla6HBU68euBdAPfjCr17W5 cYpVU4x4m8QrDccidjWMPIP4Zma2bTly/qArNI7mCzRqLaba59T2vyWJfKi1cTq/ AEF9iHSCFMvUEbesWQ0R3H7DVjCjl3+3Yf0Up/LxX0SevSHtHnVIT9Vut9EMfrgX 9j9orj7FW5Ldv9hWRXiliJ7n97kKZg7ZKICJ3aO6dyEhmZ9IO9OHN1QFz9keRSo8 adymsuJO7eXDnzoBFYRSbLzgEywDTtEcerOrSySrKq4WNqI6tQsmVs9gsKMAZ+Dw p9i1k/oyBzjKSA+QRb6C5HUW2cz8q699P+j56PffB/CtulbOvdk= =pNTJ -----END PGP SIGNATURE----- --rdF1+wqQqJO0U6pO--