public inbox for gentoo-user@lists.gentoo.org
 help / color / mirror / Atom feed
From: Frank Steinmetzger <Warp_7@gmx.de>
To: gentoo-user@lists.gentoo.org
Subject: Re: [gentoo-user] NAS and replacing with larger drives
Date: Mon, 12 Dec 2022 00:43:30 +0100	[thread overview]
Message-ID: <Y5ZrIseCoyBxVgu9@schatulle> (raw)
In-Reply-To: <CAK2H+ecQoy9ZZxYQ0GW_OFYBQnPGYQ0eNxjJb0yGiYbZ9wx7tg@mail.gmail.com>

[-- Attachment #1: Type: text/plain, Size: 3231 bytes --]

Am Sun, Dec 11, 2022 at 08:44:42AM -0700 schrieb Mark Knecht:

> Also, I think there are ways for you to build complex pools like a RAID0
> from your 6TB and 8TB drives, and then a RAID1 using the RAID0 and your
> 14TB drive but I've never tried it because mine don't have enough drive
> slots for that.

After a longer fruitless search on the interwebs (I ddidn’t want to start up
my NAS just to check this) I finally found the right search keywords and
found a reddit thread about that. And it even throws LVM into the
discussion. ^^
https://www.reddit.com/r/zfs/comments/fitc73/raidz_with_nested_vdevs/

Also <https://zfs-discuss.zfsonlinux.narkive.com/g2THW8n4/nested-vdevs>:
“Here's a definitive answer from the man page for zpool.

Virtual devices cannot be nested, so a mirror or raidz virtual device can
only contain files or disks. Mirrors of mirrors (or other combinations) are
not allowed.”


I would advise against a JBOD pool anyways. Because if one drive dies, the
whole JBOD is gone. That goes for ZFS and probably for LVM, too (though I am
not sure how writes are distributed across JBOD disks). If the goal is
redundancy, you could buy a second drive to match the size of an existing
one and build a mirror. If redundancy is not a goal, then use the drives
separately like you do now. If one fails, then only its content is gone (or
even just the files sitting on the broken sector).

> Also, turn on compression. It saves me between 15-20% so 14TB becomes 16TB
> storage. YMMV. Video files don't compress, at least not much. Data files
> generally do.

It doesn’t hurt to switch it on, especially with lzo. But with video, the
benefit will be negligible. When storing a block of data (a “record” in ZFS
speak), it is passed through the compressor and only if the compression gain
is above a given threshold (10 % methinks), the block is written to disk
with compression.

What is more relevant in filesystems for big files (i.e. videos): set the
record size to 1 MB. The default is 64 kB, IIRC. Each record requires one
block of metadata (which includes the record checksum). So bigger records →
fewer meta blocks → better storage efficiency.

If you use big records for small files, then efficiency goes down a little.
It’s a similar (but a little more complicated) principle as when you write a
100 byte text file to a file system that uses 4 kB clusters. That file will
still use up 4 kB on disk.

The record size can be set per-dataset. So in your pool you could create a
dataset with a smaller record size for office documents, images and music,
and another dataset just for videos.

> Hope this helps. I think you'll find TrueNAS fun actually but there is a
> learning curve. I've used it for about a year and barely scratched the
> surface.

The main reason for me why I would wanna use it as opposed to a standard
Gentoo install: the OOTB web interface to manage all sorts of accounts,
access and permissions under one nice hood.

-- 

Grüße | Greetings | Salut | Qapla’
Please do not share anything from, with or about me on any social network.

A fermata comes to the doctor: “I can’t hold it any longer...”

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

  reply	other threads:[~2022-12-11 23:43 UTC|newest]

Thread overview: 135+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2022-12-08 12:37 [gentoo-user] NAS and replacing with larger drives Dale
2022-12-08 13:31 ` Mark Knecht
2022-12-08 13:58   ` Dale
2022-12-08 17:16     ` Mark Knecht
2022-12-08 23:35     ` Daniel Frey
2022-12-09  0:34       ` Dale
2022-12-10  0:10     ` Paul Colquhoun
2022-12-08 18:36   ` Wols Lists
2022-12-08 20:05     ` Mark Knecht
2022-12-08 20:44     ` Frank Steinmetzger
2022-12-09 13:13       ` Michael
2022-12-09 13:38         ` Frank Steinmetzger
2022-12-09 14:27           ` [OT] " Peter Humphrey
2022-12-09 14:38             ` Frank Steinmetzger
2022-12-10  0:41               ` Peter Humphrey
2022-12-09 15:28           ` Dale
2022-12-10  9:20           ` Wols Lists
2022-12-10 16:19             ` Frank Steinmetzger
2022-12-10 16:30               ` Wols Lists
2022-12-10 17:27                 ` Michael
2022-12-10 18:17                   ` David Rosenbaum
2022-12-11  4:45               ` David Rosenbaum
2022-12-09 14:15         ` Rich Freeman
2022-12-08 23:09     ` Dale
2022-12-08 13:52 ` Rich Freeman
2022-12-08 23:30   ` Dale
2022-12-08 23:38     ` Rich Freeman
2022-12-09  0:03       ` Dale
2022-12-09  0:17         ` Peter Humphrey
2022-12-09  0:45           ` Dale
2022-12-09  8:27             ` Wol
2022-12-09 10:34               ` Peter Humphrey
2022-12-11 11:34                 ` [OT] " Peter Humphrey
2022-12-13 17:36                   ` Laurence Perkins
2022-12-09  8:24         ` Wol
2022-12-09  0:06     ` Frank Steinmetzger
2022-12-09  1:15       ` Dale
2022-12-09  7:56         ` Wol
2022-12-09  9:15           ` Dale
2022-12-09  6:22     ` William Kenworthy
2022-12-08 13:59 ` Frank Steinmetzger
2022-12-08 14:11   ` Rich Freeman
2022-12-08 16:56     ` Laurence Perkins
2022-12-08 23:26       ` Rich Freeman
2022-12-09 14:11 ` Dale
2022-12-10 20:41 ` Dale
2022-12-10 21:28   ` Mark Knecht
2022-12-10 23:54     ` Dale
2022-12-11  3:31       ` Mark Knecht
2022-12-11  4:35         ` Dale
2022-12-11 14:07           ` Mark Knecht
2022-12-11 15:01             ` Dale
2022-12-11 15:44               ` Mark Knecht
2022-12-11 23:43                 ` Frank Steinmetzger [this message]
2022-12-12  0:32                   ` Dale
2022-12-12  1:55                     ` Dale
2022-12-12 23:29                       ` Mark Knecht
2022-12-13  0:43                         ` Dale
2022-12-11  2:46     ` David Rosenbaum
     [not found]     ` <CAL+8heNN7CCQcTrhjuJboAnxvi7ACWVAgPuXqj3bwTPNaNQ94A@mail.gmail.com>
2022-12-11  2:49       ` David Rosenbaum
2022-12-11  4:38         ` David Rosenbaum
2022-12-16  4:08 ` Dale
2022-12-16 12:56   ` Frank Steinmetzger
2022-12-16 22:35     ` Dale
2022-12-16 19:12   ` Mark Knecht
2022-12-16 22:43     ` Dale
2022-12-16 23:49       ` Frank Steinmetzger
2022-12-17  3:50         ` Dale
2022-12-17  4:47           ` Frank Steinmetzger
2022-12-17  6:49             ` Dale
2022-12-17 13:54               ` Frank Steinmetzger
2022-12-17 15:15           ` Mark Knecht
2022-12-17 15:51             ` Dale
2022-12-17 16:09               ` Mark Knecht
2022-12-17 16:42                 ` Dale
2022-12-17 17:18                   ` Mark Knecht
2022-12-17 22:56                   ` David Rosenbaum
2022-12-17 19:10                 ` Wol
2022-12-17 20:03                   ` Mark Knecht
2022-12-17 23:41                     ` Dale
2022-12-18 14:04                       ` Mark Knecht
2022-12-18 15:12                         ` Dale
2022-12-18 15:27                           ` Michael
2022-12-18 18:38                             ` Dale
2022-12-18 18:55                               ` Mark Knecht
2022-12-18 19:20                                 ` Dale
2022-12-18 19:25                                   ` Mark Knecht
2022-12-18 22:08                                     ` Dale
2022-12-19 21:13                                       ` ralfconn
2022-12-18 18:56                               ` Frank Steinmetzger
2022-12-18 15:29                           ` Frank Steinmetzger
2022-12-18 18:59                             ` Dale
2022-12-18 19:53                               ` Wol
2022-12-18 22:11                                 ` Dale
2022-12-19 11:08                                   ` Wols Lists
2022-12-20  6:52                                     ` Dale
2022-12-26  8:01                                       ` David Rosenbaum
2022-12-26  8:00                                 ` David Rosenbaum
2022-12-18 15:29                           ` Mark Knecht
2022-12-18 15:38                             ` Mark Knecht
2022-12-18 15:48                               ` Living in NGL: was: " Jack
2022-12-18 16:17                                 ` Mark Knecht
2022-12-18 19:00                                   ` Jack
2022-12-18 19:07                                   ` Dale
2022-12-18 19:22                                     ` Mark Knecht
2022-12-18 19:30                                     ` Frank Steinmetzger
2022-12-18 20:06                                       ` Rich Freeman
2022-12-18 20:30                                         ` Mark Knecht
2022-12-18 20:34                                           ` Mark Knecht
2022-12-18 20:53                                           ` Frank Steinmetzger
2022-12-18 21:53                                       ` Dale
2022-12-18 22:08                                         ` Frank Steinmetzger
2022-12-18 22:18                                           ` Dale
2022-12-19  1:37                                         ` Rich Freeman
2022-12-19  5:11                                           ` Dale
2022-12-19 12:00                                             ` Rich Freeman
2022-12-19 12:51                                               ` Wols Lists
2022-12-19 13:30                                                 ` Rich Freeman
2022-12-19 16:43                                                   ` Mark Knecht
2022-12-20  0:00                                                     ` Rich Freeman
2022-12-20  1:46                                                   ` William Kenworthy
2022-12-18 17:11                           ` Wol
2022-12-18 18:03                           ` Mark Knecht
2022-12-18  0:20                     ` Wol
2022-12-17 20:47                 ` Frank Steinmetzger
2022-12-21  0:14   ` Frank Steinmetzger
2022-12-21  2:47     ` Dale
2022-12-21  5:53       ` Wols Lists
2022-12-21  6:19         ` Frank Steinmetzger
2022-12-21  7:01           ` William Kenworthy
2022-12-21 20:03           ` Wol
2022-12-21 20:40             ` Frank Steinmetzger
2022-12-21 21:33               ` Wol
2022-12-21  6:52         ` Dale
2022-12-21 13:50           ` Mark Knecht

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=Y5ZrIseCoyBxVgu9@schatulle \
    --to=warp_7@gmx.de \
    --cc=gentoo-user@lists.gentoo.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox