From: Michael <confabulate@kintzios.com>
To: gentoo-user@lists.gentoo.org
Subject: Re: [gentoo-user] Seagate hard drives with dual actuators.
Date: Fri, 15 Nov 2024 15:35:53 +0000 [thread overview]
Message-ID: <115451235.nniJfEyVGO@rogueboard> (raw)
In-Reply-To: <471aaa99-dcd1-e9e6-dcc8-725664363b62@gmail.com>
[-- Attachment #1: Type: text/plain, Size: 3584 bytes --]
On Friday 15 November 2024 11:59:34 GMT Dale wrote:
> Michael wrote:
> > On Friday 15 November 2024 05:53:53 GMT Dale wrote:
> >> The thing about my data, it's mostly large video files. If I were
> >> storing documents or something, then SSD or something would be a good
> >> option. Plus, I mostly write once, then it either sits there a while or
> >> gets read on occasion.
> >
> > For a write once - read often use case, the SMR drives are a good
> > solution.
> > They were designed for this purpose. Because of their shingled layers
> > they
> > provide higher storage density than comparable CMR drives.
>
> True but I don't like when I'm told a write is done, it kinda isn't. I
> recall a while back I reorganized some stuff, mostly renamed directories
> but also moved some files. Some were Youtube videos. It took about 30
> minutes to update the data on the SMR backup drive. The part I see
> anyway.
Right there is your problem, "... SMR backup drive". SMRs are best suited to
sequential writes. With repeat random writes they go into a read-modify-write
cycle and slow down.
Consequently, they are well suited to storage of media files, archiving data
long term and such write-once read-often applications. They are not suited to
heavy transactional loads and frequently overwritten data.
> It sat there for a hour at least doing that bumpy thing before
> it finally finished. I realize if I just turn the drive off, the data
> is still there. Still, I don't like it appearing to be done when it
> really is still working on it.
SMR drives have to read a whole band of shingled tracks, modify the small
region where the data has changed and then write the whole band of tracks back
on the disk in one go. The onboard cache on drive managed SMRs (DM-SMR) is
meant to hide this from the OS by queuing up writes before writing them on the
disk in a sequential stream, but if you keep hammering it with many random
writes you will soon exhaust the onboard cache and performance then becomes
glacial.
Host managed SMRs (HM-SMR) require the OS and FS to be aware of the need for
sequential writes and manage submitted data sympathetically to this limitation
of the SMR drive, by queuing up random writes in batches and submitting these
as a sequential stream.
I understand the ext4-lazy option and some patches on btrfs have improved
performance of these filesystems on SMR drivers, but perhaps f2fs will perform
better? :-/
> Another thing, I may switch to RAID one
> of these days. If I do, that drive isn't a good option.
Ugh! RAID striping will combine shingled bands across drives. A random write
on one drive will cause other drives to read-modify-write bands. Whatever
speed benefit is meant to be derived from striping will be reversed. On a NAS
application, where many users could be accessing the storage simultaneously
trying to save their interwebs downloads, etc., the SMR performance will nose
dive.
> When I update my backups, I start the one I do with my NAS setup first.
> Then I start the home directory backup with the SMR drive. I then
> backup everything else I backup on other drives. I do that so that I
> can leave the SMR drive at least powered on while it does it's bumpy
> thing and I do other backups. Quite often, the SMR drive is the last
> one I put back in the safe. That bumpy thing can take quite a while at
> times.
Instead of using the SMR for your /home fs backup, you would do better if you
repurposed it for media files and document backups which do not change as
frequently.
[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 833 bytes --]
next prev parent reply other threads:[~2024-11-15 15:36 UTC|newest]
Thread overview: 38+ messages / expand[flat|nested] mbox.gz Atom feed top
2024-11-13 23:10 [gentoo-user] Seagate hard drives with dual actuators Dale
2024-11-14 0:46 ` Matt Jolly
2024-11-14 13:05 ` Dale
2024-11-14 7:55 ` Wols Lists
2024-11-14 16:48 ` Dale
2024-11-15 0:18 ` [OT] " Peter Humphrey
2024-11-15 8:41 ` [gentoo-user] Hollerith (was: Seagate hard drives with dual actuators) karl
2024-11-15 9:51 ` [OT] Re: [gentoo-user] Seagate hard drives with dual actuators Wols Lists
2024-11-14 11:21 ` Michael
2024-11-14 17:00 ` Dale
2024-11-14 19:12 ` Michael
2024-11-14 19:51 ` Frank Steinmetzger
2024-11-14 19:55 ` Frank Steinmetzger
2024-11-14 23:14 ` Peter Humphrey
2024-11-14 20:33 ` Dale
2024-11-14 20:57 ` Rich Freeman
2024-11-14 23:10 ` Dale
2024-11-15 0:59 ` Rich Freeman
2024-11-15 5:53 ` Dale
2024-11-15 10:09 ` Michael
2024-11-15 11:59 ` Dale
2024-11-15 15:35 ` Michael [this message]
2024-11-15 16:36 ` Dale
2024-11-15 22:13 ` Rich Freeman
2024-11-16 11:02 ` Michael
2024-11-16 14:36 ` Rich Freeman
2024-11-16 19:47 ` Michael
2024-11-16 20:13 ` Rich Freeman
2024-11-16 23:21 ` Wol
2024-11-17 11:22 ` Michael
2024-11-17 21:26 ` Rich Freeman
2024-11-17 23:04 ` Jack
2024-11-18 0:23 ` Rich Freeman
2024-11-18 2:32 ` Matt Jolly
2024-11-15 10:38 ` Frank Steinmetzger
2024-11-15 12:19 ` Dale
2024-11-14 22:38 ` Wols Lists
2024-11-15 9:35 ` Michael
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=115451235.nniJfEyVGO@rogueboard \
--to=confabulate@kintzios.com \
--cc=gentoo-user@lists.gentoo.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox