public inbox for gentoo-user@lists.gentoo.org
 help / color / mirror / Atom feed
From: Michael <confabulate@kintzios.com>
To: gentoo-user@lists.gentoo.org
Subject: Re: [gentoo-user] Seagate hard drives with dual actuators.
Date: Fri, 15 Nov 2024 15:35:53 +0000	[thread overview]
Message-ID: <115451235.nniJfEyVGO@rogueboard> (raw)
In-Reply-To: <471aaa99-dcd1-e9e6-dcc8-725664363b62@gmail.com>

[-- Attachment #1: Type: text/plain, Size: 3584 bytes --]

On Friday 15 November 2024 11:59:34 GMT Dale wrote:
> Michael wrote:
> > On Friday 15 November 2024 05:53:53 GMT Dale wrote:
> >> The thing about my data, it's mostly large video files.  If I were
> >> storing documents or something, then SSD or something would be a good
> >> option.  Plus, I mostly write once, then it either sits there a while or
> >> gets read on occasion.
> > 
> > For a write once - read often use case, the SMR drives are a good
> > solution.
> > They were designed for this purpose.  Because of their shingled layers
> > they
> > provide higher storage density than comparable CMR drives.
> 
> True but I don't like when I'm told a write is done, it kinda isn't.  I
> recall a while back I reorganized some stuff, mostly renamed directories
> but also moved some files.  Some were Youtube videos.  It took about 30
> minutes to update the data on the SMR backup drive.  The part I see
> anyway.

Right there is your problem, "... SMR backup drive".  SMRs are best suited to 
sequential writes.  With repeat random writes they go into a read-modify-write 
cycle and slow down.

Consequently, they are well suited to storage of media files, archiving data 
long term and such write-once read-often applications.  They are not suited to 
heavy transactional loads and frequently overwritten data.


> It sat there for a hour at least doing that bumpy thing before
> it finally finished.  I realize if I just turn the drive off, the data
> is still there.  Still, I don't like it appearing to be done when it
> really is still working on it.

SMR drives have to read a whole band of shingled tracks, modify the small 
region where the data has changed and then write the whole band of tracks back 
on the disk in one go.  The onboard cache on drive managed SMRs (DM-SMR) is 
meant to hide this from the OS by queuing up writes before writing them on the 
disk in a sequential stream, but if you keep hammering it with many random 
writes you will soon exhaust the onboard cache and performance then becomes 
glacial.

Host managed SMRs (HM-SMR) require the OS and FS to be aware of the need for 
sequential writes and manage submitted data sympathetically to this limitation 
of the SMR drive, by queuing up random writes in batches and submitting these 
as a sequential stream.

I understand the ext4-lazy option and some patches on btrfs have improved 
performance of these filesystems on SMR drivers, but perhaps f2fs will perform 
better?  :-/


> Another thing, I may switch to RAID one
> of these days.  If I do, that drive isn't a good option. 

Ugh!  RAID striping will combine shingled bands across drives.  A random write 
on one drive will cause other drives to read-modify-write bands.  Whatever 
speed benefit is meant to be derived from striping will be reversed.  On a NAS 
application, where many users could be accessing the storage simultaneously 
trying to save their interwebs downloads, etc., the SMR performance will nose 
dive.


> When I update my backups, I start the one I do with my NAS setup first. 
> Then I start the home directory backup with the SMR drive.  I then
> backup everything else I backup on other drives.  I do that so that I
> can leave the SMR drive at least powered on while it does it's bumpy
> thing and I do other backups.  Quite often, the SMR drive is the last
> one I put back in the safe.  That bumpy thing can take quite a while at
> times. 

Instead of using the SMR for your /home fs backup, you would do better if you 
repurposed it for media files and document backups which do not change as 
frequently.

[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

  reply	other threads:[~2024-11-15 15:36 UTC|newest]

Thread overview: 38+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2024-11-13 23:10 [gentoo-user] Seagate hard drives with dual actuators Dale
2024-11-14  0:46 ` Matt Jolly
2024-11-14 13:05   ` Dale
2024-11-14  7:55 ` Wols Lists
2024-11-14 16:48   ` Dale
2024-11-15  0:18     ` [OT] " Peter Humphrey
2024-11-15  8:41       ` [gentoo-user] Hollerith (was: Seagate hard drives with dual actuators) karl
2024-11-15  9:51       ` [OT] Re: [gentoo-user] Seagate hard drives with dual actuators Wols Lists
2024-11-14 11:21 ` Michael
2024-11-14 17:00   ` Dale
2024-11-14 19:12     ` Michael
2024-11-14 19:51       ` Frank Steinmetzger
2024-11-14 19:55         ` Frank Steinmetzger
2024-11-14 23:14           ` Peter Humphrey
2024-11-14 20:33       ` Dale
2024-11-14 20:57         ` Rich Freeman
2024-11-14 23:10           ` Dale
2024-11-15  0:59             ` Rich Freeman
2024-11-15  5:53               ` Dale
2024-11-15 10:09                 ` Michael
2024-11-15 11:59                   ` Dale
2024-11-15 15:35                     ` Michael [this message]
2024-11-15 16:36                       ` Dale
2024-11-15 22:13                       ` Rich Freeman
2024-11-16 11:02                         ` Michael
2024-11-16 14:36                           ` Rich Freeman
2024-11-16 19:47                             ` Michael
2024-11-16 20:13                               ` Rich Freeman
2024-11-16 23:21                                 ` Wol
2024-11-17 11:22                                 ` Michael
2024-11-17 21:26                                   ` Rich Freeman
2024-11-17 23:04                                     ` Jack
2024-11-18  0:23                                       ` Rich Freeman
2024-11-18  2:32                                         ` Matt Jolly
2024-11-15 10:38                 ` Frank Steinmetzger
2024-11-15 12:19                   ` Dale
2024-11-14 22:38         ` Wols Lists
2024-11-15  9:35           ` Michael

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=115451235.nniJfEyVGO@rogueboard \
    --to=confabulate@kintzios.com \
    --cc=gentoo-user@lists.gentoo.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox