From: Mick <michaelkintzios@gmail.com>
To: gentoo-user@lists.gentoo.org
Subject: Re: [gentoo-user] Safeguarding strategies against SSD data loss
Date: Mon, 27 Oct 2014 15:22:30 +0000 [thread overview]
Message-ID: <201410271522.32452.michaelkintzios@gmail.com> (raw)
In-Reply-To: <CAGfcS_mbyhQ4hWW20h7g0WmR8Xx5iNVK1dFjSm=pcW9kNrcp4Q@mail.gmail.com>
[-- Attachment #1: Type: Text/Plain, Size: 3254 bytes --]
On Monday 27 Oct 2014 13:13:00 Rich Freeman wrote:
> On Mon, Oct 27, 2014 at 7:11 AM, Alan McKinnon <alan.mckinnon@gmail.com>
wrote:
> > On 27/10/2014 11:24, Mick wrote:
> >> I'm starting a new thread so as to not hijack the one about alternative
> >> kernels, but continue with something Volker raised.
> >>
> >> On Sunday 26 Oct 2014 23:25:50 Volker Armin Hemmann wrote:
> >>> as others have written already: ssd.
> >>>
> >>> With a caveat: if an ssd dies, it will die suddenly. Without a warning.
> >>> Usually 5 minutes before the start of your weekly or monthly backup
> >>> run. And that is first hand experience.
> >>
> >> I haven't yet started using SSD and have wondered what sort of a system
> >> should I set up to guard against such instantaneous catastrophic
> >> failures. I am interested to hear what strategies people deploy to
> >> avoid data loss with SSDs, especially on laptops that don't have the
> >> luxury of raid redundancy.
> >>
> >> With spinning drives I use tar and rsync at regular intervals. There
> >> have been a few rare cases where a drive failed without prior notice -
> >> the last one after a reboot. In such cases I am prepared to live with
> >> the risk of some data loss, on machines where raid is not an option.
> >
> > Without some form of redundancy that would be your best strategy -
> > decent and frequent backups
>
> It isn't the most mature solution, but btrfs send has a lot of
> potential here. One of the main costs of backups is the need to walk
> all the data that you intend to backup to find changes. Rsync can do
> wonders with minimizing bandwidth, and something like duplicity which
> uses librsync can do wonders to minimize the size of serializing that
> in files, but both require reading the entire filesystem.
>
> Btrfs send can serialize a set of changes in the filesystem by reading
> only the btree nodes and extents that have changed. It is fairly
> close to a git pull in that sense, though git doesn't use balanced
> trees. That would greatly reduce the IO cost of frequent backups.
> You would just periodically create a new snapshot, do a send between
> the last snapshot and the new one, and once you've confirmed
> successful completion of that you'd delete the old snapshot.
>
> Of course, IO seeks aren't nearly as expensive on an SSD as they are
> on a hard drive. I haven't really done a lot of rsync on ssds while
> using them so I can't really vouch for how much the IO impacts
> operations.
>
> But yes, backup and RAID are really your only options for SSD failure
> as far as I can see it. That and limiting the amount of data that
> can't be re-generated. If you just save the world file and all of
> /etc you could probably rebuild a Gentoo install fairly quickly on a
> new drive, and then you're just left with /home and whatever else you
> happen to have installed that sticks stuff in /var that you care
> about.
Thanks Rich, I have been reading your posts about btrfs with interest, but
have not yet used it on my systems. Is btrfs agreeable with SSDs, or should I
be using f2fs:
http://www.phoronix.com/scan.php?page=article&item=linux_314_ssdfs&num=1
--
Regards,
Mick
[-- Attachment #2: This is a digitally signed message part. --]
[-- Type: application/pgp-signature, Size: 473 bytes --]
next prev parent reply other threads:[~2014-10-27 15:22 UTC|newest]
Thread overview: 23+ messages / expand[flat|nested] mbox.gz Atom feed top
2014-10-27 9:24 [gentoo-user] Safeguarding strategies against SSD data loss Mick
2014-10-27 10:30 ` Alec Ten Harmsel
2014-10-27 11:11 ` Alan McKinnon
2014-10-27 13:13 ` Rich Freeman
2014-10-27 15:15 ` [gentoo-user] " James
2014-10-27 15:23 ` Mick
2014-10-27 15:22 ` Mick [this message]
2014-10-27 15:36 ` [gentoo-user] " Rich Freeman
2014-10-27 16:52 ` Pandu Poluan
2014-10-27 17:26 ` Volker Armin Hemmann
2014-10-27 17:30 ` Rich Freeman
2014-10-28 0:41 ` Pandu Poluan
2014-10-28 1:13 ` Rich Freeman
2014-10-28 3:45 ` Tom H
2014-10-27 17:23 ` Volker Armin Hemmann
2014-10-27 17:37 ` Rich Freeman
2014-10-28 0:56 ` Pandu Poluan
2014-10-28 3:49 ` Tom H
2014-10-27 17:20 ` Volker Armin Hemmann
2014-10-27 17:17 ` Volker Armin Hemmann
2014-10-27 12:27 ` Philip Webb
2014-10-27 14:12 ` [gentoo-user] Safeguarding strategies against SSD data loss : PS Philip Webb
2014-10-27 15:16 ` [gentoo-user] Safeguarding strategies against SSD data loss Mick
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=201410271522.32452.michaelkintzios@gmail.com \
--to=michaelkintzios@gmail.com \
--cc=gentoo-user@lists.gentoo.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox