public inbox for gentoo-user@lists.gentoo.org
 help / color / mirror / Atom feed
From: Volker Armin Hemmann <volkerarmin@googlemail.com>
To: gentoo-user@lists.gentoo.org
Subject: Re: [gentoo-user] Safeguarding strategies against SSD data loss
Date: Mon, 27 Oct 2014 18:20:43 +0100	[thread overview]
Message-ID: <544E7EEB.8010004@googlemail.com> (raw)
In-Reply-To: <201410271522.32452.michaelkintzios@gmail.com>

Am 27.10.2014 um 16:22 schrieb Mick:
> On Monday 27 Oct 2014 13:13:00 Rich Freeman wrote:
>> On Mon, Oct 27, 2014 at 7:11 AM, Alan McKinnon <alan.mckinnon@gmail.com> 
> wrote:
>>> On 27/10/2014 11:24, Mick wrote:
>>>> I'm starting a new thread so as to not hijack the one about alternative
>>>> kernels, but continue with something Volker raised.
>>>>
>>>> On Sunday 26 Oct 2014 23:25:50 Volker Armin Hemmann wrote:
>>>>> as others have written already: ssd.
>>>>>
>>>>> With a caveat: if an ssd dies, it will die suddenly. Without a warning.
>>>>> Usually 5 minutes before the start of your weekly or monthly backup
>>>>> run. And that is first hand experience.
>>>> I haven't yet started using SSD and have wondered what sort of a system
>>>> should I set up to guard against such instantaneous catastrophic
>>>> failures.  I am interested to hear what strategies people deploy to
>>>> avoid data loss with SSDs, especially on laptops that don't have the
>>>> luxury of raid redundancy.
>>>>
>>>> With spinning drives I use tar and rsync at regular intervals.  There
>>>> have been a few rare cases where a drive failed without prior notice -
>>>> the last one after a reboot.  In such cases I am prepared to live with
>>>> the risk of some data loss, on machines where raid is not an option.
>>> Without some form of redundancy that would be your best strategy -
>>> decent and frequent backups
>> It isn't the most mature solution, but btrfs send has a lot of
>> potential here.  One of the main costs of backups is the need to walk
>> all the data that you intend to backup to find changes.  Rsync can do
>> wonders with minimizing bandwidth, and something like duplicity which
>> uses librsync can do wonders to minimize the size of serializing that
>> in files, but both require reading the entire filesystem.
>>
>> Btrfs send can serialize a set of changes in the filesystem by reading
>> only the btree nodes and extents that have changed.  It is fairly
>> close to a git pull in that sense, though git doesn't use balanced
>> trees.  That would greatly reduce the IO cost of frequent backups.
>> You would just periodically create a new snapshot, do a send between
>> the last snapshot and the new one, and once you've confirmed
>> successful completion of that you'd delete the old snapshot.
>>
>> Of course, IO seeks aren't nearly as expensive on an SSD as they are
>> on a hard drive.  I haven't really done a lot of rsync on ssds while
>> using them so I can't really vouch for how much the IO impacts
>> operations.
>>
>> But yes, backup and RAID are really your only options for SSD failure
>> as far as I can see it.  That and limiting the amount of data that
>> can't be re-generated.  If you just save the world file and all of
>> /etc you could probably rebuild a Gentoo install fairly quickly on a
>> new drive, and then you're just left with /home and whatever else you
>> happen to have installed that sticks stuff in /var that you care
>> about.
>
> Thanks Rich, I have been reading your posts about btrfs with interest, but 
> have not yet used it on my systems.  Is btrfs agreeable with SSDs, or should I 
> be using f2fs:
>
>  http://www.phoronix.com/scan.php?page=article&item=linux_314_ssdfs&num=1
>

neither. Just use ext4.

You don't want to combine the sensitive nature of a ssd with the
youthful playfulness of a young filesystem.

Also, I am a little bit concerned about that 'freshly formatted' at the
start of the article.


  parent reply	other threads:[~2014-10-27 17:20 UTC|newest]

Thread overview: 23+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2014-10-27  9:24 [gentoo-user] Safeguarding strategies against SSD data loss Mick
2014-10-27 10:30 ` Alec Ten Harmsel
2014-10-27 11:11 ` Alan McKinnon
2014-10-27 13:13   ` Rich Freeman
2014-10-27 15:15     ` [gentoo-user] " James
2014-10-27 15:23       ` Mick
2014-10-27 15:22     ` [gentoo-user] " Mick
2014-10-27 15:36       ` Rich Freeman
2014-10-27 16:52         ` Pandu Poluan
2014-10-27 17:26           ` Volker Armin Hemmann
2014-10-27 17:30           ` Rich Freeman
2014-10-28  0:41             ` Pandu Poluan
2014-10-28  1:13               ` Rich Freeman
2014-10-28  3:45           ` Tom H
2014-10-27 17:23         ` Volker Armin Hemmann
2014-10-27 17:37           ` Rich Freeman
2014-10-28  0:56             ` Pandu Poluan
2014-10-28  3:49             ` Tom H
2014-10-27 17:20       ` Volker Armin Hemmann [this message]
2014-10-27 17:17     ` Volker Armin Hemmann
2014-10-27 12:27 ` Philip Webb
2014-10-27 14:12   ` [gentoo-user] Safeguarding strategies against SSD data loss : PS Philip Webb
2014-10-27 15:16   ` [gentoo-user] Safeguarding strategies against SSD data loss Mick

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=544E7EEB.8010004@googlemail.com \
    --to=volkerarmin@googlemail.com \
    --cc=gentoo-user@lists.gentoo.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox