public inbox for gentoo-user@lists.gentoo.org
 help / color / mirror / Atom feed
From: William Kenworthy <billk@iinet.net.au>
To: gentoo-user@lists.gentoo.org
Subject: Re: [gentoo-user] [OT] SMR drives (WAS: cryptsetup close and device in use when it is not)
Date: Mon, 2 Aug 2021 13:38:31 +0800	[thread overview]
Message-ID: <ae91460a-e970-7495-9aca-331674ff07ba@iinet.net.au> (raw)
In-Reply-To: <YQcUOmhhm09SkDso@kern>


On 2/8/21 5:38 am, Frank Steinmetzger wrote:
> Am Sun, Aug 01, 2021 at 11:46:02AM +0800 schrieb William Kenworthy:
>
>>>> And you are storing several machines into a single repo? The docs say this
>>>> is not supported officially. But I have one repo each for /, /home and data
>>>> for both my PC and laptop. Using a wrapper script, I create snapshots that
>>>> are named $HOSTNAME_$DATE in each repo.
>>> Basicly yes: I use a once per hour snapshot of approximately 500Gib of
>>> data on moosefs, plus borgbackups 3 times a day to individual repos on
>>> moosefs for each host.  3 times a day, the latest snapshot is stuffed
>>> into a borg repo on moosefs and the old  snapshots are deleted.  I
>>> currently manually push all the repos into a borg repo on the USB3 SMR
>>> drive once a day or so.
>>>
>>> 1. rsync (and cp etc.) are dismally slow on SMR - use where you have to,
>>> avoid otherwise.
>>>
>>> forgot to mention
>> 1a. borgbackup repos are not easily copy'able - each repo has a unique
>> ID and copy'ing via rsync creates a duplicate, not a new repo with a new
>> cache and metadata which depending on how you use can cause
>> corruption/data loss.  Google it.
> Yup. Today I did my (not so) weekly backup and rsynced the repo to the new
> drive. After that I wanted to compare performance of my old 3 TB drive and
> the new SMR one by deleting a snapshot from the repo on each drive. But Borg
> objected on the second deletion, because “the cache was newer”. But that’s
> okay. I actually like this, as this will prevent me from chaning two repos
> in parallel which would make them incompatible.
>
Keep in  mind that both repos have the same ID - you should also rsync
the cache and security directories as well as they are now out of sync
(hence the warning).  Be very careful on how you do this - you are one
step away from losing the while repo if the cache gets out of sync.  The
docs warn against rsyncing two repos and then using them at the same
time for a good reason.

BillK




  reply	other threads:[~2021-08-02  5:40 UTC|newest]

Thread overview: 64+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2021-06-14  4:50 [gentoo-user] cryptsetup close and device in use when it is not Dale
2021-06-15 13:48 ` Ramon Fischer
2021-06-15 14:21   ` Dale
2021-06-15 14:52     ` Jack
2021-06-15 15:26       ` Dale
2021-06-15 19:04         ` Ramon Fischer
2021-06-21  4:18         ` Dale
2021-06-21  4:49           ` Dale
2021-06-21  5:41             ` Dale
2021-06-21  5:59               ` Dale
2021-06-28  3:35                 ` Dale
2021-07-05  3:19                   ` Dale
2021-07-06 18:40                     ` Ramon Fischer
2021-07-06 19:43                       ` Dale
2021-07-07 14:48                       ` Dr Rainer Woitok
2021-07-07 18:08                         ` Dale
2021-07-08  8:20                           ` Ramon Fischer
2021-07-12  8:31                             ` Dale
2021-07-12 13:14                               ` Ramon Fischer
2021-08-02 13:33                                 ` Dale
2021-08-09 13:38                                   ` Ramon Fischer
2021-09-19 11:55                                     ` Dale
2021-07-25 20:29                           ` Frank Steinmetzger
2021-07-25 23:10                             ` Dale
2021-07-26 21:00                               ` Frank Steinmetzger
2021-07-26 22:48                                 ` Dale
2021-07-29 16:46                                 ` Wols Lists
2021-07-29 20:55                                   ` [gentoo-user] [OT] SMR drives (WAS: cryptsetup close and device in use when it is not) Frank Steinmetzger
2021-07-29 21:31                                     ` Frank Steinmetzger
2021-07-30 12:48                                       ` Frank Steinmetzger
2021-07-30  5:14                                     ` William Kenworthy
2021-07-30 14:29                                       ` Rich Freeman
2021-07-30 16:50                                         ` antlists
2021-07-30 18:38                                           ` Rich Freeman
2021-07-31  3:14                                         ` William Kenworthy
2021-07-31  3:50                                           ` Wols Lists
2021-07-31  4:58                                             ` William Kenworthy
2021-07-31 12:12                                               ` Rich Freeman
2021-08-01  0:41                                                 ` Frank Steinmetzger
2021-08-01  0:56                                                   ` Rich Freeman
2021-07-31 16:38                                               ` antlists
2021-08-01  0:50                                               ` Frank Steinmetzger
2021-08-01  3:36                                                 ` William Kenworthy
2021-08-01  3:46                                                   ` William Kenworthy
2021-08-01 21:38                                                     ` Frank Steinmetzger
2021-08-02  5:38                                                       ` William Kenworthy [this message]
2021-08-02 21:52                                                         ` Frank Steinmetzger
2021-08-02 23:10                                                           ` William Kenworthy
2021-08-03  8:18                                                             ` Frank Steinmetzger
2021-08-05 20:40                                                               ` Frank Steinmetzger
2021-08-06  7:22                                                                 ` William Kenworthy
2021-08-01 21:55                                                   ` Frank Steinmetzger
2021-08-02  6:12                                                     ` William Kenworthy
2021-08-02 22:03                                                       ` Frank Steinmetzger
2021-08-02 23:35                                                         ` William Kenworthy
2021-08-01  3:41                                                 ` William Kenworthy
2021-08-01 21:41                                                   ` Frank Steinmetzger
2021-07-31 12:21                                             ` Rich Freeman
2021-07-31 12:59                                               ` William Kenworthy
2021-07-31 13:30                                                 ` Rich Freeman
2021-08-01  3:05                                                   ` William Kenworthy
2021-08-01 11:37                                                     ` Rich Freeman
2021-07-31  5:23                                           ` William Kenworthy
2021-06-15 17:48     ` [gentoo-user] Re: cryptsetup close and device in use when it is not Remy Blank

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=ae91460a-e970-7495-9aca-331674ff07ba@iinet.net.au \
    --to=billk@iinet.net.au \
    --cc=gentoo-user@lists.gentoo.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox