From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 3B91F139337 for ; Mon, 2 Aug 2021 05:40:20 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 7DD9FE0960; Mon, 2 Aug 2021 05:40:12 +0000 (UTC) Received: from icp-osb-irony-out5.external.iinet.net.au (icp-osb-irony-out5.external.iinet.net.au [203.59.1.221]) by pigeon.gentoo.org (Postfix) with ESMTP id 4F3F7E0942 for ; Mon, 2 Aug 2021 05:40:10 +0000 (UTC) X-SMTP-MATCH: 0 IronPort-HdrOrdr: =?us-ascii?q?A9a23=3A11uXg6v4mNpiPVWPXgzR66Dr7skDwtV00z?= =?us-ascii?q?EX/kB9WHVpm62j5qOTdZEgviMc5wxhJU3I9ersBED4ewK4yXcX2+ks1NWZMj?= =?us-ascii?q?XOgXClLY1r4If4qgeQeREWn9Q1vc1dms5FZOEYZmIasS+V2maFOudl4N6L/K?= =?us-ascii?q?ykwc3az3trUEVDcrgI1XYfNi+rVm1wSQVLCN4SEp2A6s1b4wexYHh/VLXcOl?= =?us-ascii?q?A1G8jFqtHGmdbISjtuPW9C1CC+yROu5bL3Hlyk/H4lIkty6IZnyFKAvCfdj5?= =?us-ascii?q?/Tyc2T+1vnziv2445NkNXsjvtPbfb88fT8Dl7X+3qVTZUkUbWHpTg0rubq6F?= =?us-ascii?q?tCqqi0nysd?= X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: =?us-ascii?q?A2CxAwDZhAdh/+hY69xaGwEBAQEBAQE?= =?us-ascii?q?BBQEBARIBAQEDAwEBAUAJgVCDeAEBAYUwiQSHEQEBAQEBAQaBFC0DOAGECIY?= =?us-ascii?q?oknQLAQEBAQEBAQEBCUEEAQGEWAKDACY4EwECBBUBAQEFAQEBAQEGAwGBJIV?= =?us-ascii?q?1hkMBBSMPASMzCxgCAiYCAlcTCAEBgm2CYiWpNYExgQGEaIUugRAqjW9DfYE?= =?us-ascii?q?QgTwMA4JvPoN+DYEGgkqCZASDRhkXSWdsaRyRQViODZ0VgzGeMwYPBSaVTgi?= =?us-ascii?q?REYZ3rysvhHmBPjldgSBNHxmDJU8ZDo4rFhWOJTQBAQFnAgYBCgEBAwmICYF?= =?us-ascii?q?pXgEB?= X-IPAS-Result: =?us-ascii?q?A2CxAwDZhAdh/+hY69xaGwEBAQEBAQEBBQEBARIBAQEDA?= =?us-ascii?q?wEBAUAJgVCDeAEBAYUwiQSHEQEBAQEBAQaBFC0DOAGECIYoknQLAQEBAQEBA?= =?us-ascii?q?QEBCUEEAQGEWAKDACY4EwECBBUBAQEFAQEBAQEGAwGBJIV1hkMBBSMPASMzC?= =?us-ascii?q?xgCAiYCAlcTCAEBgm2CYiWpNYExgQGEaIUugRAqjW9DfYEQgTwMA4JvPoN+D?= =?us-ascii?q?YEGgkqCZASDRhkXSWdsaRyRQViODZ0VgzGeMwYPBSaVTgiREYZ3rysvhHmBP?= =?us-ascii?q?jldgSBNHxmDJU8ZDo4rFhWOJTQBAQFnAgYBCgEBAwmICYFpXgEB?= X-IronPort-AV: E=Sophos;i="5.84,288,1620662400"; d="scan'208";a="391028067" Received: from 220-235-88-232.dyn.iinet.net.au (HELO mail.infra.localdomain) ([220.235.88.232]) by icp-osb-irony-out5.iinet.net.au with ESMTP; 02 Aug 2021 13:39:57 +0800 Received: from localhost (mail.infra.localdomain [127.0.0.1]) by mail.infra.localdomain (Postfix) with ESMTP id 2871DA8D7 for ; Mon, 2 Aug 2021 13:39:57 +0800 (AWST) X-Virus-Scanned: amavisd-new at localdomain Received: from mail.infra.localdomain ([127.0.0.1]) by localhost (mail.infra.localdomain [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id N2r_3LMSIm47 for ; Mon, 2 Aug 2021 13:38:33 +0800 (AWST) Subject: Re: [gentoo-user] [OT] SMR drives (WAS: cryptsetup close and device in use when it is not) To: gentoo-user@lists.gentoo.org References: <6102DB58.7040103@youngman.org.uk> <56d64f52-1b9a-1309-c720-06bb63c9f80a@iinet.net.au> <7a8c52c3-4c96-89ac-ace0-6eb4b8f1401f@iinet.net.au> <6104C897.5010505@youngman.org.uk> <7e6b56a2-917f-4dd6-3599-722bca5162ca@iinet.net.au> <7b00c8ee-b142-cd21-fc9e-77d272bb116e@iinet.net.au> From: William Kenworthy Message-ID: Date: Mon, 2 Aug 2021 13:38:31 +0800 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.12.0 Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Content-Language: en-AU X-Archives-Salt: 7f60325f-76c7-4934-ba6a-e158d8a9be1c X-Archives-Hash: d39afb1c636641608d0c4296f26b03f4 On 2/8/21 5:38 am, Frank Steinmetzger wrote: > Am Sun, Aug 01, 2021 at 11:46:02AM +0800 schrieb William Kenworthy: > >>>> And you are storing several machines into a single repo? The docs say this >>>> is not supported officially. But I have one repo each for /, /home and data >>>> for both my PC and laptop. Using a wrapper script, I create snapshots that >>>> are named $HOSTNAME_$DATE in each repo. >>> Basicly yes: I use a once per hour snapshot of approximately 500Gib of >>> data on moosefs, plus borgbackups 3 times a day to individual repos on >>> moosefs for each host.  3 times a day, the latest snapshot is stuffed >>> into a borg repo on moosefs and the old  snapshots are deleted.  I >>> currently manually push all the repos into a borg repo on the USB3 SMR >>> drive once a day or so. >>> >>> 1. rsync (and cp etc.) are dismally slow on SMR - use where you have to, >>> avoid otherwise. >>> >>> forgot to mention >> 1a. borgbackup repos are not easily copy'able - each repo has a unique >> ID and copy'ing via rsync creates a duplicate, not a new repo with a new >> cache and metadata which depending on how you use can cause >> corruption/data loss.  Google it. > Yup. Today I did my (not so) weekly backup and rsynced the repo to the new > drive. After that I wanted to compare performance of my old 3 TB drive and > the new SMR one by deleting a snapshot from the repo on each drive. But Borg > objected on the second deletion, because “the cache was newer”. But that’s > okay. I actually like this, as this will prevent me from chaning two repos > in parallel which would make them incompatible. > Keep in  mind that both repos have the same ID - you should also rsync the cache and security directories as well as they are now out of sync (hence the warning).  Be very careful on how you do this - you are one step away from losing the while repo if the cache gets out of sync.  The docs warn against rsyncing two repos and then using them at the same time for a good reason. BillK