From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id B350A139355 for ; Mon, 2 Aug 2021 22:04:08 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id D639FE0959; Mon, 2 Aug 2021 22:04:02 +0000 (UTC) Received: from mout.gmx.net (mout.gmx.net [212.227.17.20]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id EA2B1E0936 for ; Mon, 2 Aug 2021 22:04:01 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1627941830; bh=8NeT3ovW5R195UWI1Nog4Vlkv67okqt2+tAH9Oua9H0=; h=X-UI-Sender-Class:Date:From:To:Subject:References:In-Reply-To; b=Vd0HE4lAR+ZLabk7D//ZMDeD1i9/MWaZxpHvWmFoX6HxWTCFKFt6j0dat+M++dTkM OrZq89afbeW3SIfFH1TzRKJ3ooPh/RkJVK5SFfEZI3U6nn29kP/xDo+gaXfjkPwlZJ 9GnCoi8/M7YKyqDP1LseQ0CXtVP604v5chThBAR4= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from kern ([92.117.45.35]) by mail.gmx.net (mrgmx104 [212.227.17.168]) with ESMTPSA (Nemesis) id 1M8ygY-1mGkJU3AfO-006AkG for ; Tue, 03 Aug 2021 00:03:50 +0200 Date: Tue, 3 Aug 2021 00:03:48 +0200 From: Frank Steinmetzger To: gentoo-user@lists.gentoo.org Subject: Re: [gentoo-user] [OT] SMR drives (WAS: cryptsetup close and device in use when it is not) Message-ID: Mail-Followup-To: gentoo-user@lists.gentoo.org References: <56d64f52-1b9a-1309-c720-06bb63c9f80a@iinet.net.au> <7a8c52c3-4c96-89ac-ace0-6eb4b8f1401f@iinet.net.au> <6104C897.5010505@youngman.org.uk> <7e6b56a2-917f-4dd6-3599-722bca5162ca@iinet.net.au> <79367904-1d97-5d5e-ab0e-5f6cbb36071d@iinet.net.au> Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="E9thGT6Aj/Qlr4kL" Content-Disposition: inline In-Reply-To: <79367904-1d97-5d5e-ab0e-5f6cbb36071d@iinet.net.au> User-Agent: Mutt 2.1.1; VIM - Vi IMproved 8.2 X-Provags-ID: V03:K1:98b8oqQB8Tdp7Vf8fvCPG0Cdls/HrTUh7XbY5IUR3h+e15KcIra SKI23p6DOp2E79f9bzTgNQF0McJ+avgFKXfQLZLjcnUpYR42AfX8NaygDDcf0r99KGCh59I RcinHEbhsy/iooNeP1b8Vd0iBA8QYwaWqcV0jQTNwrowOWFCvL9hAnycG7E8bp8xVwR70C7 kRScin8M+vaYtqm1sPmpw== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:9HntSQPDgOc=:5Xh6BZSJzEMb4Bm1H9N6Ec F+fs1t3otMvAgUK/M02L+4CyJsuOKvQW7msy57sKgfu18jXlYYIEWRP0QIZHUmgutU9Jd2qcW 0+595wgxvrpzXKj0OK8bX4qXK7NKHNke3CoDsdrBAnxVKmQVd/eVLjHhn8VkC1RPPLAhf3xAk jZQOnfYR8VYrrfXE9Gd8wiriszjiy8L9MwFJXwObnjXDg28eAkvvIxArRLx3nbtsclr/AgZx0 Hg12JBFFoD76YqRVnrdTzBN2e22ySuQAwJzpNY3nCj9t5jz+WNRT95yAyV1KsA2fH0lqZjHza KmZmRV4TFSLqY9hkzgSgkXwc1KiXHagH1ypfpjVCyCrkeoxAstgGK82CnyDxSZXuYxQUxtWI0 YnKvXnfASVB5proc1pigVkc7SXu0OsnLq4FvKkakD3OcDpLT04CeknBrxV+zf5tccxUtksUGe kaiOmMM+JeiTCKfNhp00TWIyIUNrzTdXhh8X7agGrYX3Lgb4M2tDj1PHwbBC/N0uttC7lrjwK s+oZTv/SoMvcAfGZnRRd+AMydki9/b6lCZgsqLvHYSiLLsGyfKJvOumubPsBLc5hMl4gHqCFS rhPefCqnYMarOaZhDt6SdSQBxtkhLDK9I/yKtid8YpDUww3TRX2+HcbA+DxLYrUcDHguG/Bns AceBTX13WCzAOM/Vd4M3ECO1cnaSWmTwU/aeLD5bIwLJksdTXaOHXFrwxqve45qS34mYY90lr snz+h5uo30cd0fMNyDI9xRd3i1y2XWqY1Kw9OlDQj4uKrAkAUw6j1ewHM6AiV91RrmNt19W3h vRP3Twbcjn+crC/AO04fqr9GUAcgDbqM4DCyw+w9RsI5Zg/bzu8r05KMdFWFWv2CuAR+yJeTw wqRnh0eT0RCaxOsVn8i1sw1BwJnB7bCLihy2dOZRpZbwjLzBHiphD1U+Nyb1zP/FUrmzDEwxM Gt+3NWS5jK547ZvrwjigSmJHv4rOSnf1A2Ut4PNewgCUCjo6hkvK3AZo6+osn0/fnRBBeslkm JakF6nNNH5DggSVpKVTjuPa/+r1EQifGLEqonVuoJr1sNuAIeFvYp0T9rnTw7hXTNqyItV2dK hhwp5ol6zz2fIiiebk22m1v6dYEbY2tUgrP X-Archives-Salt: 96a8a128-049d-425a-985f-272e0499d5d7 X-Archives-Hash: 5659f6b32b808fcd74270a0c142467a4 --E9thGT6Aj/Qlr4kL Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Am Mon, Aug 02, 2021 at 02:12:24PM +0800 schrieb William Kenworthy: > >>> And you are storing several machines into a single repo? The docs say= this > >>> is not supported officially. But I have one repo each for /, /home an= d data > >>> for both my PC and laptop. Using a wrapper script, I create snapshots= that > >>> are named $HOSTNAME_$DATE in each repo. > >> Basicly yes: I use a once per hour snapshot of approximately 500Gib of > >> data on moosefs, plus borgbackups 3 times a day to individual repos on > >> moosefs for each host. > > So you have: > > Host A =E2=94=80=E2=94=80[hourly]=E2=94=80=E2=94=80> Online-Borg A =E2= =94=80=E2=94=90 > > =E2=94=9C=E2=94=80=E2=94=80[3/day]= =E2=94=80=E2=94=80> Offline-Borg > > Host B =E2=94=80=E2=94=80[hourly]=E2=94=80=E2=94=80> Online-Borg B =E2= =94=80=E2=94=98 > > ? > > [=E2=80=A6] > > Hi Frank, > > Not quite - I see I could have been clearer.=C2=A0 I "experiment" a lot - > which means things break so I need to get back running quickly.=C2=A0 So = the > purpose of the online repos and snapshots is just for that - quick > recovery. Whenever you say snapshot, you meen moosefs snapshots, right? Up until this thread I=E2=80=99ve never heard of that FS. I would love to play more with storage systems, moving stuff around, backing it up, assigning space and so on (basically play admin for a few people), but apart from my ZFS-based NAS, I have nothing that would need this. I run a nextcloud instance on my shared internet host and one on my raspi. That= =E2=80=99s as far as it gets. :D > stage 1: online, immediately available > > Hosts (those with actual attached storage - a mixture of intel, arm32 > and arm64 devices are backed up to their own borg repo 3 times a day via > push.=C2=A0 One repo per machine on moosefs. > > A separate script does an hourly backup of VM, LXC images, and various > data stores via a moosefs snapshot. > > stage 2: resource management for the snapshots > > 3 times a day, a script does a borg create on the latest snapshop at the > time So you mount the latest snapshot or access it in some other way and borg *its* content, not the live data, right? > and when complete deletes all previous snapshots (-1) so at that > point I have two older snapshots available + a couple created during the > borg run - note that large multi GiB snapshots can quickly use up all > memory (32GiB) on the moosefs master unless culled regularly. Sounds a bit delicate to me. If one link fails for some reason undetectedly, you risk clog-up. > stage 3: offline because disasters happen :) > > All borg repos are on moosefs with a single root directory > (/mnt/mfs/backups) so once every day or so I manually mount the offline > disk and do a borg create on the backup directory. What happens if that daily borg runs while the repos are being written to? --=20 Gr=C3=BC=C3=9Fe | Greetings | Qapla=E2=80=99 Please do not share anything from, with or about me on any social network. Even a Bonsai dreams of greatness. --E9thGT6Aj/Qlr4kL Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCgAdFiEEVbE9o2D2lE5fhoVsizG+tUDUMMoFAmEIa8QACgkQizG+tUDU MMoEfQ/+PROpG2rF7wliyuxoSYQiACLX9W20GDO5/H2N8/kJghuWoziPOIIPix7W axSUnzaS5sn+Ueb/SzfAWE0rhJEYPPbf2+FLfHRNplYB5URphtfzU4yMxjr7ESDd 9YJ4gC79l6iJZEkLRSGnsDShXiZCKxzGKY4a/RjUi+zX3PG+t7c2sDegO1Qv53Kn o113PBiVHd2nu0g/T+epyAEqoLlAqOSWqHK8a6PkoSuTo1bhDhm9jHypHwvdMx48 RJviXgupUx2bXItHtJP7rkEWAfVd/jmCnx+hDDb/P6mY/e2WhWbLKOg7G5HoSos3 Ltr3mu052HxFKXQMHXd1uyaYRvg9AksP6HA06OS0biqLug1DKlQY0/Fztf/rarJL eDu+gXnwnCWDApmMSRZHTEqLDbAc4njUqhBE0oHipLcTiCaxymP9UuWaWz/UopyD 79c7CPM08ftf25XPliT55nCzUHJkmqlriuEkXDfi6FtWvhJ07pomQEtXfvMuOPID v9gNBUpj5Z9hT4gOELsYXmrsp8aYVIUlQYPbACS7tljifALWZ83Ap9agdNdl0PIJ kNDa6/Afhj6UwbWyDJyJjsBzD2T2gqXxDslmkb1RCctyFRGmntZZJAjxvhlfEncR VAkGTtrqxtJL4O1nXNzed1nXtmVVGwlDDIxLs6+wudL87Wp0irA= =dYR4 -----END PGP SIGNATURE----- --E9thGT6Aj/Qlr4kL--