From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id C54C215815E for ; Sat, 3 Feb 2024 18:10:51 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 6856DE2BE0; Sat, 3 Feb 2024 18:10:46 +0000 (UTC) Received: from toucan.tulip.relay.mailchannels.net (toucan.tulip.relay.mailchannels.net [23.83.218.254]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 3FF95E2BDB for ; Sat, 3 Feb 2024 18:10:45 +0000 (UTC) X-Sender-Id: thundermail|x-authsender|confabulate@kintzios.com Received: from relay.mailchannels.net (localhost [127.0.0.1]) by relay.mailchannels.net (Postfix) with ESMTP id 0AEF5821CA for ; Sat, 3 Feb 2024 18:10:44 +0000 (UTC) ARC-Seal: i=1; s=arc-2022; d=mailchannels.net; t=1706983843; a=rsa-sha256; cv=none; b=KjtUHAFJN4BlI9xFOVOJct6qRkJcvnVr/i7o1tg3HdTNUOMHS2wCIMidPASVvEjX0TgmiO 5mmLAHoS+h/Hm/dvBRD8kQeK9zvFPc2NWyzKWD7k1qXrDoGN6bKPHKPQwTehG88SlaGIPm JRuopV/70rQzemaOZGmPDy532vl7bVUDfwWi1sKgbNLgQSDDL9pOsyRBl47W0ARVdpqL/T /JXTNK25wXkLsro3kXALN83vf2b0QZWXY+X8dQXRN7Cwjq9BpcXv1ozdPkFoXsYaScVK00 kGjXOSlK16BjNx+GhyHnHmkMrFzh6RCdRwhscsGSXN7ZPi8KP17zwgWjJ3EK1Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=mailchannels.net; s=arc-2022; t=1706983843; h=from:from:reply-to:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type:in-reply-to:in-reply-to: references:references:dkim-signature; bh=Nv7+7xh827g9VWUBZD14hBrZ3R5yt+1rtbgElCo+e9A=; b=gPQN034OQpksIs95NqaefPtqfWxgCUq/cpoj1S+LlctOx4RRt1CNNr0nnEsaF6QlyVJzQb kOqegqzYHM45SLlx5C4ORxNMvfiR4E0bHZn+rX0FVXqtxE9/ZUrXY68+BelBgom4otnl6b FbYYT+teICT6fNbdX0k93uo4d9fk4pIl4yHwVWaouEQQxPdOj7vONfhJt5Tq526lAT5BeE raKL/54nuo4DLlnpitXZANPcw2NGTl2aXS29gnUGqp7yoHOTUK/Rez9lv2b2vSS5Zh55za 63b5c6lK0ViWYnHpHloBlbYTnOcUUnS83lwJ3ZUO8WxBApiRWnYcrYfyGiSvaQ== ARC-Authentication-Results: i=1; rspamd-6bdc45795d-dd6t8; auth=pass smtp.auth=thundermail smtp.mailfrom=confabulate@kintzios.com X-Sender-Id: thundermail|x-authsender|confabulate@kintzios.com X-MC-Relay: Neutral X-MailChannels-SenderId: thundermail|x-authsender|confabulate@kintzios.com X-MailChannels-Auth-Id: thundermail X-Dime-Blushing: 5aba0b344c308986_1706983843688_3083575720 X-MC-Loop-Signature: 1706983843688:3654627983 X-MC-Ingress-Time: 1706983843687 Received: from mailclean11.thundermail.uk (mailclean11.thundermail.uk [149.255.60.66]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384) by 100.123.181.231 (trex/6.9.2); Sat, 03 Feb 2024 18:10:43 +0000 Received: from cloud220.unlimitedwebhosting.co.uk (cloud220.unlimitedwebhosting.co.uk [149.255.60.183]) by mailclean11.thundermail.uk (Postfix) with ESMTPS id 5890840230 for ; Sat, 3 Feb 2024 18:10:38 +0000 (GMT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kintzios.com; s=default; t=1706983839; bh=Nv7+7xh827g9VWUBZD14hBrZ3R5yt+1rtbgElCo+e9A=; h=From:To:Subject; b=bC9YnUB5Xl3BVkYaeG+m2v6Zc/H617wVUJ8zNIgVKCp1NPy7jU4C4gcJuzB3GwLo0 //W7tFVwoQcmvjeN+/bb5A3ANoucd8/uyibMZ5YE38Lf9yci5ykcYLRxkWoClkpRZY abppZTJnJiWCdO0A9pmSNbg3Wt4BxtjVyz7iaGMs= From: Michael To: gentoo-user@lists.gentoo.org Subject: Re: [gentoo-user] Re: Suggestions for backup scheme? Date: Sat, 03 Feb 2024 18:10:26 +0000 Message-ID: <5752871.DvuYhMxLoT@rogueboard> In-Reply-To: References: Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 Content-Type: multipart/signed; boundary="nextPart6015957.lOV4Wx5bFT"; micalg="pgp-sha256"; protocol="application/pgp-signature" X-PPP-Message-ID: <170698383915.12843.12175366141271151890@cloud220.unlimitedwebhosting.co.uk> X-PPP-Vhost: kintzios.com X-Rspamd-Queue-Id: 5890840230 X-Rspamd-Server: mailclean11 X-Spamd-Result: default: False [-0.61 / 999.00]; SIGNED_PGP(-2.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; MID_RHS_NOT_FQDN(0.50)[]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; ONCE_RECEIVED(0.10)[]; MX_GOOD(-0.01)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DMARC_POLICY_ALLOW(0.00)[kintzios.com,none]; FROM_HAS_DN(0.00)[]; R_DKIM_ALLOW(0.00)[kintzios.com:s=default]; ARC_NA(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FUZZY_BLOCKED(0.00)[rspamd.com]; DKIM_TRACE(0.00)[kintzios.com:+]; RCVD_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+,1:+,2:~]; TO_DN_NONE(0.00)[]; REPLYTO_ADDR_EQ_FROM(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MISSING_XM_UA(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[gentoo-user@lists.gentoo.org]; R_SPF_ALLOW(0.00)[+mx]; NEURAL_HAM(-0.00)[-0.970]; ASN(0.00)[asn:34931, ipnet:149.255.60.0/22, country:GB]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_REPLYTO(0.00)[confabulate@kintzios.com] X-Rspamd-Action: no action X-Archives-Salt: eb78e50d-e0a0-4eca-b891-33079fe42565 X-Archives-Hash: 34eba1c2869841ecac2e183f33db4ef1 --nextPart6015957.lOV4Wx5bFT Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="UTF-8"; protected-headers="v1" From: Michael To: gentoo-user@lists.gentoo.org Reply-To: confabulate@kintzios.com Subject: Re: [gentoo-user] Re: Suggestions for backup scheme? Date: Sat, 03 Feb 2024 18:10:26 +0000 Message-ID: <5752871.DvuYhMxLoT@rogueboard> MIME-Version: 1.0 On Saturday, 3 February 2024 17:32:17 GMT Rich Freeman wrote: > On Fri, Feb 2, 2024 at 6:39=E2=80=AFPM Grant Edwards =20 wrote: > > On 2024-01-31, Rich Freeman wrote: > > > In any case, these COW filesystems, much like git, store data in a > > > way that makes it very efficient to diff two snapshots and back up > > > only the data that has changed. [...] > >=20 > > In order to take advantage of this, I assume that the backup > > destination and source both have to be ZFS? >=20 > So, the data needs to be RESTORED to ZFS for this to work. However, > the zfs send command serializes the data and so you can just store it > in files. Those files can only be read back into zfs. >=20 > It is probably a bit more typical to just pipe the send command into > zfs receive (often over ssh) so that you're just directly mirroring > the filesystem, and not storing the intermediate data. >=20 > > Do backup source and > > destination need to be in the same filesystem? Or volume? Or Pool? >=20 > No on all of these, but they can be. >=20 > > If you'll forgive the analogy, we'll say the the functionality of > > rsync (as used by rsnapshot) is built-in to ZFS. Is there an > > application that does with ZFS snapshots what the rsnapshot > > application itself does with rsync? >=20 > There are a few wrappers around zfs send. I'm using > sys-fs/zfs-auto-snapshot and what looks like a much older version of: > https://github.com/psy0rz/zfs_autobackup >=20 > > I googled for ZFS backup applications, but didn't find anything that > > seemed to be widespread and "supported" the way that rsnapshot is. >=20 > They're less popular since many just DIY them, but honestly I think > the wrapper is a nicer solution. It will rotate backups, make sure > that snapshots aren't needed before deleting them, and so on. In > order to do an incremental backup the source/destination systems need > to have matching snapshots to base them on, so that is important if > backups are sporadic. If you're just saving all the send streams then > knowing which ones are obsolete is also important, unless you want to > have points in time. This article offers some comparison tests between ZFS, Btrfs and mdadm+dm- integrity. Although the setup and scenarios are not directly comparable wi= th=20 the OP's use case they provide some insight on more typical implementations= =20 where these fs excel. https://unixsheikh.com/articles/battle-testing-zfs-btrfs-and-mdadm-dm.html --nextPart6015957.lOV4Wx5bFT Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part. Content-Transfer-Encoding: 7Bit -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEXqhvaVh2ERicA8Ceseqq9sKVZxkFAmW+gZIACgkQseqq9sKV ZxkvIxAA5NyFjBVZ9k8/TvjcG6UI/GT+6GB5XOAbqDw0m6qxQl986WHmTrG05bI9 P+lnOB7MHmF4gYm8B4+WRXTzZxzHIVpCGfv2HnfFbOmuBzdi+WqzUDom4EnxQsPR P7cSnV0XPJ4tLCShdJpyNGz9qnG9d89p+U4QH3YWP0BdSBEEKPVHfDscyyMa/mTe P0PGGPFsqofwAwDHg1/cdJ8wXnGITNQ4WltsH4jlQWKSV4i3eeoGEbI7t7uOFhQU CQq3VmoeTWKOv/7jeiHPXnsaCEFXEo1hF/9/RmQ9B57qNepuQcPE7q3tftBuCByb x+/hTK/QcxKInWmnJJDtu9qaMMclIK/cBhpy0kqC4GyGFB9XyAj5nWr/jL8dr8/F ejpy0WHYvDfQ1gh7FrNQ5BisOfUIiNt9nfgyNJqy0BfLjIz8R1rvEeO/nPrneTd5 bMGsoDPiAdjgygq0maXQAWgQEkScPQ4/ZT7RAKfjajsdgOjVwN1wIhUtjs4tu2dJ SfiWFV0KsK1uj695c8lggANZ5nAp46uyeuCAK1L4zbTgdC4mNhUgag/tSbI8ay6L WFD9DW1eOWWa+7VXzqylGd4yW85A7Vyb5ThD5tegHiW9eOEx7FS55rvzMa6qSLUf q3aV5Qo5J7iFu28ZZB9g/8QWDHsS82neqR05+tlpZPYJZwM7CAk= =w7n5 -----END PGP SIGNATURE----- --nextPart6015957.lOV4Wx5bFT--