From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 1FC6415815E for ; Sat, 3 Feb 2024 17:32:38 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 3E7E1E2B40; Sat, 3 Feb 2024 17:32:33 +0000 (UTC) Received: from mail-lf1-f52.google.com (mail-lf1-f52.google.com [209.85.167.52]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id D8106E2B39 for ; Sat, 3 Feb 2024 17:32:32 +0000 (UTC) Received: by mail-lf1-f52.google.com with SMTP id 2adb3069b0e04-51109060d6aso4441146e87.2 for ; Sat, 03 Feb 2024 09:32:32 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1706981551; x=1707586351; h=content-transfer-encoding:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=6KIiCLx535abKLpMAPvhYMeDEETBPNfcGAfpqGmDk7w=; b=OZ5IYxnRExOTJ6YuIkxWT2V7ePOhLMthJXMrIXhk+UN1PVAY9O9yGjDq1jQsHmsbFu qdeVZPQnENDZe4sfDbowbuyuY0c9s9xol2h3lCDjvGChm2l2uVFXCky2CmtC5umYdgj1 HzT3gawNw4BOz5ZL9BRU3TVv60AjnOOnqHwmxWvzgkrvzI8EjmU9BxchVbGb/Jt58zLo N0ReGF7ejmVcaBGa7LqOxJ86+KcJy1Jssub+kxtMbNCKK4PkqLzW8OziLqExwzNUpJ0t mzJCTB0xq6pz7qbSsulfxuVy33Tj9WAYrvAWOwFigE2ZsrAxHWXn86CJQKFrIbSHj0BD 5jrg== X-Gm-Message-State: AOJu0YzJskvIWBt7sNXRCjuTNXZecaKSrKYGBfPg3wKy/haGfgTm6UoI lID48+9/8+uJEB9af3wyYQTCqrtJOFVrWNnJUGWC69K+FX5PQPwRefE+n4mlfyxzlxyjutCbTXo NdyfkBudDuofotjrklv6Djk2sW0gI0/hCXcA= X-Google-Smtp-Source: AGHT+IEt6/RpRNNOuM6NbjqTTBkPKVA9/HlH+Go+hAjf7R4AMx2eC/X6TVDkoeUtyt9/xUUALOV5w2eFoMtZd/zQ0Ek= X-Received: by 2002:a05:6512:6c6:b0:511:edf:f6e2 with SMTP id u6-20020a05651206c600b005110edff6e2mr7590102lff.53.1706981550502; Sat, 03 Feb 2024 09:32:30 -0800 (PST) Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 References: <8f5371a5-07af-456e-8517-cb9bb664fac4@youngman.org.uk> In-Reply-To: From: Rich Freeman Date: Sat, 3 Feb 2024 12:32:17 -0500 Message-ID: Subject: Re: [gentoo-user] Re: Suggestions for backup scheme? To: gentoo-user@lists.gentoo.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Archives-Salt: eff83bf1-224d-4291-9c0d-56a5fc0b613f X-Archives-Hash: 86287afc54188c4f81c2c40c81ed9786 On Fri, Feb 2, 2024 at 6:39=E2=80=AFPM Grant Edwards wrote: > > On 2024-01-31, Rich Freeman wrote: > > > In any case, these COW filesystems, much like git, store data in a > > way that makes it very efficient to diff two snapshots and back up > > only the data that has changed. [...] > > In order to take advantage of this, I assume that the backup > destination and source both have to be ZFS? So, the data needs to be RESTORED to ZFS for this to work. However, the zfs send command serializes the data and so you can just store it in files. Those files can only be read back into zfs. It is probably a bit more typical to just pipe the send command into zfs receive (often over ssh) so that you're just directly mirroring the filesystem, and not storing the intermediate data. > Do backup source and > destination need to be in the same filesystem? Or volume? Or Pool? No on all of these, but they can be. > If you'll forgive the analogy, we'll say the the functionality of > rsync (as used by rsnapshot) is built-in to ZFS. Is there an > application that does with ZFS snapshots what the rsnapshot > application itself does with rsync? There are a few wrappers around zfs send. I'm using sys-fs/zfs-auto-snapshot and what looks like a much older version of: https://github.com/psy0rz/zfs_autobackup > > I googled for ZFS backup applications, but didn't find anything that > seemed to be widespread and "supported" the way that rsnapshot is. They're less popular since many just DIY them, but honestly I think the wrapper is a nicer solution. It will rotate backups, make sure that snapshots aren't needed before deleting them, and so on. In order to do an incremental backup the source/destination systems need to have matching snapshots to base them on, so that is important if backups are sporadic. If you're just saving all the send streams then knowing which ones are obsolete is also important, unless you want to have points in time. --=20 Rich