From mboxrd@z Thu Jan 1 00:00:00 1970
Return-Path: <gentoo-user+bounces-197101-garchives=archives.gentoo.org@lists.gentoo.org>
Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80])
(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
(No client certificate requested)
by finch.gentoo.org (Postfix) with ESMTPS id DA69B158017
for <garchives@archives.gentoo.org>; Wed, 29 Sep 2021 20:04:51 +0000 (UTC)
Received: from pigeon.gentoo.org (localhost [127.0.0.1])
by pigeon.gentoo.org (Postfix) with SMTP id 2D069E0894;
Wed, 29 Sep 2021 20:04:45 +0000 (UTC)
Received: from mail-oo1-xc2b.google.com (mail-oo1-xc2b.google.com [IPv6:2607:f8b0:4864:20::c2b])
(using TLSv1.2 with cipher ECDHE-RSA-CHACHA20-POLY1305 (256/256 bits))
(No client certificate requested)
by pigeon.gentoo.org (Postfix) with ESMTPS id AB48DE0867
for <gentoo-user@lists.gentoo.org>; Wed, 29 Sep 2021 20:04:44 +0000 (UTC)
Received: by mail-oo1-xc2b.google.com with SMTP id k11-20020a4abd8b000000b002b5c622a4ddso1131491oop.1
for <gentoo-user@lists.gentoo.org>; Wed, 29 Sep 2021 13:04:44 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=20210112;
h=subject:to:references:from:openpgp:autocrypt:message-id:date
:user-agent:mime-version:in-reply-to:content-transfer-encoding;
bh=yOJcm06kMNNuR/n1nPrWp8g2nEX83OE4+B9dWs+ugIk=;
b=as8tE5sz2vuhjCnZU/8tdYN/ikhehoo0Z761/XyzYfKkU+8xnquCdbCaSwNZserUtr
YUDGfHMCFILxsWeFBx7Iufhfn4jbsTSZW/epTvuSxaRGfYoufMFRg+ED1rLbqysCAUqF
R/ea/J5Y6pqR6zv3BA3XpJED5qrbLj2Ko+VmcYztknROD0MxNN0TOQrxkBzKX3U0gN8p
Tntci9IvvRwPWeuuBPyIXx/vOEX8AdQY1+SktdumWvm6TcOIjl7RCv5XVN/NI7+AhxWu
7fL7lMLqyfDW1jFXvyTEatS7B65wOyfnWXnCzOQio+DVjPfwb1/vW9tqD0NVN18jVTg5
IU4Q==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20210112;
h=x-gm-message-state:subject:to:references:from:openpgp:autocrypt
:message-id:date:user-agent:mime-version:in-reply-to
:content-transfer-encoding;
bh=yOJcm06kMNNuR/n1nPrWp8g2nEX83OE4+B9dWs+ugIk=;
b=qbs/3I7j79i85ZrzBPTGS0EWNDhmTVuY1W8LlEcpTW2K0VHrlfs13CuvZRtu1bzuCX
NsQIv/NzeMHyCyiaGtuRPj26gAPROu7ASJvplN5YV1fhb+1biTjp4WIBbUeSolE6hM2+
AlWoSYdNo98ZT97cAjLBnBsxd2QV6iIp5/86Hb7f3bNR+6yfyRdmiLb5Ss8oIvfYuIPS
jjiUStPuOsdfrtPp7Qpfj+SGo1ABAmdrLQZ9S/ODviNNJmTIyO1D77tQ9rLBC3kGvV+8
naMQ/XoeayTGUqM7ZZm15+bsD3ES2Md4J07N04p3J4VB09iIgfzQ+nP964Gr9MA7I6Cu
akXw==
X-Gm-Message-State: AOAM531MQ3nIlIDLcEWdBoGQzXP1+X9oRc9BFHYbfRVmh7E9qnMW7Qjc
rtagemAWDJ8HVu0oL5qFMng=
X-Google-Smtp-Source: ABdhPJzndfccfc1bo4CJuI+uIw65ggF2FH464DuoLhz5zcxts7GPwoXrNztV3K69ynglQO8CO1XfCQ==
X-Received: by 2002:a4a:a849:: with SMTP id p9mr1498349oom.38.1632945883947;
Wed, 29 Sep 2021 13:04:43 -0700 (PDT)
Received: from [192.168.0.100] (adsl-074-188-241-053.sip.asm.bellsouth.net. [74.188.241.53])
by smtp.gmail.com with ESMTPSA id n2sm168138oog.0.2021.09.29.13.04.42
(version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128);
Wed, 29 Sep 2021 13:04:43 -0700 (PDT)
Subject: Re: [gentoo-user] How to compress lots of tarballs
To: gentoo-user@lists.gentoo.org
References: <5513654.DvuYhMxLoT@wstn> <3138453.44csPzL39Z@wstn>
<MW2PR07MB4058563304B1A1A240350CF2D2A89@MW2PR07MB4058.namprd07.prod.outlook.com>
<4687348.31r3eYUQgx@wstn>
<CAGfcS_=+igNZDBuR9DyT-+dkSu9DYEt2sw_70YbbyycXFrXR4g@mail.gmail.com>
From: Dale <rdalek1967@gmail.com>
Openpgp: preference=signencrypt
Autocrypt: addr=rdalek1967@gmail.com; prefer-encrypt=mutual; keydata=
mQINBGFSciYBEADcEGMyJBSuavKO/XKUVvgkxck7Nl8Iuu8N2lcnRji/rSKg5c1Acix1ll9i
oW8JBCHwvn0+Xy60BvEsqcup3YSHw5STl/bR1ePEehtnYrg8FdjdS91+B805RfnKMm69rFVI
wLSBHQrSG1yxHd8CloWoEdhmVtP24buajbh114bgXd9ahtpZrCVMrWdWYUg2mEXguGV5uNAh
Rf8SWxDNc79w24JxsV34a8niMUYMjzWr0rafIbzk732X38vGjVMLo/2mMpkbp9mPp++LHoY+
0Pet8zxxdXPJSCd475kza1AD+hhSyBZXB9yknYWgyY3cZe1rGmooJSi2KX4QxO7npwLThcO1
be6KKRkd35+Fi/a1BzVOHsZMiK/gcwxEFoMd27gir4ehaeHJfFXl+65w4hj0EsOZSxrJrm2C
R50g5By2czSKP1bADEygFNpIJj51AR+wM88NImG2RPtlT2maYBzazvF05g65cdHXGp1C7W5P
wwwKU2DgABB2t7N7z5A69LnryBRw4zUYDRRYLTYlBlYgg+xILm2c0OrBdxJgLJa7JE50Eo25
d3PFwt9J0gYvqy6sPFLl9So0sDg9zm0hKQtXOP5kgropUFGrNoJI+mjwF4rYLRBVzZwNAvlO
OhEvHubBo3mEllv4x+FeptwXZxlk7gUsdqI8AxnFB8K9wi6FVQARAQABtBtEYWxlIDxyZGFs
ZWsxOTY3QGdtYWlsLmNvbT6JAk4EEwEIADgCGyMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AW
IQQSG1h01ruv/WNXc3Q3RqOgiQH1GwUCYVJy8gAKCRA3RqOgiQH1G+waEACeTZCt77jnRAmQ
AV7otKuZekDWiLi3Eig8tj5ZJiCNSYA/hIxzmexRP0GMqjitcXK1iGwWcvMzzvIq30GAjIfB
4BR38cnXbtBa6fNewiT7QaZe/Hn6yBRldXNQypzbHy+/o27bUEy+oX4rE7etUgEHQAjuw7xz
XFWg4tH1/KJvsOVY5upnWc5LdxYhsuQ3dQD4b22GsK0pOBDfb9PiirYM8eGKvrVuq4E/c75z
lDDFhINl18lNZ9D0ZFL3IkTjHsAAqFH9uhnnEB8CWdHbBewPEfRaOhBUYWZ3Q8uTkmDgZT8q
D9jlvLEdw7Nh2ApdxoepnI/4D+ql2Gr4DtH7SEPydr5gcf1Qr/2bXRb1hAYnIVcbncs/Bm3Z
bkRKPVWMfE3Fusa+p5hMzixk0YysMaTHlc7mYRYAEZGnPMXnmcCbetwARU7A0yz1M1kCMOAQ
Lsz8KH5kv3cRenMB6SFfjND2JfAK61H5TtnPq3L8noS2ZykRYxq9Nm3X64O1tJojIKBoZFr8
AwYNCvqC6puUyGMuzHPh7jPof8glfrrEKIYUvNPGMDoVX3IGetxh/9l6NcxgFA4JGoR+LS3C
zmeNrwlllAe3OEUfKoWVQ+pagpSdM+8hHolaSda4Ys66Z3fCR4ZvcTqfhTAVskpqdXa4isAk
7vTcXu3L499ttywEp7rJTbkCDQRhUnImARAAncUdVhmtRr59zqpTUppKroQYlzR0jv8oa7DG
K4gakTAT2N7evnI9wpssmzyVk8VEiLzhnFQ/Ol3FRt6hZCXDJt0clyHOyTfvz/MNFttWuZTc
mLpSvmRR6VRjAH+Tz3Eam2xUw3PGuH97BcXQ3NnX3msv1UDxtxxBu6e2YrdeOhrCUSgzokcJ
98ChUNy934cgepPybAI12lSWqVFQ1aG7jExZfiUk+333fPSDbpKoZbTW5YJLXbycmW/C1IWL
qYQyNjRWKaGoJtUWFhhmNiOQct7n90aKivNVPavmN+UQ9LlMaINtf9T6XCzLfogCFsulDCDJ
0yNQLDTurHaB4E71xoctgXmLLq9z1RQ0W2XiVAAOZQj6K3+d0AOUjDhCQ2QW8dUSq0ckkZXV
DKVJOGS8Nhf2eIWIqRnP3AcUiiaiFGqUaVUmUAZ6h/oJmgghEu/1S+pcuUKU5i69+XCZ3hH2
Jzwzbf7K+FAIkOhCfHncF8i1N1pk00pOVykNnqHTfFo3qFusHt0ZWgXVnnn4pYdXqZNoDhvF
BRE5Vm4k/k96Pw8HRx6Os6eFSRrlqGzRgqsu86FekxusXB9UGv4lJhtU/J+8MRWsh22K718s
DbQnABicGKFz1qQlWvcf59oTByhLINJCBt1WXl+TzJDXepr3QSkqmK41dO9Hob97C9dMiK8A
EQEAAYkCNgQYAQgAIAIbDBYhBBIbWHTWu6/9Y1dzdDdGo6CJAfUbBQJhUnLyAAoJEDdGo6CJ
AfUbVHIQAKSWw620vPhR3A/njU2z77F3z/Jk+HTKdE3fIyWSWdkYN7CBFL0NguOMP30WZ+qE
sJhZu7T5hf251MwQUUt27xlfnKYOmQs7CqONlXuXlGZI6WufrUjxNcVz+5gJsqvUWuuJWsgg
sDmE92IBnfG/f81fPHWQyfr/SF4wYDMyoFp5xCCQpp1zB63iuFvvrhxBkEHzmbRtVDOhl0Xp
BVEDR1w3QRACw9QJD/KM05Czv9JNQYlwinWO/OaQ9cMlUpKLgswUPg9IZ5vucxScfuAUA5uC
B1jlAQ8ZPlVukBmbEv5RGOv+lpuEbA3YDMVtEeH4YMFbjt/+vH3Cr2vTbp5JlpByLburJEH0
WXZLUawEfUsZvVwpOuJK75vaa2HYXee+Cb3iCIzwfIfctdlqzUcbGRczlRNM59hpvj4z29Gh
3kAxVHItAYq54ikxQ9l4hQ8s9sLYPbX/WtcBxNX8crBSw0FLnmzGleVEtBHyqtt5CLzQNgrj
GYWl1vKDUmRPw1CdZ1c+fMN9CY11jOM5B5ZnqZWfDeVYO2iJ5SuvTycChexCb8WYn1bdCBIo
bBtga2RBXbVt4Mh9E4owsszefn51MwfjXxB20Fc5k3GU1AVpTCMs3ayYCzo0b2pvEvdjtDcA
CYLEFPWgaFX9iQAM/CDfKvTtvgGWpqtCL2raq/mQoJEU
Message-ID: <a3d946b7-7e3d-4183-d82f-43f57561938f@gmail.com>
Date: Wed, 29 Sep 2021 15:04:41 -0500
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101
Firefox/60.0 SeaMonkey/2.53.9
Precedence: bulk
List-Post: <mailto:gentoo-user@lists.gentoo.org>
List-Help: <mailto:gentoo-user+help@lists.gentoo.org>
List-Unsubscribe: <mailto:gentoo-user+unsubscribe@lists.gentoo.org>
List-Subscribe: <mailto:gentoo-user+subscribe@lists.gentoo.org>
List-Id: Gentoo Linux mail <gentoo-user.gentoo.org>
X-BeenThere: gentoo-user@lists.gentoo.org
Reply-to: gentoo-user@lists.gentoo.org
X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply
MIME-Version: 1.0
In-Reply-To: <CAGfcS_=+igNZDBuR9DyT-+dkSu9DYEt2sw_70YbbyycXFrXR4g@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
X-Archives-Salt: 3034bd70-7fa2-4500-a182-2343418ffc5e
X-Archives-Hash: 5ebef2c6f7a199d193e4df7ac5f1a91e
Rich Freeman wrote:
> On Wed, Sep 29, 2021 at 4:27 AM Peter Humphrey <peter@prh.myzen.co.uk> wrote:
>> Thanks Laurence. I've looked at borg before, wondering whether I needed a
>> more sophisticated tool than just tar, but it looked like too much work for
>> little gain. I didn't know about duplicity, but I'm used to my weekly routine
>> and it seems reliable, so I'll stick with it pro tem. I've been keeping a
>> daily KMail archive since the bad old days, and five weekly backups of the
>> whole system, together with 12 monthly backups and, recently an annual
>> backup. That last may be overkill, I dare say.
> I think Restic might be gaining some ground on duplicity. I use
> duplicity and it is fine, so I haven't had much need to look at
> anything else. Big advantages of duplicity over tar are:
>
> 1. It will do all the compression/encryption/etc stuff for you - all
> controlled via options.
> 2. It uses librsync, which means if one byte in the middle of a 10GB
> file changes, you end up with a few bytes in your archive and not 10GB
> (pre-compression).
> 3. It has a ton of cloud/remote backends, so it is real easy to store
> the data on AWS/Google/whatever. When operating this way it can keep
> local copies of the metadata, and if for some reason those are lost it
> can just pull that only down from the cloud to resync without a huge
> bill.
> 4. It can do all the backup rotation logic (fulls, incrementals,
> retention, etc).
> 5. It can prefix files so that on something like AWS you can have the
> big data archive files go to glacier (cheap to store, expensive to
> restore), and the small metadata stays in a data class that is cheap
> to access.
> 6. By default local metadata is kept unencrypted, and anything on the
> cloud is encrypted. This means that you can just keep a public key in
> your keyring for completely unattended backups, without fear of access
> to the private key. Obviously if you need to restore your metadata
> from the cloud you'll need the private key for that.
>
> If you like the more tar-like process another tool you might want to
> look at is dar. It basically is a near-drop-in replacement for tar
> but it stores indexes at the end of every file, which means that you
> can view archive contents/etc or restore individual files without
> scanning the whole archive. tar was really designed for tape where
> random access is not possible.
>
Curious question here. As you may recall, I backup to a external hard
drive. Would it make sense to use that software for a external hard
drive? Right now, I'm just doing file updates with rsync and the drive
is encrypted. Thing is, I'm going to have to split into three drives
soon. So, compressing may help. Since it is video files, it may not
help much but I'm not sure about that. Just curious.
Dale
:-) :-)