From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from pigeon.gentoo.org ([208.92.234.80] helo=lists.gentoo.org) by finch.gentoo.org with esmtp (Exim 4.60) (envelope-from ) id 1Lg0ab-0008Uu-GP for garchives@archives.gentoo.org; Sat, 07 Mar 2009 17:45:33 +0000 Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id D156AE03D8; Sat, 7 Mar 2009 17:45:31 +0000 (UTC) Received: from mail.fraggod.net (unknown [91.191.238.58]) by pigeon.gentoo.org (Postfix) with ESMTP id 95B8BE03D8 for ; Sat, 7 Mar 2009 17:45:31 +0000 (UTC) Received: from coercion (coercion.core [IPv6:2001:470:1f0b:11de::13]) (using TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by mail.fraggod.net (Postfix) with ESMTPSA id 571BB101FDC for ; Sat, 7 Mar 2009 22:45:30 +0500 (YEKT) Date: Sat, 7 Mar 2009 22:42:13 +0500 From: Mike Kazantsev To: gentoo-user@lists.gentoo.org Subject: Re: [gentoo-user] rsync + tar + bz2 ? Message-ID: <20090307224214.342848ba@coercion> In-Reply-To: <49bf44f10903070804h585ffd1agdd88f75bb4c9310@mail.gmail.com> References: <49bf44f10903070804h585ffd1agdd88f75bb4c9310@mail.gmail.com> X-Mailer: Claws Mail 3.7.1 (GTK+ 2.14.7; i686-pc-linux-gnu) Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org Mime-Version: 1.0 Content-Type: multipart/signed; boundary="Sig_/rMK97+fx.wlEmN3JdQJ_Kvh"; protocol="application/pgp-signature"; micalg=PGP-SHA1 X-Archives-Salt: c7f87563-41fe-4b3a-b8c9-c8177eede5f5 X-Archives-Hash: 399f278acaacd9ccd893d89306fc9a22 --Sig_/rMK97+fx.wlEmN3JdQJ_Kvh Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable On Sat, 7 Mar 2009 08:04:17 -0800 Grant wrote: > I'm backing up numerous large files on another machine on my local > network. I've only been using rsync, but it occured to me that I > might be able to save some time and space if I incorporate tar and > bzip2. How will rsync interact with those? If I turn the whole > backup into a big tar.bz2, would rsync need to redownload the whole > thing if I change one file? If so, maybe I should turn different > groups of files into tar.bz2 archives so rsync only needs to > redownload an archive if one of its files has changed? It's not a default behavior, but there is an '--inplace' option. Also,there is a '--compress' option, if the bandwith is the only problem, otherwise you can use lzma (with normal-best ratio) to either acheive much better compression than bzip2 or still slightly better ratio with improved speed / less cpu time with 'lzma -1' (fast mode). And if you're going to put a lot of files (like whole fs) into a single tar just to transfer it to some remote destination, prehaps you shouldn't be using rsync at all, since you'll end up reading all the files anyway to create the tar. Alternatively, you can save disk space on the source machine by piping tar directly to destination, with compression either on the source to lessen the banwidth, or on the remote to lessen the load on the source machine cpu. That said, you can also use tar to create (or pipe) incremental backups - just the changes since the time last one was made. Tar can handle that as easily as rsync does, since it checks what needs to be transferred each time anyway. --=20 Mike Kazantsev // fraggod.net --Sig_/rMK97+fx.wlEmN3JdQJ_Kvh Content-Type: application/pgp-signature; name=signature.asc Content-Disposition: attachment; filename=signature.asc -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.10 (GNU/Linux) iEYEARECAAYFAkmysfoACgkQASbOZpzyXnHtAQCbBNDlVyzlPVkKLAH+3Muu6+uY misAnjiDpKZ1ttECL4hWmSzo55IZWqbs =hame -----END PGP SIGNATURE----- --Sig_/rMK97+fx.wlEmN3JdQJ_Kvh--