From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from pigeon.gentoo.org ([208.92.234.80] helo=lists.gentoo.org) by finch.gentoo.org with esmtp (Exim 4.60) (envelope-from ) id 1Lg1Ku-0005TU-QG for garchives@archives.gentoo.org; Sat, 07 Mar 2009 18:33:25 +0000 Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id AD3ABE01BA; Sat, 7 Mar 2009 18:33:07 +0000 (UTC) Received: from rv-out-0708.google.com (rv-out-0708.google.com [209.85.198.243]) by pigeon.gentoo.org (Postfix) with ESMTP id 794B8E01BA for ; Sat, 7 Mar 2009 18:33:07 +0000 (UTC) Received: by rv-out-0708.google.com with SMTP id f25so1025952rvb.46 for ; Sat, 07 Mar 2009 10:33:07 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=tqGZuUshK/4EbFPB8PEn8r570wOFSUrMZBGe1oXupMA=; b=epth47O4QGCMuLjIiL9hdW9KaKFzQyIn/IO/DNb1HTaw2tQlLQXXw2xctlA4gmtKUR T9mPrVOQxwyP6SqX+UPhgVByg5SZttFwXs1m6Q8gZn8YmpqwSj++loMqmM/f86yktUOT uWMWH7V52AWCfNrnaZhkUF3ellqRI5n2pM7Ns= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=rsObyItLcU6A+5bXGGXq5VUoQU387qrrybOBNqSBHbDpBEe+fdf/lQ8JdmJcfOLufl moq1WkttYvh1IYpmVwADOLeYMy236j/1Ql4Td0XCkGOUWs0cFoWUHuRv/+w9jFYJG7+6 y+Y5VVjoPW1+qTpOfO/gNfA2ZnsRu7pFvYFuk= Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org MIME-Version: 1.0 Received: by 10.114.153.18 with SMTP id a18mr2354759wae.200.1236450786879; Sat, 07 Mar 2009 10:33:06 -0800 (PST) In-Reply-To: <20090307224214.342848ba@coercion> References: <49bf44f10903070804h585ffd1agdd88f75bb4c9310@mail.gmail.com> <20090307224214.342848ba@coercion> Date: Sat, 7 Mar 2009 10:33:06 -0800 Message-ID: <49bf44f10903071033n354231berf0740fc52570263b@mail.gmail.com> Subject: Re: [gentoo-user] rsync + tar + bz2 ? From: Grant To: gentoo-user@lists.gentoo.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Archives-Salt: c5ca17a7-729e-498d-bbc2-21954da63f88 X-Archives-Hash: 32757949cfeb182d680f37acaea35518 >> I'm backing up numerous large files on another machine on my local >> network. =A0I've only been using rsync, but it occured to me that I >> might be able to save some time and space if I incorporate tar and >> bzip2. =A0How will rsync interact with those? =A0If I turn the whole >> backup into a big tar.bz2, would rsync need to redownload the whole >> thing if I change one file? =A0If so, maybe I should turn different >> groups of files into tar.bz2 archives so rsync only needs to >> redownload an archive if one of its files has changed? > > It's not a default behavior, but there is an '--inplace' option. > > Also,there is a '--compress' option, if the bandwith is the only > problem, otherwise you can use lzma (with normal-best ratio) to either > acheive much better compression than bzip2 or still slightly better > ratio with improved speed / less cpu time with 'lzma -1' (fast mode). > > And if you're going to put a lot of files (like whole fs) into a > single tar just to transfer it to some remote destination, prehaps you > shouldn't be using rsync at all, since you'll end up reading all the > files anyway to create the tar. > Alternatively, you can save disk space on the source machine by piping > tar directly to destination, with compression either on the source to > lessen the banwidth, or on the remote to lessen the load on the source > machine cpu. > > That said, you can also use tar to create (or pipe) incremental backups > - just the changes since the time last one was made. Tar can handle that > as easily as rsync does, since it checks what needs to be transferred > each time anyway. > > -- > Mike Kazantsev // fraggod.net Good stuff, thanks a lot Mike. - Grant