From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from pigeon.gentoo.org ([208.92.234.80] helo=lists.gentoo.org) by finch.gentoo.org with esmtp (Exim 4.60) (envelope-from ) id 1QYjlq-0000sv-J8 for garchives@archives.gentoo.org; Mon, 20 Jun 2011 19:04:26 +0000 Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 253661C11E for ; Mon, 20 Jun 2011 19:04:26 +0000 (UTC) Received: from mail-qy0-f174.google.com (mail-qy0-f174.google.com [209.85.216.174]) by pigeon.gentoo.org (Postfix) with ESMTP id B55BFE05B1 for ; Mon, 20 Jun 2011 18:20:03 +0000 (UTC) Received: by qyk29 with SMTP id 29so1655046qyk.19 for ; Mon, 20 Jun 2011 11:20:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type:content-transfer-encoding; bh=d7nPx5AW+MTuSZEIrecLe41l05FKO4rqlPMYE+OmDcw=; b=sgeu+i61/32EB61qQXbSDM9tp5U+Hwv4rjBds2eiIjbb3zXIcJ0orDjUzlEFdBnB1I rvQpm6oyh4nBie3/+lNzutjOppzSufIC8sqk5F+snUEJvuyFWtHy1m1dU1PK8zUlIs9i BMNlCkUjfTf7uzQrrpkYToFRhJGXW3bUGFsd0= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=VwwE+ginLLunIjlQLen962bnRPRA7fHHCwncge4qijkYLap0EdWOcX6U9cxG27NFvy Vf2ac/lK5s7Hb3HOjP4FEI1DoRh1KiK5pR5+Q6JYtCrDRWhJa7dJpesyA6uJSlsLkh3P 9ZMAp3Okt3JZL/I8YcrHR4yi9wum+YHn3Rw/w= Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-user@lists.gentoo.org Reply-to: gentoo-user@lists.gentoo.org MIME-Version: 1.0 Received: by 10.224.218.72 with SMTP id hp8mr4551643qab.78.1308594003123; Mon, 20 Jun 2011 11:20:03 -0700 (PDT) Received: by 10.224.61.14 with HTTP; Mon, 20 Jun 2011 11:20:03 -0700 (PDT) In-Reply-To: References: Date: Mon, 20 Jun 2011 11:20:03 -0700 Message-ID: Subject: Re: [gentoo-user] Use split to break up a 10GB file binary? From: Mark Knecht To: gentoo-user@lists.gentoo.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Archives-Salt: X-Archives-Hash: c59f8da1b1ae3768774d6fa55655d6a6 On Mon, Jun 20, 2011 at 10:48 AM, Allan Gottlieb wrote: > On Mon, Jun 20 2011, Paul Hartman wrote: > >> On Mon, Jun 20, 2011 at 10:25 AM, Mark Knecht wro= te: >>> Hi, >>> =C2=A0 Is split an appropriate program to use to break a single 10GB fi= le >>> into 100 100MB files to transfer over the net using rsync, and then >>> use cat to reassemble? >> >> I think it should work just fine. I've split huge files into huge >> chunks and never had any issues. >> >>> =C2=A0 Is there some better way to do this? >> >> I wonder if splitting is even necessary; rsync will analyze the file >> and only transmit the differences, right?. So I'd think that even if >> the transfer fails, a retry would pick up where it left off (assuming >> rsync keeps the failed copy). > > I believe that is the --partial option. > > allan Yes, that looks like what I want. Is there an option to have rsync keep trying if the other end goes down for a while or would I need to put the rsync command into a cron job so that it restarts every hour until it's completed the transfers? I don't see one scanning through the many, many options to rsync. Thanks, Mark