Re: [gentoo-user] Use split to break up a 10GB file binary?

[Mark Knecht <markknecht@gmail.com>]

On Mon, Jun 20, 2011 at 12:17 PM, Nils Larsson <ni1s@nerdshack.com> wrote:
> On Monday 20 June 2011 08:25:57 Mark Knecht wrote:
>> Hi,
>>    Is split an appropriate program to use to break a single 10GB file
>> into 100 100MB files to transfer over the net using rsync, and then
>> use cat to reassemble?
>>
>>    Is there some better way to do this?
>
> Maybe not better, but you could use a torrent application that support magnet
> links to send files across the net. No need to send chop it up in chunks then.

Interesting idea. I'll keep in in mind.

I've already tested that chopping the file with split and reassembling
it locally on another machine works. One advantage to chopping it up
is that because I have two ISPs in my house I can send half over each
ISP and speed things up considerably. The transfer to the remote
machine is now in progress and I've transferred about 20 of the 402
files I need to send so things are progressing splendidly at this
time.

I loaded unison on one of my local machines and will play with that.
Maybe I'll add some form of bittorrent into the mix also.

Cheers,
Mark