Re: [gentoo-user] Use split to break up a 10GB file binary?

[Mark Knecht <markknecht@gmail.com>]

On Mon, Jun 20, 2011 at 2:46 PM, Indi <thebeelzebubtrigger@gmail.com> wrote:
> On Mon, Jun 20, 2011 at 08:25:57AM -0700, Mark Knecht wrote:
>> Hi,
>>    Is split an appropriate program to use to break a single 10GB file
>> into 100 100MB files to transfer over the net using rsync, and then
>> use cat to reassemble?
>>
>>    Is there some better way to do this?
>>
>
> Just using rsync by itself would probably be a great deal faster,
> unless you have some undisclosed reason for wanting to split it up.

Hi,
   Nothing technical that's undisclosed. My original reason was not
knowing what rsync did in the case of errors I simply didn't want to
start over on such a big file. I figured there was little to lose by
stitching it back together are the other end and I could always figure
out exactly what file had failed.

   That said I don't think there's much difference in the speed. In my
case (and I think others will have a similar case) my uploads speeds
are far lower than download. I get about 8MB/S download but only about
250KB/S upload. It's that low speed that's dominating everything else.
When I first tried transferring the big file the intermediate speeds
rsync was reporting were very similar.

Cheers,
Mark