Gentoo Archives: gentoo-user

From: Paul Hartman <paul.hartman+gentoo@×××××.com>
To: gentoo-user@l.g.o
Subject: Re: [gentoo-user] Use split to break up a 10GB file binary?
Date: Mon, 20 Jun 2011 17:04:04
Message-Id: BANLkTi=3Ai7xndu+sNVCxLPKD=z8qE5vJA@mail.gmail.com
In Reply to: [gentoo-user] Use split to break up a 10GB file binary? by Mark Knecht
1 On Mon, Jun 20, 2011 at 10:25 AM, Mark Knecht <markknecht@×××××.com> wrote:
2 > Hi,
3 >   Is split an appropriate program to use to break a single 10GB file
4 > into 100 100MB files to transfer over the net using rsync, and then
5 > use cat to reassemble?
6
7 I think it should work just fine. I've split huge files into huge
8 chunks and never had any issues.
9
10 >   Is there some better way to do this?
11
12 I wonder if splitting is even necessary; rsync will analyze the file
13 and only transmit the differences, right?. So I'd think that even if
14 the transfer fails, a retry would pick up where it left off (assuming
15 rsync keeps the failed copy).
16
17 Also check out net-misc/unison. It seems to be designed for just this
18 sort of thing.

Replies

Subject Author
Re: [gentoo-user] Use split to break up a 10GB file binary? Mark Knecht <markknecht@×××××.com>
Re: [gentoo-user] Use split to break up a 10GB file binary? Allan Gottlieb <gottlieb@×××.edu>
[gentoo-user] Re: Use split to break up a 10GB file binary? Francesco Talamona <francesco.talamona@××××.eu>