Gentoo Archives: gentoo-dev

From: Stanislav Brabec <utx@g.o>
To: "leon j. breedt" <ljb@×××××××××.org>
Cc: gentoo-dev@g.o
Subject: Re: [gentoo-dev] speeding up emerge sync...and being nice to the mirrors
Date: Thu, 15 May 2003 16:26:48
Message-Id: 20030515162646.GA1299@penguin.cz
In Reply to: [gentoo-dev] speeding up emerge sync...and being nice to the mirrors by "leon j. breedt"
On Thu, May 15, 2003 at 02:50:13PM +0100, leon j. breedt wrote:
> hi, > > call me crazy, but wouldn't this be more efficient: >
... Much more efficient and convenient seems to be incremental xdelta patches on tarred repository. Delta set file size should be typically nearly less than "Total transferred file size" via rsync. Once you download "official tar.gz" (you have to have identical bit image; or tar set - to be more patient to machines with few memory) and later download only incremetal deltas. We could have, for example, hourly patches, six-hourly patches, daily patches, weekly patches etc. - so anybody should be able to upgrade from any version to latest using, say, up to 10-15 incremental delta sets. There is another way, how to serve portage tree much faster as is - use reiserfs (in tail mode) or tmpfs for tree. This is also good way to download sources over slow lines, if you have previous version. For simple implementation see example "deltaserver" at: http://www.penguin.cz/~utx/ (unusable for Gentoo, because it reconstructs byte-by-byte identical .tar, but not .tar.gz or .tar.bz2, but it can be solved.) Typical delta size for standard version update is less than 1/10 of tarball. -- Stanislav Brabec -- gentoo-dev@g.o mailing list

Replies

Subject Author
Re: [gentoo-dev] speeding up emerge sync...and being nice to the mirrors bkhl@privat.utfors.se (=?iso-8859-1?q?Bj=F6rn_Lindstr=F6m?=)