Gentoo Logo
Gentoo Spaceship




Note: Due to technical difficulties, the Archives are currently not up to date. GMANE provides an alternative service for most mailing lists.
c.f. bug 424647
List Archive: gentoo-dev
Navigation:
Lists: gentoo-dev: < Prev By Thread Next > < Prev By Date Next >
Headers:
To: "leon j. breedt" <ljb@...>
From: Stanislav Brabec <utx@g.o>
Subject: Re: speeding up emerge sync...and being nice to the mirrors
Date: Thu, 15 May 2003 18:26:46 +0200
On Thu, May 15, 2003 at 02:50:13PM +0100, leon j. breedt wrote:
> hi,
> 
> call me crazy, but wouldn't this be more efficient:
> 
...

Much more efficient and convenient seems to be incremental xdelta patches on 
tarred repository.

Delta set file size should be typically nearly less than "Total transferred
file size" via rsync.

Once you download "official tar.gz" (you have to have identical bit image; or
tar set - to be more patient to  machines with few memory) and later download
only incremetal deltas.

We could have, for example, hourly patches, six-hourly patches, daily patches,
weekly patches etc. - so anybody should be able to upgrade from any version to 
latest using, say, up to 10-15 incremental delta sets.


There is another way, how to serve portage tree much faster as is - use
reiserfs (in tail mode) or tmpfs for tree.


This is also good way to download sources over slow lines, if you have 
previous version.


For simple implementation see example "deltaserver" at:
http://www.penguin.cz/~utx/
(unusable for Gentoo, because it reconstructs byte-by-byte identical .tar, but 
not .tar.gz or .tar.bz2, but it can be solved.)

Typical delta size for standard version update is less than 1/10 of tarball.

-- Stanislav Brabec

--
gentoo-dev@g.o mailing list

Replies:
Re: speeding up emerge sync...and being nice to the mirrors
-- Björn Lindström
References:
speeding up emerge sync...and being nice to the mirrors
-- leon j. breedt
Navigation:
Lists: gentoo-dev: < Prev By Thread Next > < Prev By Date Next >
Previous by thread:
Re: speeding up emerge sync...and being nice to the mirrors
Next by thread:
Re: speeding up emerge sync...and being nice to the mirrors
Previous by date:
Re: speeding up emerge sync...and being nice to the mirrors
Next by date:
Re: Mozilla 1.3.1 ebuild


Updated Jun 17, 2009

Summary: Archive of the gentoo-dev mailing list.

Donate to support our development efforts.

Copyright 2001-2013 Gentoo Foundation, Inc. Questions, Comments? Contact us.