Gentoo Archives: gentoo-user

From: Daniel da Veiga <danieldaveiga@×××××.com>
To: gentoo-user@l.g.o
Subject: Re: [gentoo-user] Traffic volumes for distfiles mirror
Date: Mon, 29 Jan 2007 17:50:56
Message-Id: 342e1090701290945t49c4cd50mede280bf63322bae@mail.gmail.com
In Reply to: Re: [gentoo-user] Traffic volumes for distfiles mirror by Alan McKinnon
1 On 1/29/07, Alan McKinnon <alan@××××××××××××××××.za> wrote:
2 > On Monday 29 January 2007 11:15, Neil Bothwick wrote:
3 > > On Mon, 29 Jan 2007 00:47:47 -0800, kashani wrote:
4 > > > I wouldn't bother with a full mirror. Set a local rsync server that
5 > > > updates once a day and use http-replicator. That would be far less
6 > > > bandwidth than trying to keep a local dist server current.
7 > >
8 > > If daytime bandwidth is a particular issue, you can set up a cron
9 > > task on one of more machines (depending on the variety of packages in
10 > > use) to do
11 > >
12 > > emerge --sync && emerge -uDNf world
13 > >
14 > > to prime the cache during the night. That should reduce your daytime
15 > > downloads to almost zero.
16 >
17 > The daytime bandwidth is indeed the issue. This is South Africa, where
18 > technologically everything is top-notch first-world. Except for
19 > bandwidth. By local standards our pipe is quite big - a whopping 512k.
20 > Shared amongst two offices and 140 users. At least I get to do whatever
21 > I want with the bandwidth after hours - no real users to compete with,
22 > just their torrents :-)
23 >
24 > I already use a fairly complicate solution with emerge -pvf and wget in
25 > a cron on one of the fileservers, but it's getting cumbersome. And I'd
26 > rather not maintain an entire gentoo install on a server simply to act
27 > as a proxy. Would I be right in saying that I'd have to keep
28 > the "proxy" machine up to date to avoid the inevitable blockers that
29 > will happen in short order if I don't?
30 >
31 > I've been looking into kashani's suggestion of http-replicator, this
32 > might be a good interim solution till I can come up with something
33 > better suited to our needs.
34 >
35
36 I'm using a different setup, of course its a small number of machines
37 (like 5 or 6), but it works great. I use NFS to mount
38 /usr/portage/distfiles on a server sharing this dir. Each time someone
39 request a file, it goes directly to the shared dir, being available
40 for all machines. This way, its only 1 request per new file, and only
41 files that are needed for update of the particular software most
42 machines have in common.
43
44 --
45 Daniel da Veiga
46 Computer Operator - RS - Brazil
47 -----BEGIN GEEK CODE BLOCK-----
48 Version: 3.1
49 GCM/IT/P/O d-? s:- a? C++$ UBLA++ P+ L++ E--- W+++$ N o+ K- w O M- V-
50 PS PE Y PGP- t+ 5 X+++ R+* tv b+ DI+++ D+ G+ e h+ r+ y++
51 ------END GEEK CODE BLOCK------
52 --
53 gentoo-user@g.o mailing list

Replies

Subject Author
Re: [gentoo-user] Traffic volumes for distfiles mirror Mick <michaelkintzios@×××××.com>