Gentoo Archives: gentoo-soc

From: "Łukasz Zubkowicz" <lukasek@××××××××××××××××××.pl>
To: gentoo-soc@l.g.o
Subject: [gentoo-soc] Sort of "ondemand" mirror for distfiles
Date: Sun, 28 Mar 2010 12:20:12
Message-Id: 4BAF3B54.50308@students.mimuw.edu.pl
1 -----BEGIN PGP SIGNED MESSAGE-----
2 Hash: SHA1
3
4 Hi all,
5
6 I'm a CS student from Poland interested in taking part in GSoC 2010.
7 I've been using Gentoo for about 5 years. I've expanded my home network
8 recently and found some difficulties with keeping things tidy on 5
9 different boxes with Gentoo. And that's where my idea for this year's
10 GSoC has come from.
11 Most of packages I install are common to all of my machines and
12 therefore I would be happy to download them only once. It would save
13 bandwidth and time for me and others. Trying to solve this issue with
14 some ready software I've found two or three solutions, but none of them
15 satisfying. Starting with the simplest solution, I could just emerge
16 package on one machine and then copy sources to the others, but it's at
17 least a little bit stupid. Being smarter, I could export
18 /usr/portage/distfiles to other machines through NFS, but as far as I
19 know something about NFS it could raise some synchronization errors if
20 tried to merge the same packages on more than one machine
21 simultaneously. Finally, the designated solution: I could just install a
22 mirror on one of my local machines and use in within my network (just
23 like I've done it with rsyncing portage tree), but... isn't it to
24 expensive? It would be fine if I had a big network with plenty of
25 storage, but (keeping in mind my small home network) spending about
26 200GB (that number I've found somewhere) on accumulating all packages
27 doesn't seem to me a good idea. It's quite substantial amount of disk
28 space for me.
29 I feel like there was lack of solution for people like me and I bet
30 there are more such users who have about 5 to 15 machines under their
31 control. My idea is to develop kind of mirror which would act just like
32 the real "big" mirror, but not keep all of packages. Instead of that it
33 would download a package when it's needed for the first time and make
34 somehow wait machine which is asking for it (and others which will ask
35 for it in time before it's fully downloaded). Of course it's only a
36 draft, but I just wanted you to feel my idea.
37 I wait for your comments and responses. I realize that I may be terribly
38 wrong and there is already such thing which I need, but I have spent
39 some time on seeking and haven't found it. In such case I'm sorry for
40 wasting your time and... please let me know about it :) .
41
42 - --
43 Best wishes, Lukasz Zubkowicz
44 http://students.mimuw.edu.pl/~lz248258
45
46 -----BEGIN PGP SIGNATURE-----
47 Version: GnuPG v2.0.9 (GNU/Linux)
48 Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
49
50 iEYEARECAAYFAkuvO1QACgkQ+6A5fji6urEOAgCgigzFa+WY+nz86lA0ErZPpxlj
51 ZH4AoO9UctF51PAOpLVOzjAibbUYiCSE
52 =wj/o
53 -----END PGP SIGNATURE-----

Replies

Subject Author
Re: [gentoo-soc] Sort of "ondemand" mirror for distfiles Auke Booij <auke@××××××.com>
Re: [gentoo-soc] Sort of "ondemand" mirror for distfiles "Petteri Räty" <betelgeuse@g.o>