Gentoo Archives: gentoo-dev

From: Kalin KOZHUHAROV <kalin@××××××××.net>
To: gentoo-dev@l.g.o
Subject: Re: [gentoo-dev] Parallizing ebuilds - 'trivial' ebuilds
Date: Fri, 13 Jan 2006 10:58:06
Message-Id: 43C786AF.3060702@thinrope.net
In Reply to: Re: [gentoo-dev] Parallizing ebuilds - 'trivial' ebuilds by Philippe Trottier
1 Philippe Trottier wrote:
2 > Lisa Seelye wrote:
3 >
4 >> On Thu, 2006-01-12 at 00:18 +0000, Ferris McCormick wrote:
5 >>
6 >>> -----BEGIN PGP SIGNED MESSAGE-----
7 >>> Hash: SHA1
8 >>>
9 >>> On Wed, 11 Jan 2006, Lisa Seelye wrote:
10 >>>
11 >>>
12 >>>> On Wed, 2006-01-11 at 14:51 -0800, Robin H. Johnson wrote:
13 >>>>
14 >>>>> I've been cleaning up media-fonts/ to work with modular-X, and I see a
15 >>>>> lot of ebuilds with stuff like this:
16 >>>>> for font in *.bdf; do
17 >>>>> /usr/X11R6/bin/bdftopcf ${font} > `basename $font .bdf`.pcf
18 >>>>> done
19 >>>>> gzip *.pcf
20 >>>>>
21 >>>>> For having 100 files in *bdf, this is so serial it's painful.
22 >>>>
23 >>>>
24 >>>> And here I was hoping Distcc would get some usage. :(
25 >>>>
26 >>>
27 >>> Distcc gets lots of usage with modular X. But for the fonts? :)
28 >>
29 >>
30 >> Time for distfont? ;)
31 >
32 >
33 > Make this distributed tool for tar zip bzip2 and gzip and I'm in, I
34 > don't think it would be useful with anything else than Gigabit Ethernet.
35 >
36 > We might want to have in the make.conf 2 separate variables, one of them
37 > saying how many threads can be run on the machine, then How many
38 > threads/process across a cluster.
39 >
40 > For example, my Dual Xeon EM64T file server can do make -j4 locally,
41 > like in make install, make docs etc etc, But for compiling I can use
42 > -j20, really not useful over -j8 anyway. But the point is, it would be
43 > usefully to separate the load distribution on the local machine and
44 > cluster nodes.
45
46 As the discusison started...
47
48 I would like to be able to limit the -jN when there is no distcc host
49 available or when compiling c++ code, otherwise my poor laptop is dead with
50 -j5 compiling pwlib when the network is down....
51
52 It is particular example, but being able to limit portage in some way as
53 total CPU, total MEM might be interesting (just nice-ing is not enough)
54
55 Kalin.
56 --
57 |[ ~~~~~~~~~~~~~~~~~~~~~~ ]|
58 +-> http://ThinRope.net/ <-+
59 |[ ______________________ ]|
60
61 --
62 gentoo-dev@g.o mailing list

Replies