Gentoo Archives: gentoo-dev

From: Brian Jackson <brian@××××.com>
To: gentoo-dev@g.o
Subject: Re: [gentoo-dev] maybe it is time to put portage queries into a database.
Date: Tue, 24 Jun 2003 22:17:00
Message-Id: 200306241716.58107.brian@mdrx.com
In Reply to: [gentoo-dev] maybe it is time to put portage queries into a database. by Tony Clark
1 Totally agree. I have 5 Gentoo boxes at work (probably more soon), and it
2 takes a ridiculously long amount of time to do searches. One thing I would
3 suggest is to develop as an external tool, and once it matures, then shoot
4 for inclusion into portage. another suggestion would be for it to support
5 more than one type of db (sleepycat, postgres, mysql, gdbm for example). If
6 you try to make some postgres zealot put mysql on just to query packages, you
7 are going to get some very unhappy words directed your way. I can try to help
8 also in my spare time.
9
10 --Brian Jackson
11
12 On Tuesday 24 June 2003 05:00 pm, Tony Clark wrote:
13 > I wanted to quickly find a package with emerge -s whatever. I noticed that
14 > it seemed to be taking a long time now for basic searches. A couple of
15 > random example are presented below. Now in my case on the machine in
16 > question, it is probably a bit slower than need be as /usr/portage is nfs
17 > mounted but neither the nfs server, this client are what would be called
18 > slow machines and I run 100baset ethernet.
19 >
20 > 12 months ago I thought the search times where acceptable, nowdays they are
21 > pushing it and with the number of packages going into portage sooner rather
22 > than later it is going to be unacceptal. I would also suggest a
23 > centralised server approach using something like mysql as apposed to
24 > localised databases based on berekley or something else. reason being that
25 > a number a ppl are running home lans and they are increasing in popularity
26 > and there is no need to store N machines worth of data. mysql comes to mind
27 > as it is a popular database as there is a good chance that for some other
28 > application it is already running on the network. I know in my case thats
29 > so.
30 >
31 > I know this has been discussed in the past but always put down for reasons
32 > I largely agreed with, but the number of packages and times have changed.
33 > I don't mind helping out with this with some perl etc. What I was thinking
34 > on for the initial implementation would be just to store the information
35 > required for searching. I don't see a need to store all dependcies etc so
36 > the installation process actually becomes database driven. In this case
37 > the queriey times are so short to the actually installation time, no
38 > noticable speed up will take place.
39 >
40 > The floor is open, let the flames begin :)
41 >
42 > tony
43 >
44 <snipped times>
45
46 --
47 OpenGFS -- http://opengfs.sourceforge.net
48 Home -- http://www.brianandsara.net
49
50
51 --
52 gentoo-dev@g.o mailing list

Replies

Subject Author
Re: [gentoo-dev] maybe it is time to put portage queries into a database. Tony Clark <tclark@×××××.com>