| 1 |
Although I have a computer that is a bit slower I have the similiar problem. |
| 2 |
Downloading does not consume much processorpower and athor machine |
| 3 |
resources. But compiling does need a lot. Wy don't use always use 2 |
| 4 |
parallell processes, one that downloads, and one that compiles. The |
| 5 |
compiling process would still need to be synced with the downloading, but |
| 6 |
that should not be too hard to implement with some semaphore or similiar |
| 7 |
solution. |
| 8 |
|
| 9 |
/Simon Mika |
| 10 |
|
| 11 |
|
| 12 |
On Sat, Feb 07, 2004 at 01:18:47PM +0000, Thomas Horsten wrote: |
| 13 |
> Hi, |
| 14 |
> |
| 15 |
> I have a request for an emerge feature that I think would be useful for a lot |
| 16 |
> of people. |
| 17 |
> |
| 18 |
> I have quite a fast machine with RAID and 3GHz CPU, and only a 512kbit/s |
| 19 |
> Internet connection. When I do an "emerge -u world" most of the time actually |
| 20 |
> goes by waiting for packages to download. For most ebuilds, It takes roughly |
| 21 |
> the same time to download as to compile. |
| 22 |
> |
| 23 |
> So to speed up my builds, I usually start an "emerge -f -u world". Once the |
| 24 |
> first couple of packages have downloaded I then start an "emerge -u world" in |
| 25 |
> another shell. |
| 26 |
> |
| 27 |
> This works great as long as the fetcher process is ahead of the builder |
| 28 |
> process. But if some packages are built too quickly, the builder process |
| 29 |
> catches up. It then starts downloading the same file as the downloader |
| 30 |
> process, resuming from wherever the downloader had gotten to, so now two |
| 31 |
> downloaders are writing to the same file (waste of bandwidth and a possible |
| 32 |
> source of corrupted archives). |
| 33 |
> |
| 34 |
> What I suggest is that emerge will put a lockfile in place when it's |
| 35 |
> downloading a file, eg. "name-of-package.tar.bz2.lock", or by using fcntl |
| 36 |
> locks. Then if the "builder" catches up, and finds the output file is already |
| 37 |
> open, it waits on the lock for the download to complete and then continues |
| 38 |
> unpacking after that. |
| 39 |
> |
| 40 |
> I already love gentoo and the portage system, it's by far the best available, |
| 41 |
> but adding this feature would make it even better IMHO. |
| 42 |
> |
| 43 |
> Regards, |
| 44 |
> |
| 45 |
> Thomas |
| 46 |
> |
| 47 |
> |
| 48 |
> -- |
| 49 |
> gentoo-portage-dev@g.o mailing list |
| 50 |
> |
| 51 |
|
| 52 |
-- |
| 53 |
gentoo-portage-dev@g.o mailing list |
Archives