Gentoo Archives: gentoo-dev

From: Xavier Neys <neysx@g.o>
To: wolf31o2@g.o
Cc: gentoo-dev@l.g.o
Subject: Re: [gentoo-dev] rsync speed and space taken
Date: Mon, 11 Oct 2004 14:16:23
Message-Id: 416A95B3.3070506@gentoo.org
In Reply to: Re: [gentoo-dev] rsync speed and space taken by Chris Gianelloni
1 Chris Gianelloni wrote:
2 > On Sun, 2004-10-10 at 15:49 -0800, Allen Parker wrote:
3 >
4 >><angry rant>
5 >>why don't we put more stuff in mirror://gentoo/ ?? ${FILESDIR} has too
6 >>much SHIT in it... i appreciate that patches, etc have been placed
7 >>there... but we REALLY need to find a better place. I don't need my
8 >>emerge sync's taking 45 minutes on average on a 5Mbit line in
9 >>france... *45 minutes* ...just PLEASE keep the SHIT out of the portage
10 >>tree.
11 >
12 >
13 > While I completely agree that things need to be taken out of
14 > ${FILESDIR}, I have a question for you. Could you give the specs of
15 > your machine? I have several machines and even on my oldest machine
16 > with an ATA33 drive and 128MB of RAM, it takes nowhere near 45 minutes
17 > to rsync the tree. Are you using your geographic rsync mirror? Do you
18 > have any other I/O bound processes running at the same time? I'm not
19 > trying to do anything other than point out that your times seem awfully
20 > long in my experience and there is a distinct possibility that something
21 > else is causing the slowdown to such extremes on your system.
22 >
23 I also have an old box (P100 w/ 128MB of RAM, 2 ATA33 disks at ~6MB/sec, udma
24 not available) and it takes ~45 minutes to run emerge --sync. Bandwidth is not
25 the bottleneck because its mirror is sitting next to it. The bottleneck is the
26 sheer number of files to check.
27
28 FYI: /usr/portage :
29 16276 - directories
30 83779 - files including
31 L_ 24820 files under /files/
32 L_ 19118 files under /metadata/cache/
33
34 16314 - Digest
35 16284 - .ebuild
36 7816 - Manifest
37 7812 - ChangeLog
38 6726 - metadata.xml
39 5100 - .patch / .diff
40 223 - Archive (gz/bz2/tar/...)
41 89 - make.defaults
42 78 - virtuals
43 67 - parent
44 61 - use.mask
45 49 - use.defaults
46 4042 - Uncategorized
47
48
49
50 My 2/100 of your currency,
51 --
52 / Xavier Neys
53 \_ Gentoo Documentation Project
54 / French & Internationalisation Lead
55 \ http://www.gentoo.org/doc/en
56 /\

Attachments

File name MIME type
signature.asc application/pgp-signature