Gentoo Archives: gentoo-dev

From: Roman Gaufman <hackeron@×××××.com>
To: Bret Towe <magnade@×××××.com>
Cc: gentoo-dev@l.g.o
Subject: Re: [gentoo-dev] rsync speed and space taken
Date: Sun, 10 Oct 2004 20:41:10
Message-Id: 921ad39e04101013412a7d7f47@mail.gmail.com
In Reply to: [gentoo-dev] rsync speed and space taken by Bret Towe
1 Its not only about dialup users either. For example if running gentoo
2 on a production system, you would normally run glsa-check on an hourly
3 basis. If your system is volnerable, you'll normally have to emerge
4 sync first, and with the number of files there, it takes far too long.
5
6 There has been a lot of discussion about switching away from rsync
7 and/or changing ebuild structure for portage-ng -- but thats mostly
8 gossip and any progress is halted.
9
10 I do agree that some files really should be removed from the tree,
11 look at this list:
12
13 find ./ -type f | egrep -v "packages|distfiles" |xargs du | sort -n | tail -n 20
14 72 ./media-video/nvidia-kernel/files/1.0.4499/NVIDIA_kernel-1.0-4499-2.6-20031014.diff
15 72 ./net-www/apache/files/httpd-2.0.49-ssl_engine_kernel.patch
16 72 ./net-www/apache/files/patches/2.0.49-r1/01_ssl_engine_kernel.patch
17 72 ./sys-devel/binutils/files/2.13/binutils-2.13.90.0.18-ppc64-tls1.patch
18 76 ./app-accessibility/speech-tools/files/1.2.3-gcc3.4.patch
19 76 ./sys-devel/gcc/ChangeLog
20 80 ./media-video/nvidia-kernel/files/1.0.5328/NVIDIA_kernel-1.0-5328-2.6-20031226.diff
21 80 ./sys-devel/binutils/files/2.14/binutils-2.14.90.0.4-cfi.patch
22 84 ./gnome-base/gnome-session/files/gentoo-splash.png
23 84 ./gnome-base/gnome-session/files/gnome-splash.png
24 84 ./media-video/nvidia-kernel/files/1.0.4363/NVIDIA_kernel-1.0-4363-2.5-20030714.diff
25 84 ./media-video/nvidia-kernel/files/1.0.4496/NVIDIA_kernel-1.0-4496-2.6-20030905.diff
26 84 ./media-video/nvidia-kernel/files/1.0.4496/NVIDIA_kernel-1.0-4496-2.6-20031026.diff
27 84 ./x11-base/xfree/ChangeLog
28 88 ./mail-filter/amavisd-new/files/amavisd.conf
29 92 ./app-emulation/wine/files/wine-alsa.patch
30 92 ./games-emulation/nwwine/files/wine-alsa.patch
31 100 ./media-video/nvidia-kernel/files/1.0.5328/NVIDIA_kernel-1.0-5328-2.6-20040105.diff
32 120 ./sys-libs/pam/files/pam-0.75-r7-gentoo.tbz2
33 168 ./licenses/perforce.pdf
34
35
36 On Sun, 10 Oct 2004 10:38:59 -0700, Bret Towe <magnade@×××××.com> wrote:
37 > while waiting for a rsync on one of my computers i noticed
38 > there are alot of patchs, gzip, and bzip2 files in portage
39 > alot of which i wouldnt think needs to be there
40 > x11-base/xfree/files/ for one example
41 > sys-devel/gcc/files/ for another
42 > im sure there are other places that are just as bad
43 >
44 > find /mdhd/gentoo/gentoo-portage/ -name "*.bz2"|wc -l
45 > 159
46 >
47 > find /mdhd/gentoo/gentoo-portage/ -name "*.gz"|wc -l
48 > 62
49 >
50 > even with my local lans rsync mirror serving i think 6 computers currently
51 > i dont even use half of those bz2 or gz files and im sure similar goes for
52 > alot of the patchs in the tree
53 >
54 > i seem to recall there is a script or somethin, or was, that checked sizes
55 > of files in the tree perhaps it should be expanded to file types
56 > or better yet watch file counts for files that arent needed
57 > so whatever isnt a ebuild, digest, manifest, or changelog
58 > considering how long it takes to scan the tree as it is
59 > i would think this would help alot
60 > and im sure the dialup users wouldnt mind not downloading
61 > stuff they would never use
62 >
63 > Bret
64 >
65 > --
66 > gentoo-dev@g.o mailing list
67 >
68 >
69
70 --
71 gentoo-dev@g.o mailing list

Replies

Subject Author
Re: [gentoo-dev] rsync speed and space taken Marius Mauch <genone@g.o>