Gentoo Archives: gentoo-user

From: Nilesh Govindrajan <contact@××××××××.com>
To: gentoo-user@l.g.o
Subject: Re: [gentoo-user] Fast file system for cache directory with lot's of files
Date: Mon, 13 Aug 2012 13:28:08
Message-Id: 5028FF82.7020908@nileshgr.com
In Reply to: [gentoo-user] Fast file system for cache directory with lot's of files by Michael Hampicke
1 On Mon 13 Aug 2012 06:46:53 PM IST, Michael Hampicke wrote:
2 > Howdy gentooers,
3 >
4 > I am looking for a filesystem that perfomes well for a cache
5 > directory. Here's some data on that dir:
6 > - cache for prescaled images files + metadata files
7 > - nested directory structure ( 20/2022/202231/*files* )
8 > - about 20GB
9 > - 100.000 directories
10 > - about 2 million files
11 >
12 > The system has 2x Intel Xon Quad-cores (Nehalem), 16GB of RAM and two
13 > 10.000rpm hard drives running a RAID1.
14 >
15 > Up until now I was using ext4 with noatime, but I am not happy with
16 > it's performence. Finding and deleting old files with 'find' is
17 > incredible slow, so I am looking for a filesystem that performs
18 > better. First candiate that came to mind was reiserfs, but last time I
19 > tried it, it became slower over time (fragmentation?).
20 > Currently I am running a test with btrfs and so far I am quiet happy
21 > with it as it is much faster in my use case.
22 >
23 > Do you guys have any other suggestions? How about JFS? I used that on
24 > my old NAS box because of it's low cpu usage. Should I give reiser4 a
25 > try, or better leave it be given Hans Reiser's current status?
26 >
27 > Thx in advance,
28 > Mike
29
30 You should have a look at xfs.
31
32 I used to use ext4 earlier, traversing through /usr/portage used to be
33 very slow. When I switched xfs, speed increased drastically.
34
35 This might be kind of unrelated, but makes sense.
36
37 --
38 Nilesh Govindrajan
39 http://nileshgr.com

Replies

Subject Author
Re: [gentoo-user] Fast file system for cache directory with lot's of files Michael Hampicke <mgehampicke@×××××.com>