Gentoo Archives: gentoo-user

From: Fast Turtle <fturtle@×××××.com>
To: gentoo-user@l.g.o
Subject: Re: [gentoo-user] Ext3 FS File Size Limits
Date: Wed, 05 Jun 2013 03:50:49
Message-Id: 20130604204929.5d3132996b0018c6f72e9c59@gmail.com
In Reply to: Re: [gentoo-user] Ext3 FS File Size Limits by Dale
1 On Sun, 02 Jun 2013 07:11:11 -0500
2 Dale <rdalek1967@×××××.com> wrote:
3
4 > Fast Turtle wrote:
5 > > I've been going around with this little problem for a while.
6 > >
7 > > I have several 30GB files I'm trying to restore from an NTFS formatted external backup to an ext3 partition, yet every attempt has failed right after 16GB of copying without fail or error message. They silently failing and I'm stumped.
8 > >
9 > > One of the possible causes I've thought of was running out of innodes but don't know how to check that or any of the other options used to create the file system on - anyone want to help there?
10 > >
11 > > I've also decided to look at the mke2f.conf file in /etc and see some default options being passed that may be causing the problems
12 > >
13 > > [defaults]
14 > > base_features = sparse_super,filetype,resize_inode,dir_index,ext_attr
15 > > default_mntopts = acl,user_xattr
16 > > enable_periodic_fsck = 0
17 > > blocksize = 4096
18 > > inode_size = 256
19 > > inode_ratio = 16384
20 > >
21 > > Normally I use either a 1024 for most everything due to the many small files though for the partition I'm attempting to restore the files to, I've used 2048 as a compromise due to the number of larger files (music/videos) and critical backups from /etc
22 > >
23 > > I've also tried it with a default 4096 size on a 32GB ext2 formatted flash drive but even then, it's failing at 16GB w/o any error message.
24 > >
25 > >
26 >
27 >
28 > I can offer this: df -i shows inodes.
29 >
30 > root@fireball / # df -i
31 > Filesystem Inodes IUsed IFree IUse% Mounted on
32 > rootfs 1525920 22728 1503192 2% /
33 > /dev/sda6 1525920 22728 1503192 2% /
34 > devtmpfs 2049540 593 2048947 1% /dev
35 > tmpfs 2058249 654 2057595 1% /run
36 > shm 2058249 2 2058247 1% /dev/shm
37 > /dev/sda1 98392 794 97598 1% /boot
38 > /dev/mapper/OS-usr 1638400 462712 1175688 29% /usr
39 > /dev/mapper/OS-var 1703936 259049 1444887 16% /var
40 > /dev/mapper/home-home 183148544 316215 182832329 1% /home
41 > /dev/mapper/backup-backup 61046784 5818 61040966 1% /backup
42 > tmpfs 2058249 122993 1935256 6% /var/tmp/portage
43 > root@fireball / #
44 >
45 >
46 > Hope that helps on that part at least.
47 >
48 > Dale
49 >
50 > :-) :-)
51 >
52 > --
53 > I am only responsible for what I said ... Not for what you understood or how you interpreted my words!
54 >
55 >
56 Thanks Dale - Interesting what info you can get
57
58 All: Accidently discovered that tune2fs -l /dev/sda# lists all of the config info so I shouldn't have any problems
59
60 Filesystem volume name: home
61 Last mounted on: <not available>
62 Filesystem UUID: d4102f68-defd-497b-84e4-f165fd171ed7
63 Filesystem magic number: 0xEF53
64 Filesystem revision #: 1 (dynamic)
65 Filesystem features: has_journal ext_attr resize_inode dir_index filetype needs_recovery sparse_super large_file
66 Filesystem flags: signed_directory_hash
67 Default mount options: user_xattr acl
68 Filesystem state: clean
69 Errors behavior: Continue
70 Filesystem OS type: Linux
71 Inode count: 39075840
72 Block count: 156282705
73 Reserved block count: 7814135
74 Free blocks: 104269552
75 Free inodes: 38399824
76 First block: 0
77 Block size: 4096
78 Fragment size: 4096
79
80 Had KDE lockup the other day and it forced a clean install w/o it. Seems I inadvertently formatted /home using the standard 4k block size this time around.
81
82 Would explain why the 30GB files copied over w/o issue this time
83
84 I'll repost this: Thanks for the Wiki Entry Alan (keep forgetting to check it) as that certainly explains the issue and I'm going to put that into my System Log book (important notes section).
85
86 When I started playing with Linux back in 2000, I never thought much about file size limits as ext2 could handle files larger then Win98 could. Now it's come full circle as you do have to be aware of the formatting because it can affect file size limits as I discovered.