Gentoo Archives: gentoo-user

From: Frank Steinmetzger <Warp_7@×××.de>
To: gentoo-user@l.g.o
Subject: Re: [gentoo-user] NAS and replacing with larger drives
Date: Sun, 11 Dec 2022 23:43:46
Message-Id: Y5ZrIseCoyBxVgu9@schatulle
In Reply to: Re: [gentoo-user] NAS and replacing with larger drives by Mark Knecht
1 Am Sun, Dec 11, 2022 at 08:44:42AM -0700 schrieb Mark Knecht:
2
3 > Also, I think there are ways for you to build complex pools like a RAID0
4 > from your 6TB and 8TB drives, and then a RAID1 using the RAID0 and your
5 > 14TB drive but I've never tried it because mine don't have enough drive
6 > slots for that.
7
8 After a longer fruitless search on the interwebs (I ddidn’t want to start up
9 my NAS just to check this) I finally found the right search keywords and
10 found a reddit thread about that. And it even throws LVM into the
11 discussion. ^^
12 https://www.reddit.com/r/zfs/comments/fitc73/raidz_with_nested_vdevs/
13
14 Also <https://zfs-discuss.zfsonlinux.narkive.com/g2THW8n4/nested-vdevs>:
15 “Here's a definitive answer from the man page for zpool.
16
17 Virtual devices cannot be nested, so a mirror or raidz virtual device can
18 only contain files or disks. Mirrors of mirrors (or other combinations) are
19 not allowed.”
20
21
22 I would advise against a JBOD pool anyways. Because if one drive dies, the
23 whole JBOD is gone. That goes for ZFS and probably for LVM, too (though I am
24 not sure how writes are distributed across JBOD disks). If the goal is
25 redundancy, you could buy a second drive to match the size of an existing
26 one and build a mirror. If redundancy is not a goal, then use the drives
27 separately like you do now. If one fails, then only its content is gone (or
28 even just the files sitting on the broken sector).
29
30 > Also, turn on compression. It saves me between 15-20% so 14TB becomes 16TB
31 > storage. YMMV. Video files don't compress, at least not much. Data files
32 > generally do.
33
34 It doesn’t hurt to switch it on, especially with lzo. But with video, the
35 benefit will be negligible. When storing a block of data (a “record” in ZFS
36 speak), it is passed through the compressor and only if the compression gain
37 is above a given threshold (10 % methinks), the block is written to disk
38 with compression.
39
40 What is more relevant in filesystems for big files (i.e. videos): set the
41 record size to 1 MB. The default is 64 kB, IIRC. Each record requires one
42 block of metadata (which includes the record checksum). So bigger records →
43 fewer meta blocks → better storage efficiency.
44
45 If you use big records for small files, then efficiency goes down a little.
46 It’s a similar (but a little more complicated) principle as when you write a
47 100 byte text file to a file system that uses 4 kB clusters. That file will
48 still use up 4 kB on disk.
49
50 The record size can be set per-dataset. So in your pool you could create a
51 dataset with a smaller record size for office documents, images and music,
52 and another dataset just for videos.
53
54 > Hope this helps. I think you'll find TrueNAS fun actually but there is a
55 > learning curve. I've used it for about a year and barely scratched the
56 > surface.
57
58 The main reason for me why I would wanna use it as opposed to a standard
59 Gentoo install: the OOTB web interface to manage all sorts of accounts,
60 access and permissions under one nice hood.
61
62 --
63
64 Grüße | Greetings | Salut | Qapla’
65 Please do not share anything from, with or about me on any social network.
66
67 A fermata comes to the doctor: “I can’t hold it any longer...”

Attachments

File name MIME type
signature.asc application/pgp-signature

Replies

Subject Author
Re: [gentoo-user] NAS and replacing with larger drives Dale <rdalek1967@×××××.com>