1 |
On Fri, Aug 26, 2022 at 7:25 AM Rich Freeman <rich0@g.o> wrote: |
2 |
> |
3 |
> On Fri, Aug 26, 2022 at 10:09 AM Mark Knecht <markknecht@×××××.com> wrote: |
4 |
> > |
5 |
> > Obviously you can do what you are most comfortable with but to me a NAS |
6 |
machine with a bunch of external drives does not sound very reliable. |
7 |
> > |
8 |
> |
9 |
> I would have thought the same, but messing around with LizardFS I've |
10 |
> found that the USB3 hard drives never disconnect from their Pi4 hosts. |
11 |
> I've had more issues with LSI HBAs dying. Of course I have host-level |
12 |
> redundancy so if one Pi4 flakes out I can just reboot it with zero |
13 |
> downtime - the master server is on an amd64 container. I only have |
14 |
> about 2 drives per Pi right now as well - at this point I'd probably |
15 |
> add more drives per host but I wanted to get out to 5-6 hosts first so |
16 |
> that I get better performance especially during rebuilds. Gigabit |
17 |
> networking is definitely a bottleneck, but with all the chunkservers |
18 |
> on one switch they each get gigabit full duplex to all the others so |
19 |
> rebuilds are still reasonably fast. To go with 10GbE you'd need |
20 |
> hardware with better IO than a Pi4 I'd think, but the main bottleneck |
21 |
> on the Pi4 I'm having is with encryption which hits the CPU. I am |
22 |
> using dm-crypt for this which I think is hardware-optimized. I will |
23 |
> say that zfs encryption is definitely not hardware-optimized and |
24 |
> really gets CPU-bound, so I'm running zfs on top of dm-crypt. I |
25 |
> should probably consider if dm-integrity makes more sense than zfs in |
26 |
> this application. |
27 |
> |
28 |
> -- |
29 |
> Rich |
30 |
|
31 |
Quite interesting Rich. Thanks! |
32 |
|
33 |
My needs may be too 'simple'. I'm not overly worried about the government |
34 |
or foreign actors invading my world. (Even though I'm sure they could.) I |
35 |
just have a router-based firewall. My backup machines are powered down |
36 |
unless they are being used and they don't respond to wake-up over the |
37 |
network so they are safe enough for me. The one in my office backs up |
38 |
my two machines (desktop and video file server) and the second |
39 |
NAS backs up the first. They are both ZFS RAID1 using TrueNAS. I |
40 |
don't use encryption at all. A real dummy... |
41 |
|
42 |
But again, I'm not even a Gentoo user any more. I'm a KDE user |
43 |
and I could see no performance improvement using Gentoo over |
44 |
Kubuntu. My updates happen once a week, roughly, and never |
45 |
take more than 5 minutes. In 4 years I've never had an update |
46 |
fail. Kubuntu just works for me - but I'll be the first to admit I don't |
47 |
know what's running on my machine anymore so I'm not much better |
48 |
than being a Windows user in terms of control. |
49 |
|
50 |
In the old days (2001) I was a computer OS enthusiast. Today |
51 |
I play guitar, bake bread and drink a little wine. Life and focus |
52 |
changed. For a guy at home life is ok and I have backups to boot. |