Home Networking: 100TB 10Gbit Server - ZFS considerations...

Home Networking: 100TB 10Gbit Server - ZFS considerations (Performance, RAIDz vs RAID and Mirrors) Home Networking: 100TB 10Gbit Server - ZFS considerations (Performance, RAIDz vs RAID and Mirrors)
Phillip Photo

1 year 14 Views
I think video I dive a little bit deeper into why I'm using a ZFS Pool with Mirror VDEVs instead of using the more commonly used RAIDz. I also talk about the differences between traditional RAID and RAIDz which have a bigger performance difference then you might expect!

Jump links:
0:00 Video Introduction
0:30 RAID Theory (Striping, RAID5, RAID6)
2:05 RAID5 has become a problem
3:56 Mirrors
5:08 Differences between ZFS and Traditional RAID striping
5:30 Let's talk performance, shit needs to go fast (ZFS pools)
7:55 ZFS uses advanced techniques to make up some of it
8:35 How to Scale performance with ZFS
9:16 Why I'm choosing to use a mirror
10:15 Performance of mirrors
11:24 Multiple VDEV inside a Pool is the way to go
12:38 ZFS Mirror bonus advantages

If you'd like to discuss more in depth, join our discord server: https://discordapp.com/invite/abk5kuD

░▒▓[Associated blog post]▓▒░
The blog/article index for this server can be found here: https://blog.quindorian.org/2019/08/building-a-100tb-10gbit-home-server.html/

Video about the server chassis: https://youtu.be/swWgav-p2Nw
Video about preparing to build in the chassis: https://youtu.be/fU4sEzTqAwk
Video about the hardware used for this server build: https://youtu.be/O2QV0ZTFaxk
Video about installing Proxmox and setting up ZFS: https://youtu.be/ZL2JUL9oeDg
Video about ZFS, RAIDz vs RAID and Mirrors: https://youtu.be/GuUh3bkzaKE

ZFS Article mentioned in the video (picture): https://pthree.org/2012/12/05/zfs-administration-part-ii-raidz/

░▒▓[Shopping links]▓▒░
Most links will ask if you are looking on Amazon or Aliexpress. I prefer Aliexpress myself. These are affiliate links and help me out greatly!

Sadly the Inter-Tech 4U 4420 is currently only available on Amazon.de: http://geni.us/0hzpX

Motherboard and CPU:
Gigabyte AX370-Gaming-5 - http://geni.us/mbE6
(Gigabyte AX470-Gaming-5) - http://geni.us/l4wzDsL
(Gigabyte X570 Aorus Pro) - https://geni.us/9aWi
Ryzen 1700 - http://geni.us/ARHouUh
(Ryzen 2700) - http://geni.us/UutH1gh )
(Ryzen 3700) - https://geni.us/2z5Bh

64GB Kit F4-2400C15Q-64GFT - https://geni.us/SjF9

SSD - Samsung 960 Pro - https://geni.us/yTlXg5L
SSD - Samsung 860 EVO - https://geni.us/TZwHT
SSD - Seagate IronWolf 110 (Power Loss Protection, High Write Endurance) - https://geni.us/5S1Vj6V
HDD - Seagate IronWolf 10TB - https://geni.us/MuSpu8B

Graphics card:
Zotax GT710 PCIe x1 (ZT-71304-20L) - http://geni.us/rCeww

Network 10Gbit Equipment:
Mikrotik Routerboard CRS305 - https://geni.us/MpKA321
Mikrotik Routerboard CRS309 - https://geni.us/lW61Mn

Network 10Gbit Cards:
Intel x540-T1 (10Gbit copper) - https://geni.us/L9hlP9O
Intel x550-T1 Newer (10Gbit copper) - https://geni.us/mY8MK
Intel x540-T2 (10Gbit copper) - https://geni.us/Rdw8
Intel x550-T2 Newer (10Gbit copper) - https://geni.us/5Y8U
Mellanox ConnectX-2 (SFP+) - https://geni.us/LtHyGs
Mellanox ConnectX-3 (SFP+) - https://geni.us/tJ5SydD
Aquantia 1/2.5/5/10Gbit (Copper) - https://geni.us/9JcUw

SSD Hot Swap cage:
2x2.5" in 3.5" SSD hot swap cage - https://geni.us/yZtMr

LSI Card + Cables:
LSI/Broadcom SAS2008 based cards - https://geni.us/yOdyF
70cm SFF-8087 to SFF-8087 - https://geni.us/xJeS
50cm Forward SATA breakout SFF-8087 - https://geni.us/WoM1
50cm Reverse SATA breakout SFF-8087 - https://geni.us/2yj3Tc8

Very nice 1 meter 4x SATA to 4x SATA sleeved - https://geni.us/dUzZm
PWM fan split cable - https://geni.us/VEZqo5a
"Hook and Loop" cable ties - https://geni.us/jlkl

TheFatRat - Xenogenesis

During video:
Approaching Nirvana - Lapse https://youtu.be/rxokUkJ3h_0