ZFS Basics - Pools and VDEVs - Testing, Configuration, and Expansion

Рет қаралды 21,379

Күн бұрын

Being relatively new to ZFS, I wanted to make this video to review some of the basics, understand how to expand ZFS storage, and perform tests to see any differences between configurations. As there is much more to ZFS than what I have covered here, this is the first of my videos on the topic.
For additional information, please visit the links below. These are Amazon.com affiliate links, and as an affiliate, I earn from qualifying purchases.
Storage
WD RED 8T: amzn.to/38IbNuD
WD RED 6T: amzn.to/2U2yAgt
WD RED 4T: amzn.to/2t7CA4u
WD Red Pro: amzn.to/2BO6COq
Seagate Ironwolf 10T: amzn.to/2RvkKBN
Seagate Ironwolf 8T: amzn.to/2O2XpFk
Seagate Ironwolf 6T: amzn.to/2U2IJKn
NAS
QNAP TS-453D: amzn.to/3xzw97z
QNAP TS-932PX: amzn.to/3aSTkBS
Networking
QNAP 12 Port Managed 10GbE switch: amzn.to/3td6XiV
Qnap 12 Port unmanaged 10GbE switch: amzn.to/2QhsDYF
Netgear 8 Port Managed Switch: amzn.to/2SDt8O7
Netgear 10 Port Managed Switch with 2 10Gbe ports: amzn.to/2TkIes1
TP Link 16 Port Managed Switch: amzn.to/2Ru7NFk
Qnap 10Gbe NIC card: amzn.to/2JzaySY
Gigabyte GC-AQC107: amzn.to/2YFJckF
TRENDnet TEG-10GECTX: amzn.to/2w6OQzZ
QNAP QXG-10G1T: amzn.to/2Q8nHpq
10Gtek 10Gbe NIC card (Intel Compatible): amzn.to/2RtDte3
Sonnet Presto Solo 10GbE NIC: amzn.to/39qdmxP
Asus 10Gbe NIC card: amzn.to/2SDVfg0
Ubiquiti Edge Router X: amzn.to/2GOqukh
Netgear 8 Port Switch: amzn.to/2YMkIpG
Netgear 8 Port Switch: amzn.to/2yJucXP
TP -Link 8 Port: amzn.to/31kNfnP
QNAP QSW-308-1C (with combo port): amzn.to/2uVZ8Wf
QNAP QSW-308 (without combo port): amzn.to/38o9Jrk
Ipolex SFP+ Transceiver: amzn.to/36aCeHw
CAT7 Patch Cable: amzn.to/2Rxv3UD
Intel 10GbE Network Card: amzn.to/2uWTh2W
Cat7 Bulk Roll: amzn.to/2U3yA01
Keystone: amzn.to/38IVkqe
Shielded RJ45: amzn.to/37ui10P
QNAP QSW-M408-2C: amzn.to/35WuxbB
Ubiquiti Muti-Mode SFP+: amzn.to/2RL3EiI
Multi-Mode Fiber Cable: amzn.to/3kLzfNN
LinkUp KeyStone: amzn.to/36fjXLf
LinkUp RJ45 Connector: amzn.to/3eyp1yg
LinkUp CAT 8 Cable: amzn.to/3lljcXi
UpTell Cat 6a Couplers: amzn.to/3kaynBg
Intel 10GbE Network Card: amzn.to/2uWTh2W
Sabrent 5GbE USB Network Adapter (NT-SS5G): amzn.to/3vS6hEr
Chapters
00:00 Introduction
00:49 Concepts
01:26 ZPools
01:56 VDEVs
03:37 Understand Pool Storage
05:43 Building Our Pool and VDEV
06:27 Testing a Single VDEV
07:01 Adding a Second VDEV
07:29 Fault Tolerance
08:18 Testing with Two VDEVs
09:15 Overview and Summary

Пікірлер: 62

@sm5172 Ай бұрын

Finally a clear and straight to the point explanation that is becoming rarer and rarer on YT these days, thank you.

@MikeFaucher Ай бұрын

Thank you for that feedback. It is appreciated.

@Filotto Жыл бұрын

I am a beginner and I only found 30 minutes videos on zfs. I really liked how you explained the concepts thanks

@MikeFaucher Жыл бұрын

Glad it was helpful and thanks for the feedback and for watching!

@decmade 2 ай бұрын

best explanation I have seen online

@MikeFaucher 2 ай бұрын

Wow, thank for the feedback. Appreciate it.

@aliaghil1 22 күн бұрын

What a great video! Thank you for sharing it with us.

@MikeFaucher 21 күн бұрын

Glad you found it helpful and and thanks for the feedback.

@mahmoudelgendy5348 10 ай бұрын

Just helpful and straight to the point. Thnx Mike.

@MikeFaucher 10 ай бұрын

Thank you! Appreciate the feedback.

@kelvindiaz8409 Жыл бұрын

You explained this so well! Thanks!

@MikeFaucher Жыл бұрын

Thank you for the feedback. It’s appreciated.

@jeffreyrh 2 ай бұрын

You are always learning. I just learned that on UNRAID zfs, the shares are actually datasets. So if you have 2 shares on the same disk, and try to move large folders from one share to the other, expecting them to move instantly since they are on the same disk, you would be wrong. It has to do a full copy and delete because each dataset is it's own file system. I figured this out after numerous tries :)

@MikeFaucher 2 ай бұрын

Thanks for the feedback. To add to some of the confusion, everyone is implementing ZFS a bit differently.

@jayzn1931 Жыл бұрын

I finally understood expansion in TrueNas now! You cannot extend a vdev (yet) but you can extend a pool by adding vdevs, but if a single vdev fails, the whole pool dies.

@MikeFaucher Жыл бұрын

As long as you only lose one drive the raid will protect the entire pool. Thanks for the feedback.

@faisalnafees8413 9 ай бұрын

You got me worried now. So if I got 2 vdevs in a pool and 1st one dies as a whole. I'll lose the data in 2nd vdev also?

@MikeFaucher 9 ай бұрын

@@faisalnafees8413 Yes, like any raid config, assuming you have one drive of redundancy, you have to make sure you don't lose more than one drive. You need to make sure you have a backup. I just lost a raid array a couple of weeks ago so I share your concern. Fortunately it was a backup unit.

@user-jw7zj5rn8z Жыл бұрын

Thank You , this is a great intro to get started

@MikeFaucher Жыл бұрын

Great to hear. Thank you for the feedback.

@wyattarich 7 ай бұрын

Great video, hopefully you can cover mirrored array performance increases and caching next.

@MikeFaucher 7 ай бұрын

Thanks for the feedback and I will add it to my list.

@hadeseye2297 4 ай бұрын

Thanks.

@MikeFaucher 4 ай бұрын

Thanks for the feedback!

@sandrovieirafotografo 6 ай бұрын

Show, muito esclarecedor, Obrigado.

@MikeFaucher 6 ай бұрын

Gracias por los comentarios.

@Jazzynupe1911 20 күн бұрын

Side note, there is a new feature coming soon that will allow you to add a single drive to a VDev as well. Not sure if it is released yet but it was discussed in another video.

@MikeFaucher 20 күн бұрын

Yes, I heard about this. QNAP's ZFS based Hero has been doing this since the last release. I look forward to the TrueNAS Release.

@JohnUllrey Жыл бұрын

Thanks, this was supper helpful. I'm planning out my first TrueNAS build. (Like'd & Sub'd)

@MikeFaucher Жыл бұрын

Glad it helped and thanks for the feedback. Good luck with your build.

@camixxx 8 ай бұрын

Are you doing the reading and writing simultaneously? Wouldn't saturation be closer to 1250 MB/sec for a 10 Gbit connection?

@MikeFaucher 8 ай бұрын

I have yet to see anything that high but you are right in theory. In these test, limitations were from the SSD drives and controllers as they are SATA. It would take a pretty large pool or nVME to max out the 10G connection. That said, without playing with jumbo frames and relieving all the other bottlenecks. 900-1000 is a bit more real world on a 10G network, at least from what I have seen. Good observation and thanks for the feedback.

@alonzosmith6189 Жыл бұрын

Hello, great video. I researching building a TrueNAS server for home with 8 drives. I was thinking creating 1 pool and 1 vdev then creating datasets for my family members and Plex

@MikeFaucher Жыл бұрын

Sounds like a solid plan. Let me know how it works out.

@zyghom 10 ай бұрын

actually you did not say much about zfs config - rather about truenas when you said at the beginning: "I wanted to learn ZFS" I thought you would show the commands (zfs, zpool etc) to do it from the terminal ;-)

@MikeFaucher 10 ай бұрын

Thanks for the feedback. I was more focused on pools and vdev. Never been a fan of the command line but good point.

@outcast6187 Жыл бұрын

What I want is to know how to expand my currently used single 8TB drive on TrueNAS to a 3x 8TB drive setup with a RAIDZ1 configuration.

@MikeFaucher Жыл бұрын

You have to move data off the single drive and create a 3x8 VDEV, then copy the data back on to it.

@Karimpje Жыл бұрын

Hey thanks for your explanation. I have a Truenas running with a Zpool with one VDEV of 4 disks of each 4TB. I have 10TB usable storage space, because I use RAIDZ1. The Zpool is 96% full. Now I have two 4TB spare disks and I want to expand my Zpool with these disks. Should I add a new VDEV with only the two disks in a mirrored mode or should I buy myself a new 4TB disk and create a new VDEV with three 4TB disks?

@MikeFaucher Жыл бұрын

Thanks for the feedback. Personally I would buy two more as it will be more efficient.

@Karimpje Жыл бұрын

@@MikeFaucher Thanks, I'm just not sure if my NAS has much more room. I know that the two spare disks will fit, as I bought two hot swappable drive bays, I could add one more I think but another I don't know. It is not that I don't want to, it's more the limitations of the hardware I am using as a NAS (Dell Precision T7500 with 96 GB RAM and 2 Xeon X5670 CPU's)

@OT-tn7ci 2 күн бұрын

Hey thanks man, so it looks like, unless I can add more drives to vdevs later on, especially parity drives. It will be kinda hard to upgrade storage in this config.. Because of the stripping behavior. I want to first start out all my vdevs without any parity drive as I upgrade slowly. And then add in the parity drives later on, since I don't want to create new vdevs, creating new vdevs sound like a bad idea, because of the stripping behavior.

@MikeFaucher Күн бұрын

@@OT-tn7ci that feature is coming soon.

@djmulder 5 ай бұрын

Thanks for the explanation... tho I'm still not too happy with how it all works (not you but zfs in general) I come from a drobo, which ofc has it's own issues and isn't perfect. The thing I loved is that you could just plop out a disk, put in a new/bigger one and it will happily rattle along and you have more space. This is completely what I'm missing with ZFS.. I have to have equal drive sizes, need to have a fixed vdev.. or chose to lose usable space.. etc etc.. I could live with multiple vdevs if I could just expand my vdev that has bigger disks and eventually remove my vdev which has smaller (so shrink until 0).. but yeh that's not possible. So I'm thinking: I could make vdevs of 3 disks, then when I upgrade I only need to get 3 disks... which works.. but then I have the issue that I lose 1 parity disk per vdev (so a lot of usable space loss) and yeh still need to upgrade 3 disks at a time. And on top of that I don't really have full redundancy.. as yeh if 2 disks die in 1 vdev I lose my entire pool.. even if I have say 4 vdevs, so 4 parity disks, yet still effectively 1-4 disk loss.

@MikeFaucher 5 ай бұрын

I feel you pain. You could run UNRAID in its more Drobo like operation if you want to use random disks and don't mind loosing a bit performance. I use both and only use ZFS TrueNAS which has only purpose and my all flash QNAP NAS which uses ZFS but allows me to add a drive to the pool which is feautre I really like. For media and backup, UNRAID is not a fast but very scalable with different size drives.

@djmulder 5 ай бұрын

@@MikeFaucher yeah I have unraid now, but I just don't like the performance. I've been investigating zfs because of that but I just can't make the step because of the issues

@AinzOoalG0wn Жыл бұрын

oo i see uve hopped on the truenas bandwagon. yes it has zfs so thats a good place to try that out :} when ur going from qnap to truenas, u'll notice the UI setup process has some steps to do. Part of the setup, you will need another account other than the default root. Root only lets u access the UI, but it won't let u access the share (as intended for security). So u have to create an account for that, and bind it to the share u create. u also have to go to services and enable smb. Test on your desktop whether you can access the share on smb to confirm it works. There are probly other steps, but these are the main ones to do. Are u using truenas scale or core? Not sure whats the latest news, but last time scale (linux) was still considered beta. core is stable (bsd).

@MikeFaucher Жыл бұрын

Thanks for your input. I have been using it for a bit and have a couple of SMB set up. Currently due to the speed I am using it for a video server where I edit my videos. Thanks for the input as always.

@user-iu9nx8ou6z 7 ай бұрын

How about for starters ... 4 1tb drives... create the different combo's with data and parity...and explain the what's and why's .... I am using ubuntu ... then create a zfs system pool for samba so all pc with linux and windows can use samba for backup/storage et al... hows that for a start...

@MikeFaucher 7 ай бұрын

Thanks for the input. Interesting use case.

@AndrewAllmer 3 ай бұрын

Is it possible to go from RAID6 to RAID60 with zfs? I’m planning to start a pool with a 4 drive vdev in RAIDz2, then add another 4 drive vdev in RAIDz2 later to add capacity. Is that possible?

@MikeFaucher 3 ай бұрын

Yes if you are adding a whole vdev and not just adding drives. Currently, there is not way to migrate raid levels or expand a pool.

@AndrewAllmer 3 ай бұрын

@@MikeFaucher Awesome thank you!

@coletraintechgames2932 Жыл бұрын

Metadata and dedupe vdev

@MikeFaucher Жыл бұрын

Thanks.

@user-iu9nx8ou6z 7 ай бұрын

There is a lot more to zfs than this one video... why don't you do more....

@MikeFaucher 7 ай бұрын

I agree there is much more. Any suggestions on what additional topics you would like to see.

@callisoncaffrey Жыл бұрын

I see Windows, I leave.

@MikeFaucher Жыл бұрын

Thanks for your input.

@callisoncaffrey Жыл бұрын

@@MikeFaucher That's funny. I do that too! Made me smile, gets a like.

@lyndajones1133 Жыл бұрын

6:24 what did you do to get to there? like so a file on my desktop. share it to nas pool....watch its speed. gotit. but howto. there inlines why im here actually. jah know what im sayin.

@MikeFaucher Жыл бұрын

Thanks for the question, but I am not sure I completely understand. The section you are referring to only shows the capacity and then a regular file copy test (read and write) of a single VDEV. Can you clarify? Thanks