Just a small clarification about the SMB Multichannel settings. We asked the TrueNAS folks about it, and they explained that in the current version of SMB/samba in TrueNAS core, SMB Multichannel is still considered "experimental" and is therefore not a recommended configuration. The Linux version of TrueNAS, "Scale", should support SMB Multichannel by default once it matures into a stable release.

Now run it on a Raspberry Pi.

These server videos are always so incredibly interesting to me, even though they're some of the videos furthest from what I'll ever experience

"We're going Linux baby!" - Goes BSD.

It never ceases to amaze me that Linus has mad a career out of documenting his career.

Linus, its like every engineer in racing has told: "If you give your driver 100hp more they mention not noticing it, but if you take 10 away they complain the car is undriveable!"

Linus: "As you can see, it's not the weekend." LTT: Drops video on a Sunday.

Jake: "I've done a little testing on this" Also Jake: *explains every single setting and how they differed between different states during testing* This is not a "little bit of testing" my man, this is proper testing.

"I don't know why TrueNAS doesn't work the way I want it to" - proceeds to hard power down and unplug power mid startup then slaps the top of the case repeatedly. *shrug*

It's kind of funny to see how Jake and Linus roles have completely reversed since the earlier server videos. Jake used to be all over the place, a true joker. Now he's the serious one sighing at Linus.

TrueNAS : I fear no man. But that guy. *stares at Linus* He scares me.

As someone who came from BSD, I must say that BSD pre-dates Linux by a whole hell of a lot. It’s more correct to say that Linux is Unix-like.

"We could [turn compression on] later because we have stuff like Word files" Those are already compressed. .docx is just a .zip with a bunch of xml in it.

"Several Blue screens" And right there, you can see Linus's pure anger

I love how there is still disagreement over whether to call it "new new whonnock" or "Whonnock 3"

Linus has really built an enterprise here. Haven't been watching him and I didn't realize what sort of operation he was running. Good for him!

Caption corrections: Zetta-FS => ZFS (appears quite a few times) parody => parity (appears a couple times) qDevs => queue depths 18 gigabytes => 18 gibibytes

My heart skipped a beat when Linus nearly dropped the bloody server.

Jake used to get ribbed by the comments all the time, but he seems to be super knowledgeable in this stuff. It's nice to see him be an expert in a field.

ah yes, the end result of all networking projects,. You start out thinking you're gonna make everything way faster, spend an entire day setting things up, and then find out things are largely the same but maybe more stable. I've never felt like the job is 100% "done" when doing networking...

I'm amazed that you were actually running windows on your storage server all this time... That's true bravery right there!

2:35 Always glad to see a new episode of Linus Drop Tips

I love how in the last couple of years the technical discussions in the videos have become much more advanced and in-depth

From opening boxes of mediocre PC parts outside NCIX to overhauling your company's server. Pretty cool to witness this journey along the way.

"We are going Linux baby!" - Parents of Linus, probably.

I must admit, "Post" Corona bearded Linus with that out of bed hairdo goes better with Linux. Also, looking forward to the inevitable Canadian wood axe reviews. To quote 2minutepapers. What a time to be alive!

I really like it that Jake shines when he's knows his stuff. He's also good in explaining. And he tries to dumb it down (as far as it goes in this sort of videos)

i like it how someone put "0:00 intro" in the description. would've been lost without it, thanks

Mark @19:14 - "It's good, it's acceptable, it's not worse" and then finally "I could edit with this". I'm wondering where it would have ended up if he kept talking.

Jake: "There's a bunch of hard drives in there, stop slapping it!" Linus: "Who owns it?" Jake: "..."

I love how giggly Jake got whenever the speed of the drives was mentioned. It's a great feeling having the coolness of something that you like acknowledged like that.

4:11 the way you flip the screwdriver is epic

I miss this style of video. this felt like a true to old LTT video

Aww, I've been eagerly waiting for the "LTT switches to daily driving Linux" challenge and first I thought this was the video 😅

Well done LTT, your content is always fresh, entertainmenting and educational. You have built quite the team.

2:38 Linus never stopped dropping stuff, he just got better at catching 😂

I used to work for a certain cinema sound company. We were setting up a real time rendering cluster for digital cinema. What we found is that by moving from SMB to NFS we got greater throughput. We also hit the same caching issue with Windows. Linux was used as we could not solve that issue. Also, the read/write latency of SMB is around 40% worse than NFS. Not sure that would make a difference in your use case. But would make a worthwhile test.

I literally Love when Linus even feels like he can't fix it so he just yells " JAKEEEEE " Makes my day hahaha

I had a ton of fun watching this and thanks to watching for years I know exactly what is going on. I feel awesome!

Well done - I woke up to that conclusion 15 years ago, and have been exclusively running Linux since then!

The heroic effort of making Linus audible over those servers also i love how long this "newnew whonnock/whonnock 3" thing has been going on good god what is that hat ed

I remember watching LTT after school back when the storage "server" was in the bathroom -_-

i enjoy the server videos a ton like some of the other viewers. not a storage or networking geek but i love seeing that side of the operation

7:51 hey Linus. This is called a software RAID. Linux and FreeBSD are very well familiar with installing themselves sans the /boot partition on those. I thought you should know that the only downside of RAID is that RAID is always vendor-specific, no matter if your SATA/SAS controller offers quasi-hardware RAID, or you got a real hardware RAID, or software-defined RAID as with ZFS, btrfs or mdadm. No matter which way you go, when you migrate to a new RAID, you must make sure that the computer that migrates the data supports both types of RAIDs. Bare HDDs have vendor-specific headers written to them so that they actually are recognized by their RAID controller as members of an array. It's not something to worry about for tomorrow or even next year, but 10 years from now you might want to know that kind of stuff! I'm glad to see your presentation improved. Please keep up the good work.

16:51 I love how Mark organises his icons on the vertical display

Linus secretly praying that the CPU isn't enough so he can put a 64 core CPU in his home NAS

Congrats on moving to the best solution. We used to have softraid and hardraid solutions here, including Windows dynamic disks. But once you go ZFS, you never go back.

08:50 - "[Jake] There's a bunch of hard drives under there, stop slapping it" - Well that is technically not true 😅

I like how I use to feel bad for Linus when Jake first started showing up in video, but now Jake is the mature one. LOL I love LTT

10:15 Word files (at least new ones in the docx format) are actually just zip files, so they probably wouldn't compress either.

Good for you welcome to Linux you will enjoy the community. Great people ready and willing to help.

This was the funniest LTT that I have watched in a while! Jake was the perfect "straight man" (meaning deadpan NOT preference) and Linus being Linus. very entertaining and informative!

"Is our one and only production network editing server." That had the network engineer in me internally screaming about a single point of failure in the prod environment.

“Let’s just give it a sec here” *Server turns into a 737 Max*

I think on storage spaces you should have dedicated a few drives to write-back cache. Then Windows will write directly to these drives without having to worry about parity, then it can get flushed out to the big pool over time.

I love these style of videos; just fun to watch

I love when Linus makes a joke and he waits for a reaction. Nobody gives him one.

For optimal ssd performance you want ashift size * (number of drives - parity) to be as close as possible to your record size or could be multiplied to be close to the record size evenly. This decreases fragmentation and pushes to disk faster. For nvme pools this is hugely helpful. Don't forget to figure out your ashift properly and set it correctly. This is a huge performance suck in systems like this. I spent a fair amount of time testing 10x nvme systems on zfs for VM workloads.

@Linus Tech Tips - set the network cards to jumbo frames and make sure any and all switches you have can handle them. Then set workstations to jumbo frames

This is my favorite video you've posted. Glad to see you branching out from Windows.

Back in the dark ages when I was getting my CS degree there was a “computer room” on campus that held 2 IBM mainframes. Only one was in use. I asked why and they said the other one was dropped bringing it in.

"Our chunks are pretty big." Jake might have not gotten it, Linus, but I did, and I chuckled.

Listening to this half asleep when Jake says "We have to make a data set." My mind heard him say "We have to make a Datasette." (The "Datasette: was the tape drive used with early VIC 20 and C64 computers...) Oh wow, everything that's old is new again. Starts making me wonder how long many years it would take to load a 1 MB file from the good old Commodore tape drive. Hey, I got laugh out of it. :p

Agree with WSS and RAM cache. When I was using 8 HDDs in parity mode it always consumed a lot of RAM and after few minutes write speed drops a lot. But for some unknown reason when I added 4 additional HDD drives in this pool that cache thing went away.

The next Whonnok will be Whonnok One. Electronics companies have taught me how to count.

Well, you know the old saying: "The screens are always bluer on your side."

So cool! We love your content! 😄

I grew up in Whonnock. Really neat to see a server name constantly revived that reflects where I grew up.

10:48 "Yeah because why would you want things to just work immediately" Well, they do, but it means you rely on someone else's best guess of what settings should be instead of, you know, properly tuning the one storage server that your whole business depends on for best performance.

These types of videos are my favorite on LTT! The loose banter, brain-mashing, and interesting topics are all great.

I love TrueNas Im using this now for like seven months and I really love it. My server is waaaaaaay slower than this but I have built it from whatever parts I had + 2U server box...8bay 3,5 drives 24TB but it works.

I like this channel so much because I learn something new everytime.

I can't believe how many people work their editing videos that are all about the equipment they use to edit the videos. It's like a self-fulfilling prophecy

The first thing I was gonna ask is "why not BSD?" Ended up being BSD I love that.

Jesus I haven't watched an LTT video in quite a few months and the moment I click on the first one Linus almost drops something. Legendary

Idk if you guys have already done this, but could you do a video in depth about server motherboards, CPUs, ram, memory, and power supply components / specs for looking for server grade components for a small home or office server? It might be a little niche for a video, but I've been a bit fascinated by it but the info I've found has been a bit vague and hard to find when it comes to choosing server motherboards and other components.

2:35 that's some fast preemptive reflexes there, Not to jab on Linus but it's probably from experience

5:22 Honestly, two things, but TL;DR FreeBSD has my respect just as much as anything Linux-based 1. always use the right tool for the job. Linux-based operating systems tend to be pretty good (at least, more often than Windows), but that's not strictly guaranteed. 2. FreeBSD (and anything derived therefrom) is a sensible choice. Makes some design decisions that make it comparable to Linux if not better, plus ZFS is a native FreeBSD project so it'll always be a pretty good match. Heck, it has a built-in Linux binary compatibility layer (plus solid virtualization support). When my Framework gets here, I might switch to it. (Currently on Gentoo - basically a BSD-style OS but with Linux for a kernel - for the better driver support on my existing systems.) Heck, most Linux users will probably respect FreeBSD.

You cracked me up on this one, great video

LTT Folks - Mirrored VDEV's would likely yield a dramatic increase in iops compared to RAIDZ, of course you guys would have far less usable space but the performance would most likely be substantially better than what you are seeing with RAIDZ. Either way, nice setup.

16:35 Linus' dropping powers have become so strong that he doesn't even have to touch the stuff anymore.

Linus talking to the editors about pretending to edit... everything from his awkward cool boss jokes to the cinematography was just The Office...

Hey Linus, you know they make armored fiber. I am sure you knew this. But some thing you may not have know is a company name Fiber store or FS for sort. Nice thing is the custom sizes and it is cheap. it saved me from have to put in conduit with all my runs. Also the added cost per run. I though to my self there has to be a better way to do this! Aka Armor fiber cable. I know they have OM4 And OM5 depending on your needs.

Linus: “I can’t understand why these servers don’t work while tinkering with them.” Also Linus: *proceeds to not use proper power cycling on their server.”

14:10 - one of the only times I noticed high queue depth from a "consumer" application was actually running DOOM 2016 and Eternal via proton on Linux. Level loading had an average queue depth of ~30.

I thought this is going to be about Linus completely switched to Linux after the challenge.

Yep, you definitely did IT properly! I had NO idea what you guys were talking about! LOL!

Love the videos. Jake Tech Tips on this one though. I have a plex server set up on a dock- eventually would like to get a nas set up- but I don't really have Media or work with Media like these guys do. How many editors are there- and how many videos aren't released that are coming! Looks like a lootttttt of Media coming our way. Great Video. Glad to see more folks getting away from the World of Windows. OpenSource is the way.

"there's a bunch of hard drives under there. stop slapping it!" lmfao literally kept rewinding it over and over again. thank you for the laugh

Will Linus ever have a server that runs exactly the way he intended? Find out next time on new new new new new whonnock.

Hi Linus, how are you? Thanks for all videos you've shared over the years (Think I've watched most of them) :) Don't get me wrong, I like Linux and I'm running a mixed environment of several hundreds of servers (running mostly Windows). I've never had those problems that you seem to experience :)

...hm makes perfect sense. Also I like the graffity walls! Would like to see more of that!

I really love to see Jake advance from his beginning at LTT to now. You have become a well prepared and wise man, learned alot about server tech. It seems you follow Anthony's presenting style and its lovely! Keep it up :)

It's always the same in this kind of videos, Linus and his team work very hard to improve the server, they do it, they test it, they see measurable improvements, they deploy it, they ask their editors, their editors: "Is not worst, I can work with this."

You need to setup storage spaces with custom colums to get the write speeds where you want depending on the mods you want to use...

Thumbs up, good approach and nice summary of your setup! IMHO favoring the BSD based implementation in TrueNAS was a good choice as well, the implementation seems a bit more sturdy. You might want to check your disk layout, in terms of disk's sector sizes and matching stripe sizes. This is about data alignment on the disks and avoiding multiple sector-writes, which can impact the write speed and also disk space. Generally, you want ti make sure the data disks' sector sizes fit into a standard 128KB block. Example: RaidZ2 with 6 disks (= 4 data disks + 2 parity so to say), you calculate 128kB block size by 4 disks and get 32kB per disk, which can be cleanly divided by the disks' sector size of 4kB (for modern drives). So that setup would fit optimal, a stripe is evenly divided across all disks without any half sectors being used. Regarding your fairly low CPU usage .. your CPU is probably a bit overkill for the application, as ZFS has been developed with CPU load in scope. They use pretty blazingly fast hash algorithms, so your setup could possibly be able to catch even higher workloads in case you plan to add another disk shelf. (And don't slap the shelf, he's right .. google for "shouting in the datacenter" and be amazed ;) ) Do you run the pool with spinning disks or on all-flash drives? You talked about trim parameters, so you probably have SSDs in place. If you use spinning disks for "cheap" capacity, you might want to consider adding a (mirrored! you don't want to lose the data!) SSD as ZIL (ZFS intent log, it's basically acting like a write cache and journal) to your zpool. This gives the FS a bit more space to breathe. You can also take a look at "l2arc" (layer 2 adaptive replacement cache = the ZFS read cache) but i assume with your disks you probably don't need it. Just do yourself a favor and keep the allocation below 80% .. you might start to face increasingly serious degradation if you overshoot that border more and more, so keep that in mind and keep a close monitoring on that value. Do you use zfs techniques for snapshots and data replication? Feel free to ping me if you need some more info on ZFS!

"As you can see it's not the weekend" *Meanwhile it's Sunday here*

Very big brained move doing stuff like this onprem at LMG, since you get to make content about stuff you're gonna do already. Good vid. Great to see some BSD stuff and realistic IT-related content.

it takes a man of integrity to admit his mistakes and change course. hats of , Linus. We Dutch have a saying : Beter ten halve gekeerd dan ten hele gedwaald".

This is the first LTT I've watched in years.