Level1: We bootstrapped our own ZFS storage server: 172tb, extremely low cost

Рет қаралды 378,048

7 жыл бұрын

Be sure to check out the companion article at the Level1 site. More details than we could ever fit into a video!
level1techs.com/video/level1-...
Is anything unclear? or weird? Let us know -- We may use this as a jumping off point for many videos in the future. We want to do several videos on this, including videos for the linux channel, but we want your feedback on what to cover first. There are so many jumping-off points we could cover in this video.
"A day in the life of a system architect."
*1640: Correction, meant ZFS at its core, not FreeNAS. LOL.
**********************************
Thanks for watching our videos! If you want more, check us out online at the following places:
+ Website: level1techs.com/
+ Forums: forum.level1techs.com/
+ Store: store.level1techs.com/
+ Patreon: / level1
+ L1 Twitter: / level1techs
+ L1 Facebook: / level1techs
+ Wendell Twitter: / tekwendell
+ Ryan Twitter: / pgpryan
+ Krista Twitter: / kreestuh
+ Business Inquiries/Brand Integrations: Queries@level1techs.com
IMPORTANT Any email lacking “level1techs.com” should be ignored and immediately reported to Queries@level1techs.com.
-----------------------------------------------------------------------------------------------------------
Intro and Outro Music By: Kevin MacLeod (incompetech.com)
Licensed under Creative Commons: By Attribution 3.0 License
creativecommons.org/licenses/b...

Пікірлер: 604

@spacejaga 7 жыл бұрын

god those mini-movies are just on the edge of being most cringeworthy things ever and yet somehow they manage to be funny...

@myselfremade 7 жыл бұрын

Its the uncanny valley of good content/production value.

@Teknickel_ftw 5 жыл бұрын

still better than cable tv

@thingyee1118 7 жыл бұрын

I love that SOS with your eye lids.

@pedanticat5830 7 жыл бұрын

It wouldn't be the first time he's done that, lol

@00101001000000110011 7 жыл бұрын

that really hit the homerun xD

@YanDoroshenko 7 жыл бұрын

That horror sequence was MAGNIFICENT.

@imreloadin 7 жыл бұрын

I can honestly say this is the one tech channel that I'm actually excited about when I see it pop up in my subscription box! Keep up the great work guys!

@SirCrest 7 жыл бұрын

Now THIS is the kind of content I've been hoping for from you guys. Can't wait for more server stuff like this.

@SgtSayWhat 7 жыл бұрын

I understood about 7% of this, still watched it all though

@thetruthhurts2352 7 жыл бұрын

@kylerjohnson1934 7 жыл бұрын

Oh my gosh. The content is just too good on this channel!!! The perfect amount of proper useful nerdy tech, and absolutely hilarious execution. You guys are doing an amazing job. Thank you so much for the content!

@MaelosV 4 жыл бұрын

Thank you for this. I'm getting back into my own lab and this is helping me get back off the ground. I look forward to seeing more of your work and steering people your way.

@scruball1375 7 жыл бұрын

That wall had like whole of my KZfaq subscription box.

@randomtvninja 7 жыл бұрын

"if you can stick with me" are you kidding I've been waiting for heavy videos like this for a long time! I want full hour videos about all of this I need it!!!

@tkojabroni2833 7 жыл бұрын

Y'alls acting is up there with the likes of William Shatner and Ben Heckendorn

@EposVox 7 жыл бұрын

Good shit, guys. I wish I had a full server rack to work on. Good deals on bays right now.

@wilsonthesphere 7 жыл бұрын

Loved this more technical video I didn't except variety so soon. Also the skit was great and made the pace of this 20 min video seem like is was a 5 minute video. You guys are doing GREAT!!! Keep them coming.

@YumzHD 7 жыл бұрын

Loved the episode Wendell, keep it up the channel has been amazing since launch. Best of luck.

@goldbrick2751 7 жыл бұрын

You guys are freaking awesome!!! Hell yes, Gotta LOVE Krista. All the best. Can wait to see more of this.

@andreijecu765 7 жыл бұрын

The SOS in morse code Wendell is doing at the end of the video got me good,killer Krista strikes again. Excellent video,the way you combine useful knowledge with bits is amazing. Than you for this!!!!!!!!!

@aarongarza4769 6 жыл бұрын

I always love watching Level 1. You all are great. Keep it up.

@mathiswellmann6858 7 жыл бұрын

This Episode was AMAZING!!! I love the backstory and the stuff around the main topic. Very creative

@tachmonite37 7 жыл бұрын

Level 1 shows are just awesome. I love their humor and dialogue...and the information of course. great job guys. i cant get enough...

@daviddupoise6443 7 жыл бұрын

This. This right here. All day everyday. I love this well thoughtout content. It's not the sexiest most expensive hardware but instead it is the smart solution.

@ibonitog 5 жыл бұрын

Sometimes I come back to this video just for the sketches - and it's worth it every time!

@thatsux0rz 7 жыл бұрын

I love you guys. Love all the videos so far!

@GNARGNARHEAD 3 жыл бұрын

LOL!.. whoa, those heatsinks... it's amazing how far Krista has come from being on the news, a little socialization can work wonders

@jorambahler8799 7 жыл бұрын

That was really interesting stuff Wendell... glad you are up again with a fresh new team...

@post-leftluddite 6 жыл бұрын

I would LOVE to see many more videos like this, specifically dealing with Networked Storage, raid arrays and enterprise hardware

@blackfireburn 7 жыл бұрын

fav episode, i've been waiting for that for a while. good job keep it up :D

@oscargarciahinde4247 7 жыл бұрын

Guys, you're nailing it! keep up the great work!

@hivijay999 7 жыл бұрын

This was fantastic. I would love to see more videos like these showcasing server stuff. Maybe show us how to build a build server or something DevOps related?

@ScullyBrewing 7 жыл бұрын

These are the types of videos I love, as a systems admin student in college, this is my jam

@martyhastings9347 7 жыл бұрын

i am giving a lot of thought to building something like that for my family (maybe not so big). recently my hard drive failure was a failure that i have heard about but have never seen. a platter broke apart. not sure if it was caused by a head crash or not. Anyway.............after i told my wife we lost lots of pics .......lets just say i think my wife and Krista must have grown up together. i will be watching this video a few more times and looking forward to more of the same type in the future. thanks guys.

@77chrisray 7 жыл бұрын

Huge fan Wendell. Thanks for all the help for us non computer science guys. You are awesome!!

@rogerg0834 6 жыл бұрын

I have to admit..when he said having a barebone Windows image on the network ready to install...that REALLY peaked my interest. We have it at work and I must say it is really cool to do. Just boot off the network and bam..starts the install...major nerd coolness!!

@scooter4196 7 жыл бұрын

Love your videos. Very technical and very precise. Thank you!

@Banner1986 2 жыл бұрын

I'd forgotten how long ago the LSI 8880 EM2 came out... Your video just reminded me of the days when the 1078 ROC controller was taking the storage world by storm right as I was coming into the storage world, working with the field engineering team over there - not to mention the 6Gb first release, where you had everything from ZFS developers at sun working with 600 disks attached, down to the guy in his basement trying to get a new speed record with OCZs drives lol Thanks for the blast from the past Wendell!!

@johanneskaramossov5103 Жыл бұрын

awesome to see this, I only have some hobby projects myself using old enterprise hardware that i got cheap.. actually for my own experiments considering enterprises tend to dispose of them instead reselling them getting enough storage at a decent prize is my main issue(closely followed by finding the right finstacks/coolers for the cpu's in 2U and 1U racks that i can buy used).. really helps me understand the concept without needing to get all the stuff myself

@AngateWier 7 жыл бұрын

Thank you for this. I would love to see more in depth videos about the VMs and use case for this machine!

@ringlord13 7 жыл бұрын

I'm not sure that I've ever commented on any KZfaq video, but this was a seriously excellent blend of the high level project with hilarious cheesey nerd humor. Well done, +1 for fantastic entertainment!

@chrisbay8578 7 жыл бұрын

I do love it when TechTubers do overkill builds just for the heck of it :D Next time, i dare you to do a 20 GPU server, just to show Linus and his measly 10 GPU rendering machine who's the ballers now :D

@Level1Techs 7 жыл бұрын

thats the great thing, we spent practically nothing on this and it is still overkill! And, obviously, not sponsored at all. ;) It is GREAT, and made from trash that we have show how/where we get it in other videos. In total we spent only a few thousand dollars on this for everything.

@chrisbay8578 7 жыл бұрын

" we spent practically nothing.... .... In total we spent only a few thousand dollars on this for everything." I think you and i have different opinions how much "practically nothing" is :P

@brixhodl4765 7 жыл бұрын

You can buy a 01-02 V12 Mercedes CL600 for around $10,000. That is less than %10 of what it retailed for. Do I think $10,000 is a small amount of money in and of itself.... No. That said, If I was able to acquire a functional used luxury sports car for 90% off, I would still consider that practically nothing given the context. You could build a 172TB ZFS for kicks, but chances are there is a necessity for it, so like Wendell said, I took this video as kind of a hypothetical system architect type build. You could play with file systems/RAID arrays/bootstrapping,etc with much less storage.

@TheDiamondGames 7 жыл бұрын

It actually is practically nothing for 170TB of storage. You would spend around $6000 for the desktop class hard drives if you put them in a raid 0 array. One shelf would be overkill for many. Even 6 hard drives can be enough for the majority. After all, you should think what do you need this thing for and how much space you need.

@ChrisD4335 7 жыл бұрын

I wish I was at a point in my life I could say oh this is made of trash, it only cost thousands of dollars and mean it seriously. #lifegoals

@charleslowery9808 7 жыл бұрын

OMFG the skit with Kreestuh at the end, amazing, and your storage array is surely the envy of much bigger youtubers, even LMG would be jelly.

@grassyclimer6853 7 жыл бұрын

the file transfer is coming from inside the house!!

@CriticoolHit 4 жыл бұрын

::heavy data transfer sounds::

@eirajoao 7 жыл бұрын

It's for things like these that I subscribe to you guys. You might have just won yourself a new Patreon backer as I don't want you to stop doing this. Keep up doing videos that are way above my head and, therefore, are amazing.

@gorudonu 7 жыл бұрын

Really nice video. I liked examples you gave about usage. Please keep going!

@peterl4190 7 жыл бұрын

You guys are awesome :p seriously the best tech channel in youtube. Keep it up!

@mpar 7 жыл бұрын

11/10 educational entertainment. Level1 pgp cross over contexts. Cross channel tie ins. Great ground floor for building and tangenting content on. Keep up the great work.

@ipushpeople7221 7 жыл бұрын

Wow, an informative, technical, intelligent and funny video. I'm always cool with the first 3. But adding the funny parts will be great for the channel growth, congratulations and !praise

@solitude335 7 жыл бұрын

love the hacker typer in the background lol

@djsensacion7 7 жыл бұрын

He's watching the Internet...

@antfry256 7 жыл бұрын

Love the ending bit, Better start adding shelves. haha

@christoffer4017 7 жыл бұрын

I'd love to see a follow up video on this, going into detail as to how it is done in practicality. It's all very fine with talking about it, but showing how it's done also helps in educating!

@Aint1S 7 жыл бұрын

Really excellent video, the best thing that TEK Syndicate ever did was to have the 🍺🍺liver🍺🍺 forcefully separate from the 🍸brain💻! This channel is like that new email account you created years ago without all of the unnecessary SPAM in-between the messages.

@reallunacy 7 жыл бұрын

This was fantastic. Question though, did Krista kill the other guy?

@MichaelLindman 7 жыл бұрын

What? Gwendell killed Twendell?

@iboysven 7 жыл бұрын

They will just clone a new Twendell

@Level1Techs 7 жыл бұрын

Nothing a tetanus shot won't cure. Plus wendell got to ride the rack like a skateboard.

@MrSephkeene 7 жыл бұрын

That was the best part of the video!

@sykoteddy 2 жыл бұрын

I can see the quality of the videos and studio has evolved a lot since 2017 :) But as neardy as always! I found you through LTT :)

@1n50mn1ac 5 жыл бұрын

Can't say that I understood much of what you said but you do sound like a really smart guy!

@ryanbester7990 Жыл бұрын

The end scene was like a game... so cool. Also maybe put it near the beginning as a prelude for what is still to come haha

@helchez 7 жыл бұрын

Please don't stop. Love the humor.

@OhItsMulligan 7 жыл бұрын

17:46 onward is LITERALLY GOLD. The sticky notes, the SOS from Wendell. 11/10

@ryPish 7 жыл бұрын

This is all I need in a video, the tech knowledge, the humour, the cringe, all the things in just the right balance!

@MaelosV 4 жыл бұрын

Thank you guys for this.

@Nimitz_oceo 2 жыл бұрын

This is some next level stuff! Level1 makes Linus tech tips look like a truck stop

@davidg4512 7 жыл бұрын

heck yeah, been waiting for this video

@guillermo.gonzalez 7 жыл бұрын

It'd be good to see some more detailed videos on the hardware setup and its parts and also on the ZFS tuning and why. For example, interested in see how you set up the multipath and the HBAs. Also, ZFS tuning that you mention on the article. Fantastic video BTW!

@jokinboken 7 жыл бұрын

We always knew who was in charge! :-)

@chrisfenton1421 7 жыл бұрын

I would love to see a video when you come up with a virtual-to-physical imaging workflow. Great work!

@txgamer1347 7 жыл бұрын

I remember working on those PER710 Google servers at a Dell facility in Austin. Google required FLAWLESS paint and chassis, and would reject entire servers if there was one chip in the paint. They were also some of the most expensive configurations we worked out outside of the PEC Cloud series servers.

@ldsudduthhanover 7 жыл бұрын

I am literally rolling on the floor at that outro..blinking SOS...Ryan is a Clone..the KZfaqr pictures, including Barnacules..... And I learned something.. Yippee!!!

@breadtoucher 7 жыл бұрын

@johnclark8542 7 жыл бұрын

I think I just scorched my shorts. I

@TrueRegulators 7 жыл бұрын

I have only watched the intro until this moment. Thumbs up!

@MrBiky 7 жыл бұрын

Linus - Super popular, but Canadian. Barnacles - no notes. I don't know the top guy. Paul - Real chill, has cute dogs. Qain - Friend of Wendell, actually ??? elite. Kyle - A true BitWit Jayz - no notes. Jennifer - No girls on the Internet. Ryan = clone. Holy smoke, that's some creepy, but true details.

@AKAMustang 7 жыл бұрын

"Top Guy" is TimmyTechTV Qain's note says "Actually enjoys Elite", presumably referring to Elite Dangerous

@scz0 5 жыл бұрын

whose jennifer?

@N1CH0LAS12 7 жыл бұрын

Welcome to the club of more storage than brains club. I'm sitting here with 130TB redundant usable space :-)

@NickMach007 7 жыл бұрын

this was awesome. informative and definitely entertaining!

@frosty9392 4 жыл бұрын

aww, look how young and yellow they are!

@DonalTechTips 7 жыл бұрын

Great video guys!

@nadpro16 7 жыл бұрын

This is excellent, this is almost exactly what I have done with my personal file server at home. It is currently up to 60Tb with much more room to grow. It is nice to know that I think the same way in my designs. Now if only I could find a way to make money off it to. Because this is not cheap as a hobby.

@HOLLOWKILLER514 7 жыл бұрын

This is so great.

@UndeaKnight 7 жыл бұрын

😂😂 I love your intros and outros 😂😂 they're the best!! 😂😂

@cmusic52 7 жыл бұрын

I swear with the antics I'm just dying for a LOVE button here youtube!!! Ssssoooo Hilarious and Awesome!!!

@FeanorOmega 7 жыл бұрын

Love you guys and girl - keep up the great work =)

@ezforsaken 7 жыл бұрын

"really popular, but canadian" Sorry linus

@AdamJee923 7 жыл бұрын

Wow the level of acting 'scene' here in this video is breath taking lol awesome guys very entertaining

@williamwazere 7 жыл бұрын

Hahaha nice skit to wrap it up. The blinking. Great video anyway too, brilliant you lot can have fun and deliver interesting tech content.

@larrykozlowski6305 7 жыл бұрын

I work for a LAN center during the summer and setup a Docker nginx cache using ZFS for all of the different CDN's for games about 5 months back. Think it was around 80TB for Steam/Origin/UPlay/BNet and another 10TB to cache media files from Netflix/KZfaq/Facebook with a FiFo setup for when data starts getting full. It was actually a beautiful system when it was up and running and saved on a lot of bandwidth and also allowed us to let people download their games instead of being limited to the preloaded ones because we had that extra bandwidth headroom. I also setup a similar setup at home for caching my media and games just on a much smaller scale (5TB) and its actually pretty nice when you consider most of the people in my house will rewatch the same TV shows or Movies on Netflix, will download the same windows updates, and we all play the same games. Now instead of the 3 of us downloading a game 3 times, its just the one time. It is so nice lol.

@neoskribe8986 7 жыл бұрын

best ending ever.

@tamask 4 жыл бұрын

First I thought you were the same person, and I wondered how you could make the conversation so well in sync. Then I realized there really are two of you :D

@praecorloth 7 жыл бұрын

Loving this video, can't wait to see a followup to it. Though I'm surprised to hear that ZFS is supposedly "bad" at handling IO for virtual machines. I've been running VMs on a pool of mirrors for years now. The only performance issue I've run into was when I switched from iSCSI to NFS. NFS, like CIFS/SMB, is terrible at tiny IO, and modern operating systems are loaded with tiny IO. Switching back to iSCSI was a nobrainer, and the VM performance is very smooth again. One of the things I did do, however, was disable atime. For VMs, it just doesn't make a whole lot of sense, so those operations end up being wasteful.

@tasha1982ify 7 жыл бұрын

love that star trek talk - fun video und i learned alot - thx guys!

@Justin-nx5ou 6 жыл бұрын

That was great!!! Keep it up!!

@BloomerzUK 7 жыл бұрын

Awesome video guys. I'd love to see a video about UPSs and automated shutdowns.

@cataria3903 7 жыл бұрын

omg the moment u realize the background on the levelonetechs site is interactive :o omg how do i get this gravity star super cool thing as fullscreen maxed out or as an application? what a beautiful distraction!

@cataria3903 7 жыл бұрын

only pity is that scrolling down makes the new star that gets created go off the screen :( not be created at mouseclick...

@Level1Techs 7 жыл бұрын

bug fixed :)

@onkz 7 жыл бұрын

Wonderful, you're very fast at fixing bugs!

@cataria3903 7 жыл бұрын

hm bug is still there. on firefox 64 bit, 50.1.0, multiprocess windows forced on, if that matters for it.

@Jobucko 7 жыл бұрын

nodegarden.js.org/

@aarcaneorg 6 жыл бұрын

I'm already subscribed, but I ain't gonna like or favourite until Krista does something about it!

@SidTheGeek 7 жыл бұрын

You guys have a nice tech channel that i just subscribed. :)

@MrFocus 6 жыл бұрын

nice video palz we need to see more THANKS

@monolel 7 жыл бұрын

A great way of ease a very technical video... it reminds me AVGN type of producction.

@pcsecuritychannel 7 жыл бұрын

Outro: Twendell was cloned to perform such dangerous tasks! :D

@NathanDavis2 7 жыл бұрын

4:33 holy $$$$ that transfer speed. I can only dream

@tim9735 7 жыл бұрын

did wendell blink sos at the end?

@TommyThousandFaces 7 жыл бұрын

Yeah, he totally did!

@lukehouge9776 7 жыл бұрын

I think an awesome video would be about backups, how you do them, what you recommend etc. Like in the enterprise channel you talked about snapshots, and stuff like that. Thanks!

@michaelbyrd4004 5 жыл бұрын

I thought I wanted to be a tech. Level 1 lets me know that I've got a long way to go. Maybe I'll just stick to gardening. Great video!

@Azivegu 7 жыл бұрын

alright, if Ryan isn't in the next video then I'll be worried

@bingliu2932 6 жыл бұрын

It's ok, they can clone a new one.

@NoNamenoonehere 6 жыл бұрын

Krista Evil Genius page says we are currently on Ryan 4.6. due to fact Ryan keeps finding the secret lair.Wendell tho is original as he has been supplying Krista with Unlimited storage.