I predicted the future! - GRAID Graphics Accelerated Storage
Рет қаралды 2,188,362
2 жыл бұрынGet Canada's fastest internet tech with TELUS at /www.telus.com/purefibrex
Learn more about Kioxia and the BG5 Series at lmg.gg/BG5
NVMe storage is blisteringly fast but has lacked a high-performing RAID solution for a long time. Today that may be changing with GRAID's new SupremeRAID GPU accelerated NVMe RAID solution that promises to deliver over 100GB/s of sequential read performance with next to no CPU usage. Let's see if it's up to snuff.
Discuss on the forum: linustechtips.com/topic/14202...
Check out the Gigabyte R282-Z9G GRAID Rack Server: lmg.gg/Ekjzn
Check out the Micron DDR4 ECC Memory: lmg.gg/wDOjn
Check out the AMD EPYC™ 75F3 Processor: lmg.gg/d262f
Check out the Liqid Element LQD3000 PCIe SSD: lmg.gg/BDstx
Purchases made through some store links may provide some compensation to Linus Media Group.
► GET MERCH: lttstore.com
► AFFILIATES, SPONSORS & REFERRALS: lmg.gg/sponsors
► PODCAST GEAR: lmg.gg/podcastgear
► SUPPORT US ON FLOATPLANE: www.floatplane.com/
FOLLOW US ELSEWHERE
---------------------------------------------------
Twitter: / linustech
Facebook: / linustech
Instagram: / linustech
TikTok: / linustech
Twitch: / linustech
MUSIC CREDIT
---------------------------------------------------
Intro: Laszlo - Supernova
Video Link: • [Electro] - Laszlo - S...
iTunes Download Link: itunes.apple.com/us/album/sup...
Artist Link: / laszlomusic
Outro: Approaching Nirvana - Sugar High
Video Link: • Sugar High - Approachi...
Listen on Spotify: spoti.fi/UxWkUw
Artist Link: / approachingnirvana
Intro animation by MBarek Abdelwassaa / mbarek_abdel
Monitor And Keyboard by vadimmihalkevich / CC BY 4.0 geni.us/PgGWp
Mechanical RGB Keyboard by BigBrotherECE / CC BY 4.0 geni.us/mj6pHk4
Mouse Gamer free Model By Oscar Creativo / CC BY 4.0 geni.us/Ps3XfE
CHAPTERS
---------------------------------------------------
0:00 Intro
@LinusTechTips 2 жыл бұрын
Small note for around 8:34: The pieces of data striped across the array in a RAID0 configuration are typically a power of 2 bytes, not individual bits. A common strip size (the piece of data put onto each drive in a stripe) is 16KB, but you can usually adjust it to be bigger or smaller depending on your use case.
@StaticZXC 2 жыл бұрын
First, love you LTT
@fireballfurby 2 жыл бұрын
Ok
@astronemir 2 жыл бұрын
Now how am I supposed to “Well Achtually” correct people in the comments??
@ItsQualitycontent 2 жыл бұрын
I have to know. Does he actually accidentally drop stuff or does he do it for show these days
@Skibidi_Fortnite11 2 жыл бұрын
Were is scrapyard wars
@snazzy 2 жыл бұрын
I want to believe Linus dropping stuff is a bit now, but deep down, I know it’s real.
@Gryever12 2 жыл бұрын
seriously lol.
@andrew6239 2 жыл бұрын
Jesus Christ please stop the cringe
@zackthompson9914 2 жыл бұрын
Honestly it's both
@ulmekuubis 2 жыл бұрын
Linus is just like me -> clumsy 😆
@cleanlens 2 жыл бұрын
linus is a bit energetic
@thedorkequine7517 2 жыл бұрын
Linus almost dropping it in the first two minutes, just classic.
@user-nt5pl3zn4u 2 жыл бұрын
more like first 30 seconds. It's Linus we're talking about.
@lucassadik 2 жыл бұрын
lol linus is what we're talking about now?
@Starvexx 2 жыл бұрын
Just business as usual
@karehaqt 2 жыл бұрын
Linus has worse hand/eye coordination than my grandma who has Parkinsons.
@TennSeven 2 жыл бұрын
Linus dropping things and his lame segues into into sponsor and LTT Store shilling. Name a more iconic duo.
@maxvaessen 2 жыл бұрын
The vibe you guys were in during the filming of this episode made it really enjoying to watch. more of this!
@leon11235 2 жыл бұрын
Why you're confused with RAID5 results? Here's some points to consider. 1. To calculate parity it's required to send data to and from GPU, or calculate with CPU. It's a possible bottleneck. 2. Was our array in optimal state before tests? It should calculate parity data(process called build/rebuild/resync) before going to optimal state. That can limit performance too, and it explains 100% GPU usage without host I/O.
@montecrysto33 2 жыл бұрын
Fun facts: RAID originally meant "Redundant Array of Inexpensive Disks", but "inexpensive" didn't sell as well as "independant"
@Kamel419 2 жыл бұрын
I've never heard the "independent" variant until now. I'm quite sure this is another case of enough people saying it wrong that they began accepting both. This was definitely a question on my A+ exam
@stacksmasherninja7266 2 жыл бұрын
I've never heard of inexpensive tbh
@Safetytrousers 2 жыл бұрын
The term "RAID" was invented by David Patterson, Garth A. Gibson, and Randy Katz at the University of California, Berkeley in 1987. In their June 1988 paper "A Case for Redundant Arrays of Inexpensive Disks (RAID)"...Industry manufacturers later redefined the RAID acronym to stand for "redundant array of independent disks" Wiki
@imadecoy. 2 жыл бұрын
And LTT messed it up by writing "Discs"
@alangarde2928 2 жыл бұрын
Thankyou! I had a moment where I doubted myself as I thought have I been saying it wrong all this time? Turns out I'm just old instead.
@DigitalJedi 2 жыл бұрын
GPU is going to start standing for "general processing unit" before long. They do physics, they do math and hashing, they do rendering and texture mapping, and now they are freaking hardware controllers too!
@ipanesm 2 жыл бұрын
You know what? Thats pretty cool
@tbuk8350 2 жыл бұрын
Yeah, like how GPUs being incredibly fast and having stupidly fast memory that the processor can directly access from less than an inch away happened to be perfect for running ML tasks at fast speeds.
@liam9393 2 жыл бұрын
Applications beyond graphics....now the language is "accelerator" as GPU seems outdated/limited usage.
@Klokopf52 2 жыл бұрын
That's kind of what Xeon Phi was for. Parallel processing taken to the max. I cast my vote for PPU
@ninabeer4959 2 жыл бұрын
for some reason i read harrasing and hashing...
@stevenclark2188 2 жыл бұрын
7:07 12v 7a, probably sounds like a fighter jet with the afterburners on, of COURSE it's made by Delta. Their little 60mm monsters and the sound they made is part of why we started getting 80mm and then 120mm CPU coolers.
@jrcowboy1099 2 жыл бұрын
HOLY... 84W?!?! WOW! It need a lot of that power to cool itself!
@ujiltromm7358 2 жыл бұрын
@@jrcowboy1099 It's not a piece of silicon which almost entirely dissipates its power input as waste heat. It's an electric motor showing an efficiency above 95%. Of those 84W, maybe 5 are converted to heat, the rest moves air. A LOT of air.
@jrcowboy1099 2 жыл бұрын
@@ujiltromm7358 Lol, yeah you're right, I guess I was apparently brain dead when I wrote that.
@moremaddness 2 жыл бұрын
I love these server tech videos! Keep them coming guys!!!
@bobbygetsbanned6049 2 жыл бұрын
As someone who works in enterprise tech, I enjoy these videos significantly more than 70+ slide power points from our engineers.
@thedude4840 2 жыл бұрын
Oh you poor soul. If there’s nothing corps love more than profit it’s PowerPoints.
@TheOriginalNCDV 2 жыл бұрын
I remember when a "T1000" was something else completely different. And deadly. But not good with extreme temperatures...
@Felipemelazzi 2 жыл бұрын
That's a nice Terminator reference you've got there👌
@nathanlowery1141 2 жыл бұрын
Wonder if sky net used these
@durururururururu 2 жыл бұрын
@@nathanlowery1141 Skynet is a LTE internet service provided by Skytel telecommunications company in Mongolia.
@muneshify 2 жыл бұрын
You just made me laugh harder than I should, office mates looking at me having a geek attack
@fajaradi1223 2 жыл бұрын
He'll be back
@lubu602 2 жыл бұрын
i love whenever you guys work on server stuff. just absolutely top-tier stuff
@bencove717 2 жыл бұрын
Love these videos, so cool!! Aslo explaining everything that is happening and how is fantastic, even if you don't really understand, linus and team will talk it through so it's understandable to everyone, great job 👍🏻
@wap300 2 жыл бұрын
Linus says "CPUs are fricking expensive" in 2022 while literally waving a GPU in his hand. The audacity
@RapidWildFire 2 жыл бұрын
Haha
@satakrionkryptomortis 2 жыл бұрын
we are all clear that he speaks about CPUs that are like 2 3090ti with enough money left to buy a descend car second hand.
@cyborgmike9210 2 жыл бұрын
@@satakrionkryptomortis yup. And licenses are significant in VM infrastructure cost measured per CPU core.
@sputnik13 2 жыл бұрын
Funny comment, but yeah enterprises pay way more for software licenses than for hardware, oracle, esxi, etc can easily become 100s of thousands or millions a year and are priced per socket or per core
@Vatharian 2 жыл бұрын
pair of Epyc 75F3 cost over $12k, pair of Xeon 8380HL will drain you of 28k Euro. And you still can't buy 5950X for less than a kidney - if you find one, that is. Edit: It may depend on use case, but usually RAM becomes the biggest money sink, unless you are fine with dropping 64 GB in a dual socket server.
@mkusanagi 2 жыл бұрын
These are my favorite types of videos on this channel. Crazy stuff, thanks
@franksinatra2530 2 жыл бұрын
Loved the more technical aspects of this video :D
@nathanfife2890 2 жыл бұрын
I like the videos where Jake does cool stuff and Linus just watches and reacts.
@Varangian_af_Scaniae 2 жыл бұрын
They have great on camera chemistry.
@Hopgop1 2 жыл бұрын
Killing the videos lately, been great content, love Alex and Jake's hosting/co-hosting.
@ShadowLinkxMaster 2 жыл бұрын
Did they recently stop using the intros though? I could’ve sworn I hadn’t seen it on another recent upload.
@scottyvan 2 жыл бұрын
Right? These two together are electric
@dumaneduard 2 жыл бұрын
These banter videos are the best videos :)
@emt56399 2 жыл бұрын
Im exited to see the next video on this. Very exciting results
@MasterJack2 2 жыл бұрын
Lately Jake has been very good on camera, he got a lot better since 1-2 years ago when he was no good at all, to the point when I remember Linus telling the viewers and i am paraphrasing "I promise Jake is very good at what he does". Now we see he is knowledgeable and he manages to be entertaining too.
@Shadowcast140 2 жыл бұрын
he would be even better on camera if he eliminated the pedostache
@TimmyTurner421 2 жыл бұрын
@@Shadowcast140 your momma loves it though
@DerrickRG 2 жыл бұрын
He's finally filling the role that Luke had on camera.
@Igorrr3k 2 жыл бұрын
I remember the "Jake needs a sack" phase but he's massively stepped up his game, it's amazing to see!
@tylernestor2431 2 жыл бұрын
I'd love to see him healthy!
@mazgazine1 2 жыл бұрын
Its really neat when they do tests on stuff for their studio, that they ACTUALLY USE. Like the investment in the stuff isn't wasted, and the reaction is genuine to the performance to the point they they would definitely use/not use a thing is nice.
@Hjorth87 2 жыл бұрын
I'm pretty sure they often have to return some of the more sophisticated nicknacks they show off. They directly talked about it when they played around with that petabyte of nvmes.
@fl4shbangz 2 жыл бұрын
Linus said on the WAN show they would have to return most of the stuff for this project
@rukia4473 2 жыл бұрын
Please read my name💕
@luijo633 2 жыл бұрын
Yeah, i know right? like when Linus was so happy with the Framework laptop that he fraking bought it on cammera lol
@Thehoeh 2 жыл бұрын
Looking good, Jake. Keep it up!
@m4ttendo 2 жыл бұрын
Love your videos I'm addicted to them love the t-shirt swap at 15:30 on timeline 🤣
@IsaacWH 2 жыл бұрын
30 secs in and Linus's already dropping the thing. Legend.
@bustex1 2 жыл бұрын
What?
@BillyBonesYT 2 жыл бұрын
@@bustex1 what do you mean "what?" just read it again
@bustex1 2 жыл бұрын
@@BillyBonesYT read it and watched the first 30 seconds five times. Happened at like 34 second mark not first 30 seconds. What.
@athe5217 2 жыл бұрын
He's just too good. Somebody stop this man
@bigo975 2 жыл бұрын
Clumsy=Linus
@tibr 2 жыл бұрын
I wonder if this would be possible to do with any GPU with custom firmware. Would be a cool purpose for spare GPUs...
@635574 2 жыл бұрын
In b4 nvidia makes this a software feature and obsoletes this thing. Probably doesn't even need to buy them to kill them.
@firefly2472 2 жыл бұрын
Spare gpu's. HOW DARE YOUUUUUUU
@doggo_woo 2 жыл бұрын
@@firefly2472 I'm sure they're talking about 10 year old cards
@firefly2472 2 жыл бұрын
@@doggo_woo I know :) Have a few myself. And no, not gonna sell them :p
@doggo_woo 2 жыл бұрын
@@firefly2472 Gotta collect em all lol
@hiltonvusi7483 2 жыл бұрын
I just bumped into one today and I can't believe that I am learning more about it today(all in the same day)
@Oriansenshi 2 жыл бұрын
I don't know any of the computing stuff that he was talking about in this episode, but I just enjoy watching linus get excited about stuff. It brightens my day.
@HapticNoise 2 жыл бұрын
Yeahhhh gonna need you guys to either spoof or secure a license for that big boy card to see what would happen. That would be insane lol
@guspaz 2 жыл бұрын
LTT: We just had a massive storage failure where data checksums were critical to recovery. Also LTT: Let's switch to this new RAID system that has no data checksums!
@88porpoise 2 жыл бұрын
Well the server that had the issues would have a completely different use case than this server. The failure was on a long term archival storage server using HDDs. This type of server would be used for short term storage of ongoing work on SSDs. So, what they are discussing here uses more reliable equipment in a situation where any error would almost certainly be detected extremely quickly and relies on high transfer speeds and much more expensive storage.
@konzo5942 2 жыл бұрын
this is block level only, so use a checksumming filesystem? a bit unfair to compare a filesystem to a raid only software.
@kommentator1157 2 жыл бұрын
@@konzo5942 The nice thing about zfs (and btrfs) is that they can detect corruption within raid pools and AUTOMATICALLY CORRECT it. That probably won't work with this setup as everything is exposed as one single drive. You will know something failed, but not which copy is correct and you won't be able to restore it.
@konzo5942 2 жыл бұрын
@@kommentator1157 a purely filesystem software that does checksumming is going to work to correct bit rot irrespective of the underlying hardware. Also it's less of an issue with SSDs which this is only going to be used for.
@Momi_V 2 жыл бұрын
@@konzo5942 not really. This solution (like most raid only systems) presents the pool as a single logical disk. The filesystem could do checksumming and tell you something is wrong, but I doesn't have the necessary information to correct it. This solution only uses the parity data if there is a read error, regardless of whether the data from a particular drive is correct, because the raid abstraction does not utilize checksumming. Wendel from L1 techs was able to corrupt the data easily during his tests (by inserting a discrepancy on one drive to simulate the random changes to the saved values due to bitrot) and because the drive didn't report an error it was not detected. ZFS on the other hand caught and corrected the same scenario. I agree this is not a huge issue for short term live data, but if there are no protections, such discrepancies could find their way into the backups and archives because they were not detected/corrected
@garynagle3093 2 жыл бұрын
This was pretty cool to see!
@delveling 2 жыл бұрын
So kool watching you guys excited :)
@UTubeVSMechaGodzilla 2 жыл бұрын
As a tech geek it always makes me smile how giddy they are when talking about extraordinary hardware / software solutions. 😄
@ayen0nymous 2 жыл бұрын
I kinda had a feeling this man was able to look into the future.
@thegamera6963 2 жыл бұрын
Yep
@WayStedYou 2 жыл бұрын
Why does he keep dropping stuff then
@philsburydoboy 2 жыл бұрын
@@WayStedYou Dropping stuff is required to look into the future
@Sithhy 2 жыл бұрын
That's the downside of being able to look into the future
@TheRossMadness 2 жыл бұрын
It's nice to see the Level 1 Techs merch on display.
@ivanevans2820 2 жыл бұрын
The energy in this video is the best
@jseen9568 2 жыл бұрын
GPU accelerated raid, NVME drives attached with a GPU, PCIe 5 coming. I still say there could be some really interesting devices coming that could handle several different things at once, without performance issues. e.g. A single GPU, with 4 drives, in Raid, with the raid being taking care of by the GPU, and the GPU sending video output (perhaps some other computation happening as well). All without a performance being impacted with any of it.
@timsmith3743 2 жыл бұрын
It's like a return to the past when some Enterprise GPUs had inbuilt SSDs. Certainly not common, but not a new idea.
@calebschmucker4698 2 жыл бұрын
Back to the days of a math coprocessor
@rukia4473 2 жыл бұрын
Please read my name❣️
@Rich-qs6kn 2 жыл бұрын
Are we going to see less of a push for improvements to the CPU in the future then? maybe that's why Intel are moving into the GPU space.
@Finder245 2 жыл бұрын
You are underestimating the software complexity of these solutions. Anyone can duct tape together a bunch of components, but making them actually work together seamlessly is not trivial, and when something goes wrong, they are just too difficult to debug. If you look at the history of computing, simpler solutions tend to win. Only the most performance critical applications tolerate some complexity.
@jbrown-acuity 2 жыл бұрын
RAID originally stood for "Redundant Arrays of Inexpensive Disks"
@majorbogart3476 2 жыл бұрын
My experience has been "Risking All Important Data"...
@satakrionkryptomortis 2 жыл бұрын
@@majorbogart3476 thats the lack of raid shadow legend..
@TechnoBabble 2 жыл бұрын
And it still means that if you compare any kind of RAID to a dedicated, proprietary storage machine in a datacenter.
@3050Victus 2 жыл бұрын
@@satakrionkryptomortis you could have not said that but you did it anyway
@jakeaustin901 2 жыл бұрын
@@majorbogart3476 yea, if RAID 0 and not any other form
@actng 2 жыл бұрын
linus: with these enterprise drives, they're not likely to fail jake: they usually all fail at the same time :D
@TheOriginalFaxon 2 жыл бұрын
it makes me really happy that these are exactly the same as GPUs, because that means that A: The software could run on ANY gpu, and B: you can use these cards AS FUCKING GPUS if needed, meaning they won't go to waste if you no longer need them for running a RAID with. No doubt you'll need some kind of hack because of the license thing, but yea that's wild lol
@jettdragon3337 2 жыл бұрын
I wonder if you could use it as a basic display output at the same time.
@ViciousTuna2012 2 жыл бұрын
It would work the other way around. These are older GPUs. It's more likely that industry would repurpose existing but outdated GPUs to use for this application, instead of what you described.
@wayland7150 2 жыл бұрын
Mining only GPUs perhaps. Nvidia's thing is CUDA, I expect if you can run CUDA code then you can run this RAID thing.
@curvingfyre6810 2 жыл бұрын
@@ViciousTuna2012 god I hope so lol, then I might actually be able to access this technology within my lifetime. With how the setup is described, it makes me wonder just how much processing and bus bandwidth you really need for this. Presumably memory is a factor, but for simple user-oriented tasks, you legit do not need 100gb a second for *anything*. I wonder how this would interact with different solid state tech like Optane and optane hybrid. You might be able to blow the price, capacity, features, and performance of the top end raw pcie drives on the market using an old junker display processor, and 2-5 consumer optane hybrid m.2s. Of course adapters to fill that many slots may ramp up costs prohibitively. Pcie bifurcation and slot adaptation is way more expensive than it should be.
@ViciousTuna2012 2 жыл бұрын
@@curvingfyre6810 I wouldn't think of this in terms of user-oriented speed requirements. This tech is going to be most useful for server applications, which will be able to utilize that level of bandwidth (100GB/s).
@raphaelsback 2 жыл бұрын
Linus now: On these enterprise level devices it should be fine. 5 years later: Yeah guys it failed and we didn’t see it through
@Brogboolius_Maximus 2 жыл бұрын
5 years of INCREDIBLY heavy, daily use.
@Qyngali 2 жыл бұрын
And no way to detect bit rot, unlike ZFS. Having backup of bit rot is kinda pointless. :P
@eldibs 2 жыл бұрын
With the kind of airflow going through that chassis, would the RAID GPU card stay cooler if you took the shroud and fan off? Assuming the heatsink fins are oriented horizontally.
@Vatharian 2 жыл бұрын
From experience, there is no difference. A lot of bus cards, FPGAs, expanders and other PCIe appliances come in with a fan, so they can be put in a tower desktop, mostly for development purposes, but in general when you put it inside a server (especially in 1U or half-width 1U on dual node systems) it just doesn't matter.
@seldoon_nemar 2 жыл бұрын
gotta remember that it's a positive pressure system in that thing so it's forcing air though those fins even with the integrated fan turned off. when it's on it's more boosting the speed over the server's insane baseline by helping air maintain speed. it's only ever going to be a single digit percentage diffrence
@eldibs 2 жыл бұрын
Informative answers from both of you, thanks. I simply don't have rackmount server experience, and am happy to learn from those who do.
@Mountain-Man-3000 2 жыл бұрын
That wardrobe change though. Super high production quality!
@SomethingSomethingAirsoft 2 жыл бұрын
I love how that G710+ has hung around for so long. I bought mine like a week before your video covering it came out.
@AndyPhu 2 жыл бұрын
I love it when you guys include the technical information!
@UntouchedWagons 2 жыл бұрын
That's actually really cool. I'd love to see a 3090 or that super top of the line A1000 run the software raid stuff.
@alecdonaldson6272 2 жыл бұрын
For a few minutes of this video, the server fan tone fit well with the key of the background music like a droning common tone. Enough that it distracted me while they were talking
@lasthopelost9090 2 жыл бұрын
Good job you guys getting a telus sponsor thats pretty big
@Buzzfly 2 жыл бұрын
Surprised to hear them talking so positively about RAID 5 and dismissing RAID 10 as "expensive". Yes, you do lose half your capacity with RAID 10, but you get more performance, more resiliency, and importantly rebuilds are faster / less resource intensive. Rebuilding your array from a failed disk doesn't matter so much when all the drives are new, but when they're all end of life, the extra strain from a RAID 5 rebuild can cause a chain of failures, potentially causing a totally array loss. Coming from industry, I'd never deploy a RAID 5 array again, RAID 10 all the way. RAID 1 also has some good use cases.
@wobblysauce 2 жыл бұрын
Rebuilding an array is the worst part of a process when you do get a failure.
@hicknopunk 2 жыл бұрын
How do you feel about raid 6?
@88porpoise 2 жыл бұрын
He did specify that there are use cases for RAID 10, but it was severe overkill for the hardware/use case they were considering.
@giornikitop5373 2 жыл бұрын
the extra stress for raid5-6 etc while rebuilding, is more of a problem for the mechanical hard drives. ssd's, especially of that class, don't suffer the same drawbacks, only write wear matters, reads don't affect them. also due to much higher transfer speed, the rebuild will complete way faster. still, with a bit of patience and thinking, you can use a combination of different raid levels, that will fill the needs better...
@AllanSavolainen 2 жыл бұрын
I prefer RAID 50 if you wanna go with the mirroring route.
@N54.S6 2 жыл бұрын
Two minute's in and linus is already dropping thing's. Absolute legend.
@Sithhy 2 жыл бұрын
Even less than 2 minutes; more like 40 seconds
@i_am_macgyver84 2 жыл бұрын
Love the video. While I've never ran anything greater than Raid 1, between your channel and others I have been running Unraid for almost 2 years. Yes I know there are pro's and con's of both, but at this time Unraid has been great for me needs.
@Paulrere 2 жыл бұрын
I love these videos man!
@OfficialSamuelC 2 жыл бұрын
Gotta love the knowledge and expertise of Jake and the videos he does where Linus is a spectator. Jake’s skills are impressive, he seems to know everything!
@AgentSmith911 2 жыл бұрын
I love that Linus is still mega hyped about tech even after all these years 😀
@Nobe_Oddy 2 жыл бұрын
FRIKKIN AMAZING!!!! - Thanks for bringing 5this mindbending tech to our attention!! :D - Wendell is gonna LOVE THIS!!!!
@Garbimba1900 2 жыл бұрын
Man, the noise at 18:03! I don't miss the server room noise which this reminded me of. Geez, its really working!
@HrafnRaff 2 жыл бұрын
This is nuts. I know I'll never get to work on these kinds of projects, but man I'd love to. I have no need for it, I just want it lol Amazing stuff
@Je-kg8up 2 жыл бұрын
My prediction for the future- this type of card will quickly be obsolete and become integrated into CPUs or motherboards. This is a PhyX card for storage. They might continue to exist for servers though.
@ck5071 2 жыл бұрын
Hmm. Tough call. The card was running 100% the whole time and even with massive airflow was hitting 70C. Embedding that on a motherboard would need some built in cooling to support it.
@RandomnessCreates 2 жыл бұрын
Perhaps, but it's using GPU Compute at 100% and I don't think it'll be in CPUs anytime soon since it seems to be very much an enterprise solution. It might be compared to like a PhysX card but this is more akin to using a dedicated GPU for tensor applications.
@Finder245 2 жыл бұрын
If there is a market for this, AMD and Intel will integrate it into their CPUs in a more refined way.
@mariuspuiu9555 2 жыл бұрын
i can see RISC type chips made specifically for this task becoming popular.
@jameslake7775 2 жыл бұрын
"This type of card" is just a GPU. There doesn't seem to be any special fixed-function hardware or special firmware as explained, It's just offloading what the CPU would do onto what's effectively a GTX 1650 with the TDP pared back to fit under a smaller cooler. Integrating it into CPUs would just be doing GPU compute on the iGPU. For home users, the processor overhead isn't that high anyway. For servers there isn't an iGPU to offload on, and even if they did add one, it would be fighting the main CPU for die space and power budget where an add-in card would not.
@connhughes13 2 жыл бұрын
Your channel has had back to back killer videos. Between fixing GPUs and this one!
@iicuno7089 2 жыл бұрын
omg il always watch ur vids bro i learn new stuff from you linus
@uncle-ff7jq 2 жыл бұрын
Seems like an exciting step in making alternative hardware accelerators common place in systems. It's wild to think that despite how far innovation has pushed the capabilities of modern gpus in terms of video encoding and rasterization, they are but one manifestation of hardware accelerators in a wide field with new opportunities coming from things like fpgas or asics.
@Naetrox 2 жыл бұрын
It's interesting because this is much like an echo of the past. In the 90s we had co-processors and such. Sound cards were also hip until everyone had their baked-in Realtek chip. We kinda went backwards and are now seeing the start of a boom of new accelerators, possibly due to the progress of performance improvement slowing down.
@uncle-ff7jq 2 жыл бұрын
@@Naetrox Good point, it doesn’t seem as viable to just throw more general compute at a problem. Instead better specified architecture provides much more real performance. I wonder if someday the almighty cpu might become a compute analog to a clock generator.
@Naetrox 2 жыл бұрын
@@uncle-ff7jq I'm holding out for quantum computers, I think we'll see adoption of them in a few decades as we figure out how to operate them at room temperature.
@biggestballer9206 2 жыл бұрын
0:34 Linus drop this strikes again
@Killertamagotchi 2 жыл бұрын
The Server Rig in the background Ready for Take of 😂
@HueMongus101 2 жыл бұрын
I am VERY interested in this technology! More!
@davidbronke5484 2 жыл бұрын
"This server from Gigabyte handles all that through a backplane here in the front of the chassis." Wouldn't that be a "frontplane" then? Har Har.
@VitalVampyr 2 жыл бұрын
It's in the back of the front.
@acojo8205 2 жыл бұрын
You see, David, this is why your mom left
@kernelpickle 2 жыл бұрын
The part of this whole concept that I find most interesting is the fact that someone basically found a useful way to repurpose old GPUs that would otherwise be eWaste. Someone that’s into farming Chia might find something like this useful as well, so there’s still a way to earn some crypto with it.
@iTzBrillianTFX 2 жыл бұрын
You just gotta love Jake's laugh - even if he remembers me to the grumpy Jake of Two and a half men (8. Seasons). 🤭
@Norman_Fleming 2 жыл бұрын
The first few minutes explaining the how the PCIE was being used was very informative. I was wondering how much the CPU utilization was caused by the test itself.
@sitedel 2 жыл бұрын
The main interest of RAID for hard drives is the ability to hot swap any faulty drive on a running server. Could you test hot swap in this beefy configuration ?
@HoshPak 2 жыл бұрын
I am looking forward to the day someone is releasing an open source driver accelerating storage with any GPU.
@trevorjex3146 2 жыл бұрын
This would be awesome
@trevorjex3146 2 жыл бұрын
@@Prophes0r I don't think that hardware getting more capable and more general purpose is ever a bad thing. If a TON of people start using features like this in the short run it could affect the supply chain. But honestly I don't think there'll be enough people using this that it'll affect anyone's ability to get a GPU. And honestly it just means your card you have can do more things. Why would that be a bad thing?
@Naetrox 2 жыл бұрын
@@nicekeyboardalan6972 Aight rich kid, just know if war comes, you'll be first to get eaten. That said, expensive GPUs make for half decent impromptu weapons. See you on the battlefield, come sit down for some soup and bread with us.
@csgrullon 2 жыл бұрын
This was sick!
@TheLogicalphycopath 2 жыл бұрын
that hair in your eye at 4:15 man that would have drove me kitchen roll bonkers
@Aaron_Jensen 2 жыл бұрын
Hello and welcome to another fine installment of Linus loves ridiculously awesome storage solutions.
@AtomusGuy 2 жыл бұрын
"Compared to the documentation of anything Microsoft" I felt that Jake, I felt that
@kahelsoro Жыл бұрын
Excited for this tech! Hopefully enterprise brands cater this kind of technology on their systems.
@Anonymus-ih7yb 2 жыл бұрын
I like that this thing sounds like it’s taking off.
@88Xlmk 2 жыл бұрын
I bought relatively cheap Kioxia SSD this month - Toshiba NAND and 4GB DRAM controller from Samsung. it was even cheaper than a lot of low end drives from Chinese manufacturers without DRAM. Its performance is pretty good, but I'm not much of storage purist.
@Zuckerkome 2 жыл бұрын
how much did you pay?
@amogusamogus8490 2 жыл бұрын
what drive?
@gamebrigada2 2 жыл бұрын
This is like the opposite of ZFS in every way. ZFS is like "ecc for resiliency on top of hashing everything"! Graid be like "speed!!!!". It'd be interesting to see how much data corruption would happen on one of those in a real world heavy write workload.
@timsmith3743 2 жыл бұрын
While I agree, you response may lead a novice reader to mistakenly believe ZFS protects against corruption, when infact it an be the opposite. - The hash in ZFS detects corruption, can't actually be used to recover data - ZFS has next to zero protection against bitrot - ZFS can't detect errors introduced by the host, so ECC is critical at all layers, RAM. ie: Don't run ECC on cheap hardware, overclock ect.. as errors introduced on the host will get written to the ZFS and NOT detected. ZFS is perfect to host VMs but the ZFS server itself should never be virtual due to higher risk of corruption. So while ZFS is about as good as you can get in the enterprise, due to the extreme robustness, ease of recovery and tons of features. Running it on consumer hardware introduces a lot more risk over other filesystems and will generally perform poorly without a crap ton of memory.
@gamebrigada2 2 жыл бұрын
@@timsmith3743 ZFSs protection against bitrot is literally a focus in it's initial design. If your pool is using raidz, ZFS not only protects from bit rot, it eliminates it in real time. The hash that ZFS stores with every write, and the parities of your pool config allows ZFS to determine which version of data is correct and only return that data. Not only does ZFS protect against bit rot, it also protects against file corruption. ECC is recommended for ZFS systems because it's the only part of the system that is not protected against corruption. ECC protects the data while it is processed by ZFS.
@timsmith3743 2 жыл бұрын
@@gamebrigada2 , ZFS detects bit rot, but can only perform the bitflip if a replica exists. To understand your risk, you need to review the results of the scheduled scrubs and often need to replace the lost data where it can not be repaired automatically.
@jordanhildebrandt3705 3 ай бұрын
Jake's shirt! Sysadmin haiku! Brilliant!
@leetebbens8858 2 жыл бұрын
Jake really has a similar combination of knowledge and charisma that made Linus so popular and enjoyable to watch.
@alexn78666 Жыл бұрын
except he has some personality traits that are.. fairly annoying imo. hard to put words to it, but I'd have to disagree on the charisma part. he comes across as a smug know-it-all who likes to tell people how much he knows because he thinks it's impressive. unlike Linus who does it because he genuinely wants other people to learn. not always, just most of the time.
@gabrielhmi 2 жыл бұрын
This thing is sick. Could be a small revolution in scientific computing.
@SkillisForNoobs 2 жыл бұрын
We need a continuation making it work with other GPUs
@soggywilson 2 жыл бұрын
their excitement makes me happy
@relims 2 жыл бұрын
"This only runs on Linux server operating systems" Me: Yes! "So we are running Ubuntu Server 20.04 LTS" Me: Ubuntu? Noooooo
@Hobbles_ 2 жыл бұрын
This was such a cool concept and video!I would love to see the open source community come up with their own solution of this! Please see what else you can do with this, and I await the videos that will relate to it!
@mbourd25 2 жыл бұрын
Hi @Hobbes, there is the mergers + snapraid combo of you want open source projects. That's what I use in my OpenMediaVault server.
@nullnull2128 2 жыл бұрын
This!
@jestersheep9647 2 жыл бұрын
The T400/600/1000 line of GPUs are underrated gems. Tiny little powerhouses in an otherwise completely screwed GPU market!
@mycosys 2 жыл бұрын
Amazes me nobody knows about the T400, low profile, full Ampere NVenc/dec in effectively the 1630 that never happened for $150 US, in this market its a great card for HTPC/Encode servers/plex/streaming etc etc
@rileymannion5301 2 жыл бұрын
Man I was not expecting telus as the sponsor! That's a really big company
@holyassassin1985 2 жыл бұрын
i love seeing these kinds of vids to see how powerful pc's and servers can get. Wish i could afford a decent computer but im stuck with a 4 core intel laptop with 8 gigs of ram and no graphics card. Hoping one day i can afford one though, but from the looks of pricing and such i wont be able to
@DeadOnToilet 2 жыл бұрын
With RAID5/6 you lose so much write performance they’re generally terrible for write intensive applications. RAId10 is the best option for write intensive applications. Also you only lose half your drives in RAID10; it’s just a striped mirror.
@Iceman259 2 жыл бұрын
The resiliency in 10 isn’t great for critical applications. I suppose the “rebuild” time offsets that to some degree though.
@richardharvey586 2 жыл бұрын
I came here to say this. I was baffled why they tested RAID5 as that's what you're doing at the low end not the high end. As far as RAID goes in industry OBRAID10 is the norm.
@Iceman259 2 жыл бұрын
@@richardharvey586 weren't they *specifically* testing the worst case scenario in terms of write overhead on software RAID? Also, do you have an info link on OBRAID? Curious what the difference is and it returns nothing on google or stackoverflow/serverfault.
@richardharvey586 2 жыл бұрын
@@Iceman259 i thought they just wanted to test the performance. OB, one big, it's just normal RAID10.
@Iceman259 2 жыл бұрын
@@richardharvey586 Ah, gotcha. Thanks. Isn't the fault tolerance low with RAID10? In the worst case scenario two drive failures is game over. But that's only if the failures are in both halves I guess.
@Rhythmattica 2 жыл бұрын
This ep is a fkin Winner ! With straight, fairdinkum , good as gold info...So entertaining!
@Nevakonaza. 2 жыл бұрын
Gotta admit,Linus has some superb staff,It appears they all have their areas if expertise and they are damn good at it too,I especially enjoyed the video card repair attempt recently posted :)
@takehirolol5962 2 жыл бұрын
Linus, you are an insider and the number one Tech channel, of course you knew...
@ImLunaUwU 2 жыл бұрын
We didn't even have to wait a minute before Linus almost dropped it.
@eTiMaGo 2 жыл бұрын
I just want to say thanks for introducing me to Termius, was looking for something a bit more modern than MobaXterm :D
@shankararhuddlan270 2 жыл бұрын
Did he just wink at the camera after that awesome recovery catch?! Haha Linus you're freaking awesome!
@karehaqt 2 жыл бұрын
IBM and Nvidia are working on a much better version of this concept, enables a GPU to connect directly to a computer's SSD to bypass the CPU completely.
@karehaqt 2 жыл бұрын
@@marcogenovesi8570 Will this be open sourced like IBM/Nvidia plan to do with what they are doing?
@Rokkprojekk 2 жыл бұрын
@@karehaqt does Nvidia have any open source products?
@eabelcourt 2 жыл бұрын
This system is completely a different use case to what Nvidia recently announced with IBM. What Nvidia-IBM are making are something akin to DirectStorage where pulling dataset blocks from storage for number crunching/training are quite slow going via the CPU so like MSDS is cutting out the middle man. What this GRAID system is doing is using a relatively inexpensive workstation card (stability etc) to be the write target for the disk are so it can use the massive amount of mathematical capability of the GPU cores to calculate parity data which is pure math of block A + block B = block C and if you were to lose either A or B you could get the missing data back because you have 2 parts of the 3 sided equation. In short, it's just using the Nvidia card as a write accelerator which is pretty impressive and am also a little surprised this hasn't been posited before now.
@karehaqt 2 жыл бұрын
@@marcogenovesi8570 The software is what I was implying, not the hardware.
@myselfremade 2 жыл бұрын
AMD already did it years ago
@trevorsmith470 2 жыл бұрын
For the Kioxia BG5, I'm surprised you didn't mention its application in the steam deck, as it uses M.2-2230 SSDs as well.
@technicavivunt 2 жыл бұрын
I wish I could find one too. Seems like everywhere I look they’re still unavailable
@hazonku 2 жыл бұрын
That's absolutely insane, and the fact it really is just a GPU is even more insane. Only a matter of time before folks are working around the license & just running this sorta setup with whatever their last GPU was. I'd love to finally build a a new system & then give my now old 1080TI a new lease on life as a raid controller for a home server to hold all of my own footage & assets.
@8lec_R 2 жыл бұрын
Finally good stuff I can learn from
@1981AdamGs 2 жыл бұрын
Not going to lie, I found Jake incredibly annoying when he first started. But now the videos with Jake and Linus are my favorite videos. Those two have found a really nice chemistry.
@chocolate_maned_wolf 2 жыл бұрын
yeah they kinda cute ngl 🥴
@sune9578 2 жыл бұрын
Agreed. I went back to a few older videos just to see what changed and it seems that he's definitely mellowed out a lot. They've had this "close friends" type relationship for awhile but I think Jake might've been overdoing it for the camera back then. Seems like he's a lot more comfortable now.
@chocolate_maned_wolf 2 жыл бұрын
@@sune9578 gay erasure
@sune9578 2 жыл бұрын
@@chocolate_maned_wolf Excuse me. I think it is you that is doing the erasing of the gay.
@chocolate_maned_wolf 2 жыл бұрын
@@sune9578 ok boomer 🤓
Linus Tech Tips
Рет қаралды 2,1 МЛН
Tips Workshop
Рет қаралды 15 МЛН
Anyaischuk LIVE
Рет қаралды 14 МЛН
Linus Tech Tips
Рет қаралды 2,3 МЛН
Linus Tech Tips
Рет қаралды 2,3 МЛН
MaxxPC
Рет қаралды 1,3 МЛН