Liquid Cooling Takes Over at SC21

  Рет қаралды 22,920

ServeTheHome

ServeTheHome

Күн бұрын

At Supercomputing 2021 (#SC21) I walked the show floor and checked out all of the different liquid cooling vendors that were exhibiting at this show.
STH Main Site Articles: (See links below)
STH Merch on Spring: the-sth-merch-shop.myteesprin...
STH Top 5 Weekly Newsletter: eepurl.com/dryM09
----------------------------------------------------------------------
Where to Find STH
----------------------------------------------------------------------
STH Main Site: www.servethehome.com
STH Forums: forums.servethehome.com
Follow on Twitter: / servethehome
----------------------------------------------------------------------
Timestamps
----------------------------------------------------------------------
00:00 Introduction
03:04 A Look at Supercomputer Nodes
05:34 Immersion cooling
13:11 Rear door heat exchangers and CDUs
18:44 Blocks, Couplers, Pumps, Tubing, and Components
27:51 Final Words
----------------------------------------------------------------------
Other STH Content Mentioned in this Video
----------------------------------------------------------------------
- WILD hardware of OCP 2021 - • WILD Cloud Hardware at...
- Submer liquid immersion cooling - www.servethehome.com/submer-i...
- Liquid Cooling in Servers with 400W and 500W A100's - • Liquid Cooling High-En...
- Facebook OAM Launch Hands-on - www.servethehome.com/facebook...
Disclosure: Kioxia gave me the mask the day prior because I broke the one I had.

Пікірлер: 76
@JeffGeerling
@JeffGeerling 2 жыл бұрын
St. Louis-I'm from there!
@T0mParker
@T0mParker 2 жыл бұрын
The Iceotope chassis has to be the most innovative out there? The only immersion cooling solution (complete removal of air flow in the rack) where it is possible to maintain cooling during servicing events and no requirement to lift the server out of the rack with lifting cranes like tank immersion.
@edwardallenthree
@edwardallenthree 2 жыл бұрын
My first liquid cooled computer was built 20 years ago. It was overkill with a five gallon bucket reservoir and an industrial pump. Love seeing this technology in the data center now.
@blablip4712
@blablip4712 2 жыл бұрын
Dude Im a mechanical thermal engineer, these vids are amazing!!!
@jeremybarber2837
@jeremybarber2837 2 жыл бұрын
Super late to watching this but THANK YOU for this fantastic video. Ton of fantastic info.
@MrNortySpock
@MrNortySpock 2 жыл бұрын
Glad you got to visit the STL Arch and go up to the top; it's a super cool nerdy destination that not enough people have heard of. Love watching your channel and your enthusiasm, even if I'm still hosting my containers on a Raspberry Pi. :) Sincerely, a Missourian on the KC side.
@bits2646
@bits2646 2 жыл бұрын
Now that's my jam... I was really into watercooling, remember the beginnings of EK (yes, I know Edward and some early employees from local tech forum, also did lots of custom loops myself back in the days of high school), and now I'm really into enterprise servers, and this really makes me goosebumps :DD I was waiting for that moment that liquid cooling will dominate the server space, especially seeing GPGPU and different really powerful accelerators used more and more and more and especially CPU TDP bump up and essentially more than doubling the TDP that used to be like less than a decade ago... Too bad I wasn't financially able to spin up my own company focusing on that, I've been planning different cooling systems for almost 20 years now since I was 11, 12 years old and started moving my focus to that space exactly a decade ago, when BTC GPU mining was in, before all FPGA and ASIC and ton of nonsense crypto started rolling out and got dominated with players with big initial investment, which I didn't had funds for at the time...
@PhilJohn1980
@PhilJohn1980 2 жыл бұрын
"What is this? An immersion rack for ANTS?!? It needs to be at least ... THREE times bigger!"
@ServeTheHomeVideo
@ServeTheHomeVideo 2 жыл бұрын
Awesome! I like the fact our audience gets that reference.
@mgonzalez726
@mgonzalez726 2 жыл бұрын
Great video of SC21. I was not able to attend unfortunately. Thanks for getting the CEJN name right! I am Sales Engineer for Thermal Control Applications at CEJN NA.
@prashanthb6521
@prashanthb6521 2 жыл бұрын
This was like a kid in a candy store for me. Thanks for take me around the show :)
@seitenryu6844
@seitenryu6844 2 жыл бұрын
Cool to CEJN shown. Finally a vendor I use at work. Their hydraulic and pneumatic connectors are fantastic quality. Staubli is Stah-blee. They're popular in motorsport for fuel or liquid quick disconnect.
@ultraderek
@ultraderek 2 жыл бұрын
You witnessed a Zoolander moment with the GRC ice rack solution. 😂
@ServeTheHomeVideo
@ServeTheHomeVideo 2 жыл бұрын
I was so tired I could not remember the quote, but yes.
@maxhammick948
@maxhammick948 2 жыл бұрын
Hyperscaling for ants! Microhyperscale!
@IsabelValoria
@IsabelValoria 2 жыл бұрын
My thoughts exactly =D
@zyeborm
@zyeborm 2 жыл бұрын
Feel real bad for the guy who tried to make the reference that nobody got lol
@metallurgico
@metallurgico 2 жыл бұрын
LTT: You don't need liquid cooling for you RAM STH: Hold my SuperMicro
@happydawg2663
@happydawg2663 2 жыл бұрын
This is great reporting, thank you!
@Ozzkuu
@Ozzkuu 2 жыл бұрын
Absolutely bonkers to hear these multiple hundred kilowatts of cooling in the size of packages as those were. I also wonder if the 3M Novec stuff will start to leak to us mere mortals now that it seems it is starting to be more widely used in the industry.
@T0mParker
@T0mParker 2 жыл бұрын
Highly unlikely, it's ridiculously expensive, ~£50 per kg (and it's ~1.6kg per litre roughly) and awful for the environment, high global warming potential. It has to be extremely well controlled. Not for the DIYer.
@Ozzkuu
@Ozzkuu 2 жыл бұрын
@@T0mParker According to 3M the Novec line has GWP of 1 which is comparable to plain CO2
@Raccoonov
@Raccoonov 2 жыл бұрын
Impressive review! Thank you, mate!
@DrivingWithJake
@DrivingWithJake 2 жыл бұрын
Hopefully next year I'll be at some of these! Busy this year getting our new data center suite finished up!
@IsabelValoria
@IsabelValoria 2 жыл бұрын
"I'm here at LIQID ... they don't actually do liquid cooling, but there's a lot of people at their booth because they have a BAR!" Hahaha. Really enjoyed this video. Thanks, Patrick.
@ServeTheHomeVideo
@ServeTheHomeVideo 2 жыл бұрын
Every afternoon they had lots of people. Every afternoon they had a bar.
@Spicer1104
@Spicer1104 2 жыл бұрын
I hope icetope will sell the chassis without servers in them. I’d love to try one. Also 4u chassis for a diy server would be cool
@codyweaver5721
@codyweaver5721 2 жыл бұрын
Loved watching this, and I really hope Motivair sees this and maybe reaches out to do something one-on-one. What a missed opportunity on their part! I've certainly encountered these weird cold shoulder thing as some shows in the past.
@vlycop7404
@vlycop7404 2 жыл бұрын
when i was at school over 5y ago i discovered rear heat exchange door. For some reason they had that in place. I have never seen any liquid cooling since in DC, and i've work on HPC and big company... I really hop I'll get to work on hardware like that without working for a gafam.
@christopherjackson2157
@christopherjackson2157 2 жыл бұрын
Nice. I miss conferences and shows
@ServeTheHomeVideo
@ServeTheHomeVideo 2 жыл бұрын
Me too. Or at least the big vibrant ones.
@christopherjackson2157
@christopherjackson2157 2 жыл бұрын
@@ServeTheHomeVideo I really enjoy this format btw
@BusAlexey
@BusAlexey 2 жыл бұрын
13:05 they cool people with the liquid in a bar :D
@shadowmist1246
@shadowmist1246 2 жыл бұрын
Enjoyed this video. I appreciate you taking the time. Video idea: Liqid's new PCIe Gen 4.0 CDI Device Expansion.
@WalkersLawn
@WalkersLawn 2 жыл бұрын
I love the Dynatron products! I've always wondered if there was such a cooler to fit into my 2U server. Thanks to your video I've found the answer to that question. Although it'll be complete overkill for my needs, I'm buying this today! By the way, love the videos! Dynatron L3 CPU Cooler for 1U Server 👍
@2dozen22s
@2dozen22s 2 жыл бұрын
Quite excited about the fluid microchannel plates. I wonder how dense you could make stuff with that level of cooling.
@bryansuh1985
@bryansuh1985 2 жыл бұрын
Ahhh Missouri. Forever shall they be remembered in my heart as the state that tried to ban the f12 key
@jmonsted
@jmonsted 2 жыл бұрын
I see exactly zero chance that anyone would adopt submerged cooling as anything more than a demo or for extremely niche systems that need massive cooling capacity. It seems fun enough, but that's a ridiculous hassle to deal with when servicing systems, the infrastructure takes up massive amounts of space. Compare to that something like the rear door cooler capable of 200 kW or the quickconnect liquid manifolds, where you can avoid pretty much all of the hassle. We adopted the rear door coolers about seven years ago with good success (the boss just way overbuilt the solution).
@Dr_b_
@Dr_b_ 2 жыл бұрын
This is literally cool
@MoraFermi
@MoraFermi 2 жыл бұрын
I do hope that Fluorinert fountains return as a trend in datacenter decor!
@john-r-edge
@john-r-edge 2 жыл бұрын
"These coolers are cool" - you have to listen carefully as Patrick is using the same word in two different ways - a treat for linguists. But what if a particular technology was proving really popular, and thus hot? And did he mention Coldplay?
@hokatichenci
@hokatichenci 2 жыл бұрын
Bar next to the booth? What a great idea, stealing that one for my next booth setup.
@ServeTheHomeVideo
@ServeTheHomeVideo 2 жыл бұрын
They had it again this afternoon.
@ColinRichardson
@ColinRichardson 2 жыл бұрын
Definitely need to narrow the parameters of the focus of that camera.. maybe to a centre point or small centre area.. Multipoint is obviously not your friend at shows like this.
@ewenchan1239
@ewenchan1239 2 жыл бұрын
I DO wonder though, if "Direct-to-CPU" cooling is actually synonymous with "direct die" cooling (because direct die cooling was also something that I had learned about in the mid 2000's whilst I was working on designing and engineering my own waterblock for said Socket 940 AMD Opterons).
@famillefamille9273
@famillefamille9273 2 жыл бұрын
Hi everyone, Firstly great informative video. Can someone share best solution for a cooling system that can hold 4 to 6 s19 pro miner. These miner are best used by product describ in your video.
@Alphahydro
@Alphahydro 2 жыл бұрын
That was some serious hardware,...............and by the way, the audio and video seemed fine to me.
@JeffGeerling
@JeffGeerling 2 жыл бұрын
Yeah, sounded great here!
@thomasb1521
@thomasb1521 2 жыл бұрын
Liquid know how to attract interest
@biggerandbetterthings7222
@biggerandbetterthings7222 2 жыл бұрын
aww coolio, but i was hoping you would mention laminar flow! i'm sure some very very high end systems use it, idk tho :)
@stuartlunsford7556
@stuartlunsford7556 2 жыл бұрын
Don't touch the glass! :P
@computersales
@computersales 2 жыл бұрын
These look fancier than my solution. Two box fans, an old furnace thermostat, zip ties, and an outlet controlled by a relay. Pretty sure I can cool at least 1KW 😂
@Nobe_Oddy
@Nobe_Oddy 2 жыл бұрын
that was REALLY eye opening for me!! - TOO BAD you camera didn't want to focus properly :( - was there a setting that wasn't set to use in close up shots? maybe was better suited for distant landscapes? anyway, I think that the company doing immersion INSIDE the chassis was the most useful... I always thought that full immersion tanks were really wasteful... wasteful of having so much extra liquid and VERY WASTEFUL of space- you CANNOT put a second immersion tank over top of one on your ground level without some SERIOUS infrastructure to hold all that weight.... when you immerse each board in a small amount of the liquid, then have it flowing in a purposefully directed way, you can draw off the warm liquid and cool it in a smaller heat exchanger then pump it back into each machine.... this allows you stay with vertical setup and use MUCH LESS on tubing inside each chassis, fewer pumps if you let gravity do some of the work, less metal on creating surface area (i would think, but I'm not sure of that totally) and you just pump the fluid into the chassis with some guides so that it flows over each component you need cooled and out the warm side. it's not under high pressure so you can only have a small amount of liquid in each chassis and there is still tons of space above it. this reduces the amount of liquid (which costs less) and the weight of the whole system is cut down DRAMATICLY (so you don't have to think of infrastructure needing to be super overkill compared to a huge tub of liquid) sorry for rambling, but I had thought a bit about this the first time I found out that full immersion tubs are a thing (which I learned about from THIS AMAZING CHANNEL in their fairly recent liquid cooling video) and just saw how much waste there was and that there HAS to be an easier way to do it.... I feel like this would be the MOST efficient cooling system compared to all others taking up the same amount of space. (if you are factoring in everything like space, weight, costs of liquid, pumps, tubing, heat exchanger, fins for surface area, etc.... but I'm only guessing based on what I've seen here... I could be COMPLETELY WRONG lol) THANK FOR THIS GREATR VIDEO!!! :D
@ServeTheHomeVideo
@ServeTheHomeVideo 2 жыл бұрын
Thanks for the amazing comment. I think the company you are looking for is Iceotope.
@AchwaqKhalid
@AchwaqKhalid 2 жыл бұрын
The way it should be if you want to run one of those fast servers at home 🖥
@ankittayal8291
@ankittayal8291 2 жыл бұрын
🔥🔥
@jms019
@jms019 2 жыл бұрын
IBM should have exhibited an old mainframe. Or Cray…
@amateurwizard
@amateurwizard 2 жыл бұрын
Hey Ryan. How's it going.
@1mrhamel
@1mrhamel 2 жыл бұрын
:D
@MrMike-fn4hi
@MrMike-fn4hi 2 жыл бұрын
@@1mrhamel Hi Ryan!
@Test-bi5rg
@Test-bi5rg 2 жыл бұрын
What‘s the price for the 3M liquid right now?
@ServeTheHomeVideo
@ServeTheHomeVideo 2 жыл бұрын
No idea on that.
@KurtHectic97
@KurtHectic97 2 жыл бұрын
THIS!
@Emma__Smith
@Emma__Smith 2 жыл бұрын
I love your videos and your content.. but dude. it may be time to hire a video guy lol... The focus is all over the place, its not your fault, its hard to talk and pull focus at the same time but like you could even hire some highschool AV kid to follow you around at the trade show or something.
@ServeTheHomeVideo
@ServeTheHomeVideo 2 жыл бұрын
100% This is still a challenge of the pandemic. It is harder to get a camera person in. Once things open up a bit more, there will be someone running the camera like we had Joe at the PhoenixNAP tour and some of the recent Supermicro videos.
@Emma__Smith
@Emma__Smith 2 жыл бұрын
@@ServeTheHomeVideo Darn COVID lol.. still love the videos anyways!
@zyeborm
@zyeborm 2 жыл бұрын
@@ServeTheHomeVideo Or at least a steadycam type dealy? I love the video but legit got motion sick watching it and had to turn it into a postage stamp in the corner of the screen.
@foxale08
@foxale08 2 жыл бұрын
What is this!? A center for ants!?
@ServeTheHomeVideo
@ServeTheHomeVideo 2 жыл бұрын
The building has to be at least three times bigger than this!
@vanderchicken3141
@vanderchicken3141 2 жыл бұрын
What is the point of filming and uploading 4k if you never take the time to make sure things are in focus? Half your video was a blurry mess. Focus peaking displays and external monitors exist for a reason. And for god sakes, image stabilization and holding the camera steady, instead of shaking it all about? Please?
@ServeTheHomeVideo
@ServeTheHomeVideo 2 жыл бұрын
This was literally a "ok 60 min to run through the floor" activity. All of those things exist (and the FX3's stabilization was on) but using them would have meant this video would not have happened because there was no time. I was the only independent media not just doing paid projects at SC21 so it was either this or nobody would have shown off all of the stuff on the floor this year. The SC21 Top 10 at least had a gimbal that arrived the next day after this was filmed. Normally I would have someone shooting to do all of this, but harder to get extra people during a pandemic show.
@blacklupus
@blacklupus 2 жыл бұрын
My 300$ Samsung phone has better image stabilisation than that camera. Can't watch videos like that.
@catchnkill
@catchnkill 2 жыл бұрын
He is a computer guy and not a video guy. Yes. A DJI mobile phone gimbo will do.
@biggerandbetterthings7222
@biggerandbetterthings7222 2 жыл бұрын
lol, give him a break, he is luckier then us :P
@caldodge
@caldodge 2 жыл бұрын
Ditch the stupid mask.
@ServeTheHomeVideo
@ServeTheHomeVideo 2 жыл бұрын
Required in the St Louis convention center
Crazy Ethernet SSD Hands on with Kioxia EM6 NVMeoF SSDs
16:03
ServeTheHome
Рет қаралды 66 М.
WHAT’S THAT?
00:27
Natan por Aí
Рет қаралды 13 МЛН
Little girl's dream of a giant teddy bear is about to come true #shorts
00:32
Fabiosa Animated
Рет қаралды 4,1 МЛН
A clash of kindness and indifference #shorts
00:17
Fabiosa Best Lifehacks
Рет қаралды 110 МЛН
First Water Cooled Mac Studio
17:25
Linus Tech Tips
Рет қаралды 2 МЛН
TinyPilot Voyager Simple Open Remote KVM with Raspberry Pi
26:09
ServeTheHome
Рет қаралды 55 М.
High end 2U 4 Node Supermicro BigTwin
11:04
ServeTheHome
Рет қаралды 27 М.
AMD Walloped Intel on Top500 Supercomputer List
18:57
ServeTheHome
Рет қаралды 30 М.
Inside a Liquid Cooled Bitcoin Mine
48:26
VoskCoin
Рет қаралды 184 М.
CXL in Next-gen Servers Will Make Today's Servers Obsolete
24:58
ServeTheHome
Рет қаралды 46 М.
This insane 500$ Water Block allows 13900K Overclocking above 6 GHz
25:00
iPhone 15 Pro в реальной жизни
24:07
HUDAKOV
Рет қаралды 419 М.
Самые крутые школьные гаджеты
0:49
Это Xiaomi Su7 Max 🤯 #xiaomi #su7max
1:01
Tynalieff Shorts
Рет қаралды 1,5 МЛН
Что не так с раскладушками? #samsung #fold
0:42
Не шарю!
Рет қаралды 214 М.
Klavye İle Trafik Işığını Yönetmek #shorts
0:18
Osman Kabadayı
Рет қаралды 6 МЛН