Thanks so much for including our RAK system Wendell! (replaced axe handle or not!) Your 8-channel vs. 4-channel testing results mirror our own - it's incredible the performance boost 8-channel memory gives to UE compiles!

"So I bought 3 other Threadripper systems!"... Never change Wendell.

you're living your best hardware life building these epyc systems, and you look a lot healthier, and the content is always very detailed. very inspiring bro.

Please make more videos geared towards game dev workloads, there is very little good information available out there when it comes to hardware configs for things such as build servers.

Thanks for the mention and the hardware!

Real world utilization! YAAAAAAYYYY!! Thanks, much appreciated 😁

OMG I love you! Some of the best information for Threadripper systems. This video was super helpful, please give me more!!

Good stuff, definitely looking forward to more of this.

It would have been interesting to have a baseline of fastest AM5 alternative with these Threadripper comparisons as it would give a baseline of something individuals with limited budgets would actually buy for this.

I’d have killed for this performance a few years ago… I was running a XR research project for the BBC and we were recompiling an Unreal Engine based prototype between users to explore accessibility customisations…. Waiting 15-20 minutes each time was brutal and limited the amount we could experiment and learn from each user.

Even though ill probably never use a threadripper machine, I always love the content you do with these kinds of systems, keep up the great work Wendell!

AMD Threadripper had a marvel movie it would be "Threadripper in the Multicore of Madness".

Really useful comparison info. Would like to see some modeling workloads, like mapping and water modelling. That's a common use case for these big budget workstations.

Amazing! Thank you Wendell, I have been looking into making a ramdisk based TR / Epic dev machine for UE. Now if only AMD and industry could kick off the CxL memory option too so that we can have some additional and larger RAM storage or cache options.

Oh these big compiles... I remember the initial compilation tests on Threadripper 1950X (also different usecase when I was comparing some Open CL workloads run on it vs. on Fiji Pro), that platform was stellar after years of Intel 4 cores 😁 1950X still going strong today in my main PC, but simply no competition to the current gen whatsoever, not even the normal Ryzens haha

I've have been running a 14 core broadwell xeon for a while now with quad channel ddr4 and I have constantly been geting weird stutters despite my system supposedly being pretty beefy. Sure it's old for some games but it's really strong for nearly everything I ever have to do for it. Fast forward to a month ago when I started trying to play Helldivers and the stuttering had been at it's worst. Looking for solutions I found a few settings for windows that were supposed to be for helping laptops save battery power. Now I have maybe rebuilt windows 4-5 times on this rig, probably more. So I've tried countless settigns and fresh installs and kept seeign the same issues. Memory tests never showed any issues either. The setting that I think helped the most was disabling dynamic tick. It was either that or disabling multiplane overlay or disabling core parking with the registry. Ever since those changes windows has been razor sharp. Helldivers is butter-smooth and fully ray-traced Cyberpunk went from 45 fps to an easy 60. It was never the gpu, I was always cpu bound in all of these tasks. My theory was that my 14 core cpu was barely breaking a sweat and so windows was clocking everything down to needlessly save power. Have you encountered anything like that with high core count chips like the threadripper? PS: this is somewhat unrelated but blocking windows search in the firewall is a handy way to tempter that nuisance as well.

Which DDR5 modules did you use to hit the 1TB load?

Zram (also Zswap) lead to regular deadlocks on our bigmem hpc nodes. Not worth the trouble.

On 4chan Threadripper platform, it is clear that the memory bandwith has not scaled as fast as the number of cores and compute performance, and cache can only help up to some point where raw bandwith becomea critical. Computing the Gb/s per Core or Gb/s / Gflop is a good indicator. Also the size if the active dataset is critical: if you have 100Gb+ of active data that is accessed constantly, the memory bottleneck is probable, like in CFD for example where a large set of data is treated iterativelly at each simulation step.

Really amazing performance overall, but as you mentioned; the CPUs have gotten so fast that they are specifically good at things like compiling. I have a 3960x system and it is still blazing fast for my development work. My software isn't large so compile time is like literally instant.

Can you run CFD benchmarks, like WPCcfd 😭🙏

I wish I could play (and work with, I know you work hard) with all that hardware. Instead if I want to learn CUDA, I have to scrounge over 300$ on Jetson Nano 2GB Dev Kit. Jetson Nano itself is cheaper, but it has to go on the board, which isn't cheap. And I know there were some extensions....... getting off track here. I am jealous and envious Wendell - you're beautiful human being, but I do love so much hardware!

Those cases are huge.

zRAM! It's like Shazam!, but for your Linux system (queue drum riff)... Jokes aside, this was another very informative presentation. I've been running Arch on all my systems for several years, and among all the lesser known optimizations, zRAM is not one I had knowledge of until today. It also seems like some distros are enabling zRAM by default like Pop!_OS. My current threadripper build (7970x) just got a lot more exciting!

Bro, I really appreciate this deep dive. I always assumed that the 64 was going to curb stomp on the 32, but that isnt really the case. Unreal (and other programs like Houdini) can be real zebra cases lol

Need to test if memory ranks also have an impact. Would like to test my 2990wx with 256gb vs the 7000s :)

I’ve been compiling UE4 on 3700x before, and it took hours to do so. These system are certainly fast. One game that I was working with is on Unity 3D and … damn it took hour to build. Turn out it runs external tools to convert those textures (and it runs through node js script to boot). I usually start my works on clean build so I do have a few hour for making coffee every enhancement I worked on lol.

I'm curious if one of the Epyc 3dVCache 9004X series chips would outperform the TR pros even if you went with lower core count Epyc's.

The "Unity building process" you refer to is actually called a "Unity build" or a "Jumbo build", and has nothing to do with Unity the game engine. Instead, it entails combining all the source and headers into a single translation unit, which can lead to significant speedups, because headers don't get repeatedly compiled in every TU, and linker has less work to do.

very interesting, it seems like when you have twice as many channels as you do ccd's performance suffers (as we see with the 32 core 8 channel). Its almost like each ccd is working extra hard because it has to handle more channels. As for the 24 core with 4 channels, understand there are still 4 ccds here (6 cores per ccd), so we dont see it impacted vs the 32core 4 channel (which you verbally mentioned.) Correct me if I am wrong here.

How did the Silverstone Rack Case go with the non-Pro Threadripper?

What is the aio watercooler model at 4:29 ? @wendell

It took me a long time to learn a valuable lesson about computers. PC's are by far the fastest depreciating thing there is. I built computers for 25 years and lost my ass on all of them. I now buy only last gen PC's from Dell or Lenovo. I am on a refurbished I7 13700 that I got for $560. It's so much more satisfying getting a deal than building your own at an extreme loss.

The stutter problem is interesting. Why could it be ? Are you sure it is TPM ?

CPUs have come along way. When I first started compiling a full build of UE 4 it took over 4 hours for a full build. Even a modern i7 can now do it in about an hour. However, unless you are making low level engine changes you are probably doing an incremental build and not a full build of the engine. An incremental build is usually less than 10 minutes on most modern desktop CPUs. These machines great for a subset of the development team, but probably overkill for most devs.

Would love followup on the TPM stutter stuff... Purchased a discrete TPM for my 7970X build, specifically to (hopefully) address this issue?

Wendell looking more healthy ever video

Wendell you're the only one I know whose buying Threadripper. Most given up on AMD after they screwed them over with X399 and TRX40.

6:26 wait....you compiled clang???? Thats a brave man right there!

@level1techs At 2m 53 seconds, the black server rack in the middle, could you share the name please? :) (Looking to buy a new server chassis)

saying you have a 'problem' really is an understatement. I get that this is your business and all, but those are €10.000+ systems (probably 20.000+ by the time it's fully outfitted) and you have like 5 of them

If I recall TPM stutter on AMD was caused by the fTPM. Maybe using an actual TPM module eliminates it? All of the TRPro's I have deployed at the office have a discrete TPM and do not suffer this issue when compiling UE.

I'm so glad a channel like this exists.

Can you run MS SQL Server under Linux and avoid the processor group nonsense?

Yeah, mystical hardware indeed. As I saw the Thredripper 4000 series launched, and no DIY hardware. Just the OEM's are getting them. But 69 minutes, NICE!! HUH-HU!!

*_AHHHHHHHH!!!_* 😖 My BRAIN hurts! 🧠🔨 I just saw that ASRock WRX90 motherboard at NewEgg earlier today. It's *BEASTLY.* 👹

But how does it bench on MS Office Suite?

Waiting for SQL video :)

I'm going to be really sorry if ATX goes away, I have some -axes- pc cases still strong from the 90s.

Can you elaborate on how TPM stuttering affects compilation, and how you detected that? Windows or Linux?

You have more computing power and memory there than many universities here in Spain.

Opinion: Should I buy a threadripper pro 24 core cpu or is it so much better to get the 24 core series 7 pro or no pro?

What's the use of a 2TB swap?

LOL ... literally as i am developing on UE5.

Thanks for posting this. Would be cool if you could do a real world rendering test using Dreanworks' MoonRay (now free open source), even if just for a 10 second scene.

@1:10 - I wonder will the axe/blade/handle story "Trigger" anyone?

i had to double check he wasnt sped up the first 8 seconds

In a case like this, deactivating Hyperthreading may help.

I think that when you compare the price/performance, it looks like that the sweet spot might actually be the 64-core, non-Threadripper Pro, with 4 channels (TRX50), and 256 GB of RAM. I haven't run the calculations yet, but to get it down to sub 10-minute compiles, you're just throwing money and hardware at the problem.

The overhype of UE is actually counter productive as it makes graphics evolution stuck with old screen space and shadow map techniques. Convinient developers may forget about path tracing and use mediocre lumen instead that got lots of light leaking, inaccurate scene lighting and flat reflections etc.

Gigabyte just announced a new TR motherboard :) The TRX50 AI TOP Will you test it ?

Speeds up from 32 to 24 cores? Perhaps memory starved cores? I do know that currently with linpack and other memory heavy workloads, at 6200 or 6400 MT/s, buildzoid can manage to fully utilize between 10,5 and 11,5 (21 to 23 threads) cores on 12 and 16 cores desktop parts. Now 8 channels of memory should prevent that, but if there is bottleneck somewhere in infinity fabric - maybe that could warrant small investigation? Like checking if all cores fully utilize memory and seeing if IF overclock alone doesn't improve results. Also it would be cool to see how X3D parts handle it, but maybe that is further in the video.... I keep pausing and commenting.... well at worst it shouldn't be bad for the algorithm.

Through the magic of buying 3 more of them..

It’s hard to justify Threadripper Pro or even Threadripper when EPYC Genoa 96 core with all the server goodies is available on eBay for less than the cost of a 24 core Threadripper….

I didn't understand 1/10 of this😂, I'm just fascinated by these Threatripper CPU's. I run a 7900x, 32gb 6000mhz DDR5 ram for focus stacking extreme macro photography.

The TPM stutter still wasn't fixed! :-0

When are we going to get 3d v-cache on threadripper?

Wendel, next you're playing Unreal Tournament 2004 in the Omni onslaught server on a Saturday or Sunday night say hi to a brother 🙂 - Unicorn_Vomit

The 'rip of Theseus

Damn, sad to see we're still doomed by the TPM stutter issue.

People still run windows for something that isn't Desktop?

The bogeyman of "Processor Groups" emerges again to scare the children, but yet again there's no data to substantiate the scary legends. Benchmark the build on Windows and Ubuntu and share the results, and then if the Windows results are markedly lower, perhaps that's the explanation. Until then, the sky's not falling in the Windows scheduler, as far as I can tell. And I say that as (a) someone who runs Proxmox on my own 7995WX, and (b) hasn't touched the kernel in 25 years. But without numbers, it's just an oft-repeated opinion.

Interesting. Would like to see a follow up video on a Intel platform. Including a workflow to any kind of VR real time.

so 96 cores without SMT is sweet spot? 😄

You mentioned testing Grok is these Threadrippers related with that ?

7 months later and there's STILL f* all motherboards for TRX50. Where is the Zenith Extreme? Aorus Xtreme? Etc etc. Compared to the extended functionality and greatly increased MB range of TRX40, TRX50 is a bit...sh#t. AMD putting another nail into enthusiast/non-pro Threadripper!

Yowza. This is an expensive video.

Who is upvoting the comments from KZfaq's porn bots? what !

Still disappointed with AMD’s decision to only use a 4-channel memory configuration with 1DPC motherboards for non-PRO and 8-channel/1DPC for the PRO variant. They f’ing knew that 2DPC is a pain-in-the-ass on these platforms then don’t castrate the theoretically available 12 memory channels at least on the PRO configuration to give users more memory slots.

No one is doing full rebuilds for every run. Plus, there is also distributed build.

One of the sad things about the experience building on Windows being better? Windows sucks as a platform. It's a shame that all that great engineering has been done to have it all tossed on a bonfire with bullshit features and spyware.

Just let me know when you don't want one of those anymore.

If your game needs a 10k PC it's going to fail

Nice tax write-off...oh, my bad, wrong channel!

Unreal engine more like possed engine lol they them engine