The June 2024 Tech Debrief: Computex, AI PC, and all the Chips

Рет қаралды 6,209

14 күн бұрын

Part of Today's stream is #sponsored by ASM: lnk.bio/ASMOfficial
My Newsletter: www.more-moore.com
Follow George at Chips and Cheese: www.chipsandcheese.com

Пікірлер: 29

@TechTechPotato 12 күн бұрын

Part of Today's stream is #sponsored by ASM: lnk.bio/ASMOfficial

@quantuminfinity4260 12 күн бұрын

No wonder they’re so expensive, Dr. Cutress keeps eating them all!

@thereddog223 12 күн бұрын

Nom nom

@susanparr1006 12 күн бұрын

Need to get improve George's microphone setup

@EricLikness 10 күн бұрын

Something about 1.)Noise Cancellation or 2.)Noise Gating is clipping George's mic so heavily that at start|end of each short sentence it kind of stifles/deadens his audio. For longer sentences/dialog, it becomes easier to listen to. Having said that, the closer George leaned over towards his microphone, the better it sounded. So that's the simplest fix. 👍

@donnydarko7624 11 күн бұрын

Moving CAMM2 to the back of the motherboard giving boardmakers the ability to shrink the trace length seems like the obvious move for the technology.

@Chicagoben 11 күн бұрын

It’s not very consumer and vendor friendly though compared to dimms.

@LisaSamaritan 12 күн бұрын

DIMM is from the 90's, before that we had SIMM (in the 80's). But the design is similar in both.

@EricLikness 10 күн бұрын

1:37:11 nVidia for Training AMD for Inference. I will take note of that. Definitely worthwhile. Inference long term is the ONLY rent one can seek after something's been trained and the "gold vein" of data has been depleted. They (the whole lot of them) with their LLMs want moar, and moar data. And now are trying to create funny ways of "synthesizing" the data to train on. So definitely Inference is the only way any of these companies make a profit in the future.

@ChrisJackson-js8rd 11 күн бұрын

asrock's making ocf mobos again? i wonder what the availability will be

@ChrisJackson-js8rd 11 күн бұрын

i think it's probably early for a debate about whether ai pc can compare to windows 95. and i don't think subject matter experts are the people the best situated to make the comparison. windows 95 was significant more than anything for how it opened up the pc to lay people and allowed non-experts to do the things on pc's that only experts had been able to do previously. and then the effect that had on the pc ecosystem. microsoft definitely seems convinced that ai will significantly change how the windows ui is designed. whether that's about making the ui more accessible or making it cheaper to build and maintain isn't something theyve been very clear about.

@chrisgarner5765 12 күн бұрын

50 tops npu vs old 3090 = 600 tops, I mean any 3000rtx or better is generations faster, so on desktop it does not mean much same for any laptop with rtx.

@MaxIronsThird 12 күн бұрын

4W vs 400W

@LisaSamaritan 12 күн бұрын

That's right. NPU's are for running things in the background, with minimal power draw.

@chrisgarner5765 12 күн бұрын

@@MaxIronsThird I get the power thing, I'm more talking in general, but I'm running multiple 20b parameter models at a time on my machine, so for me power is a moot point. My work load will not even run on a laptop.

@pilsen8920 11 күн бұрын

@chrisgarner5765 Yeah, it's not for development it's for end user's. I would think a developer would know not to use a end user product for development.

@chrisgarner5765 11 күн бұрын

@@pilsen8920 yep, but Microsoft and vendors make it sound like you cannot run AI without a npu and that just isn't true lol is more my point.

@Xevos701 12 күн бұрын

CHEESE

@cracklingice 5 күн бұрын

Silly vendors. CAMM2 is for laptops.

@--waffle- 12 күн бұрын

"Live to LinkedIn"....lol, that's some proper nerd shit right there.

@spewp 11 күн бұрын

This stream is a tough listen. If you have to coach your co-host through everything you want them to cover, might as well just stream it yourself?

@TechTechPotato 10 күн бұрын

George is still learning how to explain stuff to a wide audience. I have 10+ years of experience on him. But he has knowledge I do not, and provides a different perspective

@FARFolomew 11 күн бұрын

NVIDIA and its valuation is such a black box to me. I just don't get it. I can understand its total domination and position in the world of AI, but I can't tangibly grasp the uniqueness and quality of the products NVIDIA makes and the effect they have on the world stage like I can with a company such as Apple, for example.

@chrisgarner5765 12 күн бұрын

I mean mi300 vs Blackwell, there is a huge bandwidth différance between them 6TBs per sec vs 8TBs per sec is a huge différance at scale also cuda is now closed source lol so AMD and intel will finely have to do their own thing vs coping someone else's work!

@chrisgarner5765 12 күн бұрын

We do not need CAM, we need desktop to switch from dual channel to quad channel! So in doing this, ddr4 in quad channel would still be comparable to ddr5 in dual and would allow headroom to the customer and vendors! CAM isn't very friendly to the consumer or vender!