The close business relationships between AMD, Microsoft, and OpenAI are starting to make a lot of sense.

Potentially easier analogy; A CPU core is like a 4 math professors, a GPU core is like a 1000 promotional pocket calculators.

I hope there will be a common instruction set for matrix operations (what's in all of these AI-branded coprocessors) so that developers could just use it not specializing for a specific hardware implementation.

I definitely was considering a Phoenix APU before knowing about Ryzen AI and my excitement only increased hearing this news. AI upscaling for video content is the thing I'm most excited about because there are so many low bitrate low resolution videos out there and the potential for conferencing is also huge since webcams probably won't get any better (if the covid home office years didn't get OEMs to improve their webcams nothing will)

Great video! First time here but Im subbed. Loved the format and the info given. Well done!

Manual rotoscoping in video editors would take from a few minutes to hours depending on the complexity of the scenes, and I was surprised to see an AI engine pull that off in seconds.

You've absolutely nailed it on the need for strong software support. I looked into it, and apparently it has it's own special API/SDK required to utilize it. This is a big disappointment, they should allow it to plug in to DirectML (this is how AI acceleration works on Xboxes and it's great). By integrating it into existing APIs AMD would have a large amount of support out of the gate and avoid further fracturing the programming ecosystem.

Mindblowing stuff. Definitely convinces me to continue waiting for 7040 availability in thin and lights. Aside from all the potential applications, battery life improvements should also be significant.

Basically, AI needs to multiply the weights set by a model across the whole network to figure out the best fit output, but it doesn't need high precision, since it only needs to determine a rough estimate on it's certainty.

Nice video shot, thanks for sharing with us, well done :)

My best idea for AI in games is AI vision and hearing systems for NPCs. At the moment in gaming, let's take a Stealth game example, the enemies have vision and hearing cones, dumb pure distance mechanics triggering a behaviour branch if the player is close enough or loud enough, usually augmented with simplistic rules based around crouching, movement speed limits, baked shadow regions and 'special grass' Replace that with a quick and dirty low resolution rendering of what the NPC is looking at using the GPU. Now run that image through a trained neutral network. Suddenly this opens up the possibilities of real effects from movement, lighting and camouflage. Literal camouflage, you're trying to fool the pattern matching algorithm in the machine in exactly the same way we try to fool the pattern matching algorithm situated between every humans ears 👉🧠 Same with audio, you render the sound at where the NPC is and run it through another NN and see if it meets a threshold to trigger the NPC AI (too many things named AI) universities branch. The game design trick is feeding back to the player the level of danger they are in without hokey constructs like the 'interest danger' markers in games like far cry.

A highly interesting and insightful video! Thank you.

quaity content, thank u so much wd love to see more of you, specially for new chip paradigms , on the research side of things

Great video, very informative. These are the kinds of videos I like to educate myself on the future of computing. Coreteks is a great channel, but his niche is mainly for the future of gaming and graphics, which is less relevant to what I need to know about.

Always happy to see a new upload. Thanks for covering this! As a gamer, I’m excited to see how good AI upscaling become. DLSS 2/3 has already shown a lot of promise, now just waiting for AMD to release their version.

Wieder top Video! Again, a high quality video!

GPU-style parallel processors are very nice-to-haves for digital artists such as musicians, video editors, and animators.

great vid as always, thanks

ah yes, the APU that I've been waiting for. Not yet out there but looking very promising. Any idea of when it will be out? Also, are those AI cores also supposed to be used for something like FSR, such as in the way that Nvidia uses AI cores in its GPUs to sharpen and upscale stuff? Thanks and cheers.

I feel like, outside of notebooks and mobile computing, by the time specialized hardware is preferable for handling AI tasks, that discrete accelerator cards will be the market standard. Either that, or GPUs will market AI accelerators on their boards and make use of the insane bandwidth PCIe 5 gives them. Integrated AI cores will be more or less like integrated graphics in future in x86/PC applications

Ai is the future. Even now in its infancy it helps me a bunch. If it became 100x better in assisting me. DAMN! It'll do all my work for me.

Thank you and a great overview. I'm getting into AI machine learning and am hoping to utilize this new feature for training models. Do you have any resources on how to utilize Ryzen AI for machine learning model training?

This is what I'm waiting for. Hope it will be available in some mini PC form. Also hope there will be an API available for XDNA in Linux.

Microsoft will be requiring this and needs at least 40-50 TOPS of performance for it to be a smooth AI experience with windows 11, presumably with the upcoming Co-Pilot.

As an FPGA engineer I've used DSP cores to accelerate certain algorithms in hardware and upon hearing that MAC is the basis of AI I pictured the Leonardo DiCaprio pointing meme, where DSP cores are pointing at AI cores

Windows 11 getting its own software based AI-engine to complement these AI hardware accelerators that can improve Audio, video and telecommunications would be amazing, and about time as Apple has been doing this for years since they moved to M-series Macs.

Very good video. Most of the information on XDNA is exact, I mean not overestimated!!! All the animations on the AI Engine are really nice, compared to my poor PPTs !

Just looking at AI art, this makes me super optimistic about the gaming industry. The environments that AI will create will be incredible.

AI engines and dedicated AI capabilities are already available on Apple and Intel cpus. Apple has dedicated IP for AI offloading and intel has TMUL instructions in Alder lake for AI operations. It's just a matter of which one has more application support and which one is more effective in terms of performance and power consumption. Secondly as you said meteor lake has dedicated AI engine on the cpu and raptor lake has onboard AI IP.

i wonder if it will help at game resolution upscaling and frame interpolation

This was GREAT!!

What AMD needs to do is innovate further on their cache chiplet design and SoC infinity fabric IP to form a VRAM like cache for these DSPs. This is just another AVX extension or Snapdragon DSP equivalent (still awesome to see) but AMD is positioned to fix the real problem with machine learning models which is memory hierarchy. CPUs are surprisingly powerful compared to GPUs it's the memory locality that really makes GPUs outperform CPUs by so much due to cache misses in parameter space. Throw an L4 equivalent on the outside of the CCX chiplet and extend the ISA for AVX (also throw bfloat16 in there please).

Man I wish I had something like this when I was taking a class on ai last year. Some code would take several minutes to run. This probably would have cut that down a bit. If compilers can take advantage of such features on the silicon automatically it will have huge implications for students. Additionally once ai cores are common to most laptop chips universities can adjust curriculums to teach cs students how to leverage them before they graduate.

Very helpful 👍

what a great channel. i am so glad I found it..

sorry if you already mentioned this but are the ai cores only for amd to use for fsr or something or its something users can use for machine learning or whatever and how do these compare to gpu? like can i do as much as on gpu with this or how much better or worse is it? again, if you already mentioned this im really sorry but im too tired to rewatch it again today

Great analogy using the cooking! AI is here to say, and this is only the beginning. There will be more and AI in the future, behind the scenes, you won't even know its there, but it ill make tasks easier and better. Of course I'll get a phoenix GPU when they are released, the excitement is on the edge, not in the back row.

7:39-7:41 audio blip from the audio editing on “transistor”

Dude your accent is perfect for explaining technical stuff. Consider using a German word once in a while to make it perfect. Great work !

The'ol Math Co-processor is back!

What is your thoughts on Brainchip's Akida?

Mmmm... 🤤 That notion of game enemies leveraging the AI Engine, is nifty! I don't know exactly how improved it would be over the current means, which have already had "learning" abilities; albeit, minimal and session based. if the new one could store complex info and re-use it on the next game load, that'd be great. (although, this probably falls under "machine learning", not "general AI" 😕)

You should take a look at Alethea AI. They are introducing CharacterGPT. We can create interactive AI characters by simply entering some text. Also they are working on the ownership of AI generative content.

Going to need some new vector extensions to accelerate ai type workloads on regular cpus

If it only runs on AMD's APUs, then it will only run on a fraction of PCs, making for a small target market for software developers. It makes sense to add it to their desktop Ryzens to, and possibly their discrete GPUs, possibly even separate PCIe cards with just XDNA on it (market dominance will require the tech to be available to PC users with Intel CPUs and nVidia GPUs). But I can't see how the market will embrace this technology if it is only available on AMD's APUs.

A Ai engine coupled with a small FPGA on chip could cover a lot of non efficient tasks that would burden a GPU or CPU's main task set correct?

Are these type of engine more like a Coral o Jetson Nano, used only for inference, or can be used efficiently also for training?

Why there is "bleeding edge" instead of leading at 0:14?

This week I built an AMD system based on the x670e-Pro chipset (Pcie5) with an 8-core processor. When they come out, I will drop in a CPU with Ryzen AI ...

AMD should work to make it compatible with the ONNX format (by microsoft) it's open source and support a lot of hardware. It's the beginning of a "standard" for this industry.

Its a matter of cost as if the 7040 undercuts what is likely to be the m3 then there is a huge new arena of local voice activated LLMs that a single server can service a reasonable number of zones for most homes. The Home HAL is on the way and that is the 2001 type not abstraction layer.

There's still no benchmark results about 'Ryzen AI' till this moments.

I'm actually very happy to see this. I have been expecting something similar for a while. Although I was envisioning it being more like those "Physics" cards in the early 2000s. It seems that ever since the Xbox 360/PS3 era began, in game AI (NPCs, Enemies, wildlife, etc) has basically been an afterthought IF that. I believe it's because by the time those consoles were releases they were already rather outdated compared to PC capabilities and have been trying g to keep up (and failing) ever since. That means when studios make games, even if they will be prominently for PC, they can't get too "fancy" or else the difference between the PC version and the console versions wpuld be too great and point out how bad the system is. I doubt they would get a license to sell such a bad port and without console licenses they will not get budget. So in order to maintain the illusion of graphical improvements over time, things like AI and view distance etc. were left on the cutting room floor. Think about A-Life in STALKER games that allows for AI based enemy tactics, wildlife, and NPC interactions. It makes for a much more realistic, immersion heavy game experience that is almost always diffrent since even when you are not around or on the map, the NPCs etc do their own thing. Also think about the first FEAR game, the enemy tactics were amazing and felt real, but graphical quality was compromised to do so(was worth it). Anyway, my point is that I hope this is used for such things moving forward. I know publishers would almost never approve lowering graphical quality just for better AI since their market research says "graphics are the most importantpart of a game" (aka asking random people who have no idea what makes a game good, "what makes a game good?"). However if this hardware becomes more common, they wouldn't have to make that trade off. Lastly, I believe that MS and Sony only have maybe one more "Next Gen" console in them before the price/performance of a PC would surpass what they can make and sell. They already take a bigger and bigger loss on the system sales each cycle and rely on licensing to make up for it. However since they seem to use next gen APUs now, so that means of they can get, say a AMD APU with RDNA3/4 and "AI cores" games may start making use of in game AI again since it won't have to be a trade off/can be applied to console titles. They could also allow for things like DLSS type AI upscalling can be taken off the GPU and given to the CPU perhaps. I see APUs being the main go to in the future. AMD has the head start and chiplet stacking/3D cache can make them extremely powerful. I also see dedicated APU motherboards that have both system RAM and VRAM slots that will allow for more upgrade paths and less waste. Yes a mobo will cost like $300+, but you won't need the whole GPU PCB and there could even be some performance gains by having all of that in the mobo instead of having to all go through PCIE slots. Anyway, this is good news I think! There are also really promising potential for other things, but that is a secret as I am currently working on something that would benifiet greatly from such a thing. It wpuld also be nice to have offline home assistant/automation computing more readily available to more people instead of having everything that happens in their home get sent to an Amazon server to be analyzed and archived just so it can play a song when you ask it to. This is possible now if you have a server with a GPU now(like me) but it's not supported very well as far as software choices. If it wasn't such a weird thing to set up, I'm sure there wpuld be much more options. I will conclude here, thanks for the video!! I'm looking forward to hearing more on the new "Zen 4D" and how RDNA3 is evolving. I'm not keeping up with most the main outlets because they are getting annoying, so I'm counting on you to keep me up to date! :-D have a great weekend!!

RX-DNA is something I can see happening in the near future, imo this is too good of an opportunity to miss for naming a GPU

I am about to have lunch and that sandwitch looked so tasty that it distracted me from the topic of the video xD

Sheesh, it's about time. Apple and Google have had "neural engines" for years. Apple's new M-series SoCs have also good AI accelerator blocks.

Would be very cool with rpg games where the plot is set up, but AI follows the actions and style of the player to update the story during play. Making each playthrough unique...

Any news about apples rumored m2 pro and m2 max refresh?

Interesting, I see that the AI cores are VLIW. If that's VLIW like Itanium as opposed to VLIW like ATI's old GPU instruction set it's fascinating. Could VLIW work when in the limited context of machine learning inference? Will it be compiled or hand written? Yes, interesting indeed.

Would be nice to have A.I. accelerated graphics replacing traditional raster tech in the near future. Maybe full Path-Traced graphics with A.I. accelerators can make huge GPUs unnecessary and we can simply use APUs and re-shrink the ultimate gaming machines to the size of watches.

Is it going to replace tensor cores?

What about ai in smartphone chips?

The question is, with local AI processing, will applications stop sending PII to the cloud to be processed and cataloged improving use privacy, or will it just save Google, Facebook, Amazon, Microsoft, and others money on processing data, letting them harvest more "polished" PII.

I wonder if AMD's HSA (Heterogenous System Architecture) can rise from the grave now. Seems the perfect fit for adding AI inference to your code?

Is this the AMD 7040 series?

Interesting. This with artificial intelligence sounds nice and great, if it is programmed and used correctly. Can make cpu/gpu more efficient. Clearly this is part of the "internet of things" where everything is connected. But not many people think that artificial intelligence is actually fallen angel technology.

I have a feeling this is gonna be obsolete in five years when they come up with non von Neumann AI. The linear algebra accelerators in CPU and GPU they're still pretty competitive cause I don't think programmers want to work with the asic or they might need a more complex algorithm.

We need ai shader compilation to get rid of stutters.

I spent the weekend benchmarking apple M2Max and newer ANE. For densenet121, it can do over 700 FPS versus 100 FPS on GPU. It's taken AMD far too long to add tensor processors.

Notably, Apple A11 neural engine has never been used outside of Face ID, Apple made neural engine effectively public, starting with A12.

Cool, but what's the killer app??

the extremely rapid AI development in form of software and hardware implies this that, the hardware must be replaced much faster now

Nvidia have this for several years already. AMD was needing it.

i wonder how this is going to be exposed to the os and software. i'd like them to make this configurable through the compilers so that devs could use the ai cores if available.

Okay should I be buying M2 apple mini or Laptop or Win based intel i7 or Ryzen ? I am developer need lots of RAM, CPU, DDR memory and ability to work on databases, programming IDEs like visual studio, anaconda.

As we can increase system RAM, if this tech is harnessed well, and if it can compete and give outputs similar to RTX 4090 cards, "in terms of only AI", that would be great.

Is that a grandfather clock running off camera?

I want an AI that will help me get rid of Noisy neighbors

can't wait for my cpu to have existential crisis

I am concerned that if every tech company gets in on AI and it all backfires what the fallout will be and how they will try to make consumers pay for it to bail them out.

A big use will be night to light. Perfect sunny days in even pitch black. What is black for the human eye is just nuances of dark for the AI with a decent optic. and as such, you can implement it in the windshield and sidewindows in your car so at night, you get 240fps AI sunshine at 1am during pitchblack driving. On the phone too.. just hold up your phone or put it in a headset to see around you while underground, or outdoor while its dark.

Didn't Intel Icelake have AI accelerators? I may be mistaken though.

Nice

Thats no a big deal for 90% of home users, for shure. But wait till they make a partnership with unreal and we start seeing it on NPCs or something like that lol

I'd like to understand how strategies deployed by AMD will compare to NVDA, and maybe Broadcom with RISC /ARM, and is this why NVDA bought ARM? There is a hell of alot of hype about NDVA, are they likely to live up to that? What will AI do to already seemingly dying INTC?

Interesting, but it'll need to be sold to the average user of a PC as something they need. That will need to be built into the Windows 11 scheduler, which for some reason is having problems with Zen 4 cores over 2 CCD's, and Intel's big, little design. Understandably with 2 different core designs for Intel, but CCD's have been an AMD standard for generations now. Also Zen 5 will use a big Zen 4+ core and smaller Zen 5 little core. It'll be another generation, Zen 6 earliest we see AI in desktop CPU's from AMD.

What’s the difference between this and MMX?

There is always some hype. Not always being bad. I think it depends on both demand and chip design possibilities. I just don't know if that AI chip cores is not that what was otherwise listed in chip specs as there were AVX, MMX and other cpu extensions if correct. AMD calling software devs to make good use of those AI areas in chip really looks like other attempt to make use of raytracing or other cores. It's AMD business to sell what they make. I remember Intel Pentium MMX having some extensions, claiming better gaming performance, but when you went in AMD chip one gen later, you usually found that extensions there too, with sometimes either better pricing or simply higher raw performance over Intel. "I just hope my computer won't watch me for every single action one day in future, giving me advice to live better, faster, more efficient and doing more things at once, asking only plug me into grid and slap cooler on my head. Turn me off if I become idle but consuming too much." (xd) When I played chess with computer, it was tough at medium difficulty on PC 8086 upto 486. 3D shooter bots in Quake 1 or 3 were beatable bit higher, being quite fast, dextrous and a accurate. Playing vs bots in World of warships seems quite easy most of time, they sometimes get stuck at islands( no complain on devs), mostly not that devastating gunners, but already change course, speed etc. It is still programmed, having bots with performance equal to human is not goal of coop game there (IMHO), many players prefer relax, easier game than that one pvp. But I can imagine AI could make fair bot enemy either matching player skills or surpassing and teach what to improve passive way or with guidance/AI tips. Finally AI could just teach car drivers how to drive well without complete automatization of it. I personally don't seek AI driving my life, some Google results on my casual search is enough.

Basically AI is not well suited with Windows 10/11 OS, but if Windows 12 comes with an AI software integration with the AIE processors...we will see a huge revolution in processing data and information....when playing games, your computer will know straight what is the average resolution and quality to play the game before installing....or youtube will know the perfect resolution and internet speed for your videos, and aditional content...and in Microsoft office.....in excel to predict about your data imput...or microsoft word to correct your spell(s)....and if microsoft aquire Chat GPT, plus a software integration with AIE processors.....then will be a feast

Why don't we get this accelerator on desktop chips?

Yeah, AI hardware is definitely mass producing fast food. Or even junk food, when you consider that precision can get as low as just two bits per coefficient.

Are AI processors going to be programmed by a specialized programming language like GLSL or OpenCL for GPU's? I hope they get standardized soon so software can take advantage of the hardware even if it is from various different APU or AI hardware producers.

It seems Meteor Lake is d e l a y e d again and may even be scrapped ( at least for Desktop) due to the lack of high CPU Frequency , instead there may be another Raptor Lake Refresh , Raptor Lake itself wasnt planned and is only a refresh of Alderlake . Maybe we will see Meteor Lake on mobile 2023 but that depends on " Intel 4 " which still has some issues but may be good enough for mobile .

AMD must adopt the soc design.

my heart broke when i saw that DSP, i shouldn't have upgraded too soon

maybe they can use this AI for pricefinding that isnt redicoulus for the 7000 series cpu....

I want my CPU, GPU, APU, and QPU (Quantum Processing Unit).

Wish amd would get into arm chips. We need a new mobile OS for phones that can hdmi out for desktop mode.

So a return of the FPU, math coprocessor.

It's not exactly the singularity -- but it will be an important milestone when gaming NPCs become more interesting and thoughtful people than the mass of real human NPCs who actually run the world. We're already getting very close...