Architecture All Access: Modern CPU Architecture 2 - Microarchitecture Deep Dive

Architecture All Access: Modern CPU Architecture 2 - Microarchitecture Deep Dive | Intel Technology

Рет қаралды 143,674

Күн бұрын

What is a CPU microarchitecture and what are the building blocks inside a CPU? Boyd Phelps, CVP of Client Engineering at Intel, takes us through key microarchitecture concepts like pipelines, speculation, branch prediction as well as the main building blocks in the front and back end of a CPU. Want to learn about the history of CPU architecture? Check out part one here: • Architecture All Acces...
Boyd Phelps has worked on some of the most well-known chip designs in Intel’s history, from Nehalem to Haswell to Tiger Lake and more.
Architecture All Access is a master class technology series featuring Senior Intel Technical Leaders taking an educational approach to the historical impact and future innovations of key architectures that will continue to be at the center of ‘world-changing technology that enriches the lives of every person on earth.’ If you are interested in CPUs, FPGAs, Quantum Computing and beyond, subscribe and hit the bell to get new episode notifications.
Chapters:
0:00 Welcome to CPU Architecture Part 2
0:51 Meet Boyd Phelps, CVP of Client Engineering
1:14 What Are We Covering?
1:47 Key Building Blocks in a CPU
3:16 Pipeline Depth
5:15 Speculation
7:06 Branch Prediction
7:35 Speculative Execution
12:48 The Microprocessor Front End: Predict and Fetch
14:44 The Microprocessor Front End: Decode
17:19 Superscalar Execution
18:36 Out-Of-Order
19:57 CPU Back End
23:35 Micro-Architecture Summary
24:39 Where Are We Headed?
Subscribe now to Intel Technology on KZfaq: intel.ly/3P9BA7x
About Intel Technology:
Intel has always been at the forefront of developing exciting new technology for business and consumers including emerging technologies, data center servers, business transformation, memory and storage, security, and graphics. The Intel Technology KZfaq channel is a place to learn tips and tricks, get the latest news, and watch product demos from both Intel and our many partners across multiple fields.
Connect with Intel Technology:
Visit Intel Technologies WEBSITE: intel.ly/IntelTechnologies
Follow Intel Technology on TWITTER: / inteltech
Architecture All Access: Modern CPU Architecture 2 - Microarchitecture Deep Dive | Intel Technology
/ inteltechnology

Пікірлер: 198

@LeleSocho 3 жыл бұрын

Hey this was incredibly produced and clear enough for many people to understand, you guys should publicize it more because i stumbled upon it almost casually.

@hariranormal5584 3 жыл бұрын

When a actual Microprocessor company makes a video UNDERSTANDING how they work? Heh, and for the fact this actually isn't made bad. Don't get me wrong other content in KZfaq that explain this sometimes can be easier and maybe harder. But I actually am amazed Intel really is doing this

@monavie9110 2 жыл бұрын

@@hariranormal5584 absolutely

@GregoryJones9038 3 жыл бұрын

Honestly Boyd Phelps did an incredible job with these two videos. Granted I've been around since the 486 days and have always had an understanding of the various CPU architectures, but this was incredible with it's depth.

@adinchandra1797 3 жыл бұрын

First time I have Phone, Internet access and Social Media, I started Addicted to all about Technology Especially about CPU

@platin2148 3 жыл бұрын

I would look at posts from fabian gisen and agner

@user-eb6vc2gs9e 3 жыл бұрын

This means you know who is George Boole

@tuongnguyen9391 3 жыл бұрын

I want intel to make more technical video like this. The more the better, I have a genuine interest for the inner working of the product instead of just buying it and wish for larger caches , better features.....As a customer , I really love your dedicated effort of creating a highly understable video with good analogy

@bgtubber 3 жыл бұрын

I love this series! It's incredible how these devices even work without a hitch given how mindbogglingly complex they are.

@glenwaldrop8166 3 жыл бұрын

What's really amazing is they don't run without a hitch, there is an acceptable error rate that they recover from. That is part of why systems are more stable today than previously, more threads, more cores, if a thread crashes it doesn't take down the entire system. It's not just at the CPU level but errors still exist they just don't take down entire systems as often.

@karenkomeh737 2 жыл бұрын

@kilman54 3 жыл бұрын

I don't normally thumbs up or comment on a video, but, when I do, it's because a channel has done something really amazing and I want them to continue!

@ThunderingRoar 11 ай бұрын

The editor needs a raise

@JJsTechEsports 3 жыл бұрын

Incredibly well done, breaking down such a complex topic into chunks that are digestible isn't easy and you guys did that super well!

@Happiness-lp9fw 3 жыл бұрын

24:30 Yes, it was very beautiful 😌

@kcvinu Жыл бұрын

Lots of information with high quality content. Great effort Intel !!! And the host is doing an amazing job. His way of teaching is marvelous. For the last few weeks, I was searching for the topic "Computer architecture". Since, I am a hobby programmer, I would like to know more about how CPU execute my code. Thanks a lot for this series. :)

@MadamLava094 2 жыл бұрын

This was actually incredibly well put together! I always found that nothing really would ever bother to explain how exactly the subcomponents of a CPU talked to eachother, but this really helps show how a CPU is a lot of smaller, specific-purpose modular pieces talking to eachother

@sulikns4152 8 ай бұрын

Oh thank u very much! reading "Inside the machine" book for now and it was too hard to understand all of this. This is great videocourse!

@alexandrebustico9691 3 жыл бұрын

Love it. Explanation on branching and speculative execution is great. We must emphases that branching is the key of turing completeness which permit the birth of computer from previous simple calculator.

@mistercohaagen 3 жыл бұрын

Haven't been this captivated since reading Peter Norton's pink shirt book; "Programmer's Guide to the IBM PC". Deep and geeky is what the future is made of.

@SaladinG14 3 жыл бұрын

Awesome animations and analogies, altogether very easy to understand! I admit I'm heavily biased, but I think even a lay person with some passing interest would be able to understand a few of the important big-picture points.

@Nelthalin 3 жыл бұрын

Thanks Boyd for these very clear video's i knew the basics but Part2 was very interesting and helped me to paint a clearer picture of what was going on. I would love to see more of these video's and even go more in depth!

@FullBrainiac Жыл бұрын

The content of this video was so clear that I saw myself working at an intel lab for a brief second in a near future. Thanks Boyd !!! Great Video

@aaronchung9838 3 жыл бұрын

This is so good, it is easy for a newbie to understand. And it’s not boring for someone who’s already knows how a CPU works.

@KillerLettuce 3 жыл бұрын

This was really cool. Any can get a part 3 that explains how this is all translated onto a physical processor? How do we take these concepts and functions and make them work in the physical world?

@localcashmere 2 жыл бұрын

Think of it in this way, trillions of electric signals go through a CPU, these electric signals are sometimes of low current, sometimes of high current. Low current is interpreted as 0, while High is interpreted as 1. Now we have all the characters that make up the language of computers. The CPU then uses Hardware languages like VHDL to operate these 0s and 1s. This is how Physical things do software work.

@fernandoayala876 Жыл бұрын

Having had the opportunity to be at Intel for years (no longer there), so proud to see these series coming up. Very well done, something rather complex explained in a simple form. Hope that entice and nurture the imagination and curiosity of everyone, especially younger ones!

@jamespriest7328 3 жыл бұрын

Love this intel!!! Do more of it and yes let the world know about this. Ads maybe.

@spithere4933 3 жыл бұрын

This magic! many civilizations shook

@twpayne 3 жыл бұрын

This is absolutely brilliantly explained and presented, thank you.

@Validole 3 жыл бұрын

Very well explained. The microcode decoding part was especially informative.

@aimanbryan1424 3 жыл бұрын

This is beautiful.

@vaidotasremeika7200 3 жыл бұрын

Absolutely amazing, thank you!

@Umeldaraje 3 жыл бұрын

I am in chip design from 1984 and tried many times to explain to people what am I doing. If I would have had these videos my explanation could have been easier. The animation and graphics are unbelievable quality. The Part 1 is a good umbrella explanation of the chip design in general and CPUs in particular. I will call this the 10.000 feet view. The Part 2 is the 1 foot view directly into the processor architecture so some industry lingo and knowledge is required. I would have liked to have a 3.000 feet and a 100 feet view for popularizing chip design and CPU for people who do not have an electronics background. Intel has all the capabilities to do it so please consider it. In the times of Artificial Intelligence and Biotech advancements making more people understand where all started and how it humans can benefit from their merger should be a good topic to cover. Looking forward for new videos from you.

@mfc1190 Жыл бұрын

This is literally amazing. Great explanation and great work on building these technologies. Speculative execution was really cool for me to learn about

@ttlim6752 3 жыл бұрын

Thank you Intel for putting this up. I like it a lot!

@Reinturtle 3 жыл бұрын

It is a freaking miracle that we can make these things work reliably!

@mattanderson2074 9 ай бұрын

Absolutely brilliant. From start to finish.

@DANKAF 3 жыл бұрын

very helpful for CS students

@binhnq_tokyo_shorts_24 3 жыл бұрын

It was truly remarkable. The best and most stunning lecture about CPU that I've ever seen.

@DeepFrydTurd 2 жыл бұрын

This is entertaining :) I already have a CS Degree and work as a Network Forensics Analyst but I still find this entertaining better than watching some non sense videos. I like learning about the physics of the electrons or photons inside the CPU highway and logic gates and conducting test's of new architecture designs in a digital 3D simulator environment.

@AlexSchendel 3 жыл бұрын

Honestly an incredible series! They seem to have found a perfect balance of details versus overview. It's not so high-level to seem common sense and it's not so in-the-weeds to seem impossible to understand. Also, the animation work is amazing. Great work all around.

@TalonsTech 3 жыл бұрын

Good stuff. This was highly interesting watch. Enjoying my 11900K. Looking forward to Alder Lake and Intel’s GPU launch.

@julienp4563 3 жыл бұрын

Thanks for this content, I liked it. I wish and hope more technical content like this one in the future.

@nadranaj 2 жыл бұрын

great video with excellent graphical representation to simplify the complex concepts.

@Anurag_Saxena 7 ай бұрын

superb. mind-blowing. beyond one's imgination!

@renzomarini2480 3 жыл бұрын

Please do more of these! I'm really enjoying the series.

@pierreboyer9277 3 жыл бұрын

Thanks for the video. I learned interesting things !

@sahandsalam4627 Жыл бұрын

Extremely motivative and well comprehensive.

@orelmac 3 жыл бұрын

Loved it. Thanks!

@kentlisius7675 3 жыл бұрын

I really liked the TV sticks with the embedded technology they came out with. Above all I've found that the key to unlocking the potential of any product is to have in specification RAM from a quality manufacturer!

@mallikarjunareddyankinapal5977 2 жыл бұрын

Great summary of uArch. Awesome!

@slyblood85 3 жыл бұрын

Awesome videos I can show people to help them understand what I am talking about, only thing I think was missed(unless i missed it) was how hyperthreading works in the pipeline.. that'd been cool to show.

@Sakur.aiMusic Жыл бұрын

This was actually extremely informative. I already knew a little bit about micro-architecture before hand. And now, seeing how some of this works, both the re-order buffer and branch prediction seem like they could be exploited to run unsigned code.

@vanshthakur7060 2 жыл бұрын

what a beautiful and educative illustration!

@tosemusername 3 жыл бұрын

Well done, Intel. Loved it. Wish there was more of this.

@thomasdevisser Жыл бұрын

These videos are so impressive, I would pay for a full course

@computerscience-hx7vn 4 ай бұрын

Incredible! the explanation and animation both!

@OTechnology 3 жыл бұрын

This is an incredible video!

@justsomejazz 2 жыл бұрын

Thanks so much. This is fantastic. I'm using this to teach my daughter.

@paramveerteli 3 жыл бұрын

Seen both parts. Great....

@Validole 3 жыл бұрын

Will you make more of these? They were incredibly informative: before, caches and pipelining were this black magic that was hard to reason about, especially as my previous reference point was essentially AVR MCU architecture (let's leave aside PIC because that's an entirely different beast altogether).

@AliceyBob 2 жыл бұрын

I have not got words for congratulate this amazing videos !!!

@Arkan_Fadhila 3 жыл бұрын

Thank you for this beautiful explanation of modern cpu. I hop you don't stop producing this series. I think GPU will be interesting topic to discuss as we all know intel have great iGPU today and hopefully will release discreate gpu soon

@dennysgrimaldi9623 3 жыл бұрын

This is really good, nice video

@MrJackPL 3 жыл бұрын

This is just awesome!

@Olibelus 2 жыл бұрын

This was amazing, thank you!

@harirao12345 8 ай бұрын

Fantastic! Thank you!

@shaxjl 2 жыл бұрын

very very great video!! thank you very much!

@agitkaplan7991 8 ай бұрын

Great videos, thanks!

@leonardjoseph3152 3 жыл бұрын

thanks for complete and clear explanation

@vladmihai306 3 жыл бұрын

Great video, congrats for making it!

@Nour-eddineTaleb Жыл бұрын

Very well done, but still waiting for the cache episode.

@mycollegeshirt 2 жыл бұрын

That was soo soo fantastic, I can't believe it wow.

@mariocortes2670 Жыл бұрын

Great job and great video!

@sunilkumar-ls2yb 2 жыл бұрын

great and simple explaination dude

@MrHav1k 11 ай бұрын

This is an incredible video!! Leave it to Intel to produce it. Thank you!

@cralx2k 2 жыл бұрын

JUST AMAZING... thanks

@ljwobker 3 жыл бұрын

This is really great stuff, but I found a bug in your code at the 5:00 mark... A 5 GHz processor doesn't mean "each completes in 5 billionths of a second" -- it means that each completes in 1/5 of a billionth of a second. It's a clock every 200 ns, not a clock every 5 µs... But at least we didn't divide by zero!

@SaladinG14 3 жыл бұрын

Nice catch!

@praveenalapati5234 Жыл бұрын

Excellent Presentation.

@Van_Verder Жыл бұрын

Stellar presentation!

@luminomaximus8583 3 жыл бұрын

Thank you.

@elhadjiousmanediallo1618 3 жыл бұрын

Highly informative

@mycollegeshirt 2 жыл бұрын

Man if you guys could go even deeper, it whatever just amazing work

@aleb34 2 жыл бұрын

the pitch at 4:57 gave me shivers

@stachowi 2 жыл бұрын

Totally found this by accident, but so informative.

@friendlyfripptit2228 2 жыл бұрын

This mini-series was excellent! yummy good!

@amanrawat1458 Жыл бұрын

Please keep teaching us similar content. Some people like us are thirsty to learn

@pstefanics 3 жыл бұрын

Incrediby well produced and informative. One question: at 4:58, shouldn't the time to complete a stage be 0.2 (1/5th) billionths of a second if the CPU is running at 5GHz? It looks like 5 billionths of a second per stage would give a 200 MHz clock speed.

@fapitbullet 3 жыл бұрын

This video series is fantastic ! The animations, production quality are top-notch!

@hassanfirasat3079 3 жыл бұрын

Amazing...

@IslamIsDanger 3 жыл бұрын

Keep it going!

@emilienamaury3839 3 жыл бұрын

Cause this 2 videos, I want read more and more about this subject, so thk.

@michaelsandrik9819 3 жыл бұрын

This is a great series! Hope there are more of them!

@NizarElZarif 3 жыл бұрын

The video is very well executed, but I think you went a little too fast on branch prediction stuff. I already know who it works but I had a hard time following that example, especially when talking about the assembly code. But this video is very well done.

@pierreboyer9277 3 жыл бұрын

It feels like uOps are the actual basic instruction set. Which makes it feels like ISA is actually a higher level language hardcoded in the hardware. But then what is the point of the higher complexity ISA and not using uOps as the basic instruction set directly? Is it why x86 has like 2500 instructions in its ISA? And RISC-V on the other hand as less instructions. 50 I think. Which sounds like many more than the really basic instructions so I guess they also use uOps?

@storyls 3 жыл бұрын

>Why not use uOPs as the basic instruction set directly? You could, but the issue is that it’s going to cost you a lot of memory. Really it’s just space complexity, instructions take up little memory, uOPs a lot. uOPs are basically a bunch of wires that go throughout the CPU and say things like “connect register 4 to the bus leading to the ALU” or “write output of ALU to the register file.” Each uOP also has to tell which modules of the CPU stay on and which stay off, and for the vast majority of instructions, each uOP is going to be sending a LOT of 0s to all the modules that don’t need to be operating for this instruction. While an instruction alone can take up say 2 bytes, each uOP could be telling hundreds of modules what to do. The decode stage itself is pretty dumb usually. It essentially uses storage, the instruction is an address and in that storage for that address there is some firmware for all the uOPs. Also each architecture can have all sorts of different uOPs for the same ISA.

@dinos22 2 жыл бұрын

Awesome video

@blueguy5588 2 жыл бұрын

Mindblowing

@maha5 Жыл бұрын

Well processed.

@hupa1a 3 жыл бұрын

Fantastic!

@JoseJimeniz 2 жыл бұрын

If you want a more technical explanation, that in a lot of ways explains some of it much better, look up Eric Brumer's "Compiler Confidential" video. He goes into nitty-gritty detail the internal fetch-decode-pipeline.

@haongwong 3 жыл бұрын

we need more people educated on this!

@k2t210 3 жыл бұрын

Outstanding

@malleshkoujalagi1125 2 жыл бұрын

Awesome!!! got clearly instruction-->decode-->uops and ooo execution, dependent uops execution. Please clarify how data caches are used if uops are memory bound?