Architecture All Access: Modern CPU Architecture 2 - Microarchitecture Deep Dive | Intel Technology
Вставка
- Опубліковано 5 чер 2024
- What is a CPU microarchitecture and what are the building blocks inside a CPU? Boyd Phelps, CVP of Client Engineering at Intel, takes us through key microarchitecture concepts like pipelines, speculation, branch prediction as well as the main building blocks in the front and back end of a CPU. Want to learn about the history of CPU architecture? Check out part one here: • Architecture All Acces...
Boyd Phelps has worked on some of the most well-known chip designs in Intel’s history, from Nehalem to Haswell to Tiger Lake and more.
Architecture All Access is a master class technology series featuring Senior Intel Technical Leaders taking an educational approach to the historical impact and future innovations of key architectures that will continue to be at the center of ‘world-changing technology that enriches the lives of every person on earth.’ If you are interested in CPUs, FPGAs, Quantum Computing and beyond, subscribe and hit the bell to get new episode notifications.
Chapters:
0:00 Welcome to CPU Architecture Part 2
0:51 Meet Boyd Phelps, CVP of Client Engineering
1:14 What Are We Covering?
1:47 Key Building Blocks in a CPU
3:16 Pipeline Depth
5:15 Speculation
7:06 Branch Prediction
7:35 Speculative Execution
12:48 The Microprocessor Front End: Predict and Fetch
14:44 The Microprocessor Front End: Decode
17:19 Superscalar Execution
18:36 Out-Of-Order
19:57 CPU Back End
23:35 Micro-Architecture Summary
24:39 Where Are We Headed?
Subscribe now to Intel Technology on UA-cam: intel.ly/3P9BA7x
About Intel Technology:
Intel has always been at the forefront of developing exciting new technology for business and consumers including emerging technologies, data center servers, business transformation, memory and storage, security, and graphics. The Intel Technology UA-cam channel is a place to learn tips and tricks, get the latest news, and watch product demos from both Intel and our many partners across multiple fields.
Connect with Intel Technology:
Visit Intel Technologies WEBSITE: intel.ly/IntelTechnologies
Follow Intel Technology on TWITTER: / inteltech
Architecture All Access: Modern CPU Architecture 2 - Microarchitecture Deep Dive | Intel Technology
/ inteltechnology - Наука та технологія
Hey this was incredibly produced and clear enough for many people to understand, you guys should publicize it more because i stumbled upon it almost casually.
When a actual Microprocessor company makes a video UNDERSTANDING how they work? Heh, and for the fact this actually isn't made bad. Don't get me wrong other content in UA-cam that explain this sometimes can be easier and maybe harder. But I actually am amazed Intel really is doing this
@@hariranormal5584 absolutely
I want intel to make more technical video like this. The more the better, I have a genuine interest for the inner working of the product instead of just buying it and wish for larger caches , better features.....As a customer , I really love your dedicated effort of creating a highly understable video with good analogy
Honestly Boyd Phelps did an incredible job with these two videos. Granted I've been around since the 486 days and have always had an understanding of the various CPU architectures, but this was incredible with it's depth.
I don't normally thumbs up or comment on a video, but, when I do, it's because a channel has done something really amazing and I want them to continue!
First time I have Phone, Internet access and Social Media, I started Addicted to all about Technology
Especially about CPU
I would look at posts from fabian gisen and agner
This means you know who is George Boole
I love this series! It's incredible how these devices even work without a hitch given how mindbogglingly complex they are.
What's really amazing is they don't run without a hitch, there is an acceptable error rate that they recover from. That is part of why systems are more stable today than previously, more threads, more cores, if a thread crashes it doesn't take down the entire system.
It's not just at the CPU level but errors still exist they just don't take down entire systems as often.
)l
Incredibly well done, breaking down such a complex topic into chunks that are digestible isn't easy and you guys did that super well!
The editor needs a raise
This was actually incredibly well put together! I always found that nothing really would ever bother to explain how exactly the subcomponents of a CPU talked to eachother, but this really helps show how a CPU is a lot of smaller, specific-purpose modular pieces talking to eachother
Oh thank u very much! reading "Inside the machine" book for now and it was too hard to understand all of this. This is great videocourse!
Lots of information with high quality content. Great effort Intel !!! And the host is doing an amazing job. His way of teaching is marvelous. For the last few weeks, I was searching for the topic "Computer architecture". Since, I am a hobby programmer, I would like to know more about how CPU execute my code. Thanks a lot for this series. :)
Love this intel!!! Do more of it and yes let the world know about this. Ads maybe.
This magic! many civilizations shook
Love it. Explanation on branching and speculative execution is great. We must emphases that branching is the key of turing completeness which permit the birth of computer from previous simple calculator.
This is so good, it is easy for a newbie to understand. And it’s not boring for someone who’s already knows how a CPU works.
Thanks Boyd for these very clear video's i knew the basics but Part2 was very interesting and helped me to paint a clearer picture of what was going on. I would love to see more of these video's and even go more in depth!
24:30 Yes, it was very beautiful 😌
The content of this video was so clear that I saw myself working at an intel lab for a brief second in a near future. Thanks Boyd !!! Great Video
Awesome animations and analogies, altogether very easy to understand! I admit I'm heavily biased, but I think even a lay person with some passing interest would be able to understand a few of the important big-picture points.
Having had the opportunity to be at Intel for years (no longer there), so proud to see these series coming up. Very well done, something rather complex explained in a simple form. Hope that entice and nurture the imagination and curiosity of everyone, especially younger ones!
It is a freaking miracle that we can make these things work reliably!
Haven't been this captivated since reading Peter Norton's pink shirt book; "Programmer's Guide to the IBM PC".
Deep and geeky is what the future is made of.
Thank you Intel for putting this up. I like it a lot!
This is literally amazing. Great explanation and great work on building these technologies. Speculative execution was really cool for me to learn about
This is absolutely brilliantly explained and presented, thank you.
It was truly remarkable. The best and most stunning lecture about CPU that I've ever seen.
This is entertaining :)
I already have a CS Degree and work as a Network Forensics Analyst but I still find this entertaining better than watching some non sense videos. I like learning about the physics of the electrons or photons inside the CPU highway and logic gates and conducting test's of new architecture designs in a digital 3D simulator environment.
Very well explained. The microcode decoding part was especially informative.
Honestly an incredible series! They seem to have found a perfect balance of details versus overview. It's not so high-level to seem common sense and it's not so in-the-weeds to seem impossible to understand.
Also, the animation work is amazing. Great work all around.
Good stuff. This was highly interesting watch. Enjoying my 11900K. Looking forward to Alder Lake and Intel’s GPU launch.
This was actually extremely informative. I already knew a little bit about micro-architecture before hand.
And now, seeing how some of this works, both the re-order buffer and branch prediction seem like they could be exploited to run unsigned code.
I am in chip design from 1984 and tried many times to explain to people what am I doing. If I would have had these videos my explanation could have been easier. The animation and graphics are unbelievable quality. The Part 1 is a good umbrella explanation of the chip design in general and CPUs in particular. I will call this the 10.000 feet view. The Part 2 is the 1 foot view directly into the processor architecture so some industry lingo and knowledge is required. I would have liked to have a 3.000 feet and a 100 feet view for popularizing chip design and CPU for people who do not have an electronics background. Intel has all the capabilities to do it so please consider it. In the times of Artificial Intelligence and Biotech advancements making more people understand where all started and how it humans can benefit from their merger should be a good topic to cover. Looking forward for new videos from you.
Absolutely amazing, thank you!
Absolutely brilliant. From start to finish.
I really liked the TV sticks with the embedded technology they came out with. Above all I've found that the key to unlocking the potential of any product is to have in specification RAM from a quality manufacturer!
This was really cool. Any can get a part 3 that explains how this is all translated onto a physical processor? How do we take these concepts and functions and make them work in the physical world?
Think of it in this way, trillions of electric signals go through a CPU, these electric signals are sometimes of low current, sometimes of high current. Low current is interpreted as 0, while High is interpreted as 1. Now we have all the characters that make up the language of computers. The CPU then uses Hardware languages like VHDL to operate these 0s and 1s. This is how Physical things do software work.
Awesome videos I can show people to help them understand what I am talking about, only thing I think was missed(unless i missed it) was how hyperthreading works in the pipeline.. that'd been cool to show.
very helpful for CS students
This is beautiful.
Will you make more of these? They were incredibly informative: before, caches and pipelining were this black magic that was hard to reason about, especially as my previous reference point was essentially AVR MCU architecture (let's leave aside PIC because that's an entirely different beast altogether).
Please do more of these! I'm really enjoying the series.
Thanks for this content, I liked it. I wish and hope more technical content like this one in the future.
Loved it. Thanks!
Extremely motivative and well comprehensive.
These videos are so impressive, I would pay for a full course
Thank you for this beautiful explanation of modern cpu. I hop you don't stop producing this series. I think GPU will be interesting topic to discuss as we all know intel have great iGPU today and hopefully will release discreate gpu soon
Great summary of uArch. Awesome!
Well done, Intel. Loved it. Wish there was more of this.
great video with excellent graphical representation to simplify the complex concepts.
superb. mind-blowing. beyond one's imgination!
Fantastic! Thank you!
Thanks so much. This is fantastic. I'm using this to teach my daughter.
This is just awesome!
what a beautiful and educative illustration!
I have not got words for congratulate this amazing videos !!!
Thanks for the video. I learned interesting things !
Incredible! the explanation and animation both!
This is an incredible video!
This was amazing, thank you!
Seen both parts. Great....
Great videos, thanks!
Great job and great video!
very very great video!! thank you very much!
Thank you.
Man if you guys could go even deeper, it whatever just amazing work
JUST AMAZING... thanks
Stellar presentation!
This video series is fantastic ! The animations, production quality are top-notch!
This is really good, nice video
Very well done, but still waiting for the cache episode.
Amazing...
That was soo soo fantastic, I can't believe it wow.
Great video, congrats for making it!
Excellent Presentation.
Keep it going!
thanks for complete and clear explanation
Totally found this by accident, but so informative.
Please keep teaching us similar content. Some people like us are thirsty to learn
great and simple explaination dude
This is really great stuff, but I found a bug in your code at the 5:00 mark... A 5 GHz processor doesn't mean "each completes in 5 billionths of a second" -- it means that each completes in 1/5 of a billionth of a second.
It's a clock every 200 ns, not a clock every 5 µs... But at least we didn't divide by zero!
Nice catch!
Awesome!!! got clearly instruction-->decode-->uops and ooo execution, dependent uops execution. Please clarify how data caches are used if uops are memory bound?
Fantastic!
This is a great series! Hope there are more of them!
Highly informative
The video is very well executed, but I think you went a little too fast on branch prediction stuff. I already know who it works but I had a hard time following that example, especially when talking about the assembly code. But this video is very well done.
Incrediby well produced and informative. One question: at 4:58, shouldn't the time to complete a stage be 0.2 (1/5th) billionths of a second if the CPU is running at 5GHz? It looks like 5 billionths of a second per stage would give a 200 MHz clock speed.
Nice!
This is an incredible video!! Leave it to Intel to produce it. Thank you!
This mini-series was excellent! yummy good!
This was a great, short and in-depth explanation with awesome animations & examples. Please make more such videos.
Mindblowing
If you want a more technical explanation, that in a lot of ways explains some of it much better, look up Eric Brumer's "Compiler Confidential" video. He goes into nitty-gritty detail the internal fetch-decode-pipeline.
This guy is awesome !!
Loved it.
Outstanding
Cause this 2 videos, I want read more and more about this subject, so thk.
It feels like uOps are the actual basic instruction set. Which makes it feels like ISA is actually a higher level language hardcoded in the hardware. But then what is the point of the higher complexity ISA and not using uOps as the basic instruction set directly? Is it why x86 has like 2500 instructions in its ISA? And RISC-V on the other hand as less instructions. 50 I think. Which sounds like many more than the really basic instructions so I guess they also use uOps?
>Why not use uOPs as the basic instruction set directly?
You could, but the issue is that it’s going to cost you a lot of memory. Really it’s just space complexity, instructions take up little memory, uOPs a lot.
uOPs are basically a bunch of wires that go throughout the CPU and say things like “connect register 4 to the bus leading to the ALU” or “write output of ALU to the register file.” Each uOP also has to tell which modules of the CPU stay on and which stay off, and for the vast majority of instructions, each uOP is going to be sending a LOT of 0s to all the modules that don’t need to be operating for this instruction. While an instruction alone can take up say 2 bytes, each uOP could be telling hundreds of modules what to do.
The decode stage itself is pretty dumb usually. It essentially uses storage, the instruction is an address and in that storage for that address there is some firmware for all the uOPs.
Also each architecture can have all sorts of different uOPs for the same ISA.
Exceptional.
Thank you very much for these kinds of videos, truly amazing.
Awesome video
7:00 at "Branch Prediction" is this what the cache memory does? storing the right paths and then when the branch appears again it know where to go?