Meteor Lake: AI Acceleration and NPU Explained | Talking Tech | Intel Technology
Вставка
- Опубліковано 11 лип 2024
- The PC industry is at a significant inflection point, and with Meteor Lake, we’re bringing AI to client computing at scale. Join us as we sit down with Darren Crews, Sr. Principal Engineer, AI SW Architecture and Intel Fellow Tom “TAP” Petersen as they explain how the Intel Core Ultra delivers AI acceleration across the CPU, GPU, and our new NPU (or neural processing unit). You’ll learn how the NPU is optimized to handle dense and sustained AI workloads efficiently. We also discuss why it’s crucial to focus on software and APIs to create a friendly developer experience. Talking Tech goes in depth on Meteor Lake with Intel architects and engineers: intel.ly/3MmhpRl
VP of Design Engineering Group Tim Wilson explains Meteor Lake in Architecture All Access: intel.ly/3Spf6ku
Chapters:
00:00 - Intro
00:33 - Purpose and role of the NPU
01:45 - APIs
02:24 - NPU compute engines explained
05:06 - Drivers and software
06:56 - Bringing AI to client
09:25 - Conclusion
About Intel Technology: Intel has always been at the forefront of developing exciting new technology for business and consumers including emerging technologies, data center servers, business transformation, memory and storage, security, and graphics. The Intel Technology UA-cam channel is a place to learn tips and tricks, get the latest news, and watch product demos from both Intel and our many partners across multiple fields.
Connect with Intel Technology: Visit Intel Technologies WEBSITE: intel.ly/IntelTechnologies Follow Intel Technology on TWITTER: intel.ly/3MmhqET - Наука та технологія
The reason most A.I. is done in cloud is lack of VRAM. For years, GPU companies have been milking on VRAM, just like Apple charging a fortune for memory upgrades. I do hope CPU's take over GPU in regard to A.I. processing so we average consumers don't have to spend thousands of dollars just to get 32GB of VRAM.
i think that would happen the same as cores in cpu. Intel monopoly followed this rule of static number cores until a new competition (AMD) moves towards a new approach of more cores and unleash that every intel cpu came with more cores than before. I think that now that AMD, Intel are invading the NVIDIA Market, nvidia will create new gpus with highest VRAM for lower prices.
I'm sharing this with all my friends!
Question : why the Integrated Arc GPU on Meteor Lake not having XMX unit for AI Acceleration? Is it because the Meteor Lake already have an NPU? Or is there some other concerns like power usage? Thanks!
Really excited for Meteor Lakes NPU. Intel showed off a lot of partners, including big names like Adobe that are working directly with Intel on AI software integration. Intel is the only one actually bring AI to everyone. Nvidia GPUs are far too expensive for the average laptop and AMD has zero software support for their NPU. Meanwhile Intel will ship 100 million AI CPUs in 2024.
Lol how do software engineer make app for AMD NPU then? 🤣😂💩
Intel with this looks promising. I think they purposely made their desktop processors boring to highlight their laptop processors more.
Arrow Lake Desktop with next Gen CPU cores in 2024.
I like to see that in your desktop and workstation CPUs.
Appreciate the top-down explanation. What would be the potentional gaming applications? I know that XeSS is accelerated through the XMX hardware on the arc GPUs, but a competitor has also been working on NN-based denoisers for Ray/Path tracing. Is Intel going to use the NPU + XMX for such capabilities?
General applications are more relevant, of course.
Thank you for those kind words! We suggest you to visit our newsroom for upcoming updates via intel.ly/3TwL66D Do not hesitate to DM us if you have any further queries.
Thanks, I have been trying to find something that would explain a lot of the guts how NPUs work, at a technical but not field expert level... I was hoping for an article, but I haven't found any, so a video will do.
In particular the 4th section, "NPU compute engines explained" is what I was hoping for. An expanded version of that could be even better
Cool new pc era incoming =)
Any hope of getting a tutorial on getting Meteor Lake set up for running AI through Python and a couple of common libraries for developers? I talk with a lot of people that develop AI apps at the moment (and make a few contributions myself) and I'd like to look at supporting Intel's AI engine, but I don't have one personally, and I'm not sure how well supported it is on Linux (where I do the bulk of my development). A look at the process of getting it setup for development would make a big difference!
Just waiting to buy it for a desktop pc! Integrate it with peripherals!
Can the NPU run LLMs locally?
Yes it can. It will depend on the "size" of LLM
Can NPU be used for video game enemy npc AI?
It's up to the devs to implement AI. But currently games don't use NPU kinda AI. They use Behavior tress and state machines for AI which are run on CPU. It's hard coded AI rather than random trained AI. And as for LLMs current NPUs are too weak to run good LLMs.
I feel that UltraCore is a mega BASS kind of positivity, But that aside i think maybe intel does adders++ on the internal integer instructions? makes sense to me. RS
Intel please do arc a990 with 4 media encoder decoder, 1440p120fps with higher wattage. Will the upcoming cpus have 24 cores ? Also Music at the end ?
Alchemist has had its full stack launched. Intel has limited resources to devote to graphics, so Intel is taking a measured approach to its bet on the complexity of components (lower performance, smaller dies are cheaper to design and produce). As long as Intel continues iterating with Battlemage and Celestial, they'll get there eventually. Larger parts with more Xe Cores will come and the Xe cores will get much more performant very quickly as AXG learns through trial and error where the bottlenecks of their architecture lies.
As for CPUs... 24 core CPUs have been out for over a year with the 13900K. The 14900K also has 24 cores. If you're looking for all P-cores, then there's the Xeon w9-3975X as an unlocked, in-box workstation CPU with 36 P-cores.
So is any of this NPU going to help with tasks outside of AI operations?? like in normal software that most people that are going to buy a portable laptop? most consumers of laptops arent going to use AI software locally, if you want high end AI computation its a cool idea to be able to do it on a laptop, but I feel like this isnt going to help performance for most consumers of laptops... unless they can accelerate software for video or image rendering.. this feels a lot like physic accelerated chips that nvidia put on their cards, Physx was pretty much abandon years later because there wasnt an incentive for devs to use it...
NPU doesnt accelerate graphics.. not to say a dev cant use it in graphics design software for an AI add in, but currently NPU does nothing for Adobe products for example
Imagine if in a few years videogames require NPU to run.
I read a rumor windows 12 coming in June will require an NPU to run, and the next xbox will have an NPU
@@Zreknarf i hope not
@misterPAINMAKER it looks like GPUs can already do anything NPUs can do, it's just ~50x less efficient. so I imagine you'll be able to run any NPU optimized game on a GPU, just won't be power (or cost) efficient.
@@Zreknarf FYI an nvidia GPU has massively more AI acceleration capability than any NPU - up to thousands of tiems more depnding on the GPU
@garywicks5927 any CPU integrated NPU sure, I'd argue that's not true if you consider discrete NPUs like the $30,000 nvidia H100. and still the CPU integrated NPU will be 50x more efficient in those tasks than a GPU, which is nothing to sneeze at
shintel baby
Snakeoil Lake