Do you really need a GPU or NPU for AI?

[@ps3301]

Most people don't seem to know that if you play a game that requires a lot of smart ai components, npu will take on that workload from GPU and make it run smoother.

[@briancase6180]

An NPU wastes a lot of die area? Have you looked at the die plot of an Apple M-series chip? You are just wrong with that statement. The smaller the process the more difficult the routing? What? Do you understand that process progression is accompanied, typically, by an increase the number of metal layers? Memory bandwidth? Again, have you looked at Apple M-series chips? They have plenty of memory bandwidth and they use a very cost-effective design and implementation strategy. The Apple M4--the lowest-end member of the coming M4 family--increased memory bandwidth by 20% to keep pace with the clock rate. It's about 120GB/s. That's a lot for a low-end chip.

[@petersuvara]

The NPUnfeels like putting an ASIC to process bitcoin hash functions on your chip. Agree on all points here.

[@mic11-j2x]

you don't need, cpu can do it all just that it wastes a lot of energy and it would deter the development of AI in the long run