If you did that, you'd stumble into the Apple GPU's lack of tensor acceleration ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

bigyabai on May 3, 2025 | parent | context | favorite | on: Run LLMs on Apple Neural Engine (ANE)

If you did that, you'd stumble into the Apple GPU's lack of tensor acceleration hardware. For an Nvidia-like experience you'd have to re-architecture the GPU to subsume the NPU's role, and if that was easy then everyone would have done it by now.

sroussey on May 3, 2025 | [–]

M1/M2 shared a GPU design, same with M3/M4. So maybe M5 will have a new design that includes tensor cores in the GPU.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact