apple-aiml-research/ml-ane-transformers
View on GitHub ↗ ★ 2,751 Python
Reference implementation of the Transformer architecture optimized for Apple Neural Engine (ANE)
6 mentions on Hacker News by 5 people: 2 stories, 4 comments · first 2022-06-08 · latest 2025-10-15
20082026
-
…that! You are right. Surprising… since Apple has shown that it’s possible through CoreML ( https://github.com/apple/ml-ane-transformers ) I would hope that the Foundation Models ( https://developer.apple.com/documentation/foundationmodels…
comment by hannesfur · 2025-10-15 · in Apple M5 chip -
I wonder if Apple ever followed up with this: https://github.com/apple/ml-ane-transformers They claim their ANE-optimized models achieve "up to 10 times faster and 14 times lower peak memory consumption compared to baseline…
comment by behnamoh · 2025-05-03 · in Run LLMs on Apple Neural Engine (ANE) -
Have you seen this? https://github.com/apple/ml-ane-transformers
comment by Tepix · 2023-04-16 · in Web LLM – WebGPU Powered Inference of Large Language Models -
maybe https://github.com/apple/ml-ane-transformers
comment by egman_ekki · 2023-03-25 · in What we know about the Apple Neural Engine