Hacker GitHub

← All repos

smpanaro/more-ane-transformers

View on GitHub ↗ ★ 62 Python

Run transformers (incl. LLMs) on the Apple Neural Engine.

3 mentions on Hacker News by 2 people: 0 stories, 3 comments · first 2023-04-11 · latest 2023-10-12

Mentions per year 3 mentions · busiest year 2023 (3)
20082026
AllStoriesComments NewestTopOldest
  1. …Engine. This would likely be even faster. [2] https://github.com/wangchou/whisper.coreml/ [3] https://github.com/smpanaro/more-ane-transformers/
    comment by smpanaro · 2023-10-12 · in M2 Ultra can run 128 streams of Llama 2 7B in parallel
  2. …of die space currently (on Macbook at least, I'm sure they find uses for it in the iPhone) [1] https://github.com/smpanaro/more-ane-transformers/blob/main/...
    comment by anentropic · 2023-04-11 · in The Coming of Local LLMs
  3. …this is not on Apple's roadmap at all currently) [1] https://github.com/hollance/neural-engine [2] https://github.com/smpanaro/more-ane-transformers/blob/main/...
    comment by anentropic · 2023-04-11 · in Anthropic’s $5B, 4-year plan to take on OpenAI