ROCm/FastFlowLM
View on GitHub ↗ ★ 2,033 C++
Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.
5 mentions on Hacker News by 4 people: 1 story, 4 comments · first 2026-01-02 · latest 2026-04-02
20082026
-
…for NPUs is really low power devices, and not useful if you have an APU/GPU like Strix Halo. [1]: https://github.com/FastFlowLM/FastFlowLM
comment by cpburns2009 · 2026-04-02 · in Lemonade by AMD: a fast and open source local LLM server using GPU and NPU -
That won't give you NPU support, which relies on https://github.com/FastFlowLM/FastFlowLM . And that says "NPU-accelerated kernels are proprietary binaries", not open source.
comment by zozbot234 · 2026-04-02 · in Lemonade by AMD: a fast and open source local LLM server using GPU and NPU -
Finally there's good news for Linux users: https://github.com/FastFlowLM/FastFlowLM
comment by pstuart · 2026-03-03 · in Welcome (back) to Macintosh -
▲ 4
FastFlowLM (FLM) – Unlock Ryzen AI NPUsstory by jakogut · 2026-02-26 · 1 comment
-
…2, so the architecture is spatial dataflow and programmable interconnects), but it's there. See https://github.com/FastFlowLM/FastFlowLM (which is directly supported by https://lemonade-server.ai/ https://github.com/lemonade-sdk/lemonade )…
comment by zozbot234 · 2026-01-02 · in Dell's version of the DGX Spark fixes pain points