lemonade-sdk/llamacpp-rocm
View on GitHub ↗ ★ 819 Python
Fresh builds of llama.cpp with AMD ROCm™ acceleration
3 mentions on Hacker News by 2 people: 0 stories, 3 comments · first 2026-04-02 · latest 2026-11-08
20082026
-
…but it wasn't materially better than my lemonade setup. I might revisit after this post, though! https://github.com/lemonade-sdk/llamacpp-rocm
comment by rpdillon · 2026-11-08 · in Llama-modchip: 284B DeepSeek on 64GB RAM, no GPU -
…On the performance side, lemonade comes bundled with ROCm and Vulkan. These are sourced from https://github.com/lemonade-sdk/llamacpp-rocm and https://github.com/ggml-org/llama.cpp/releases respectively.
comment by sawansri · 2026-04-02 · in Lemonade by AMD: a fast and open source local LLM server using GPU and NPU -
…don't like their combined server, and what I use instead is their llama CPP build for ROCm. https://github.com/lemonade-sdk/llamacpp-rocm But I'm not doing anything with images or audio. I get about 50 tokens a second with GPT OSS 120B. As…
comment by rpdillon · 2026-04-02 · in Lemonade by AMD: a fast and open source local LLM server using GPU and NPU