kyuz0/amd-strix-halo-toolboxes
View on GitHub ↗ ★ 2,014 Python
8 mentions on Hacker News by 8 people: 0 stories, 8 comments · first 2025-10-31 · latest 2026-08-25
20082026
-
…of anything else. Just a few GB for the OS and llama.cpp. These are roughly the settings I use: https://github.com/kyuz0/amd-strix-halo-toolboxes#kernel-par...
comment by SwellJoe · 2026-08-25 · in Qwen 3.8-Flash-Next releasing tomorrow (125B a6B) -
yes. I build a docker file from this: https://github.com/kyuz0/amd-strix-halo-toolboxes It has all the backends you want. Just a script rebuilds it. Then I just put it in a docker compose and whenever we want to update it, we pull the repo…
comment by cyanydeez · 2026-07-23 · in New Framework Desktop Option with AMD Ryzen AI Max+ Pro 495 and 192GB Memory -
Sounds like you got it sorted, but more generally this may be interesting: https://github.com/kyuz0/amd-strix-halo-toolboxes
comment by c7b · 2026-07-02 · in Kimi K2.7 Code is generally available in GitHub Copilot -
…the scenic route. All you really need is podman, toolbx, and the Strix Halo toolbox images from https://github.com/kyuz0/amd-strix-halo-toolboxes . Then you just download your ggufs and hand them to llama-server. Yes, there are other…
comment by bityard · 2026-04-19 · in My first impressions on ROCm and Strix Halo -
…I didn't have time to to diagnose perf problems, and llama.cpp is working well for my needs. [0] https://github.com/kyuz0/amd-strix-halo-toolboxes
comment by seemaze · 2026-04-13 · in Taking on CUDA with ROCm: 'One Step After Another' -
I took my setup from here: https://github.com/kyuz0/amd-strix-halo-toolboxes Still lot to learn, but after a while you have something like Qwen3-Coder-Next-Q8_0 running and - at least for me - it works quite well, both as ChatGPT like…
comment by meta-level · 2026-02-28 · in How do I cancel my ChatGPT subscription? -
If you're on Strix Halo, check out Donato's prebuilt toolboxes for ROCm with RADV or Vulkan: https://github.com/kyuz0/amd-strix-halo-toolboxes It takes all the work out of it, you just start llama-server in the container context and you're…
comment by Zetaphor · 2026-02-21 · in With Nvidia's GB10 Superchip, I'm Running Serious AI Models in My Living Room -
…those yet. But the benchmarks are awesome! Lots to learn from. Framework forum can be useful, too. https://github.com/kyuz0/amd-strix-halo-toolboxes Also nice: https://llm-tracker.info/ It links to some benchmark site with models by size.…
comment by dennemark · 2025-10-31 · in Ask HN: Who uses open LLMs and coding assistants locally? Share setup and laptop