Hacker GitHub

← All repos

amd/RyzenAI-SW

View on GitHub ↗ ★ 893 Python

AMD Ryzen™ AI Software includes the tools and runtime libraries for optimizing and deploying AI inference on AMD Ryzen™ AI powered PCs.

11 mentions on Hacker News by 9 people: 1 story, 10 comments · first 2023-10-21 · latest 2026-04-02

Mentions per year 11 mentions · busiest year 2024 (6)
20082026
AllStoriesComments NewestTopOldest
  1. …models that are proprietary. See https://github.com/amd/iron https://github.com/Xilinx/mlir-aie https://github.com/amd/RyzenAI-SW/ . It would be nice to explore whether one can simply develop kernels for these NPU's using Vulkan Compute…
    comment by zozbot234 · 2026-04-02 · in Lemonade by AMD: a fast and open source local LLM server using GPU and NPU
  2. …the iGPU as well, be sure to compile llama.cpp w/ the LLAMA_HIP_UMA=1 flag. If you take a look at https://github.com/amd/RyzenAI-SW you can see there's a fair amount of software to play with on the NPU now, but Phoenix is only 16 TOPS, so…
    comment by lhl · 2024-10-03 · in AMD GPU Inference
  3. There's actually seems to be a bunch of stuff now: * https://github.com/amd/RyzenAI-SW - has a list of demos and how to use it directly (including apparently w/ PyTorch and LLMs) * https://github.com/huggingface/optimum-amd - can use…
    comment by lhl · 2024-09-27 · in AMD Unveils Its First Small Language Model AMD-135M
  4. …From there, here is list of Ryzen AI engine enabled laptop/mini PC models https://github.com/amd/RyzenAI-SW/issues/18 gather all that, I wonder how on earth these benchmarks comparing oranges to apples.
    comment by diimdeep · 2024-07-21 · in AMD Ryzen AI 9 HX 370 12-Core APU Is Faster Than M3 Max
  5. …things a bit as well. It looks like it's its currently running on its own ONNX/Vitis (Xilinx) stack https://github.com/amd/RyzenAI-SW , and really it should either get folded into ROCm (or a new SYCL/oneAPI-ish layer needs to be adopted to…
    comment by lhl · 2024-06-17 · in An interview with AMD CEO Lisa Su about solving hard problems
  6. …see that the performance of the CPU only implementation and the NPU implementation are identical. https://github.com/amd/RyzenAI-SW/blob/main/example/transfor... What this should tell you is that "15 TOPs" is an irrelevant number in this…
    comment by imtringued · 2024-04-24 · in AMD unveils Ryzen Pro 8000-series processors
  7. Unfortunately, Ryzen AI, while neat, remains Windows-exclusive https://github.com/amd/RyzenAI-SW/issues/2
    comment by i80and · 2024-01-14 · in AMD Unveils Ryzen 8000G Series Processors: Zen 4 APUs for Desktop with Ryzen AI
  8. ▲ 60
    AMD wants to know if you would like Ryzen AI support for Linux
    story by fastily · 2023-10-23 · 14 comments
  9. Better yet, +1 the comment by the AMD employee who specifically asked for it: https://github.com/amd/RyzenAI-SW/issues/2#issuecomment-1773...
    comment by pritambaral · 2023-10-21 · in AMD Wants to Know If You'd Like Ryzen AI Support on Linux
  10. …lack of info, save from the input of a very helpful employee) to me shows the state of ryzenai: https://github.com/amd/RyzenAI-SW/issues/5#issuecomment-1726...
    comment by mardifoufs · 2023-10-21 · in AMD Wants to Know If You'd Like Ryzen AI Support on Linux
  11. The important part: let them know on this GitHub issue by adding a comment that says +1: https://github.com/amd/RyzenAI-SW/issues/2 And yes, it’s weird that they have to ask. I thought a significant amount of AI work was done in Linux.
    comment by TaylorAlexander · 2023-10-21 · in AMD Wants to Know If You'd Like Ryzen AI Support on Linux