Hacker GitHub

← All repos

slashml/amd_inference

View on GitHub ↗ ★ 233 Python

Docker-based inference engine for AMD GPUs

5 mentions on Hacker News by 2 people: 1 story, 4 comments · first 2024-10-02 · latest 2024-10-03

Mentions per year 5 mentions · busiest year 2024 (5)
20082026
AllStoriesComments NewestTopOldest
  1. Why ROCm 5.4, and not the latest (6.2)? https://github.com/slashml/amd_inference/blob/main/Dockerfil... Also looks like the Docker image provided by this project doesn't successfully build: https://github.com/slashml/amd_inference/issues/2
    comment by lenova · 2024-10-03 · in AMD GPU Inference
  2. haha, I was a bit confused, but I was referring to this one https://github.com/slashml/amd_inference . But the comment applies to other repos as well, do open issues in them, helps the maintainers prioritize features.
    comment by fazkan · 2024-10-03 · in AMD GPU Inference
  3. …to https://github.com/ROCm/ROCm/issues/2216 You just need to update the version check here https://github.com/slashml/amd_inference/blob/4b9ec069c4b2ac... feel free to open an issue, with the requirements and we will test it.
    comment by fazkan · 2024-10-02 · in AMD GPU Inference
  4. you can mount a specific device to docker. If you read the script, we are mounting GPUs https://github.com/slashml/amd_inference/blob/main/run-docke...
    comment by fazkan · 2024-10-02 · in AMD GPU Inference