containers/ramalama
View on GitHub ↗ ★ 3,099 Python
RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.
9 mentions on Hacker News by 9 people: 2 stories, 7 comments · first 2025-01-31 · latest 2026-01-26
20082026
-
…layered on the ostree. Before RamaLama, getting llama.cpp working with my GPU was a major PITA. https://github.com/containers/ramalama
comment by discardedrefuse · 2025-09-26 · in Ollama Web Search -
I would recommend not wasting time with ollama, https://github.com/containers/ramalama just works on that chip.
comment by nicolaslem · 2025-08-27 · in Framework Laptop 16 -
…a subprocess listening on a unix socket, and forward requests to it I'd recommend taking a look at https://github.com/containers/ramalama its more similar to what you're describing in the way it uses llama-server, also it is container…
comment by cdoern · 2025-08-11 · in Ollama and gguf -
I believe that is what https://github.com/containers/ramalama set out to do.
comment by sitkack · 2025-08-05 · in Ollama Turbo -
Take a look at https://github.com/containers/ramalama/tree/main#credit-wher... for comparison. Ollama really should improve their acknowledgements and check license conformance more thoroughly.
comment by mkesper · 2025-05-16 · in Ollama violating llama.cpp license for over a year -
https://github.com/containers/ramalama
comment by mohsen1 · 2025-02-19 · in Meta announces LlamaCon, its first generative AI dev conference on April 29 -
About time. https://github.com/containers/ramalama also working on this
comment by arcmechanica · 2025-02-08 · in Docker Bake is now generally available