EricLBuehler/mistral.rs
View on GitHub ↗ ★ 7,793 Rust
Fast, flexible LLM inference
11 mentions on Hacker News by 10 people: 6 stories, 5 comments · first 2024-04-25 · latest 2026-06-18
20082026
-
▲ 20
Show HN: Run Agent Skills with mistral.rs v0.8.10: /v1/skills support and morestory by ericlbuehler · 2026-06-18 · 2 comments
-
▲ 2
Mistral.rs – Fast, zero-config multimodal LLM inference for a variety of modelsstory by Curiositry · 2026-02-10 · 2 comments
-
There is also another Mistral implementation: https://github.com/EricLBuehler/mistral.rs Not sure what the difference is, but it seems to be just be overall better received.
comment by Ygg2 · 2026-02-10 · in Rust implementation of Mistral's Voxtral Mini 4B Realtime runs in your browser -
▲ 2
Thoughts on Mistral.rsstory by ericlbuehler · 2025-04-30 · 2 comments
-
▲ 5
Fast LLM Inference in Ruststory by goranmoomin · 2024-10-19 · 0 comments
-
how does this compare to https://github.com/EricLBuehler/mistral.rs ?
comment by nikolayasdf123 · 2024-10-12 · in Lm.rs: Minimal CPU LLM inference in Rust with no dependency -
…like llama.cpp - https://github.com/ggerganov/llama.cpp/blob/master/examples/... or mistral.rs - https://github.com/EricLBuehler/mistral.rs/blob/master/docs/... lmstudio and ollama use llama.cpp underneath. cut the middle man
comment by homarp · 2024-10-06 · in Show HN: Open-source real-time talk-to-AI wearable device for few $ -
…has pretty good abstractions in order to not depend and package llama.cpp for every platform. [0] https://github.com/EricLBuehler/mistral.rs
comment by satvikpendem · 2024-10-01 · in Comparing our Rust-based indexing and querying pipeline to Langchain -
…crate from candle. If you haven't checked it out yet, mistral.rs implements some of these things ( https://github.com/EricLBuehler/mistral.rs ). Eric hasn't done multi-GPU inference yet, but I know it's on his roadmap. Not sure if it…
comment by zackangelo · 2024-09-19 · in Moshi: A speech-text foundation model for real time dialogue -
▲ 1
Mistral.rs: Faster than llama.cpp on CUDAstory by georgehill · 2024-07-24 · 0 comments
-
▲ 5
Mistral.rs: Fast LLM Enginestory by atrudeau · 2024-04-25 · 0 comments