Hacker GitHub

← All repos

EricLBuehler/mistral.rs

View on GitHub ↗ ★ 7,793 Rust

Fast, flexible LLM inference

11 mentions on Hacker News by 10 people: 6 stories, 5 comments · first 2024-04-25 · latest 2026-06-18

Mentions per year 11 mentions · busiest year 2024 (7)
20082026
  1. ▲ 20
    Show HN: Run Agent Skills with mistral.rs v0.8.10: /v1/skills support and more
    story by ericlbuehler · 2026-06-18 · 2 comments
  2. ▲ 2
    Mistral.rs – Fast, zero-config multimodal LLM inference for a variety of models
    story by Curiositry · 2026-02-10 · 2 comments
  3. There is also another Mistral implementation: https://github.com/EricLBuehler/mistral.rs Not sure what the difference is, but it seems to be just be overall better received.
  4. ▲ 2
    Thoughts on Mistral.rs
    story by ericlbuehler · 2025-04-30 · 2 comments
  5. ▲ 5
    Fast LLM Inference in Rust
    story by goranmoomin · 2024-10-19 · 0 comments
  6. how does this compare to https://github.com/EricLBuehler/mistral.rs ?
  7. …like llama.cpp - https://github.com/ggerganov/llama.cpp/blob/master/examples/... or mistral.rs - https://github.com/EricLBuehler/mistral.rs/blob/master/docs/... lmstudio and ollama use llama.cpp underneath. cut the middle man
  8. …has pretty good abstractions in order to not depend and package llama.cpp for every platform. [0] https://github.com/EricLBuehler/mistral.rs
  9. …crate from candle. If you haven't checked it out yet, mistral.rs implements some of these things ( https://github.com/EricLBuehler/mistral.rs ). Eric hasn't done multi-GPU inference yet, but I know it's on his roadmap. Not sure if it…
  10. ▲ 1
    Mistral.rs: Faster than llama.cpp on CUDA
    story by georgehill · 2024-07-24 · 0 comments
  11. ▲ 5
    Mistral.rs: Fast LLM Engine
    story by atrudeau · 2024-04-25 · 0 comments