Hacker GitHub

← All repos

EricLBuehler/mistral.rs

View on GitHub ↗ ★ 7,793 Rust

Fast, flexible LLM inference

11 mentions on Hacker News by 10 people: 6 stories, 5 comments · first 2024-04-25 · latest 2026-06-18

Mentions per year 11 mentions · busiest year 2024 (7)
20082026
AllStoriesComments NewestTopOldest
  1. There is also another Mistral implementation: https://github.com/EricLBuehler/mistral.rs Not sure what the difference is, but it seems to be just be overall better received.
    comment by Ygg2 · 2026-02-10 · in Rust implementation of Mistral's Voxtral Mini 4B Realtime runs in your browser
  2. how does this compare to https://github.com/EricLBuehler/mistral.rs ?
    comment by nikolayasdf123 · 2024-10-12 · in Lm.rs: Minimal CPU LLM inference in Rust with no dependency
  3. …like llama.cpp - https://github.com/ggerganov/llama.cpp/blob/master/examples/... or mistral.rs - https://github.com/EricLBuehler/mistral.rs/blob/master/docs/... lmstudio and ollama use llama.cpp underneath. cut the middle man
    comment by homarp · 2024-10-06 · in Show HN: Open-source real-time talk-to-AI wearable device for few $
  4. …has pretty good abstractions in order to not depend and package llama.cpp for every platform. [0] https://github.com/EricLBuehler/mistral.rs
    comment by satvikpendem · 2024-10-01 · in Comparing our Rust-based indexing and querying pipeline to Langchain
  5. …crate from candle. If you haven't checked it out yet, mistral.rs implements some of these things ( https://github.com/EricLBuehler/mistral.rs ). Eric hasn't done multi-GPU inference yet, but I know it's on his roadmap. Not sure if it…
    comment by zackangelo · 2024-09-19 · in Moshi: A speech-text foundation model for real time dialogue