Hacker GitHub

← All repos

mistralai/mistral-inference

View on GitHub ↗ ★ 10,824 Jupyter Notebook archived

Official inference library for Mistral models

10 mentions on Hacker News by 10 people: 1 story, 9 comments · first 2023-09-27 · latest 2025-08-11

Mentions per year 10 mentions · busiest year 2023 (6)
20082026
AllStoriesComments NewestTopOldest
  1. …a small company like mistral should back yet IMO. They do release high quality inference code, ie https://github.com/mistralai/mistral-inference
    comment by mattnewton · 2025-08-11 · in Mistral Integration Improved in Llama.cpp
  2. …but I enjoy the expert guidance you provide in your videos. Please don't stop! great content! 1. https://github.com/mistralai/mistral-inference/blob/main/src...
    comment by gnunez · 2025-02-05 · in Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]
  3. …actually, you can use Mistral 7B v0.3 Instruct for this, here’s a guide in the readme, scroll down https://github.com/mistralai/mistral-inference Make sure to put a json schema as well as few shot examples of json values for the same…
    comment by bionhoward · 2024-07-13 · in Azure OpenAI down in multiple regions
  4. …ebookresearch/llama/blob/main/llama/mo... Mistral (is rumored to have) forked llama and is 369 lines: https://github.com/mistralai/mistral-src/blob/main/mistral/m... and both of these are SOTA open source models.
    comment by swyx · 2024-01-01 · in Stuff we figured out about AI in 2023
  5. Mistral is not llama architecture. https://github.com/mistralai/mistral-src
    comment by jasonjmcghee · 2023-12-08 · in Mistral "Mixtral" 8x7B 32k model [magnet]
  6. …me the hardware I could produce a LLM of high quality from scratch using their architecture. [0] https://github.com/mistralai/mistral-src/blob/main/mistral/m...
    comment by godelski · 2023-09-28 · in Mistral 7B
  7. The source used to create the model is here: https://github.com/mistralai/mistral-src/blob/main/mistral/m... The source used to train information into the model is elsewhere. You have the engine. You don't have the source of the data.
    comment by HanClinto · 2023-09-27 · in Mistral 7B
  8. Hey, how did you try it on M1? I don't see any MPS support. https://github.com/mistralai/mistral-src/issues/2 edit: nevermind https://ollama.ai
    comment by olso · 2023-09-27 · in Mistral 7B
  9. …page has more information on their sliding window attention method to achieve this performance: https://github.com/mistralai/mistral-src If Mistral 7b lives up to the claims, I expect these techniques will make their way into llama.cpp.…
    comment by loudmax · 2023-09-27 · in Mistral 7B