Hacker GitHub

← All repos

ShelbyJenkins/llm_client

View on GitHub ↗ ★ 254 Rust

The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes

7 mentions on Hacker News by 2 people: 1 story, 6 comments · first 2024-03-12 · latest 2025-07-24

Mentions per year 7 mentions · busiest year 2024 (6)
20082026
AllStoriesComments NewestTopOldest
  1. …implementing your gui for other rust LLM projects? I’m looking for a front end for my project: https://github.com/ShelbyJenkins/llm_client
    comment by J_Shelby_J · 2024-10-11 · in Lm.rs: Minimal CPU LLM inference in Rust with no dependency
  2. …Currently to support llama.cpp, but this is pretty neat too. Any plans to support grammars? [0] https://github.com/ShelbyJenkins/llm_client
    comment by J_Shelby_J · 2024-10-11 · in Lm.rs: Minimal CPU LLM inference in Rust with no dependency
  3. …I'm still using llama.cpp on the backend, but eventually want to move to candle via mistral.rs. [1] https://github.com/ShelbyJenkins/llm_client
    comment by J_Shelby_J · 2024-09-19 · in Moshi: A speech-text foundation model for real time dialogue
  4. …I’m working out of. The chunking hasn’t been pushed, but you can see the decision making workflows. https://github.com/ShelbyJenkins/llm_client
    comment by J_Shelby_J · 2024-06-08 · in Breaking up is hard to do: Chunking in RAG applications
  5. …As a result, most models will reason their way to the answer, and then end with 'The answer is:'. https://github.com/ShelbyJenkins/llm_client/blob/e3c4a860dda...
    comment by J_Shelby_J · 2024-06-05 · in Simple tasks showing reasoning breakdown in state-of-the-art LLMs
  6. …everything in a single lang especially as the monopoly of CUDA inevitably gets chipped away. [0] https://github.com/ShelbyJenkins/llm_client [1] https://github.com/huggingface/candle
    comment by J_Shelby_J · 2024-03-12 · in Go, Python, Rust, and production AI applications