Hacker GitHub

← All repos

magnitudedev/magnitude

View on GitHub ↗ ★ 7,666 Rust

Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.

13 mentions on Hacker News by 3 people: 3 stories, 10 comments · first 2025-04-25 · latest 2026-10-01

Mentions per year 13 mentions · busiest year 2026 (9)
20082026
AllStoriesComments NewestTopOldest
  1. …mind creating an issue on GitHub with information about what didn't work and maybe a screenshot? https://github.com/magnitudedev/magnitude/issues
    comment by anerli · 2026-10-01 · in Launch HN: Magnitude (YC S25) – Self-optimizing inference engine for agents
  2. …issue here? There's also a github issue open on this topic if you want to leave a comment there: https://github.com/magnitudedev/magnitude/issues/142
    comment by anerli · 2026-09-30 · in Launch HN: Magnitude (YC S25) – Self-optimizing inference engine for agents
  3. …is a good callout! Feel free to open an issue for any features that you'd like to see in Magnitude https://github.com/magnitudedev/magnitude/issues
    comment by anerli · 2026-09-30 · in Launch HN: Magnitude (YC S25) – Self-optimizing inference engine for agents
  4. Issues should already be open for anyone to report! https://github.com/magnitudedev/magnitude/issues Let me know if you keep running into problems for some reason
    comment by anerli · 2026-09-30 · in Launch HN: Magnitude (YC S25) – Self-optimizing inference engine for agents
  5. …full context window. All our benchmarks are open source so you can check it out here if you'd like: https://github.com/magnitudedev/magnitude/blob/main/inferenc...
    comment by anerli · 2026-09-30 · in Launch HN: Magnitude (YC S25) – Self-optimizing inference engine for agents
  6. https://github.com/magnitudedev/magnitude/issues/141 would love to try it again when you have updates
    comment by herf · 2026-09-30 · in Launch HN: Magnitude (YC S25) – Self-optimizing inference engine for agents
  7. …GPU might be a bug - would you be willing to open a github issue with more detail on your setup? https://github.com/magnitudedev/magnitude/issues As for performance, there may be some variability still depending on the model and backend.…
    comment by anerli · 2026-09-30 · in Launch HN: Magnitude (YC S25) – Self-optimizing inference engine for agents
  8. …optimize that path, we used 16-bit KV instead. The source for the benchmark is available here also: https://github.com/magnitudedev/magnitude/tree/main/inferenc...
    comment by anerli · 2026-09-30 · in Launch HN: Magnitude (YC S25) – Self-optimizing inference engine for agents
  9. Got really inspired by Magnitude ( https://github.com/magnitudedev/magnitude ) recently and am tired of the manual process of QAing frontend features, so I decided to build a GH Action that does it for me. If you have a GH repo that…
    comment by bpmcgough · 2025-07-18 · in I built a GH Action that uses AI to manually QA your PR using Magnitude/Claude
  10. …to support a variety of providers. I'll keep this in mind and implement soon! edit: tracking here https://github.com/magnitudedev/magnitude/issues/6
    comment by anerli · 2025-04-25 · in Show HN: Magnitude – open-source, AI-native test framework for web apps