Hacker GitHub

← All repos

ggml-org/llama.cpp

View on GitHub ↗ ★ 133,134 C++

LLM inference in C/C++

738 mentions on Hacker News by 471 people: 96 stories, 642 comments · first 2023-03-10 · latest 2026-10-28

Mentions per year 738 mentions · busiest year 2023 (316)
20082026
AllStoriesComments NewestTopOldest
  1. ▲ 3
    Gguf: Harden loader against malformed tensor dims and metadata types
    story by gzxharrison001 · 2026-08-26 · 0 comments
  2. ▲ 4
    Release v0.2.0 · ggml-org/llama.cpp
    story by kyisaiah47 · 2026-08-25 · 0 comments
  3. ▲ 11
    LLama.cpp Got Screwd
    story by trilogic · 2026-07-09 · 5 comments
  4. ▲ 3
    TurboPrefill: 2.7× faster than llama.cpp Pipeline Parallel on Llama-3-70B
    story by trykhlieb · 2026-06-30 · 0 comments
  5. ▲ 2
    Llama.cpp b9180: MTP support landed
    story by usagisushi · 2026-05-17 · 0 comments
  6. ▲ 3
    Grinder12: 0.96-Bit Lossless Streaming KV-Cache (16.55x VRAM Savings
    story by AMICLLC · 2026-05-10 · 0 comments
  7. ▲ 1
    Llama and Spec: MTP Support
    story by jhoho · 2026-05-07 · 0 comments
  8. ▲ 4
    Llama.cpp's Agents.md
    story by Wowfunhappy · 2026-03-25 · 1 comment
  9. ▲ 6
    Tell HN: Llamacpp now supports unified system RAM offloading on Linux
    story by dabockster · 2026-03-24 · 0 comments
  10. ▲ 839
    Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI
    story by lairv · 2026-02-20 · 223 comments
  11. ▲ 6
    Yet another reminder why you should not use Ollama
    story by dcreater · 2026-02-05 · 5 comments
  12. ▲ 1
    Show HN: Notebook page on llama.cpp official webui
    story by hleszek · 2026-02-04 · 0 comments
  13. ▲ 4
    Llama.cpp launches official WebUI for local LLMs
    story by victormustar · 2025-11-04 · 0 comments
  14. ▲ 2
    Guide: Setting up Nvidia DGX Spark with ggml
    story by homarp · 2025-10-14 · 0 comments
  15. ▲ 6
    Llama.cpp: Deterministic Inference Mode (CUDA): RMSNorm, MatMul, Attention
    story by diwank · 2025-09-15 · 0 comments
  16. ▲ 2
    A better Llama-CLI help doc
    story by dcreater · 2025-09-02 · 1 comment
  17. ▲ 2
    Guide: Running GPT-OSS with Llama.cpp
    story by homarp · 2025-08-21 · 0 comments
  18. ▲ 95
    Mistral Integration Improved in Llama.cpp
    story by decide1000 · 2025-08-11 · 15 comments
  19. ▲ 35
    Llama.cpp: Add GPT-OSS
    story by atgctg · 2025-08-05 · 0 comments
  20. ▲ 3
    AMD teams contributing to the llama.cpp codebase
    story by gzer0 · 2025-07-28 · 0 comments
  21. ▲ 2
    Hunyuan-A13B model support has been merged into llama.cpp
    story by empire23 · 2025-07-08 · 0 comments
  22. ▲ 5
    Is GitHub Releases Down?
    story by rvz · 2025-06-17 · 3 comments
  23. ▲ 550
    Vision Now Available in Llama.cpp
    story by redman25 · 2025-05-10 · 104 comments
  24. ▲ 3
    Llama.cpp now supports tool calling (OpenAI-compatible)
    story by ochafik · 2025-02-01 · 1 comment
  25. ▲ 17
    Ollama are 'try[ing to] achieve vendor lock-in'
    story by alexmorley · 2025-01-31 · 5 comments
  26. ▲ 1
    Ggml: X2 speed for WASM by optimizing SIMD
    story by btilly · 2025-01-28 · 2 comments
  27. ▲ 6
    DeepSeek-R1 speeds up llama.cpp code by x2
    story by roboboffin · 2025-01-28 · 3 comments
  28. ▲ 4
    Llama.cpp PR with 99% of code written by DeepSeek-R1
    story by zelag · 2025-01-28 · 0 comments
  29. ▲ 7
    Ggml 2x WASM Speed with SIMD Optimization Using 99% DeekSeek-R1-Generated Code
    story by bratao · 2025-01-27 · 0 comments
  30. ▲ 155
    Llama.cpp Now Supports Qwen2-VL (Vision Language Model)
    story by BUFU · 2024-12-14 · 50 comments
  31. ▲ 2
    Llama.vim: Plugin for Neovim
    story by mariuz · 2024-10-22 · 0 comments
  32. ▲ 2
    Llama.vim: Plugin for Neovim
    story by ibobev · 2024-10-21 · 0 comments
  33. ▲ 2
    Attention and final logit soft-capping, update scaling factor to Gemma2
    story by tosh · 2024-07-01 · 0 comments
  34. ▲ 3
    Distributed LLM Inference with Llama.cpp
    story by tosh · 2024-05-24 · 0 comments
  35. ▲ 382
    New exponent functions that make SiLU and SoftMax 2x faster, at full accuracy
    story by weinzierl · 2024-05-15 · 72 comments
  36. ▲ 2
    ggml: Add Flash Attention
    story by tosh · 2024-05-13 · 0 comments
  37. ▲ 2
    llama.cpp bfloat16 support
    story by indigodaddy · 2024-04-30 · 0 comments
  38. ▲ 3
    GGML Flash Attention support merged into llama.cpp
    story by smcleod · 2024-04-30 · 1 comment
  39. ▲ 7
    Llama.cpp Working on Support for Llama3
    story by theolivenbaum · 2024-04-18 · 0 comments
  40. ▲ 1
    Llama.cpp: Improve CPU prompt eval speed
    story by tosh · 2024-04-17 · 0 comments
  41. ▲ 2
    Llama.cpp: Mac Prebuilds
    story by tosh · 2024-03-22 · 0 comments
  42. ▲ 11
    Grok-1 Support for Llama.cpp
    story by schappim · 2024-03-22 · 2 comments
  43. ▲ 3
    Control Vectors have been added to llama.cpp
    story by Der_Einzige · 2024-03-16 · 0 comments
  44. ▲ 17
    Gemma Is Added to Llama.cpp
    story by behnamoh · 2024-02-21 · 0 comments
  45. ▲ 3
    Llama.cpp supports distributed inference across machines on a local network
    story by behnamoh · 2024-01-27 · 0 comments
  46. ▲ 2
    Llama.cpp incoming backends: Vulkan, Kompute, SYCL
    story by irusensei · 2024-01-27 · 0 comments
  47. ▲ 2
    Llama.cpp: Self-Extend Support
    story by tosh · 2024-01-09 · 0 comments
  48. ▲ 5
    Llama.cpp: SOTA 2-bit quants
    story by tosh · 2024-01-07 · 0 comments
  49. ▲ 2
    K-Quants
    story by tosh · 2023-12-29 · 0 comments
  50. ▲ 3
    CUDA: Faster Mixtral Prompt Processing
    story by tosh · 2023-12-21 · 0 comments