Hacker GitHub

← All repos

ikawrakow/ik_llama.cpp

View on GitHub ↗ ★ 3,362 C++

llama.cpp fork with additional SOTA quants and improved performance

15 mentions on Hacker News by 13 people: 3 stories, 12 comments · first 2024-09-30 · latest 2026-07-22

Mentions per year 15 mentions · busiest year 2026 (8)
20082026
AllStoriesComments NewestTopOldest
  1. It works, thanks to https://github.com/ikawrakow/ik_llama.cpp/pull/1911 , which got merged in early June. However, there might still be some issue with the chat template.
    comment by throwdbaaway · 2026-07-22 · in Laguna S 2.1
  2. …looks like my original comment was flagged for some reason. The fix is open upstream as PR #2138 ( https://github.com/ikawrakow/ik_llama.cpp/pull/2138 )
    comment by neomindryan · 2026-07-15 · in Running Gemma 4 26B at 5 tokens/sec on a 13-year-old Xeon with no GPU
  3. …NaN-free, fluent-looking multilingual gibberish. The fix is open upstream as PR #2138 ( https://github.com/ikawrakow/ik_llama.cpp/pull/2138 ), awaiting review. Fair warning on the AI angle: the patch was written by Claude at my direction.…
    comment by neomindryan · 2026-07-15 · in Running Gemma 4 26B at 5 tokens/sec on a 13-year-old Xeon with no GPU
  4. Hello, it's the internet calling, today is that day. https://github.com/ikawrakow/ik_llama.cpp Edit: it's gonna be slow if you're not using any VRAM. But it's possible. Software isn't going to speed that up anytime soon, it's just a…
    comment by Catloafdev · 2026-06-29 · in Qwen 3.6 27B is the sweet spot for local development
  5. …https://github.com/ggml-org/llama.cpp/blob/master/tools/llam... ik_llama includes llama-sweep-bench https://github.com/ikawrakow/ik_llama.cpp/blob/main/examples... When comparing hardware, the output of these tools is very helpful to let…
    comment by Aurornis · 2026-06-01 · in A 10 year old Xeon is all you need
  6. …is a fork of llama.cpp which specializes on CPU inference, some benchmarks from 1 year ago: https://github.com/ikawrakow/ik_llama.cpp/discussions/164
    comment by kgeist · 2026-01-28 · in I have written gemma3 inference in pure C
  7. Have you tried anything with https://codeberg.org/ikawrakow/illama https://github.com/ikawrakow/ik_llama.cpp and their 4Bit-quants? Or maybe even Microsofts Bitnet? https://github.com/microsoft/BitNet https://github.com/ikawrakow/ik_llama.c…
    comment by LargoLasskhyfv · 2026-01-07 · in A 30B Qwen model walks into a Raspberry Pi and runs in real time
  8. Take a look at ik_llama.cpp: https://github.com/ikawrakow/ik_llama.cpp CPU performance is much better than mainline llama, as well as having more quantization types available
    comment by akawry · 2025-08-10 · in I want everything local – Building my offline AI workspace
  9. I heard that ik_llama.cpp performs better for CPU use: https://github.com/ikawrakow/ik_llama.cpp/
    comment by RossBencina · 2025-08-08 · in Benchmark Framework Desktop Mainboard and 4-node cluster
  10. try https://github.com/ikawrakow/ik_llama.cpp
    comment by leeoniya · 2025-06-24 · in Basic Facts about GPUs
  11. There seems to be some bad blood between ikawrakow and ggerganov: https://github.com/ikawrakow/ik_llama.cpp/discussions/316
    comment by Philpax · 2025-05-16 · in Ollama's new engine for multimodal models
  12. There's also some interpersonal conflict in llama.cpp that's hampering other bug fixes https://github.com/ikawrakow/ik_llama.cpp/pull/400
    comment by Maxious · 2025-05-16 · in Ollama's new engine for multimodal models