kvcache-ai/ktransformers
View on GitHub ↗ ★ 19,651 Python
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
14 mentions on Hacker News by 11 people: 2 stories, 12 comments · first 2024-08-29 · latest 2026-03-24
20082026
-
▲ 14
Show HN: KTransformers:671B DeepSeek-R1 on a Single Machine-286 tokens/s Prefillstory by sssummer · 2025-02-10 · 0 comments
-
▲ 20
Show HN: KTransformers–236B Model and 1M Context LLM Inference on Local Machinesstory by sssummer · 2024-08-29 · 3 comments