logxio/picchio
View on GitHub ↗ ★ 17 Python
Catch local LLMs spilling into the CPU. One run shows GPU placement, prefill, decode, memory, power and a verdict.
3 mentions on Hacker News by 1 person: 3 stories, 0 comments · first 2026-07-11 · latest 2026-08-23
20082026
-
▲ 8
I found why Qwen3.8-27B was 14× slower on my 4070 Superstory by logickkk1 · 2026-08-23 · 0 comments
-
▲ 19
Same model, same Q4_K_M label: 5.02, 5.07 and 5.27 bits per weightstory by logickkk1 · 2026-07-14 · 2 comments
-
▲ 2
Show HN: Catch your local LLM falling back to CPUstory by logickkk1 · 2026-07-11 · 0 comments