Hacker GitHub

← All repos

Luce-Org/lucebox

View on GitHub ↗ ★ 2,981 C++

LLM speculative inference server for heterogeneous hardware & consumer GPUs

5 mentions on Hacker News by 3 people: 3 stories, 2 comments · first 2026-04-20 · latest 2026-06-16

Mentions per year 5 mentions · busiest year 2026 (5)
20082026
AllStoriesComments NewestTopOldest
  1. ▲ 3
    256K context with 72MiB of KV cache on the GPU
    story by GreenGames · 2026-06-16 · 0 comments
  2. ▲ 3
    PFlash: 10x prefill speedup over llama.cpp at 128K on a RTX 3090
    story by GreenGames · 2026-05-01 · 1 comment
  3. ▲ 165
    We got 207 tok/s with Qwen3.5-27B on an RTX 3090
    story by GreenGames · 2026-04-20 · 52 comments