Hacker GitHub

← All repos

algorithmicsuperintelligence/optillm

View on GitHub ↗ ★ 4,334 Python

Optimizing inference proxy for LLMs

22 mentions on Hacker News by 3 people: 9 stories, 13 comments · first 2024-09-13 · latest 2025-06-19

Mentions per year 22 mentions · busiest year 2025 (12)
20082026
AllStoriesComments NewestTopOldest
  1. ▲ 4
    Show HN: DeepThink Plugin – Bring Gemini 2.5's parallel reasoning to open models
    story by codelion · 2025-06-19 · 0 comments
  2. ▲ 48
    Show HN: System Prompt Learning – LLMs Learn Problem-Solving from Experience
    story by codelion · 2025-06-02 · 13 comments
  3. ▲ 397
    Show HN: AutoThink – Boosts local LLM performance with adaptive reasoning
    story by codelion · 2025-05-28 · 68 comments
  4. ▲ 2
    Show HN: OptiLLMBench – Test how inference optimization tricks scale up LLMs
    story by codelion · 2025-02-17 · 0 comments
  5. ▲ 67
    Launch HN: Patched (YC S24) – AI workflows for post-code tasks
    story by rohansood15 · 2024-10-31 · 20 comments
  6. ▲ 1
    Entropy Decoding in Optillm and Early Results on GSM8k
    story by codelion · 2024-10-20 · 0 comments
  7. ▲ 1
    Unbounded Context with Memory
    story by codelion · 2024-10-12 · 1 comment
  8. ▲ 2
    Optillm: An Optimizing Inference Proxy with Plugins
    story by codelion · 2024-10-05 · 1 comment
  9. ▲ 2
    Cot Decoding – Eliciting Reasoning from LLMs
    story by codelion · 2024-09-24 · 0 comments