Hacker GitHub

← All repos

Tiiny-AI/PowerInfer

View on GitHub ↗ ★ 9,874 C++

High-speed Large Language Model Serving for Local Deployment

6 mentions on Hacker News by 6 people: 2 stories, 4 comments · first 2023-12-19 · latest 2024-06-12

Mentions per year 6 mentions · busiest year 2023 (4)
20082026
AllStoriesComments NewestTopOldest
  1. ▲ 417
    High-Speed Large Language Model Serving on PCs with Consumer-Grade GPUs
    story by dataminer · 2023-12-20 · 83 comments
  2. ▲ 4
    PowerInfer: High-Speed Large Language Model Serving on Consumer-Grade GPUs
    story by limoce · 2023-12-19 · 1 comment