Hacker GitHub

← All repos

turboderp-org/exllamav2

View on GitHub ↗ ★ 4,648 Python

A fast inference library for running LLMs locally on modern consumer-class GPUs

9 mentions on Hacker News by 8 people: 1 story, 8 comments · first 2023-09-13 · latest 2024-07-16

Mentions per year 9 mentions · busiest year 2023 (6)
20082026
AllStoriesComments NewestTopOldest
  1. ▲ 322
    Exllamav2: Inference library for running LLMs locally on consumer-class GPUs
    story by Palmik · 2023-09-13 · 125 comments