vllm-project/llm-compressor
View on GitHub ↗ ★ 3,957 Python
State-of-the-art LLM compression, built for production inference with vLLM
5 mentions on Hacker News by 3 people: 1 story, 4 comments · first 2024-08-20 · latest 2026-08-19
20082026
-
▲ 1
LLM compressor: compress models for efficient deploymentstory by hajduksplit · 2024-08-20 · 1 comment