← All repos

InternLM/lmdeploy

View on GitHub ↗ ★ 8,140 Python

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

3 mentions on Hacker News by 1 person: 0 stories, 3 comments · first 2023-08-25 · latest 2023-10-07