← All repos

tensorchord/openmodelz

View on GitHub ↗ ★ 282 Go

Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)

3 mentions on Hacker News by 2 people: 3 stories, 0 comments · first 2023-08-07 · latest 2024-12-28