tensorchord/openmodelz
View on GitHub ↗ ★ 282 Go
Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
3 mentions on Hacker News by 2 people: 3 stories, 0 comments · first 2023-08-07 · latest 2024-12-28
20082026
-
▲ 1
Show HN: OpenModelZ – Autoscale vLLM/SGLang... on Kubernetes (and other clouds)story by gaocegege · 2024-12-28 · 0 comments
-
▲ 3
Show HN: One-click machine learning deployment at scale on any clusterstory by gaocegege · 2024-01-11 · 0 comments
-
▲ 2
One-click machine learning deployment (e.g. LLM) at scale on any clusterstory by loa_observer · 2023-08-07 · 0 comments