bentoml/OpenLLM
View on GitHub ↗ ★ 12,586 Python
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
7 mentions on Hacker News by 6 people: 4 stories, 3 comments · first 2023-06-13 · latest 2023-07-08
20082026
-
▲ 659
OpenLLMstory by fzliu · 2023-06-19 · 169 comments
-
▲ 3
OpenLLM: An open platform for operating large language models in productionstory by jonbaer · 2023-06-14 · 0 comments
-
▲ 3
An open platform for operating large language models (LLMs) in productionstory by sherlockxu · 2023-06-13 · 0 comments
-
▲ 6
MLOps for LLMsstory by fzliu · 2023-06-13 · 0 comments