Hacker GitHub

← All repos

bentoml/OpenLLM

View on GitHub ↗ ★ 12,586 Python

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

7 mentions on Hacker News by 6 people: 4 stories, 3 comments · first 2023-06-13 · latest 2023-07-08

Mentions per year 7 mentions · busiest year 2023 (7)
20082026
AllStoriesComments NewestTopOldest
  1. https://github.com/oobabooga/text-generation-webui https://github.com/bentoml/OpenLLM https://www.reddit.com/r/LocalLLaMA/top/?t=month
    comment by JimmyRuska · 2023-07-08 · in PdfGptIndexer: Indexing and searching PDF text data using GPT-2 and FAISS
  2. They have a section about it in the README: https://github.com/bentoml/OpenLLM#-telemetry
    comment by nacs · 2023-06-19 · in OpenLLM
  3. What's the rationale for telemetry tracking? https://github.com/bentoml/OpenLLM/blob/main/src/openllm/uti...
    comment by photochemsyn · 2023-06-19 · in OpenLLM
  4. ▲ 659
    OpenLLM
    story by fzliu · 2023-06-19 · 169 comments
  5. ▲ 3
    OpenLLM: An open platform for operating large language models in production
    story by jonbaer · 2023-06-14 · 0 comments
  6. ▲ 3
    An open platform for operating large language models (LLMs) in production
    story by sherlockxu · 2023-06-13 · 0 comments
  7. ▲ 6
    MLOps for LLMs
    story by fzliu · 2023-06-13 · 0 comments