Hacker GitHub

← All repos

bentoml/OpenLLM

View on GitHub ↗ ★ 12,586 Python

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

7 mentions on Hacker News by 6 people: 4 stories, 3 comments · first 2023-06-13 · latest 2023-07-08

Mentions per year 7 mentions · busiest year 2023 (7)
20082026
AllStoriesComments NewestTopOldest
  1. https://github.com/oobabooga/text-generation-webui https://github.com/bentoml/OpenLLM https://www.reddit.com/r/LocalLLaMA/top/?t=month
    comment by JimmyRuska · 2023-07-08 · in PdfGptIndexer: Indexing and searching PDF text data using GPT-2 and FAISS
  2. They have a section about it in the README: https://github.com/bentoml/OpenLLM#-telemetry
    comment by nacs · 2023-06-19 · in OpenLLM
  3. What's the rationale for telemetry tracking? https://github.com/bentoml/OpenLLM/blob/main/src/openllm/uti...
    comment by photochemsyn · 2023-06-19 · in OpenLLM