Hacker GitHub

← All repos

hyperonym/basaran

View on GitHub ↗ ★ 1,277 Python archived

Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.

6 mentions on Hacker News by 6 people: 3 stories, 3 comments · first 2023-03-06 · latest 2023-06-19

Mentions per year 6 mentions · busiest year 2023 (6)
20082026
  1. …do something like this. Turns out I had bookmarked them a while ago. https://github.com/r2d4/openlm https://github.com/hyperonym/basaran
    comment by d4rkp4ttern · 2023-06-19 · in OpenLLM
  2. …to increase retrieval quality 1 https://github.com/underlines/awesome-marketing-datascience/... 2 https://github.com/hyperonym/basaran 3 https://github.com/iaalm/llama-api-server
  3. ▲ 17
    Basaran is an open-source alternative to the OpenAI text completion API
    story by tosh · 2023-05-31 · 0 comments
  4. …finetune of LLaMA-65B by Tim Dettmers from the paper here: https://arxiv.org/abs/2305.14314 [1] https://github.com/hyperonym/basaran
  5. ▲ 3
    Basaran is an open-source alternative to the OpenAI text completion API
    story by thunderbong · 2023-03-07 · 0 comments
  6. ▲ 5
    Show HN: Basaran – OpenAI-compatible streaming API for your own models
    story by peakji · 2023-03-06 · 0 comments