ray-project/ray-llm
View on GitHub ↗ ★ 1,260 archived
RayLLM - LLMs on Ray (Archived). Read README for more info.
3 mentions on Hacker News by 2 people: 2 stories, 1 comment · first 2023-05-31 · latest 2023-08-29
20082026
-
…( https://github.com/ray-project/ray ) is available for anyone to use. You can also use Aviary ( https://github.com/ray-project/aviary ) to serve any of those models yourself.
comment by waleedk · 2023-08-29 · in Llama 2 is about as factually accurate as GPT-4 for summaries and is 30X cheaper -
▲ 1
Evaluate Multiple LLMs Easilystory by fzliu · 2023-06-02 · 0 comments
-
▲ 5
Aviary simplifies OSS LLM eval and deploymentstory by waleedk · 2023-05-31 · 3 comments