Hacker GitHub

← All repos

vectara/open-rag-eval

View on GitHub ↗ ★ 423 Python

RAG evaluation without the need for "golden answers"

3 mentions on Hacker News by 2 people: 1 story, 2 comments · first 2025-04-08 · latest 2025-07-05

Mentions per year 3 mentions · busiest year 2025 (3)
20082026
AllStoriesComments NewestTopOldest
  1. …aims to address that via reference-free evaluation such as UMBRELA and AutoNuggetizer scores. Repo: https://github.com/vectara/open-rag-eval and a nice UI to use this with: openevaluation.ai Would love to hear feedback on this after you…
    comment by ofermend · 2025-07-05 · in About AI Evals
  2. …and Vectara, and hoping others can contribute more connectors to other RAG systems. repo: https://github.com/vectara/open-rag-eval UI for reviewing eval results: https://openevaluation.ai/ Papers: https://arxiv.org/pdf/2406.06519 and…
    comment by ofermend · 2025-06-13
  3. ▲ 6
    Open RAG Eval
    story by TastyLamps · 2025-04-08 · 1 comment