Hacker GitHub

← All repos

openai/evals

View on GitHub ↗ ★ 19,688 Python

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

24 mentions on Hacker News by 22 people: 7 stories, 17 comments · first 2023-03-14 · latest 2025-09-30

Mentions per year 24 mentions · busiest year 2023 (19)
20082026
AllStoriesComments NewestTopOldest
  1. ▲ 1
    Tell HN: OpenAI charges you even if you're helping them on their Eval plarform
    story by behnamoh · 2023-03-19 · 2 comments
  2. ▲ 3
    GPT-4 doesn't pay close attention to detail in some cases
    story by mcaledonensis · 2023-03-18 · 2 comments
  3. ▲ 1
    Show HN: Visualize OpenAI Evals of GPT-4
    story by confutio · 2023-03-16 · 0 comments
  4. ▲ 1
    OpenAI crowd sources LLM benchmarking datasets by offering advanced GPT-4 access
    story by teaearlgraycold · 2023-03-15 · 2 comments
  5. ▲ 8
    Ask HN: Are you willing to contribute to OpenAI Evals?
    story by nullptr_deref · 2023-03-14 · 5 comments
  6. ▲ 3
    Example PR to OpenAI evals to get GPT-4 early API access
    story by harrisonjackson · 2023-03-14 · 0 comments
  7. ▲ 123
    Evals: a framework for evaluating OpenAI models and a registry of benchmarks
    story by tosh · 2023-03-14 · 16 comments