openai/simple-evals
View on GitHub ↗ ★ 4,692 Python
10 mentions on Hacker News by 10 people: 4 stories, 6 comments · first 2024-04-12 · latest 2026-04-08
20082026
-
…that (I bet it doesn't!) these are bullshit machines. [0]: https://arxiv.org/pdf/2601.03267 [1]: https://github.com/openai/simple-evals
comment by camgunz · 2026-04-08 · in ML promises to be profoundly weird -
…are those? The 08-06 release seems to be a bit higher on numerous benchmarks than what that shows: https://github.com/openai/simple-evals?tab=readme-ov-file#be...
comment by usaar333 · 2024-12-06 · in Llama-3.3-70B-Instruct -
…The folks I've shared this with so far have found it useful - I hope you do as well! [1] https://github.com/openai/simple-evals [2] https://openai.com/index/hello-gpt-4o/
comment by harlanlewis · 2024-05-15 · in LLM price vs. performance (Google sheet) -
▲ 3
GPT-4o Benchmark Resultsstory by joak · 2024-05-13 · 0 comments
-
…MMLU 86.1 86.4 86.7 DROP 83.5 80.9 86.0 MATH 57.8 52.9 73.4 HumEv 84.1 74.4 88.2 *using API prompt: https://github.com/openai/simple-evals
comment by tedsanders · 2024-04-18 · in Meta Llama 3 -
…very exciting to have models this good that you can run locally and modify! GPT-4 numbers from from https://github.com/openai/simple-evals gpt-4-turbo-2024-04-09 (chatgpt)
comment by modeless · 2024-04-18 · in Meta Llama 3 -
▲ 2
GPT-4-turbo-2024-04-09 "wins" simple evals benchmarkstory by zurfer · 2024-04-17 · 0 comments
-
▲ 1
OpenAI: Simple-Evalsstory by tosh · 2024-04-12 · 0 comments
-
▲ 3
OpenAI/Simple-Evalsstory by davidbarker · 2024-04-12 · 0 comments