carlini/yet-another-applied-llm-benchmark
View on GitHub ↗ ★ 1,070 Python
A benchmark to evaluate language models on questions I've previously asked them to solve.
4 mentions on Hacker News by 4 people: 3 stories, 1 comment · first 2024-02-20 · latest 2024-06-27
20082026
-
Someone made a framework to make and test llms on your own benchmarks you might find it useful https://github.com/carlini/yet-another-applied-llm-benchmark
comment by FergusArgyll · 2024-05-28 · in Chatbot Arena Leaderboard: Gemini 1.5 Flash, Pro and Advanced Results