fstandhartinger/jevbench

JevBench by Benchmark Heaven: benchmark and leaderboard for AI decision models, measuring typed decision accuracy, calibration, latency and cost.

4 mentions on Hacker News by 3 people: 1 story, 3 comments · first 2026-09-22 · latest 2026-09-23

Mentions per year 4 mentions · busiest year 2026 (4)

20082026

All Stories Comments Newest Top Oldest

Happy to — please open an issue at https://github.com/fstandhartinger/jevbench/issues with an endpoint or runnable code, the model and licence, and whether it was trained on the public items. Every entrant runs through the same harness,…
comment by florianstandhar · 2026-09-23 · in Show HN: JevBench, a reproducible benchmark for typed decision models
…hard up about things? Also every single question (even in the hard set) is single dimensional?: https://github.com/fstandhartinger/jevbench/blob/main/datase... Jeeze, this is getting sad. I guess after all the mass-psychoses where people…
comment by BoorishBears · 2026-09-23 · in OpenAI is well positioned to fast-follow Jev
…trying to figure out what exactly the tests here are. I guess I found some of the questions (here: https://github.com/fstandhartinger/jevbench/blob/main/datase... ) e.g., "instructions": "Which intent does the user's message express?",…
comment by ks2048 · 2026-09-23 · in Show HN: JevBench, a reproducible benchmark for typed decision models