lechmazur/sycophancy
View on GitHub ↗ ★ 71
LLM benchmark and leaderboard for narrator-bias sycophancy, opposite-narrator contradictions, and judgment consistency.
3 mentions on Hacker News by 1 person: 1 story, 2 comments · first 2026-03-10 · latest 2026-03-28
20082026
-
I built this benchmark this month: https://github.com/lechmazur/sycophancy . There are large differences between LLMs. There are large differences between LLMs. For example, Mistral Large 3 and GPT-4.1 will initially agree with the…
comment by zone411 · 2026-03-28 · in AI overly affirms users asking for personal advice -
I built two related benchmarks this month: https://github.com/lechmazur/sycophancy and https://github.com/lechmazur/persuasion . There are large differences between LLMs. For example, good luck getting Grok to change its view, while Gemini…
comment by zone411 · 2026-03-28 · in Folk are getting dangerously attached to AI that always tells them they're right