kagisearch/llm-chess-puzzles

Benchmark LLM reasoning capability by solving chess puzzles.

6 mentions on Hacker News by 3 people: 2 stories, 4 comments · first 2024-03-25 · latest 2025-04-27

Mentions per year 6 mentions · busiest year 2024 (4)

20082026

All Stories Comments Newest Top Oldest

…gets 85% correctly solved is unexpected and somewhat scary (if model was not trained on this). [1] https://github.com/kagisearch/llm-chess-puzzles
comment by freediver · 2025-04-27 · in Watching o3 model sweat over a Paul Morphy mate-in-2
Also check https://github.com/kagisearch/llm-chess-puzzles
comment by freediver · 2025-01-24 · in The chess puzzle for every LLM
…performing model. A 1000x1000 image costs $0.003. 2. Cognitive ability on visuals went up sharply. https://github.com/kagisearch/llm-chess-puzzles It solves twice as much despite a minor update. It could just be better trained on chess…
comment by muzani · 2024-05-14 · in GPT-4o
…testing goes, it is topping our leaderboard for chess puzzle solving by a wide margin now: https://github.com/kagisearch/llm-chess-puzzles?tab=readme-o...
comment by freediver · 2024-05-13 · in GPT-4o