Hacker GitHub

← All repos

lechmazur/writing

View on GitHub ↗ ★ 464

This benchmark tests how well LLMs incorporate a set of 10 mandatory story elements (characters, objects, core concepts, attributes, motivations, etc.) in a short creative story

7 mentions on Hacker News by 2 people: 2 stories, 5 comments · first 2025-01-06 · latest 2025-09-10

Mentions per year 7 mentions · busiest year 2025 (7)
20082026
AllStoriesComments NewestTopOldest
  1. It is the new leader on my Short Story Creative Writing benchmark: https://github.com/lechmazur/writing/
    comment by zone411 · 2025-08-08 · in GPT-5
  2. …https://github.com/lechmazur/nyt-connections https://github.com/lechmazur/generalization https://github.com/lechmazur/writing
    comment by zone411 · 2025-06-12 · in First thoughts on o3 pro
  3. If there isn’t, an AI could write it: https://github.com/lechmazur/writing?tab=readme-ov-file
    comment by thih9 · 2025-04-17 · in This 'College Protester' Isn't Real. It's an AI-Powered Undercover Bot for Cops
  4. …on the Short Story Creative Writing Benchmark, but Claude Sonnets and DeepSeek R1 score higher. ( https://github.com/lechmazur/writing/ ) - Improves upon GPT-4o's score on the Confabulations/Hallucinations on Provided Documents Benchmark,…
    comment by zone411 · 2025-02-28 · in GPT-4.5
  5. …Benchmark: https://github.com/lechmazur/generalization LLM Creative Story-Writing Benchmark: https://github.com/lechmazur/writing Extended NYT Connections LLM Benchmark: https://github.com/lechmazur/nyt-connections/ and a couple more that…
    comment by zone411 · 2025-02-10 · in PhD Knowledge Not Required: A Reasoning Challenge for Large Language Models