CTGT-Inc/lineage-eval
View on GitHub ↗ ★ 9 Python
Model-agnostic benchmark, generation and LLM-judging harness, and interactive viewer for evaluating selective censorship in language models.
4 mentions on Hacker News by 2 people: 1 story, 3 comments · first 2026-07-30 · latest 2026-08-06
20082026
-
…contains all the eval data and will be updated with additional runs per xlr8harder's suggestion. https://github.com/CTGT-Inc/lineage-eval
comment by cgorlla · 2026-08-06 -
…evaluation prompts [1]. There is just too little overlap in the transferred knowledge. [0]: https://github.com/CTGT-Inc/lineage-eval/blob/main/data/benc... [1]: https://github.com/CTGT-Inc/lineage-eval/blob/main/data/benc...
comment by maxloh · 2026-07-30 · in Show HN: Distilling DeepSeek into GPT-OSS doesn't transfer censorship. Try it -
You can see exactly what prompts we used and the results here: https://github.com/CTGT-Inc/lineage-eval/tree/main/data We found V4 Flash was significantly more censored than the baseline.
comment by cgorlla · 2026-07-30 · in Show HN: Distilling DeepSeek into GPT-OSS doesn't transfer censorship. Try it -
▲ 170
Show HN: Distilling DeepSeek into GPT-OSS doesn't transfer censorship. Try itstory by cgorlla · 2026-07-30 · 73 comments