mukhal/intrinsic-source-citation
View on GitHub ↗ ★ 23 Python
[COLM '24] Source-Aware Training Enables Knowledge Attribution in Language Models
3 mentions on Hacker News by 2 people: 0 stories, 3 comments · first 2024-07-18 · latest 2024-09-27
20082026
-
It's just training the source association together with the training set: https://github.com/mukhal/intrinsic-source-citation The only 2 reasons big LLM providers refuse to do it is 1) to prevent a long slew of content creators filing…
comment by DoctorOetker · 2024-09-27 · in I Am Tired of AI -
Wait for the first large scale LLM using source-aware training: https://github.com/mukhal/intrinsic-source-citation This is not something that can be LoRa finetuned after the pretraining step. What we need is a human curated benchmark for…
comment by DoctorOetker · 2024-09-06 · in Phind-405B and faster, high quality AI answers for everyone -
…After pretraining, they teach the model how to cite these documents when generating answers. Code: https://github.com/mukhal/intrinsic-source-citation
comment by mkhalifa · 2024-07-18 · in Training LLMs to cite the pretraining data