MoonshotAI/Attention-Residuals

3 mentions on Hacker News by 3 people: 2 stories, 1 comment · first 2026-03-16 · latest 2026-05-04

Mentions per year 3 mentions · busiest year 2026 (3)

20082026

All Stories Comments Newest Top Oldest

…on static data but also on the capability of handling context in itself. Kimi introduced this https://github.com/MoonshotAI/Attention-Residuals but i'm pretty sure closed labs like Google had something like this for a while.
comment by AntiUSAbah · 2026-05-04 · in The Road to a Billion-Token Context