Hacker GitHub

← All repos

jquesnelle/yarn

View on GitHub ↗ ★ 1,813 Python

YaRN: Efficient Context Window Extension of Large Language Models

3 mentions on Hacker News by 3 people: 1 story, 2 comments · first 2023-08-31 · latest 2024-04-22

Mentions per year 3 mentions · busiest year 2023 (2)
20082026
AllStoriesComments NewestTopOldest
  1. …context window via fine tuning. The authors claim this method was used to extend Llama 2 to 128k: https://github.com/jquesnelle/yarn
    comment by tarruda · 2024-04-22 · in Has Llama-3 just killed proprietary AI models?
  2. Open researchers are trying to shrink and speed up 138K models e.g. YaRN https://github.com/jquesnelle/yarn It's very compelling and opens up a lot of use cases, so I've been keeping an eye out for advancements. However, inferencing on…
    comment by fancy_pantser · 2023-11-06 · in New models and developer products