Hacker GitHub

← All repos

HazyResearch/safari

View on GitHub ↗ ★ 920 Assembly

Convolutions for Sequence Modeling

3 mentions on Hacker News by 3 people: 0 stories, 3 comments · first 2023-04-24 · latest 2023-11-29

Mentions per year 3 mentions · busiest year 2023 (3)
20082026
AllStoriesComments NewestTopOldest
  1. …and language: (cv) https://arxiv.org/abs/2301.00808 , (cv) https://arxiv.org/abs/2110.00476 , (nlp) https://github.com/HazyResearch/safari MLPs also seem to scale: (cv) https://arxiv.org/abs/2105.01601 , (cv)…
    comment by godelski · 2023-11-29 · in MeshGPT: Generating triangle meshes with decoder-only transformers
  2. …which as we all know is too costly for long sequences (O(n²)). Lately I've been playing with https://github.com/hazyresearch/safari , which uses a lot less compute and seems promising, though it reminds me of things like FNet. Otherwise,…
    comment by cs702 · 2023-05-05 · in Unlimiformer: Long-Range Transformers with Unlimited Length Input
  3. the code is here https://github.com/hazyresearch/safari you should try it and let us know your verdict.
    comment by lucidrains · 2023-04-24 · in Scaling Transformer to 1M tokens and beyond with RMT