Hacker GitHub

← All repos

google/flaxformer

View on GitHub ↗ ★ 372 Python archived

3 mentions on Hacker News by 3 people: 0 stories, 3 comments · first 2023-07-24 · latest 2023-07-26

Mentions per year 3 mentions · busiest year 2023 (3)
20082026
AllStoriesComments NewestTopOldest
  1. …checked exhaustively). [1]: https://pytorch.org/docs/stable/generated/torch.nn.Multihead... [2]: https://github.com/google/flaxformer/blob/main/flaxformer/co...
    comment by babel_ · 2023-07-26 · in Attention Is Off By One
  2. …Specifically google did. This exact same idea has been in flaxformers since at least November 2021. https://github.com/google/flaxformer/blame/ee62754ebe5a5eeb1... Specifically to save people a click it says: > """Softmax function with an…
    comment by sedael · 2023-07-24 · in Attention Is Off By One
  3. …seen this trick in practice multiple times. For example, see this snippet from an old Google repo: https://github.com/google/flaxformer/blob/ee62754ebe5a5eeb11...
    comment by alsodumb · 2023-07-24 · in Attention Is Off By One