lucidrains/x-transformers
View on GitHub ↗ ★ 5,964 Python
A concise but complete full-attention transformer with a set of promising experimental features from various papers
3 mentions on Hacker News by 3 people: 2 stories, 1 comment · first 2021-05-08 · latest 2024-04-01
20082026
-
…this positional embedding has been implemented by lucidrains in his x-transformers package: https://github.com/lucidrains/x-transformers/blob/main/x_tra...
comment by kir-gadjello · 2023-03-15 · in GPT-4 architecture: what we can deduce from research literature