lucidrains/x-transformers
View on GitHub ↗ ★ 5,964 Python
A concise but complete full-attention transformer with a set of promising experimental features from various papers
3 mentions on Hacker News by 3 people: 2 stories, 1 comment · first 2021-05-08 · latest 2024-04-01
20082026
-
▲ 1
x-transformersstory by fzliu · 2024-04-01 · 0 comments
-
…this positional embedding has been implemented by lucidrains in his x-transformers package: https://github.com/lucidrains/x-transformers/blob/main/x_tra...
comment by kir-gadjello · 2023-03-15 · in GPT-4 architecture: what we can deduce from research literature -
▲ 96
X-Transformers: A fully-featured transformer with experimental featuresstory by blackcat201 · 2021-05-08 · 37 comments