meta-pytorch/gpt-fast
View on GitHub ↗ ★ 6,269 Python
Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
6 mentions on Hacker News by 5 people: 2 stories, 4 comments · first 2023-11-30 · latest 2024-06-13
20082026
-
▲ 1
GPT-Fast: Simple and efficient GPT inference in <1000 LOC of Pythonstory by Palmik · 2023-12-06 · 1 comment
-
▲ 5
Fast and hackable PyTorch native transformer inferencestory by gavi · 2023-11-30 · 0 comments