FMInference/FlexLLMGen
View on GitHub ↗ ★ 9,343 Python archived
Running large language models on a single GPU for throughput-oriented scenarios.
14 mentions on Hacker News by 13 people: 2 stories, 12 comments · first 2023-02-20 · latest 2023-12-03
20082026
-
▲ 192
FlexGen: Running large language models on a single GPUstory by behnamoh · 2023-03-26 · 43 comments
-
▲ 682
Running large language models like ChatGPT on a single GPUstory by _nhynes · 2023-02-20 · 264 comments