bitsandbytes-foundation/bitsandbytes
View on GitHub ↗ ★ 8,535 Python
Accessible large language models via k-bit quantization for PyTorch.
9 mentions on Hacker News by 8 people: 2 stories, 7 comments · first 2023-04-05 · latest 2024-06-25
20082026
-
▲ 15
Ask HN: Are you training and running custom LLMs and how are you doing it?story by kordlessagain · 2023-08-14 · 2 comments
-
▲ 1
Bitsandbytes: 8-bit CUDA functions for PyTorchstory by anotherpaulg · 2023-05-25 · 0 comments