Lightning-AI/lit-llama

View on GitHub ↗ ★ 6,080 Python

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

5 mentions on Hacker News by 4 people: 1 story, 4 comments · first 2023-03-28 · latest 2023-06-13

Mentions per year 5 mentions · busiest year 2023 (5)

20082026

All Stories Comments Newest Top Oldest

▲ 158
Show HN: A fully open-source (Apache 2.0)implementation of llama
story by osurits · 2023-03-28 · 52 comments