Hacker GitHub

← All repos

explosion/curated-transformers

View on GitHub ↗ ★ 889 Python

🤖 A PyTorch library of curated Transformer models and their composable components

8 mentions on Hacker News by 2 people: 4 stories, 4 comments · first 2023-06-18 · latest 2023-12-20

Mentions per year 8 mentions · busiest year 2023 (8)
20082026
AllStoriesComments NewestTopOldest
  1. …can be implemented in about 100 lines (excluding Python import ceremony and comments). E.g.: BERT: https://github.com/explosion/curated-transformers/blob/main/... Llama 1/2: https://github.com/explosion/curated-transformers/blob/main/...…
    comment by danieldk · 2023-12-20 · in Implementation of Mamba in one file of PyTorch
  2. ▲ 2
    Curated Transformers: MosaicMPT LLM decoder in 90 lines
    story by danieldk · 2023-08-10 · 0 comments
  3. …on this project. Seeing Candle wants to make me port curated-transformers to Candle for fun: https://github.com/explosion/curated-transformers
    comment by danieldk · 2023-08-08 · in Candle: Torch Replacement in Rust
  4. …possible that OpenAI’s implementation switches to a greedy decoder with a temperature of 0). [1] https://github.com/explosion/curated-transformers
    comment by danieldk · 2023-08-05 · in Non-determinism in GPT-4 is caused by Sparse MoE
  5. ▲ 3
    Curated Transformers: LLMs from reusable building blocks
    story by danieldk · 2023-08-04 · 0 comments
  6. ▲ 10
    Show HN: Curated Transformers – PyTorch LLMs with less code duplication
    story by syllogism · 2023-07-15 · 0 comments
  7. ▲ 7
    Show HN: Curated Transformers – Lightweight, composable PyTorch transformers
    story by danieldk · 2023-07-13 · 0 comments
  8. …Falcon with key-value caching and it the speed is on-par with other models of the same size: https://github.com/explosion/curated-transformers/blob/main/... (This is a correct implementation of the decoder layer.)
    comment by danieldk · 2023-06-18 · in Falcon LLM – A 40B Model