Hacker GitHub

← All repos

explosion/curated-transformers

View on GitHub ↗ ★ 889 Python

🤖 A PyTorch library of curated Transformer models and their composable components

8 mentions on Hacker News by 2 people: 4 stories, 4 comments · first 2023-06-18 · latest 2023-12-20

Mentions per year 8 mentions · busiest year 2023 (8)
20082026
AllStoriesComments NewestTopOldest
  1. …can be implemented in about 100 lines (excluding Python import ceremony and comments). E.g.: BERT: https://github.com/explosion/curated-transformers/blob/main/... Llama 1/2: https://github.com/explosion/curated-transformers/blob/main/...…
    comment by danieldk · 2023-12-20 · in Implementation of Mamba in one file of PyTorch
  2. …on this project. Seeing Candle wants to make me port curated-transformers to Candle for fun: https://github.com/explosion/curated-transformers
    comment by danieldk · 2023-08-08 · in Candle: Torch Replacement in Rust
  3. …possible that OpenAI’s implementation switches to a greedy decoder with a temperature of 0). [1] https://github.com/explosion/curated-transformers
    comment by danieldk · 2023-08-05 · in Non-determinism in GPT-4 is caused by Sparse MoE
  4. …Falcon with key-value caching and it the speed is on-par with other models of the same size: https://github.com/explosion/curated-transformers/blob/main/... (This is a correct implementation of the decoder layer.)
    comment by danieldk · 2023-06-18 · in Falcon LLM – A 40B Model