Hacker GitHub

← All repos

togethercomputer/RedPajama-Data

View on GitHub ↗ ★ 4,998 Python

The RedPajama-Data repository contains code for preparing large datasets for training large language models.

9 mentions on Hacker News by 9 people: 1 story, 8 comments · first 2023-04-17 · latest 2024-08-29

Mentions per year 9 mentions · busiest year 2023 (6)
20082026
  1. ▲ 2
    RedPajama-Data: Code for preparing large datasets
    story by harrisonpowers · 2023-04-17 · 0 comments