ArthurHeitmann/arctic_shift
View on GitHub ↗ ★ 1,811 TypeScript
Making Reddit data accessible to researchers, moderators and everyone else. Interact with the data through large dumps, an API or web interface.
7 mentions on Hacker News by 6 people: 0 stories, 7 comments · first 2024-04-24 · latest 2026-09-30
20082026
-
…hands. https://atprotoalternatives.com/ Historical Reddit data remains available via torrent: https://github.com/ArthurHeitmann/arctic_shift/blob/master/d...
comment by toomuchtodo · 2026-09-30 · in Reddit is killing RSS feeds and ending public API access because of AI bots -
…https://news.ycombinator.com/item?id=49481557 (potential durable architecture subthread discussion) https://github.com/ArthurHeitmann/arctic_shift | https://github.com/ArthurHeitmann/arctic_shift/blob/master/d... (Reddit example, with the…
comment by toomuchtodo · 2026-09-04 · in Is there any way to contribute to nitter and xcancel's legal fights? -
…for importing data from the monthly arctic shift dumps so that archives can be updated monthly. https://github.com/ArthurHeitmann/arctic_shift/releases Arctic Shift https://academictorrents.com/browse.php?search=RaiderBDev Watchful1…
comment by 19-84 · 2026-01-13 · in Show HN: Self-host Reddit – 2.38B posts, works offline, yours forever -
…sets of posts and comments (perhaps depending on removal request coverage?) One is Arctic Shift: https://github.com/ArthurHeitmann/arctic_shift/releases Another is PullPush: https://pullpush.io/
comment by diggings · 2026-01-13 · in Show HN: Self-host Reddit – 2.38B posts, works offline, yours forever -
…original import, taking a few days to finish. [1] https://github.com/Paul-E/Pushshift-Importer [2] https://github.com/ArthurHeitmann/arctic_shift/blob/master/d...
comment by Paul-E · 2025-12-30 · in Show HN: 22 GB of Hacker News in SQLite -
…with that goal. It picks up where PushShift left off when the API changes killed that project. https://github.com/ArthurHeitmann/arctic_shift
comment by Seattle3503 · 2025-08-18 · in ArchiveTeam has finished archiving all goo.gl short links -
…that also shows how ineffective this is. We still have public reddit archives (like Pullpush and https://github.com/ArthurHeitmann/arctic_shift ) which contain comments as they were originally posted. This isn't gonna be a problem for…
comment by float-trip · 2024-04-24 · in Reddit Will License Its Data to Train LLMs, We Made a FF Extension to Replace