Hacker GitHub

← All repos

webrecorder/warcio

View on GitHub ↗ ★ 485 Python

Streaming WARC/ARC library for fast web archive IO

3 mentions on Hacker News by 3 people: 0 stories, 3 comments · first 2017-11-08 · latest 2025-12-24

Mentions per year 3 mentions · busiest year 2017 (1)
20082026
AllStoriesComments NewestTopOldest
  1. A cool feature would be to be able to read WARC files from crawling the target site previously. https://github.com/webrecorder/warcio https://github.com/ArchiveTeam/grab-site
    comment by toomuchtodo · 2025-12-24 · in Show HN: Got Tired of LLMs refusing to visit URLs Built open source analyzer CLI
  2. It’s an iso standard. There’s warc libraries around. Ex: https://github.com/webrecorder/warcio
    comment by abracadaniel · 2024-08-03 · in ArchiveTeam Warrior
  3. https://github.com/webrecorder/warcio - python library. Tooling is not the best, which is precisely why anybody would bother paying for their service. You can do lots of fancy stuff with warc and cdx index. Check out WAIL(…
    comment by xfer · 2017-11-08 · in Show HN: PageDash, Your Personal Web Archive