internetarchive/warcprox
View on GitHub ↗ ★ 468 Python
WARC writing MITM HTTP/S proxy
11 mentions on Hacker News by 10 people: 0 stories, 11 comments · first 2014-10-29 · latest 2026-05-09
20082026
-
…proxy doing it. Maybe something like the InternetArchive warcproc [0]. Haven't tried yet. - [0] https://github.com/internetarchive/warcprox
comment by sunshine-o · 2026-05-09 · in Google broke reCAPTCHA for de-googled Android users -
…space being so cheap in the ~$15/TB range makes this more feasible even for video archival [1] https://github.com/internetarchive/warcprox
comment by unforgivenpasta · 2023-11-25 · in Offpunk 2.0 -
…help these (or other) tools to keep our web's archival records alive and flowing, please do so. [1] https://github.com/internetarchive/warcprox
comment by uniqueuid · 2022-06-19 · in Show HN: WarcDB: Web crawl data as SQLite databases -
Similar: github.com/InternetArchive/warcprox
comment by TheTechRobo · 2022-03-02 · in Help preserve the internet with Archiveteam's warrior -
…https://www.iso.org/standard/44717.html [2] https://github.com/webrecorder/webrecorder-desktop [3] https://github.com/internetarchive/warcprox
comment by uniqueuid · 2022-01-30 · in Tofuproxy – Web proxy, TLS terminator, X.509 TOFU manager, WARC/gemini browser -
…suite for producing high-fidelity archives injects JS [1] into pages served by its MITM proxy. [0] https://github.com/internetarchive/warcprox [1] https://github.com/webrecorder/wombat
comment by jswrenn · 2020-06-15 · in Authenticating Shared Web Caches -
…diving a topic. [1] https://github.com/machawk1/warcreate [2] https://github.com/machawk1/wail [3] https://github.com/internetarchive/warcprox EDIT: I forgot to mention https://github.com/webrecorder/webrecorder (the best general purpose…
comment by shasheene · 2019-12-19 · in This Page is Designed to Last -
I've enjoyed great success with various archiving proxies, including https://github.com/internetarchive/warcprox#readme and https://github.com/zaproxy/zaproxy#readme (which saves the content to an embedded database, and can be easier to…
comment by mdaniel · 2018-03-07 · in Ask HN: What is the best way to archive a webpage -
…project makes me wish for more free time). I have half a mind to fork this and add something like https://github.com/internetarchive/warcprox , or at the very least walk through the generated HTML and brute-force inline all assets as a…
comment by rcarmo · 2017-05-05 · in Show HN: Pocket Stream Archive – A personal Way-Back Machine -
…Firefox) which has either been integrated to store directly or simply is using a proxy like https://github.com/internetarchive/warcprox which adds every requested resource to a WARC file ( https://en.wikipedia.org/wiki/Web_ARChive ).
comment by acdha · 2016-03-07 · in FLIF – Free Lossless Image Format -
…run locally that let you access the content of a WARC as if you were browsing the original site. https://github.com/internetarchive/warcprox is even by IA themselves, so clearly they're working on it. A viewer that let you browse the…
comment by db48x · 2014-10-29 · in The new archive.org