Hacker GitHub

← All repos

fake-name/ReadableWebProxy

View on GitHub ↗ ★ 204 Python

Rewriting web proxy and archival tool. At this point, it just tries to download all the things.

11 mentions on Hacker News by 4 people: 0 stories, 11 comments · first 2016-08-23 · latest 2019-12-22

Mentions per year 11 mentions · busiest year 2018 (5)
20082026
AllStoriesComments NewestTopOldest
  1. Obligatory bump for my project ReadableWebProxy ( https://github.com/fake-name/ReadableWebProxy ) that was originally intended to do this. At this point, it does a GIANT pile of additional things most of which are specific to my interests,…
    comment by fake-name · 2019-12-22 · in Show HN: Local Node.js app to save everything you browse and serve it offline
  2. …) looks promising, although it isn't capturing the "live" browser feed. Readable-Web Proxy ( https://github.com/fake-name/ReadableWebProxy ) also looks interesting, but seems to be external as well. Maybe I just need to suck it up and roll…
    comment by Reelin · 2019-12-05 · in How I Switched to Plan 9
  3. …https://getpolarized.io/ (as seen on HN previously) https://github.com/kanishka-linux/reminiscence https://github.com/fake-name/ReadableWebProxy
    comment by mwest · 2019-05-17 · in Internet Data Is Rotting
  4. …actual browser internals are horrible). I've also written all my own server-side componentry[1]. 1: https://github.com/fake-name/ReadableWebProxy
    comment by fake-name · 2019-02-19 · in Bookworm: A Simple, Focused eBook Reader
  5. Whee, a topic close to my heart! https://github.com/fake-name/ReadableWebProxy is a project of mine that started out as a simple rewriting proxy, but at this point is basically a self-contained archival system for entire websites, complete…
    comment by fake-name · 2018-11-23 · in Archiving web sites
  6. https://github.com/fake-name/ReadableWebProxy Disclaimer - It's a project of mine, specifically written for my interests, and is very much not production ready. It does have a full blown spider in it, which supports distributed fetching…
    comment by fake-name · 2018-10-01 · in Inside Wayback Machine, the internet’s time capsule
  7. …hard? It's literally 3 lines of work, if you use a tool that does most of the work for you. [Here]( https://github.com/fake-name/ReadableWebProxy/blob/510cc41ae... ) is a migration I have for one of my hobby projects. Tthe process is…
    comment by fake-name · 2018-08-30 · in Postgres data types you should consider using
  8. Archiving backend: https://github.com/fake-name/ReadableWebProxy Stores the scraped content in a postgres database, with external blob storage for binary content. Additionally, historical records of the scraped content are kept, so I have…
    comment by fake-name · 2018-06-05 · in Observations running 2M headless sessions
  9. How about Readable-Web Proxy? https://github.com/fake-name/ReadableWebProxy
    comment by bunnybender · 2018-02-05 · in Show HN: Simple Print – Convert web articles into printable PDFs
  10. All my junk is on github already: https://github.com/fake-name/ReadableWebProxy https://github.com/fake-name/AutoTriever https://github.com/fake-name/IntraArchiveDeduplicator https://github.com/fake-name/MangaCMS…
    comment by fake-name · 2017-06-22 · in Verizon is killing Tumblr’s fight for net neutrality
  11. …in my bedroom (My home servers are in my bedroom closet). --- It's all on github, FWIW: Manager: https://github.com/fake-name/ReadableWebProxy Agent and salt scheduler: https://github.com/fake-name/AutoTriever
    comment by fake-name · 2016-08-23 · in Web Scraping in 2016