ArchiveTeam/wpull
View on GitHub ↗ ★ 613 HTML
Wget-compatible web downloader and crawler.
4 mentions on Hacker News by 4 people: 0 stories, 4 comments · first 2015-08-12 · latest 2017-05-06
20082026
-
Highly recommend switching to wpull ( https://github.com/chfoo/wpull ), which was built as a wget replacement. It's what grab-site uses, which is a successor to ArchiveTeam's ArchiveBot. "grab-site is made possible only because of wpull,…
comment by toomuchtodo · 2017-05-06 · in Show HN: Pocket Stream Archive – A personal Way-Back Machine -
https://github.com/chfoo/wpull
comment by mh- · 2016-03-02 · in Curl vs. Wget -
…might have more fun with wpull, it has more sensible options to grab resources on referenced urls. https://github.com/chfoo/wpull
comment by aw3c2 · 2015-12-21 · in Homemade RSS aggregator followup -
I highly recommend you check out https://github.com/chfoo/wpull
comment by anc84 · 2015-08-12 · in Tiny, dirty, iffy, good enough, basic multi-threaded web crawler in Python