← All repos

get-set-fetch/scraper

View on GitHub ↗ ★ 112 TypeScript

Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases: SQLite, MySQL, PostgreSQL. Supported headless clients: Puppeteer, Playwright, Cheerio, JSdom.

3 mentions on Hacker News by 1 person: 1 story, 2 comments · first 2021-01-20 · latest 2021-02-11