get-set-fetch/scraper

View on GitHub ↗ ★ 112 TypeScript

Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases: SQLite, MySQL, PostgreSQL. Supported headless clients: Puppeteer, Playwright, Cheerio, JSdom.

3 mentions on Hacker News by 1 person: 1 story, 2 comments · first 2021-01-20 · latest 2021-02-11

Mentions per year 3 mentions · busiest year 2021 (3)

20082026

All Stories Comments Newest Top Oldest

…ExtractUrlsPlugin use different DOM wrappers (native, cheerio, jsdom) to scrape the content. [1] https://github.com/get-set-fetch/scraper
comment by a1sabau · 2021-02-11 · in Web Scraping 101 with Python
https://github.com/get-set-fetch/scraper - I've been working (intermittently :) ) on a nodejs or browser extension scraper for the last 3 years, see the other projects under the get-set-fetch umbrella. Putting a lot more effort lately as I…
comment by a1sabau · 2021-02-02 · in Ask HN: What is your “I don't care if this succeeds” project?
▲ 5
Show HN: Plugin Based, Batteries Included, Web Scraper
story by a1sabau · 2021-01-20 · 1 comment