apify/got-scraping
View on GitHub ↗ ★ 777 TypeScript
HTTP client made for scraping based on got.
3 mentions on Hacker News by 2 people: 1 story, 2 comments · first 2021-08-06 · latest 2022-08-23
20082026
-
…For scraping via HTTP requests (e.g. cheerio/jsdom), we develop library called got-scraping ( https://github.com/apify/got-scraping ), that tries to mimic real browsers while doing fast HTTP requests. Crawlee is and always will be open…
comment by B4nan · 2022-08-23 · in Show HN: Crawlee – Web scraping and browser automation library for Node.js -
…now, which means all normal users use HTTP2... You get the point. What we use now is Got Scraping ( https://github.com/apify/got-scraping ). It's a special purpose extension of Got (HTTP client with 18 mil weekly downloads) that masks its…
comment by mnmkng · 2021-09-14 · in How to Crawl the Web with Scrapy