Anorov/cloudflare-scrape
View on GitHub ↗ ★ 3,549 Python
A Python module to bypass Cloudflare's anti-bot page.
3 mentions on Hacker News by 3 people: 0 stories, 3 comments · first 2016-04-28 · latest 2022-01-12
20082026
-
…numerous libraries and different proxy providers, but reliability is patchy. Previous fixes like https://github.com/Anorov/cloudflare-scrape don't seem to work anymore after Cloudflare updates, so I've switched to using a pretty optimised…
comment by joe_91 · 2022-01-12 · in The State of Web Scraping 2022 -
I switched to using https://github.com/Anorov/cloudflare-scrape in my RSS bot because several of the blogs I follow moved to CloudFlare. It wasn't precisely a drop-in replacement for Requests, but it wasn't too hard to wire up.
comment by bonkabonka · 2016-10-05 · in Cloudflare and RSS -
…headless browsers). Also I can't imagine it's particularly safe running such a service. [0]: https://github.com/Anorov/cloudflare-scrape/ [1]: https://github.com/doloopwhile/PyExecJS
comment by brbsix · 2016-04-28 · in Show HN: Jam API, turn any site into a JSON api using CSS selectors