← All repos

cytopia/crawlpy

View on GitHub ↗ ★ 54 Python

Scrapy python crawler/spider with post/get login (handles CSRF), variable level of recursions and optionally save to disk

3 mentions on Hacker News by 1 person: 3 stories, 0 comments · first 2016-07-31 · latest 2016-10-01