crawlab-team/crawlab
View on GitHub ↗ ★ 12,293 Go
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架
4 mentions on Hacker News by 3 people: 3 stories, 1 comment · first 2019-09-10 · latest 2020-06-22
20082026
-
▲ 2
Crawlab: Distributed web crawler admin platform for spiders managementstory by r_singh · 2020-06-22 · 0 comments
-
▲ 1
A Crawler Admin GitHub Project Reaching 5k Stars in 1 Yearstory by tikazyq · 2020-04-07 · 0 comments
-
▲ 7
Distributed Web Crawler Management Platformstory by tikazyq · 2020-02-04 · 0 comments
-
Something like Crawlab ( https://github.com/crawlab-team/crawlab ) is what I was imagining. May fork this to make it work if some of the other suggestions do not pan out.
comment by hexadec · 2019-09-10 · in Ask HN: How to manage long running scripts?