Hacker GitHub

← All repos

crawlab-team/crawlab

View on GitHub ↗ ★ 12,293 Go

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

4 mentions on Hacker News by 3 people: 3 stories, 1 comment · first 2019-09-10 · latest 2020-06-22

Mentions per year 4 mentions · busiest year 2020 (3)
20082026
AllStoriesComments NewestTopOldest
  1. Something like Crawlab ( https://github.com/crawlab-team/crawlab ) is what I was imagining. May fork this to make it work if some of the other suggestions do not pan out.
    comment by hexadec · 2019-09-10 · in Ask HN: How to manage long running scripts?