pditommaso/awesome-pipeline
View on GitHub ↗ ★ 6,630
A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin
9 mentions on Hacker News by 7 people: 1 story, 8 comments · first 2015-08-03 · latest 2023-03-07
20082026
-
As a long-time fan of DAG-oriented tools, congrats on the launch. Maybe you can get added here https://github.com/pditommaso/awesome-pipeline now or in the future... This is a problem space I've worked in and been thinking about for a…
comment by slotrans · 2023-03-07 · in Launch HN: DAGWorks – ML platform for data science teams -
…but I suppose the inertia to install the tool everyone knows about is really big. BTW, here's https://github.com/pditommaso/awesome-pipeline a list of almost 200 pipeline toolkits.
comment by sdepablos · 2020-05-29 · in Introduction to Apache Airflow -
> Any other open source alternatives out there? Here's a big handful of them: https://github.com/pditommaso/awesome-pipeline
comment by hartzell · 2019-12-26 · in Dolphin Scheduler -
I've been referencing this lately: https://github.com/pditommaso/awesome-pipeline
comment by kanzure · 2019-04-21 · in Ask HN: What does your ML pipeline look like? -
Seems like a good time to link to this curated list of pipeline toolkits (not all python). https://github.com/pditommaso/awesome-pipeline/blob/master/R...
comment by chrisjc · 2018-09-24 · in Pypeline: A Python library for creating concurrent data pipelines -
Send a pull request to add it to https://github.com/pditommaso/awesome-pipeline/blob/master/R...
comment by samuell · 2018-05-09 · in Mara: A lightweight ETL framework, halfway between plain scripts and Airflow -
…For those interested, a nice list of workflow managers, engines, and even languages can be found at https://github.com/pditommaso/awesome-pipeline .
comment by myxie · 2017-11-12 · in Modeling Science as a Directed Graph -
…http://nextflow.io [4] https://bitbucket.org/snakemake/snakemake/wiki/Home [5] http://bpipe.org [6] https://github.com/pditommaso/awesome-pipeline [7] http://pachyderm.io
comment by samuell · 2017-05-15 · in Data Science Workflow: Overview and Challenges -
▲ 2
Awesome Pipelinestory by samuell · 2015-08-03 · 0 comments