argoproj/argo-workflows
View on GitHub ↗ ★ 17,079 Go
Workflow Engine for Kubernetes
17 mentions on Hacker News by 14 people: 2 stories, 15 comments · first 2017-09-19 · latest 2020-05-30
20082026
-
…- https://docs.metaflow.org/ - https://github.com/dagster-io/dagster - https://github.com/argoproj/argo - https://github.com/prefecthq/prefect
comment by knite · 2020-05-30 · in Introduction to Apache Airflow -
Have a look at Argo if you are interested in leveraging k8s infrastructure https://github.com/argoproj/argo/blob/master/README.md#what-... . For us, we settled with Netflix Conductor as it scaled pretty well and allowed us to have pretty…
comment by pookeh · 2019-05-25 · in Ask HN: Best distributed job processing system in 2019? -
…jobs, ETL?). I’m curious what differences/trade offs there are in Gaia vs something like Argo ( https://github.com/argoproj/argo ) or Buildkite ( https://buildkite.com/ ). It looks like at least one difference is an actual API for steps…
comment by NightMKoder · 2019-01-04 · in Show HN: Gaia – Build pipelines in any programming language -
Another cool Argo: https://github.com/argoproj/argo "The Workflow Engine for Kubernetes"
comment by bryanlarsen · 2018-12-19 · in Project Argo Goes Open Source: On-Prem Automation and Path to Hybrid Environment -
Well you can use https://github.com/argoproj/argo for workflow needs without need to version everything. For data versioning if you need, you can use https://dvc.org/ As this gives me freedom to choose as if I want data versioning and/or…
comment by emkt · 2018-11-17 · in Pachyderm Raises $10M to Bring Data Provenance to the Enterprise -
…run docker daemon in sidecar container. Here is a sample argo workflow which uses this technique: https://github.com/argoproj/argo/blob/master/examples/sideca...
comment by alexmt · 2018-11-11 · in Argo: Open source Kubernetes native workflows, events, CI and CD -
Docs have been updated and linked to in the getting started guide: https://github.com/argoproj/argo/blob/master/docs/workflow-r...
comment by jessesuen · 2018-11-11 · in Argo: Open source Kubernetes native workflows, events, CI and CD -
…on that resource). Currently, the bare minimum for a workflow to function is outlined here: https://github.com/argoproj/argo/issues/983#issuecomment-435... I will make sure that the docs are updated, so that this information is well…
comment by jessesuen · 2018-11-11 · in Argo: Open source Kubernetes native workflows, events, CI and CD -
…about 30 seconds searching, this gets you 90% of the way there from what I can tell on my phone. https://github.com/argoproj/argo/issues/725
comment by tw04 · 2018-11-11 · in Argo: Open source Kubernetes native workflows, events, CI and CD -
…of that problem and it handled it gracefully. For batch workloads something like Argo can help: https://github.com/argoproj/argo . So basically I agree, it probably would've made more sense to build something on top of Kubernetes. But…
comment by cdoxsey · 2018-10-30 · in Peloton: Uber’s Unified Resource Scheduler for Diverse Cluster Workloads -
Happy to answer any questions about how we use Argo ( https://github.com/argoproj/argo ), PlanetUtils ( https://github.com/interline-io/planetutils ), or any of the other open-source "ingredients."
comment by drewda · 2018-05-29 · in Producing 200 OpenStreetMap extracts in 35 minutes using Kubernetes and Argo -
The latest Argo release ( https://github.com/argoproj/argo/releases ) supports resubmitting workflows with "memoized" steps.
comment by devedlee · 2018-05-14 · in Ask HN: How do you handle long-running workflows at your company? -
We developed and use Argo ( https://github.com/argoproj/argo ), a Kubernetes-native workflow engine. Argo is currently used by companies like Cyrus Biotechnology, Gladly, Google, Intuit, and NVIDIA. Currently collecting use cases and…
comment by devedlee · 2018-05-14 · in Ask HN: How do you handle long-running workflows at your company? -
…Workflows are written as yaml templates and support DAGs as well as loops and conditionals. https://github.com/argoproj/argo We use this at my company to stitch together various scientific software packages each of which can take minutes…
comment by gaigepr · 2018-05-14 · in Ask HN: How do you handle long-running workflows at your company? -
…found Argo. We are in the process of migrating our home-rolled scientific JS based workflows. https://github.com/argoproj/argo
comment by unit_circle · 2018-05-14 · in Ask HN: How do you handle long-running workflows at your company? -
▲ 5
Argo: Container-native workflows for Kubernetesstory by rsanders · 2017-12-06 · 0 comments
-
▲ 4
Show HN: Argo – Container-native workflows for Kubernetesstory by devedlee · 2017-09-19 · 0 comments