kedro-org/kedro
View on GitHub ↗ ★ 11,041 Python
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
14 mentions on Hacker News by 8 people: 5 stories, 9 comments · first 2019-06-05 · latest 2023-08-11
20082026
-
…on top of each other using semi-automatic data annotations similar to how it is done in kedro ( https://github.com/kedro-org/kedro ).
comment by suslik · 2023-08-11 · in Nextflow: Data-Driven Computational Pipelines -
An often overlooked framework used by NASA among others is Kedro https://github.com/kedro-org/kedro . Kedro is probably the simplest set of abstractions for building pipelines but it doesn't attempt to kill Airflow. It even has an Airflow…
comment by Peteris · 2022-09-14 · in Dabbling with Dagster vs. Airflow -
…users such as NASA, Telkomsel, XP Investimentos, Sber and Beamery! Check out the repository here: https://github.com/kedro-org/kedro/
comment by joelschw · 2022-01-20 · in Kedro joins the Linux Foundation -
…) and has been framed as the "React for Data Science". Check out our repository: https://github.com/quantumblacklabs/kedro Please apply here mentioning Kedro + HN in your application: https://rb.gy/1njxa1 We are at an exciting juncture in
comment by joelschw · 2021-06-01 · in Ask HN: Who is hiring? (June 2021) -
…) and has been framed as the "React for Data Science". Check out our repository: https://github.com/quantumblacklabs/kedro Please apply here mentioning Kedro + HN in your application: https://rb.gy/1njxa1 We are at an exciting juncture in
comment by joelschw · 2021-04-01 · in Ask HN: Who is hiring? (April 2021) -
…with yet another machine learning pipeline automation framework, you should check out Kedro ( https://github.com/quantumblacklabs/kedro ). Kedro has the simplest, leanest, functional-programming inspired pipeline definition and also spits…
comment by Peteris · 2020-12-21 · in Netflix's Metaflow: Reproducible machine learning pipelines -
One way to get around this is to use Kedro https://github.com/quantumblacklabs/kedro , which is the most minimal possible pipeline interface, yet allows you to export to other pipeline formats and/or build your own exporters.
comment by Peteris · 2020-05-29 · in Introduction to Apache Airflow -
…to use in production, but a little unweildy for anything else. You can use something like Kedro ( https://github.com/quantumblacklabs/kedro ) to get started building pipelines with pure Python functions. Kedro has its own pipeline…
comment by Peteris · 2020-05-29 · in Introduction to Apache Airflow -
…and `spark_to_pandas` utility decorators, etc. There's a brief integration tutorial here: https://github.com/quantumblacklabs/kedro/tree/develop/kedro... Full disclosure: I'm a data engineer at QuantumBlack (if it wasn't obvious already!)
comment by deepyaman · 2019-06-06 · in Kedro: open-source library for production-ready machine learning code