Hacker GitHub

← All repos

Factual/drake

View on GitHub ↗ ★ 1,482 Clojure

Data workflow tool, like a "Make for data"

21 mentions on Hacker News by 14 people: 1 story, 20 comments · first 2013-01-24 · latest 2026-09-09

Mentions per year 21 mentions · busiest year 2013 (8)
20082026
AllStoriesComments NewestTopOldest
  1. …document data pipelines, but it's easy for it to become spaghetti. [Edit: There's the decade-stale https://github.com/factual/drake "Drake is similar to GNU Make, but designed especially for data workflow management". I can't remember why…
    comment by wwfn · 2026-09-09 · in Maak.el: Lisp machine command runner in Emacs, infinitely extensible and Scheme
  2. Drake is nice for these kinds of data dependencies. https://github.com/Factual/drake
    comment by sheriff · 2021-01-27 · in Nq – A simple Unix job queue system
  3. …workflows it doesn't feel good enough to me. What do you folks use? Drake, "make for data" https://github.com/Factual/drake seems ok, but doesn't have "batch" jobs, (aka "pattern rules") where you can do every file in a directory matching…
    comment by rockmeamedee · 2018-07-11 · in How ProPublica Illinois Uses GNU Make to Load Data
  4. To amend, why I'm even bringing this up, what worries me about Drake is this: https://github.com/Factual/drake/pulse/monthly Its GitHub pulse is - dead; For two years now. Makes me think one of the other projects listed might be better…
    comment by fnl · 2018-01-27 · in Data Science at the Command Line
  5. …endata.github.io/cookiecutter-data-science DataVersionControl: https://dataversioncontrol.com/ Drake: https://github.com/Factual/drake Luigi: https://github.com/spotify/luigi Pachyderm: http://www.pachyderm.io/ Sacred:…
    comment by fnl · 2018-01-27 · in Data Science at the Command Line
  6. I have briefly used https://github.com/Factual/drake for this. It is a bit unpolished and still a work in progress, but has some features that are useful for data science workflows that most software build tools do not cover: * Steps can…
    comment by ProblemFactory · 2017-03-14 · in Buck – A build system developed and used by Facebook
  7. …to plug Make and Drake for manipulating data in a replicable way: https://bost.ocks.org/mike/make/ https://github.com/Factual/drake If you're processing data using tools that cannot trace their ancestry directly to some time before 1985,…
    comment by edw · 2017-02-09 · in Joining a billion rows 20x faster than Apache Spark
  8. How is this different from drake? drake - Data workflow tool, like a "Make for data" (in Clojure): https://github.com/Factual/drake
    comment by nivertech · 2016-04-03 · in Show HN: Stu – Build automation / make replacement for data mining projects
  9. https://github.com/Factual/drake from the data science toolbox is useful. "Drake is similar to GNU Make, but designed especially for data workflow management"
    comment by elchief · 2015-11-10 · in Too much of the research process is now shrouded by the opaque use of computers
  10. ▲ 5
    Drake, a kind of ‘make for data’
    story by herrherr · 2015-10-12 · 0 comments
  11. drake[0] from factual falls into this category as well. [0] - https://github.com/Factual/drake
    comment by carrollgt · 2015-06-05 · in Airbnb Engineering
  12. …from 'hack' one liner to a more maintainable / supportable solution. For instance drake ( https://github.com/Factual/drake ) a 'Make for data' which does dependency checking would allow for sensible restarts of the pipeline. The O'Reilly…
    comment by charltones · 2015-01-19 · in Command-line tools can be faster than your Hadoop cluster
  13. …about dat yet, but it looks like it would be a good end-point for serving the data as well. 0 - https://github.com/Factual/drake
    comment by jboggan · 2014-09-25 · in Package Data Like Software
  14. nice post! i'd like to make a shameless plug for Drake, a 'make for data' workflow tool. https://github.com/Factual/drake
    comment by dirtyvagabond · 2013-09-19 · in Command-line tools for data science
  15. …script which you need to run quickly, but for interactive development, it should work just fine: https://github.com/Factual/drake/wiki/Faster-startup:-Drake-...
    comment by aboytsov · 2013-01-26 · in Introducing Drake, a kind of ‘make for data’
  16. The project's README file ( https://github.com/Factual/drake - scroll down) contains building and running instructions, as well as how to create a simple script to run Drake which you can put on your PATH.
    comment by aboytsov · 2013-01-26 · in Introducing Drake, a kind of ‘make for data’
  17. …be more than happy to review code contributions. First of all, you can file a feature request: https://github.com/Factual/drake/issues Adding a new filesystem to Drake's source is very easy. You just create a filesystem object that…
    comment by aboytsov · 2013-01-25 · in Introducing Drake, a kind of ‘make for data’
  18. …Hadoop client library to talk to HDFS). But it's a good point nevertheless. I'll mention it in https://github.com/Factual/drake/issues/1 . Thanks!
    comment by aboytsov · 2013-01-25 · in Introducing Drake, a kind of ‘make for data’
  19. …about the priority in which features should be implemented by submitting a feature request at https://github.com/Factual/drake/issues , or +1'ing an existing one. There are so many potential features to be added to Drake, and a lot of them…
    comment by aboytsov · 2013-01-25 · in Introducing Drake, a kind of ‘make for data’
  20. …it could be extended indefinitely. If you're serious about it, please submit a feature request ( https://github.com/Factual/drake/issues ), and describe more specifically what you would like to be able to do in your case. Thank you for a…
    comment by aboytsov · 2013-01-25 · in Introducing Drake, a kind of ‘make for data’
  21. There is love for R in Drake! As of about an hour ago: https://github.com/Factual/drake/commit/f63dd2630ca3e5e4a6a6...
    comment by dirtyvagabond · 2013-01-24 · in Introducing Drake, a kind of ‘make for data’