TimelyDataflow/differential-dataflow on Hacker News

…Dataflow [2]. [0] https://arxiv.org/html/2510.12269v3 [1] https://arxiv.org/html/2601.17188v1 [2] https://github.com/TimelyDataflow/differential-dataflow

comment by AlotOfReading · 2026-07-14 · in Show HN: I implemented a neural network in SQL

Is it related to Differential Dataflow / timely dataflow https://github.com/TimelyDataflow/differential-dataflow

comment by d0mine · 2024-10-25 · in Streaming joins are hard

…It would be neat if postgres adopted something similar for live-updating materialized views. https://github.com/timelydataflow/differential-dataflow https://materialize.com/

comment by infogulch · 2023-10-21 · in We Built a Streaming SQL Engine

…to the point of building OctoSQL[1] around it, so I'm really curious about the details here) [0]: https://github.com/TimelyDataflow/differential-dataflow [1]: https://github.com/cube2222/octosql

comment by cube2222 · 2023-06-07 · in Hydroflow: Dataflow Runtime in Rust

Differential dataflow is seriously amazing: https://github.com/timelydataflow/differential-dataflow/blob... Implemented in Rust: https://crates.io/crates/differential-dataflow

comment by kccqzy · 2023-05-10 · in Ask HN: What is new in algorithms and data structures these days?

alternate: https://github.com/TimelyDataflow/differential-dataflow/blob...

comment by rbranson · 2022-11-15 · in How PlanetScale Boost serves SQL queries faster

…graph" neural-whatever-matrix-multiplication-libs ( https://ocaml.xyz/tutorial/cgraph.html ) - https://github.com/timelydataflow/differential-dataflow , incremental dataflow computations edit: i almost forgot all the openssl perl scripts,…

comment by lapinot · 2022-09-04 · in Program Synthesis is Possible (2018)

…a lot of progress applying it for OLAP and readyset [3] is using similar techniques for OLTP. [1] https://github.com/TimelyDataflow/differential-dataflow [2] https://materialize.com/ [3] https://readyset.io/

comment by sujayakar · 2022-06-22 · in Convex vs. Firebase

…I guess a subgraph in a "differential dataflow" (which I have read about but never really used). https://github.com/TimelyDataflow/differential-dataflow

comment by abeppu · 2021-08-10 · in MapReduce is making a comeback

…and subsume map-reduce. This article feels like hyping up the durability of the Model T. [0] https://github.com/TimelyDataflow/differential-dataflow

comment by _huayra_ · 2021-08-10 · in MapReduce is making a comeback

…[1]: https://materialize.com/lateral-joins-and-demand-driven-quer... [2]: https://github.com/TimelyDataflow/differential-dataflow

comment by namibj · 2021-07-28 · in Searching for a better persistent cache

…nor do we have a dependence on it. [1] https://github.com/TimelyDataflow/timely-dataflow [2] https://github.com/TimelyDataflow/differential-dataflow

comment by cirego · 2021-04-22 · in Ask HN: Is there a way to efficiently subscribe to an SQL query for changes?

…the concept across, but feel free to follow up if you're still not seeing the incrementality. [0]: https://github.com/TimelyDataflow/differential-dataflow#an-e...

comment by namibj · 2021-03-20 · in Differential Datalog

…SELECT * FROM v ORDER BY col LIMIT 5 -- order and limit computed ad hoc, but still fast [0]: https://github.com/TimelyDataflow/differential-dataflow

comment by benesch · 2021-03-01 · in Introducing dbt + Materialize

…out how this would work in the context of DDflow, let us know. This sounds very interesting. [0]: https://github.com/TimelyDataflow/differential-dataflow

comment by namibj · 2021-02-14 · in Data Laced with History: Causal Trees and Operational CRDTs (2018)

…when arrangements where called `ValueHistory` to offload part of the memory usage to SSDs. [0]: https://github.com/TimelyDataflow/differential-dataflow/tree... [1]: https://mtrlz.dev/api/rust/dogsdogsdogs/index.html (3rd party rustdoc for…

comment by namibj · 2021-01-22 · in Why isn't differential dataflow more popular?

…[3]: https://mtrlz.dev/api/rust/dogsdogsdogs/index.html_ [4]: https://github.com/TimelyDataflow/differential-dataflow/tree...

comment by namibj · 2021-01-22 · in Why isn't differential dataflow more popular?

…get to trying some WCOJ code later today. [0]: https://github.com/vmware/differential-datalog [1]: https://github.com/TimelyDataflow/differential-dataflow/tree... [2]: https://github.com/frankmcsherry/blog/blob/master/posts/2020... [3]:…

comment by namibj · 2021-01-22 · in Why isn't differential dataflow more popular?

…[1]: https://github.com/frankmcsherry/blog/blob/master/posts/2018... [2]: https://github.com/TimelyDataflow/differential-dataflow/issu...

comment by namibj · 2021-01-22 · in Why isn't differential dataflow more popular?

…and we need analytics. As far as I can tell it breaks analytics work into parallel workloads. [0] https://github.com/TimelyDataflow/differential-dataflow/

comment by roenxi · 2021-01-22 · in Why isn't differential dataflow more popular?

Differential Dataflow and McSherry’s commercial SQL Driver implementation at Materialize: - https://github.com/TimelyDataflow/differential-dataflow/ - https://materialize.com/

comment by pgt · 2020-12-26 · in Ask HN: What startup/technology is on your 'to watch' list?

…Thank you! I certainly hope so! [1]: https://materialize.com/robust-reductions-in-materialize/ [2]: https://github.com/timelydataflow/differential-dataflow/blob...

comment by rkhaitan · 2020-12-03 · in Materialize Raises a $32M Series B

…the project itself. The GitHub repo has pointers to all of that. See also differential dataflow ( https://github.com/timelydataflow/differential-dataflow ).

comment by scott_s · 2020-12-02 · in Materialize Raises a $32M Series B

…can: https://tonsky.me/blog/datomic-as-protocol/ And keeping a close eye on Differential Dataflow: https://github.com/TimelyDataflow/differential-dataflow/ DD is commercialized in Materialize: https://materialize.io/ The solution is likely…

comment by pgt · 2020-10-21 · in Ask HN: The state of Firebase alternatives in 2020?

…the paradigms of the Build Systems a la Carte paper fit into Raph’s pictured theory of reactive UI? https://github.com/TimelyDataflow/differential-dataflow https://github.com/mstone/focus/blob/master/docs/ot-theory.a...…

comment by anoncept · 2020-09-26 · in Towards Principled Reactive UI

…an open PR in differential dataflow to make some changes to avoid a planned break in the future. https://github.com/TimelyDataflow/differential-dataflow/pull... I think they are doing the right thing with the break (it adds something I've…

comment by frankmcsherry · 2020-08-13 · in "Rust does not have a stable ABI"

…have to catch up Haskell at some point, sigh. [1]: https://github.com/rust-lang/chalk.git [2]: https://github.com/TimelyDataflow/differential-dataflow

comment by Ericson2314 · 2020-08-08 · in Formulog: ML + Datalog + SMT

For more concise and precise explanations of the rationale for these kinds of tools, see this paper: https://github.com/TimelyDataflow/differential-dataflow/raw/... -- here's the abstract: > Existing computational models for processing…

comment by cs702 · 2020-07-14 · in Eventual Consistency isn’t for Streaming

…Oracle, but you can evaluate our stuff and let everyone know. So that's one difference. [0]: https://github.com/TimelyDataflow/differential-dataflow/tree...

comment by frankmcsherry · 2020-06-15 · in Recently minted database technologies that I find intriguing

This seems conceptually similar to differential dataflow. https://github.com/timelydataflow/differential-dataflow/blob...

comment by telekid · 2020-04-16 · in EventReduce: An algorithm to optimize database queries that run multiple times

…!= rendering and JSX is an abomination. For optimal performance, look into differential dataflow: https://github.com/TimelyDataflow/differential-dataflow/issu...

comment by pgt · 2020-04-04 · in Show HN: 33 line React

…we might expose something closer to the raw differential dataflow API [0] for power users. [0]: https://github.com/TimelyDataflow/differential-dataflow

comment by benesch · 2020-02-18 · in Materialize: A Streaming Data Warehouse

…Red Planet Labs. incr_dom source: https://github.com/janestreet/incr_dom Differential Dataflow: https://github.com/TimelyDataflow/differential-dataflow Declarative Dataflow Client: https://github.com/sixthnormal/clj-3df Crux adapter for…

comment by pgt · 2019-12-02 · in Moxie: Incremental Declarative UI in Rust

…view maintenance, UI view maintenance (subsumes React), and differential database streaming: https://github.com/TimelyDataflow/differential-dataflow

comment by pgt · 2019-10-22 · in Ask HN: What's a promising area to work on?

…involved in many things) 1. You can implement some minor flavor of Doop in differential dataflow ( https://github.com/TimelyDataflow/differential-dataflow/tree... ). The fragment came from Yannis which he described as a minimal non-trivial…

comment by frankmcsherry · 2019-03-11 · in The Essence of Datalog (2018)