estuary/flow
View on GitHub ↗ ★ 987 Rust
🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, by managing your data flows with Estuary. 🌊
13 mentions on Hacker News by 3 people: 0 stories, 13 comments · first 2021-04-23 · latest 2026-05-28
20082026
-
…Fibonacci sequence (very inefficiently, with lots of spawned sub-tasks and message passing) [2] [1] https://github.com/estuary/flow/tree/master/crates/automatio... [2] https://github.com/estuary/flow/blob/master/crates/automatio...
comment by jgraettinger1 · 2026-05-28 · in Building durable workflows on Postgres -
…[1] https://www.estuary.dev [2] https://docs.estuary.dev/concepts/derivations/#read-delay [3] https://github.com/estuary/flow/blob/master/examples/citi-bi...
comment by jgraettinger1 · 2024-04-02 · in How to stream PostgreSQL CDC to Kafka and use Propel to get an instant API -
…data locality) with some additional shard and sequence-number bits. It's worked really well for us: https://github.com/estuary/flow/blob/master/supabase/migrati... we use macaddr8 instead of bigint, because it has a postgres serialization…
comment by jgraettinger1 · 2023-06-22 · in Unexpected downsides of UUID keys in PostgreSQL -
…Go and are heavily built on top of gazette which is an internally developed streaming engine. Flow: https://github.com/estuary/flow Gazette: https://gazette.readthedocs.io/en/latest/ Backend Engineer: https://www.estuary.dev/about/#backend…
comment by Estuary · 2022-09-01 · in Ask HN: Who is hiring? (September 2022) -
…Go and are heavily built on top of gazette which is an internally developed streaming engine. Flow: https://github.com/estuary/flow Gazette: https://gazette.readthedocs.io/en/latest/ We are looking for a backend engineer who is early in…
comment by Estuary · 2022-08-01 · in Ask HN: Who is hiring? (August 2022) -
…go and are heavily built on top of gazette which is an internally developed streaming engine. Flow: https://github.com/estuary/flow Gazette: https://gazette.readthedocs.io/en/latest/ We are looking for a junior backend engineer with 2-3…
comment by Estuary · 2022-07-01 · in Ask HN: Who is hiring? (July 2022) -
…go and are heavily built on top of gazette which is an internally developed streaming engine. Flow: https://github.com/estuary/flow Gazette: https://gazette.readthedocs.io/en/latest/ Our team is rapidly growing, VC funded and led by two…
comment by Estuary · 2022-06-06 · in Ask HN: Who is hiring? (June 2022) -
It does seem like a weird bug that this would cause errors https://github.com/estuary/flow/runs/5642694619?check_suite_... seems like it should be some kind of warning instead of an error?
comment by TehShrike · 2022-03-22 · in On 2022-04-05, the default branch will be renamed from “master” to “main” -
…SQL schemas into JSON schemas, and from there to, say, equivalent Elastic Search schema. [0]: https://github.com/estuary/flow
comment by jgraettinger1 · 2022-01-20 · in DynamoDB 10 years later -
…if tasks manage a lot of state. With a read-time shuffle, you can scale them independently. [1]: https://github.com/estuary/flow
comment by jgraettinger1 · 2021-10-18 · in Issues we've encountered while building a Kafka based data processing pipeline -
…[1]: https://gazette.readthedocs.io/en/latest/consumers-concepts.... [2]: https://github.com/estuary/flow
comment by jgraettinger1 · 2021-10-18 · in Issues we've encountered while building a Kafka based data processing pipeline -
…built off of Singer) as the best steps in this direction and are leaning into that effort ourselves. [1] github.com/estuary/flow
comment by jgraettinger1 · 2021-07-29 · in What the Heck is a Data Mesh? -
…your views into Firestore (or another Postgres table) where you'd subscribe for live updates. [1]: https://github.com/estuary/flow
comment by jgraettinger1 · 2021-04-23 · in Ask HN: Is there a way to efficiently subscribe to an SQL query for changes?