xataio/pgstream
View on GitHub ↗ ★ 1,208 Go
PostgreSQL replication with DDL changes
15 mentions on Hacker News by 7 people: 5 stories, 10 comments · first 2024-07-17 · latest 2026-02-26
20082026
-
This sounds cool, adding to my list of things to try out. One note, this shouldn't be confused with https://github.com/xataio/pgstream which does logical replication/CDC with DDL changes.
comment by tudorg · 2026-02-26 · in Show HN: pg_stream – incremental view maintenance for PostgreSQL in Rust -
…This is a key limitation to be aware of. A way to workaround it could be to use pgstream ( https://github.com/xataio/pgstream ) to copy from the production database to a production replica. Pgstream can also do anonymization on the way,…
comment by tudorg · 2025-12-25 · in Instant database clones with PostgreSQL 18 -
From the newish Go-based Postgres CDC tools, I know about: * pgstream: https://github.com/xataio/pgstream * pg_flo: https://github.com/pgflo/pg_flo Are there others? Each of them has slightly different angles and messaging, but it is…
comment by mebcitto · 2025-01-03 · in Kuvasz-streamer: open-source CDC for Postgres for low latency replication -
Have you seen pgstream? https://github.com/xataio/pgstream It is similar to pg_replicate and could be a good fit for streaming CDC data from Postgres. There is no built-in output plugin specifically for DuckDB but it might help you for…
comment by gulcin_xata · 2024-12-15 · in Stream Processing with DuckDB/Polars? -
…plugin. I've created an issue in the repo to support retries , since this is a valuable feature ( https://github.com/xataio/pgstream/issues/67 ). Worth mentioning that the retry strategy is defined on a processor level. The opensearch…
comment by eminano · 2024-09-02 · in Postgres Webhooks with Pgstream -
…an interesting idea. Pgstream does offer the ability to unsubscribe from the notifications ( https://github.com/xataio/pgstream/blob/main/pkg/wal/process... ), but it relies on the receiver actively making that request. It can be annoying…
comment by eminano · 2024-09-02 · in Postgres Webhooks with Pgstream -
…application relies on all events being eventually delivered. I have created an issue in the repo ( https://github.com/xataio/pgstream/issues/67 ) to add support for notification retries. Thanks for everyone's feedback, it's been very…
comment by eminano · 2024-09-02 · in Postgres Webhooks with Pgstream -
…endpoints - systems like GitHub where anyone can sign up for hook deliveries. 2. is more important. https://github.com/xataio/pgstream/blob/bab0a8e665d37441351c... shows that the HTTP client can be configured with a timeout (which defaults…
comment by simonw · 2024-09-01 · in Postgres Webhooks with Pgstream -
It looks to me like it's at-most-once. This code here https://github.com/xataio/pgstream/blob/bab0a8e665d37441351c... logs an error if a delivery fails but does not appear to queue it for a second attempt.
comment by simonw · 2024-09-01 · in Postgres Webhooks with Pgstream -
The GitHub repo README gives a better sense of the capabilities of the pgstream system: https://github.com/xataio/pgstream?tab=readme-ov-file#archit... For deployments at a more serious scale, it seems they support buffering WAL events…
comment by jitl · 2024-09-01 · in Postgres Webhooks with Pgstream