Hacker GitHub

← All repos

xataio/pgstream

View on GitHub ↗ ★ 1,208 Go

PostgreSQL replication with DDL changes

15 mentions on Hacker News by 7 people: 5 stories, 10 comments · first 2024-07-17 · latest 2026-02-26

Mentions per year 15 mentions · busiest year 2024 (11)
20082026
  1. This sounds cool, adding to my list of things to try out. One note, this shouldn't be confused with https://github.com/xataio/pgstream which does logical replication/CDC with DDL changes.
  2. …This is a key limitation to be aware of. A way to workaround it could be to use pgstream ( https://github.com/xataio/pgstream ) to copy from the production database to a production replica. Pgstream can also do anonymization on the way,…
  3. ▲ 77
    Pgstream: Postgres streaming logical replication with DDL changes
    story by fenn · 2025-09-15 · 6 comments
  4. From the newish Go-based Postgres CDC tools, I know about: * pgstream: https://github.com/xataio/pgstream * pg_flo: https://github.com/pgflo/pg_flo Are there others? Each of them has slightly different angles and messaging, but it is…
  5. Have you seen pgstream? https://github.com/xataio/pgstream It is similar to pg_replicate and could be a good fit for streaming CDC data from Postgres. There is no built-in output plugin specifically for DuckDB but it might help you for…
    comment by gulcin_xata · 2024-12-15 · in Stream Processing with DuckDB/Polars?
  6. …plugin. I've created an issue in the repo to support retries , since this is a valuable feature ( https://github.com/xataio/pgstream/issues/67 ). Worth mentioning that the retry strategy is defined on a processor level. The opensearch…
    comment by eminano · 2024-09-02 · in Postgres Webhooks with Pgstream
  7. …an interesting idea. Pgstream does offer the ability to unsubscribe from the notifications ( https://github.com/xataio/pgstream/blob/main/pkg/wal/process... ), but it relies on the receiver actively making that request. It can be annoying…
    comment by eminano · 2024-09-02 · in Postgres Webhooks with Pgstream
  8. …application relies on all events being eventually delivered. I have created an issue in the repo ( https://github.com/xataio/pgstream/issues/67 ) to add support for notification retries. Thanks for everyone's feedback, it's been very…
    comment by eminano · 2024-09-02 · in Postgres Webhooks with Pgstream
  9. …endpoints - systems like GitHub where anyone can sign up for hook deliveries. 2. is more important. https://github.com/xataio/pgstream/blob/bab0a8e665d37441351c... shows that the HTTP client can be configured with a timeout (which defaults…
    comment by simonw · 2024-09-01 · in Postgres Webhooks with Pgstream
  10. It looks to me like it's at-most-once. This code here https://github.com/xataio/pgstream/blob/bab0a8e665d37441351c... logs an error if a delivery fails but does not appear to queue it for a second attempt.
    comment by simonw · 2024-09-01 · in Postgres Webhooks with Pgstream
  11. The GitHub repo README gives a better sense of the capabilities of the pgstream system: https://github.com/xataio/pgstream?tab=readme-ov-file#archit... For deployments at a more serious scale, it seems they support buffering WAL events…
    comment by jitl · 2024-09-01 · in Postgres Webhooks with Pgstream
  12. ▲ 2
    Pgstream – Postgres replication that includes schema definitions
    story by mebcitto · 2024-07-27 · 0 comments
  13. ▲ 1
    Pgstream – Postgres replication events with schema changes
    story by mebcitto · 2024-07-24 · 0 comments
  14. ▲ 2
    pgstream – open-source Postgres replication events with DDL support
    story by mebcitto · 2024-07-19 · 0 comments
  15. ▲ 8
    Show HN: Pgstream – CDC tool for PostgreSQL with DDL support
    story by tudorg · 2024-07-17 · 0 comments