Shopify/ghostferry
View on GitHub ↗ ★ 858 Go
The swiss army knife of live data migrations
4 mentions on Hacker News by 4 people: 0 stories, 4 comments · first 2018-05-03 · latest 2025-03-09
20082026
-
…zero downtime data migration tool that powers the shard balancing tool at Shopify, also using TLA+: https://github.com/Shopify/ghostferry/blob/main/tlaplus/ghos... I also was able to find an concrrency bug before a single line of code was…
comment by pwnna · 2025-03-09 · in Formal Verification of Zero-Downtime Database Migration in PlusCal -
…Ghostferry only supports MySQL and does structure, dump and binlog streaming at the same time. https://github.com/Shopify/ghostferry This one seems to only start streaming the binlog after the initial snapshot is imported which makes me…
comment by ChocolateGod · 2024-12-05 · in An open-sourced MySQL PostgreSQL data migration tool in Rust -
I've come across this repo which use TLA+ to validate data migrations. https://github.com/Shopify/ghostferry
comment by unrequited · 2019-11-29 · in TLA+ model checking made symbolic -
Back when I worked for Shopify, I got a chance to work on something similar -- GhostFerry( https://github.com/shopify/ghostferry ), which allows for doing all sorts of migrations, that too between various databases. It was recently…
comment by throwawaypls · 2018-05-03 · in GitHub's online schema migration for MySQL