backtrace-labs/verneuil
View on GitHub ↗ ★ 527 C
Verneuil is a VFS extension for SQLite that asynchronously replicates databases to S3-compatible blob stores.
8 mentions on Hacker News by 3 people: 0 stories, 8 comments · first 2022-03-01 · latest 2024-09-25
20082026
-
That's how https://github.com/backtrace-labs/verneuil 's read replication is meant to be used. There's a command-line tool to recreate a sqlite DB file from a snapshot's manifest, with an optional local cache to avoid fetching unchanged…
comment by pkhuong · 2024-09-25 · in Rearchitecting: Redis to SQLite -
…port, or could it also support "live-replication" from S3, instead of just on-demand restores? https://github.com/backtrace-labs/verneuil supports this. Sadly it isn't very actively maintained and buggy.
comment by the_duke · 2023-08-11 · in What HashiCorp’s license change means for our customers -
Verneuil https://github.com/backtrace-labs/verneuil might work for you. Its replication client can use a persistent chunk cache (no fsync, so doesn't survive reboots), and there's a CLI utility to reconstitute a sqlite db file…
comment by pkhuong · 2023-06-26 · in Mycelite: SQLite extension to synchronize changes across SQLite instances -
https://github.com/backtrace-labs/verneuil doesn't even need an HTTP connection between the writer and readers: readers only interact with the object store.
comment by pkhuong · 2022-10-14 · in Litestream live replication has been moved to the LiteFS project -
Nifty, reminds me of https://github.com/backtrace-labs/verneuil or possibly https://litestream.io/
comment by aleph- · 2022-09-13 · in Show HN: Query SQLite files stored in S3 -
Verneuil ( https://github.com/backtrace-labs/verneuil ) offers that for read replicas, because backtrace as well has some multi-GB sqlite DBs. It's a VFS (loadable at runtime as a sqlite extension), instead of a filesystem. I don't…
comment by pkhuong · 2022-07-27 · in LiteFS a FUSE-based file system for replicating SQLite -
https://github.com/backtrace-labs/verneuil is in-process (precisely to minimise deployment pain).
comment by pkhuong · 2022-04-25 · in Ask HN: Have you used SQLite as a primary database? -
https://github.com/backtrace-labs/verneuil/ is one way to address the diffing / read replica part of the problem. I believe it's compatible with gossipping: most of the data is in small content-addressed chunks, with small manifests that…
comment by pkhuong · 2022-03-01 · in Ask HN: P2P Databases?