Hacker GitHub

← All repos

superfly/litefs

View on GitHub ↗ ★ 4,912 Go

FUSE-based file system for replicating SQLite databases across a cluster of machines

38 mentions on Hacker News by 26 people: 2 stories, 36 comments · first 2022-07-26 · latest 2025-06-03

Mentions per year 38 mentions · busiest year 2022 (19)
20082026
AllStoriesComments NewestTopOldest
  1. …I think these two are particularly interesting: - https://github.com/superfly/corrosion - https://github.com/superfly/litefs (Disclosure: they sponsor some of my work.)
    comment by simonw · 2025-06-03 · in My AI skeptic friends are all nuts
  2. You might like https://github.com/superfly/litefs or https://github.com/benbjohnson/litestream
    comment by yencabulator · 2025-02-14 · in Show HN: SQLite disk page explorer
  3. …and LiteFS. I don't see people brandishing the ”not open contribution” to Ben's projects. https://github.com/superfly/litefs?tab=readme-ov-file#contri... https://github.com/benbjohnson/litestream?tab=readme-ov-file...
    comment by ncruces · 2024-12-10 · in Limbo: A complete rewrite of SQLite in Rust
  4. …high availability and low global latency, whilst Litestream is designed for disaster recovery. [0] https://github.com/superfly/litefs
    comment by ayuhito · 2024-01-02 · in Litestream – Opensource disaster recovery and continuous replication for SQLite
  5. …sharing the underlying database for internal tooling was really helpful for that use case. [1]: https://github.com/superfly/litefs
    comment by benbjohnson · 2023-09-14 · in Skip the API, ship your database
  6. …service for your sqlite database so you can keep your database synced across multiple nodes. https://github.com/superfly/litefs LiteFS Cloud which is the a service they provide just helps you backup and recover sqlite databases. You can do…
    comment by impulser_ · 2023-09-13 · in Skip the API, ship your database
  7. …be a fit for you or, at the very least, it could be a helpful reference for your Rust port. [1]: https://github.com/superfly/litefs
    comment by benbjohnson · 2023-08-11 · in What HashiCorp’s license change means for our customers
  8. …to the write-ahead log #. superfly/litefs: a FUSE-based file system for replicating SQLite https://github.com/superfly/litefs #. sqldiff: https://www.sqlite.org/sqldiff.html https://news.ycombinator.com/item?id=31265005 #. dolthub/dolt:…
    comment by westurner · 2023-08-09 · in SQLedge: Replicate Postgres to SQLite on the Edge
  9. …- https://fly.io/blog/all-in-on-sqlite-litestream/ - https://fly.io/blog/introducing-litefs/ - https://github.com/superfly/litefs - https://github.com/benbjohnson/litestream - https://fly.io/blog/sqlite-internals-wal/ -…
    comment by ryanrussell · 2023-07-21 · in Fly.io Postgres cluster down for 3 days, no word from them about it
  10. …you issue one or more queries in a batch over HTTP and they'll be run in a single transaction. [1]: https://github.com/superfly/litefs/issues/326
    comment by benbjohnson · 2023-07-05 · in LiteFS Cloud: Distributed SQLite with Managed Backups
  11. Basically, LiteFS: https://github.com/superfly/litefs And then some load balancer cleverness that reroutes writes to a specific VM: https://fly.io/blog/globally-distributed-postgres/
    comment by mrkurt · 2023-06-28 · in We raised a bunch of money
  12. …which seem to be actively developed by fly.io for a similar use case https://litestream.io/ https://github.com/superfly/litefs
    comment by sho · 2023-06-26 · in Mycelite: SQLite extension to synchronize changes across SQLite instances
  13. …-- - Meanwhile Litestream exists https://github.com/benbjohnson/litestream/ - Ben is developing https://github.com/superfly/litefs at Fly so that you can talk to your SQLite through a FUSE filesystem. (and work has stopped on the streaming…
    comment by maxmcd · 2023-01-25 · in SQLite-based databases on the Postgres protocol
  14. …want something smarter and very much more sqlite optimized, you probably want to look at litefs. https://github.com/superfly/litefs
    comment by linsomniac · 2023-01-09 · in CDC File Transfer
  15. …on your replica can listen for events and they are already synced up with your database state. [1]: https://github.com/superfly/litefs/issues/20
    comment by benbjohnson · 2023-01-06 · in I Migrated from a Postgres Cluster to Distributed SQLite with LiteFS
  16. …it [1] so I think this is regular sqlite performance with a fuse overhead to reads/writes. - [0] https://github.com/superfly/litefs/blob/main/docs/ARCHITECTU... - [1] https://github.com/superfly/litefs/issues/149
    comment by mhio · 2023-01-06 · in I Migrated from a Postgres Cluster to Distributed SQLite with LiteFS
  17. …writers. LiteFS is Ben Johnson's newer project that does SQLite synchronization across nodes: https://github.com/superfly/litefs
    comment by mtlynch · 2023-01-05 · in LiteSync – Easy synchronization of SQLite databases
  18. …most of the way there to what you're trying to do. [1]: https://fly.io/docs/litefs/position/ [2]: https://github.com/superfly/litefs/issues/253
    comment by benbjohnson · 2023-01-04 · in WAL Mode in LiteFS
  19. …yet so I have no say on it. [1]: https://litestream.io/ [2]: https://github.com/rqlite/rqlite [3]: https://github.com/superfly/litefs
    comment by stevefan1999 · 2022-11-11 · in Database Review 2021
  20. …addition of WAL support[1] in litefs, would it be possible to add the same to mvsqlite too? [1] https://github.com/superfly/litefs/pull/120
    comment by darthShadow · 2022-10-14 · in Litestream live replication has been moved to the LiteFS project
  21. …The only dependency is Consul although you could get around that by using a static leader[1]. [1]: https://github.com/superfly/litefs/pull/47
    comment by benbjohnson · 2022-10-14 · in Litestream live replication has been moved to the LiteFS project
  22. …don't want that dependency. I need to write up some docs but there's some info on the PR itself: https://github.com/superfly/litefs/pull/47
    comment by benbjohnson · 2022-10-14 · in Litestream live replication has been moved to the LiteFS project
  23. …we use) commented on it recently[1]. macOS support will be via a VFS extension in the future. [1]: https://github.com/superfly/litefs/issues/119#issuecomment-1...
    comment by benbjohnson · 2022-10-14 · in Litestream live replication has been moved to the LiteFS project
  24. We actually kinda see parts of this in https://github.com/superfly/litefs , albeit for SQLite. And here we see some ideas forming around "pluggable storage for PostgresQL": https://wiki.postgresql.org/wiki/Future_of_storage#Pluggable...…
    comment by pistoriusp · 2022-10-03 · in Postgres WASM
  25. …a sheared state.) Disclaimer: I wrote the FUSE framework LiteFS uses, https://bazil.org/fuse https://github.com/superfly/litefs/blob/52e269d4b04070690ce2... https://github.com/superfly/litefs/blob/52e269d4b04070690ce2...…
    comment by yencabulator · 2022-09-22 · in LiteFS
  26. …Unix VFS. As such, the testing coverage from the SQLite test suite mostly tests non-VFS code. [1]: https://github.com/superfly/litefs/issues/17
    comment by benbjohnson · 2022-09-22 · in LiteFS
  27. …[3]: https://raft.github.io/ [4]: https://raft.github.io/#implementations [5]: https://github.com/superfly/litefs
    comment by no_wizard · 2022-09-21 · in LiteFS
  28. I really like the ongoing innovation in the SQLite ecosystem! How does this compare to LiteFS? https://github.com/superfly/litefs
    comment by ngrilly · 2022-09-17 · in Marmot: A Distributed SQLite Replicator
  29. …Will the read replicas scale down to 0 along with LiteFS when the primary scales down to 0? [1] https://github.com/superfly/litefs
    comment by gregwebs · 2022-09-15 · in Show HN: WunderBase – Serverless OSS database on top of SQLite, Firecracker
  30. …all provide different trade-offs (e.g. rqlite is 'more strongly consistent' than litefs). [0]: https://github.com/superfly/litefs [1]: https://github.com/rqlite/rqlite [2]: https://github.com/canonical/dqlite
    comment by tekacs · 2022-09-10 · in Transcending Posix: The End of an Era?
  31. …using FUSE, making arbitrary SQLite-using applications leader-replica style distributed for HA: https://github.com/superfly/litefs (see also https://litestream.io/ for WAL-streaming backups, that's the foundation of this)
    comment by yencabulator · 2022-08-21 · in Turning SQLite into a Distributed Database
  32. Checkout quite interesting replication projects https://github.com/superfly/litefs and https://github.com/benbjohnson/litestream
    comment by bobek · 2022-08-16 · in SQLite is not a toy database (2021)
  33. …clear. The live-replication work has been abandoned and the author is working on this instead: https://github.com/superfly/litefs
    comment by ralferoo · 2022-08-12 · in Ask HN: Who is using C++ as the main language for new project?
  34. I'd give LiteFS a run soon. SqlLite is cross-platform, but seems like LiteFS is not. True? https://github.com/superfly/litefs
    comment by mandeepj · 2022-07-26 · in LiteFS a FUSE-based file system for replicating SQLite
  35. …a single node app. We still have a ways to go on that vision but that's what we're going for. [1] https://github.com/superfly/litefs/issues/18
    comment by benbjohnson · 2022-07-26 · in LiteFS a FUSE-based file system for replicating SQLite
  36. …connecting from primary to replica. I added an issue to the LiteFS project to track it. Thanks! [1] https://github.com/superfly/litefs/issues/16 [2] https://github.com/superfly/litefs/issues/24
    comment by benbjohnson · 2022-07-26 · in LiteFS a FUSE-based file system for replicating SQLite