phiresky/sqlite-zstd
View on GitHub ↗ ★ 1,704 Rust
Transparent dictionary-based row-level compression for SQLite
8 mentions on Hacker News by 6 people: 2 stories, 6 comments · first 2020-12-17 · latest 2025-02-17
20082026
-
…but only on small (~10GB) databases. No reason why it couldn't work for bigger DBs though. [0] https://github.com/phiresky/sqlite-zstd
comment by zimpenfish · 2025-02-17 · in Searchcode.com’s SQLite database is probably 6 terabytes bigger than yours -
▲ 5
SQLite Transparent Compressionstory by edweis · 2024-09-17 · 2 comments
-
…handle, but it's the biggest I've worked with. Most of my SQLite databases are under 500MB). [1]: https://github.com/phiresky/sqlite-zstd
comment by tazu · 2024-08-16 · in Ask HN: What is the biggest size of a SQLite database you have worked with? -
Have you compared LZ4 to other compression algorithms, zstd for example? ( https://github.com/phiresky/sqlite-zstd ) Given that LiteFS operates at the filesystem layer via FUSE, have you considered it against designs that use built-in…
comment by infogulch · 2023-01-04 · in WAL Mode in LiteFS -
In combination with SQLite to allow fast random access (query) and compression: https://github.com/phiresky/sqlite-zstd
comment by punnerud · 2022-12-19 · in Zstandard – Fast real-time compression algorithm -
▲ 420
Show HN: Reduce SQLite database size by up to 80% with transparent compressionstory by phiresky · 2022-08-01 · 90 comments
-
…dictionaries based on groups of data rows. Disclaimer: I made it and it's not production ready [1] https://github.com/phiresky/sqlite-zstd
comment by phiresky · 2021-09-27 · in SQLite Archive Files (2018) -
…are faster in the compressed DB when the cache is cold and only somewhat slower when it is hot :) https://github.com/phiresky/sqlite-zstd
comment by phiresky · 2020-12-17 · in Zstandard v1.4.7