Hacker GitHub

← All repos

phiresky/sqlite-zstd

View on GitHub ↗ ★ 1,704 Rust

Transparent dictionary-based row-level compression for SQLite

8 mentions on Hacker News by 6 people: 2 stories, 6 comments · first 2020-12-17 · latest 2025-02-17

Mentions per year 8 mentions · busiest year 2022 (2)
20082026
AllStoriesComments NewestTopOldest
  1. …but only on small (~10GB) databases. No reason why it couldn't work for bigger DBs though. [0] https://github.com/phiresky/sqlite-zstd
    comment by zimpenfish · 2025-02-17 · in Searchcode.com’s SQLite database is probably 6 terabytes bigger than yours
  2. …handle, but it's the biggest I've worked with. Most of my SQLite databases are under 500MB). [1]: https://github.com/phiresky/sqlite-zstd
    comment by tazu · 2024-08-16 · in Ask HN: What is the biggest size of a SQLite database you have worked with?
  3. Have you compared LZ4 to other compression algorithms, zstd for example? ( https://github.com/phiresky/sqlite-zstd ) Given that LiteFS operates at the filesystem layer via FUSE, have you considered it against designs that use built-in…
    comment by infogulch · 2023-01-04 · in WAL Mode in LiteFS
  4. In combination with SQLite to allow fast random access (query) and compression: https://github.com/phiresky/sqlite-zstd
    comment by punnerud · 2022-12-19 · in Zstandard – Fast real-time compression algorithm
  5. …dictionaries based on groups of data rows. Disclaimer: I made it and it's not production ready [1] https://github.com/phiresky/sqlite-zstd
    comment by phiresky · 2021-09-27 · in SQLite Archive Files (2018)
  6. …are faster in the compressed DB when the cache is cold and only somewhat slower when it is hot :) https://github.com/phiresky/sqlite-zstd
    comment by phiresky · 2020-12-17 · in Zstandard v1.4.7