pedrocr/syncer
View on GitHub ↗ ★ 186 Rust
A filesystem that pretends you have all your files locally while caching only the most recently used
6 mentions on Hacker News by 2 people: 0 stories, 6 comments · first 2018-02-12 · latest 2020-03-07
20082026
-
…not ideal. But it's the kind of thing I've envisioned to stop using a NAS and just point syncer at: https://github.com/pedrocr/syncer/
comment by pedrocr · 2020-03-07 · in Cloud Storage for $2 per TB per month -
Is there a reason you are managing locking at the application layer on the SQLite connection object? https://github.com/pedrocr/syncer/blob/24d70fd452aa6b1463090... This is going to absolutely destroy your throughput. I am not sure about…
comment by bob1029 · 2019-08-18 · in 35% Faster Than The Filesystem (2017) -
The code for my most recent case is here: https://github.com/pedrocr/syncer/ The db code itself is here: https://github.com/pedrocr/syncer/blob/24d70fd452aa6b1463090... WAL is being used but that's not enough to get a mixed INSERT/SELECT…
comment by pedrocr · 2019-08-18 · in 35% Faster Than The Filesystem (2017) -
…fast open is not relevant. Here's an example of where I'd really like postgres to replace sqlite: https://github.com/pedrocr/syncer/ I've had to add an extra caching layer because of sqlite INSERT performance. Given that I've already had…
comment by pedrocr · 2019-08-18 · in 35% Faster Than The Filesystem (2017) -
…you index into the Vec with the first bits of the key hash and then use the HashMap within it: https://github.com/pedrocr/syncer/blob/master/src/rwhashes.r... Worked fine but a full ConcurrentHashMap would be much nicer.
comment by pedrocr · 2019-01-30 · in Lock-Free Rust: Crossbeam in 2019 -
…you want that you end up going to LevelDB or LMDB and losing the niceness of an SQL interface. [1] https://github.com/pedrocr/syncer
comment by pedrocr · 2018-02-12 · in Appropriate Uses for SQLite