phiresky/sql.js-httpvfs on Hacker News

There is also the deep magic... https://github.com/phiresky/sql.js-httpvfs

comment by tekne · 2026-07-23 · in What happened to TheNumbers.com

…hosting sqlite DBs with client side queries and http range requests is an interesting approach: https://github.com/phiresky/sql.js-httpvfs

comment by kiney · 2026-01-01 · in Show HN: Use Claude Code to Query 600 GB Indexes over Hacker News, ArXiv, etc.

…to previous days. It's reminiscent of that brilliant SQLite.js VFS trick from a few years ago: https://github.com/phiresky/sql.js-httpvfs - only that one used HTTP range headers, this one uses sharded files instead. The interactive SQL…

comment by simonw · 2025-12-30 · in Show HN: 22 GB of Hacker News in SQLite

…this ends up being ~4mb over the wire obviously this solution doesn't scale (versus something like https://github.com/phiresky/sql.js-httpvfs ) but sometimes it's fun to "just" send the sqlite database to the frontend and be done :-)

comment by gregsadetsky · 2025-12-21 · in Show HN: Search the lyrics of 500 HÖR Berlin techno sets

…IPFS and GitHub" https://news.ycombinator.com/item?id=42264274 : >> phiresky/sql.js-httpvfs: https://github.com/phiresky/sql.js-httpvfs >> mmomtchev/sqlite-wasm-http: https://github.com/mmomtchev/sqlite-wasm-http >> This project is…

comment by westurner · 2025-10-29 · in Hosting SQLite Databases on GitHub Pages (2021)

There are implementations for that: For example https://github.com/psanford/sqlite3vfshttp or https://github.com/phiresky/sql.js-httpvfs

comment by johannes1234321 · 2025-09-07 · in SQLite's File Format

…re: "Loading partial SQLite databases over HTTP": > sql.js-httpvfs: https://github.com/phiresky/sql.js-httpvfs > sqlite-wasm-http: https://github.com/mmomtchev/sqlite-wasm-http >> This project is inspired from @phiresky/sql.js

comment by westurner · 2024-11-28 · in Show HN: TeaTime – distributed book library powered by SQLite, IPFS and GitHub

…downloading it." "but uses the new official SQLite WASM distribution." [1][2] [2] sql.js-httpvfs: https://github.com/phiresky/sql.js-httpvfs [1] sqlite-wasm-http: https://www.npmjs.com/package/sqlite-wasm-http [3] sqlite3vfshttp:…

comment by westurner · 2024-10-31 · in Using SQLite as storage for web server static content

I thought about creating a search engine using https://github.com/phiresky/sql.js-httpvfs , commoncrawl and cloudflare R2. But never found the time to start...

comment by manx · 2024-10-10 · in Nixiesearch: Running Lucene over S3, and why we're building a new search engine

….) [1] https://github.com/sql-js/sql.js/ [2] https://pagefind.app/ [3] https://github.com/phiresky/sql.js-httpvfs

comment by gudzpoz · 2024-08-09 · in SQLite FTS5 Extension

…[1]. Works with github pages just fine [2]... Your web server must respect HTTP range requests. [1] https://github.com/phiresky/sql.js-httpvfs [2] With the caveat that you have to commit your database index (lunr's json, or sqlite's db…

comment by adityaathalye · 2024-07-29 · in Microfeatures in My Blog

…and use range queries using something like this: https://github.com/psanford/sqlite3vfshttp https://github.com/phiresky/sql.js-httpvfs Simon Willison wrote about it: https://simonwillison.net/2022/Aug/10/sqlite-http/

comment by tionis · 2024-07-10 · in Turbopuffer: Fast search on object storage

…shouldn't block a beta release. Also do you build with sqlite-httpvfs? This would go together great https://github.com/phiresky/sql.js-httpvfs

comment by lsb · 2024-05-03 · in I’m writing a new vector search SQLite Extension

…that will be unmaintained in few years. [1]: https://news.ycombinator.com/item?id=27016630 [2]: https://github.com/phiresky/sql.js-httpvfs

comment by Ciantic · 2023-12-31 · in A future for SQL on the web (2021)

…info in my other comment. I'm still exploring but so far it's been pretty impressive to me. [0] https://github.com/phiresky/sql.js-httpvfs

comment by noman-land · 2023-07-06 · in Cloud Backed SQLite

…in action. It's impressively quick and I haven't even fine-tuned it at all yet. SQLite rules. [0] https://github.com/phiresky/sql.js-httpvfs [1] https://github.com/noman-land/transcript.fish

comment by noman-land · 2023-07-06 · in Cloud Backed SQLite

…https://phiresky.github.io/blog/2021/hosting-sqlite-database... So presumably in a similar manner as https://github.com/phiresky/sql.js-httpvfs you could map SQLite pages to leaf torrents too and get the chunking you are looking for.

comment by theptip · 2022-10-10 · in Transmission 4.0.0 beta 1

…of allowing complex client-side querying of a dataset that is static but too big to transfer). < https://github.com/phiresky/sql.js-httpvfs >

comment by sgbeal · 2022-10-04 · in SQLite: QEMU All over Again?

…https://github.com/michalc/sqlite-s3-query/blob/main/sqlite_... Here's the inspiration for that: https://github.com/phiresky/sql.js-httpvfs

comment by simonw · 2022-07-10 · in Show HN: mbtiles-s3-server – serve vector map tiles directly from mbtiles on S3

Seems like a great use case for static sqlite hosting https://github.com/phiresky/sql.js-httpvfs

comment by johtso · 2022-06-11 · in The Winamp Skin Museum is powered by a SQLite3 database with 1.2GB of metadata

…Lite to accessing a hosted SQL database using HTTP range requests as can be done in sql.js like https://github.com/phiresky/sql.js-httpvfs ? I put together a Pyodide-based web app where users need a few indexed queries from a 600mb SQLite…

comment by thadk · 2022-05-04 · in Datasette Lite: a server-side Python web application running in a browser

…languages including Go[0] and Javascript[1]. [0]: https://github.com/psanford/sqlite3vfshttp [1]: https://github.com/phiresky/sql.js-httpvfs

comment by psanford · 2022-03-11 · in Ws4sqlite: Query SQLite via HTTP

…only so far; IDK about resource quotas and multi-GB datasets), serverless search with WASM workers https://github.com/phiresky/sql.js-httpvfs : > sql.js is a light wrapper around SQLite compiled with EMScripten for use in the browser…

comment by westurner · 2022-02-01 · in WebVM: Server-less x86 virtual machines in the browser

…filtering that common search engines apply to their results. [1] https://commoncrawl.org/ [2] https://github.com/phiresky/sql.js-httpvfs

comment by phil294 · 2022-01-27 · in Show HN: Link-Archive.org

…same as the chunking instructions for hosters who have a maximum file size as is demonstrated here: https://github.com/phiresky/sql.js-httpvfs/blob/master/creat...

comment by SahAssar · 2022-01-15 · in Database-less torrent website

…file rather than IPFS. They only download the parts of the SQLite files needed when querying. 0: https://github.com/phiresky/sql.js-httpvfs 1: https://github.com/phiresky/sql.js-httpvfs#inspiration 2: https://github.com/lmatteis/torrent-net…

comment by samwillis · 2022-01-13 · in Database-less torrent website

…the sourcemaps in their build, so one can see the code from the Usage section of sql.js-httpvfs ( https://github.com/phiresky/sql.js-httpvfs#usage ) copy-pasted into App.tsx, but I didn't find any other identifying text I'd actually guess…

comment by mdaniel · 2021-08-22 · in A web database of all AWS IAM actions

Looks pretty similar to https://github.com/phiresky/sql.js-httpvfs My first instinct is to wonder why not giving them credit, but maybe you’d never heard of it before…

comment by molyss · 2021-08-15 · in Show HN: SQLite-S3-query – Python function to query a SQLite database on S3

…Headers you can't set on GitHub Pages (that's the reason I mirrored it to Netlify originally) [1] https://github.com/phiresky/sql.js-httpvfs/issues/13

comment by phiresky · 2021-07-31 · in Hosting SQLite Databases on GitHub Pages

…SharedArrayBuffer and Atomics.wait to make that work [2]. [1] https://www.sqlite.org/vtab.html [2] https://github.com/phiresky/sql.js-httpvfs/blob/master/src/v...

comment by phiresky · 2021-05-02 · in Hosting SQLite databases on GitHub Pages or any static file hoster

…"bytes=" + from + "-" + to); I am a little surprised you can just do that. In https://github.com/phiresky/sql.js-httpvfs/blob/master/src/l...

comment by tlb · 2021-05-02 · in Hosting SQLite databases on GitHub Pages or any static file hoster