Hacker GitHub

← All repos

avinassh/fast-sqlite3-inserts

View on GitHub ↗ ★ 409 Rust

Some bunch of test scripts to generate a SQLite DB with 1B rows in fastest possible way

6 mentions on Hacker News by 3 people: 0 stories, 6 comments · first 2021-07-18 · latest 2023-04-13

Mentions per year 6 mentions · busiest year 2021 (2)
20082026
AllStoriesComments NewestTopOldest
  1. …my rationale and approach here - https://avi.im/blag/2021/fast-sqlite-inserts/ the repo link - https://github.com/avinassh/fast-sqlite3-inserts
    comment by avinassh · 2023-04-13 · in SQLite performance tuning: concurrent reads, multiple GBs and 100k SELECTs/s
  2. …under a minute. I ran my script with PyPy, with zero changes and it was 4x times faster! code here: https://github.com/avinassh/fast-sqlite3-inserts my blog post: https://avi.im/blag/2021/fast-sqlite-inserts/
    comment by avinassh · 2023-03-15 · in Python-based compiler achieves orders-of-magnitude speedups
  3. …(zero changes) using PyPy, and I got 3.5x better speed. I published my findings here [1]. [0] - https://github.com/avinassh/fast-sqlite3-inserts [1] - https://avi.im/blag/2021/fast-sqlite-inserts/
    comment by avinassh · 2022-11-26 · in I/O is no longer the bottleneck
  4. …scratch [0] - https://github.com/avinassh/della [1] - https://github.com/avinassh/rockstar [2] - https://github.com/avinassh/fast-sqlite3-inserts [3] - https://github.com/avinassh/py-caskdb
    comment by avinassh · 2022-05-16 · in Ask HN: Which personal projects got you hired?
  5. https://github.com/avinassh/fast-sqlite3-inserts
    comment by tln · 2021-07-25 · in Inserting 130M SQLite rows per minute from a scripting language
  6. …for i in range(1, 50): execute_stmt COMMIT; You do not create a long list of parameters. https://github.com/avinassh/fast-sqlite3-inserts/blob/master... ;)
    comment by siscia · 2021-07-18 · in Inserting a billion rows in SQLite under a minute