Hacker GitHub

← All repos

deepseek-ai/smallpond

View on GitHub ↗ ★ 5,028 Python

A lightweight data processing framework built on DuckDB and 3FS.

14 mentions on Hacker News by 14 people: 3 stories, 11 comments · first 2025-02-28 · latest 2026-08-17

Mentions per year 14 mentions · busiest year 2025 (11)
20082026
AllStoriesComments NewestTopOldest
  1. …But you have DuckLake, Quack, and even DeepSeek made their own distributed DB based on DuckDB: https://github.com/deepseek-ai/smallpond
    comment by abirch · 2026-08-17 · in A Preview of DuckDB v2.0
  2. Which, unfortunately, is not maintained: https://github.com/deepseek-ai/smallpond
    comment by esafak · 2026-01-30 · in Quack-Cluster: A Serverless Distributed SQL Query Engine with DuckDB and Ray
  3. Hi mosselman, GizmoEdge is not open-source. DeepSeek has "smallpond" however, which is open-source: https://github.com/deepseek-ai/smallpond I plan on getting GizmoEdge to production-grade quality eventually so folks can use it as a…
    comment by philbe77 · 2025-10-24 · in A sharded DuckDB on 63 nodes runs 1T row aggregation challenge in 5 sec
  4. DeepSeek released smallpond 0 - https://github.com/deepseek-ai/smallpond 1 - https://www.definite.app/blog/smallpond (overview for data engineers, practical application)
    comment by mritchie712 · 2025-10-24 · in A sharded DuckDB on 63 nodes runs 1T row aggregation challenge in 5 sec
  5. …Deepseek has addressed not only efficient AI but also distributed computing: 1. smallpond: https://github.com/deepseek-ai/smallpond 2. 3fs: https://github.com/deepseek-ai/3FS 3. deepep: https://github.com/deepseek-ai/DeepEP
    comment by OutOfHere · 2025-03-04 · in DeepSeek's smallpond: Bringing Distributed Computing to DuckDB
  6. The function argument defaults to polars, but the actual benchmark code sets duckdb by default. https://github.com/deepseek-ai/smallpond/blob/ed112db42af4d0...
    comment by tomnipotent · 2025-03-03 · in Smallpond – A lightweight data processing framework built on DuckDB and 3FS
  7. …for the GraySort benchmark it dispatches to Polars by default to do the actual sorting, not DuckDB: https://github.com/deepseek-ai/smallpond/blob/ed112db42af4d0... .
    comment by orlp · 2025-03-02 · in Smallpond – A lightweight data processing framework built on DuckDB and 3FS
  8. smallpond: https://github.com/deepseek-ai/smallpond : > A lightweight data processing framework built on DuckDB and 3FS.
    comment by westurner · 2025-03-02 · in Understanding Smallpond and 3FS
  9. https://github.com/deepseek-ai/smallpond
    comment by ok123456 · 2025-03-02 · in Understanding Smallpond and 3FS
  10. Smallpond. Runs on their RDMA powered 3fs ("fire-flyer file system") filesystem. https://github.com/deepseek-ai/smallpond https://news.ycombinator.com/item?id=43200793 I didn't find anything of value in this article. Did enjoy…
    comment by jauntywundrkind · 2025-03-02 · in Understanding Smallpond and 3FS
  11. They appear to have Python bindings which seems reasonable from an API / usability perspective? https://github.com/deepseek-ai/smallpond In terms of fast FUSE - also my first question, appears to be`io_uring` + FUSE :)…
    comment by grohan · 2025-02-28 · in Fire-Flyer File System (3FS)