Hacker GitHub

← All repos

antirez/ds4

View on GitHub ↗ ★ 24,197 C

DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm

74 mentions on Hacker News by 57 people: 5 stories, 69 comments · first 2026-05-07 · latest 2026-10-13

Mentions per year 74 mentions · busiest year 2026 (74)
20082026
AllStoriesComments NewestTopOldest
  1. …a couple of months. edit - I also have been fiddling with Deepseek v4 Flash via Antirez's setup ( https://github.com/antirez/ds4 ), and it's pretty fantastic (and fantastically easy to get running). It's pretty pokey on the Spark, though,…
    comment by lee_ars · 2026-06-13 · in AI coding at home without going broke
  2. …enough model to converse with, and has the benefit of being entirely self-contained/private. [0] https://github.com/antirez/ds4
    comment by jumploops · 2026-06-13 · in How to setup a local coding agent on macOS
  3. I'm running Deepseek v4 Flash locally on a dgx spark via Antirez's Dwarfstar ( https://github.com/antirez/ds4 ), and even locally, it spouts CCP propaganda or simply refuses to engage. The CCP leanings are baked into the model weighting.…
    comment by lee_ars · 2026-06-11 · in Notes on DeepSeek
  4. …systems (about 14 tok/sec). Antirez created a fabulous 2 bit quant and a highly tuned LLM server https://github.com/antirez/ds4
    comment by sfifs · 2026-06-11 · in OpenAI mulls slashing prices as it competes with Anthropic for users
  5. DS4 flash runs okay on MacBook Pro though: https://github.com/antirez/ds4#speed
    comment by epolanski · 2026-06-08 · in DeepSeek V4 Pro beats GPT-5.5 Pro on precision
  6. …my current favorite for coding and deepseek-r1 for general tasks. I also started yesterday testing https://github.com/antirez/ds4 - it works _very_ well from what I could see so far. What comes next? Trying to figure out what is the…
    comment by igorhvr · 2026-06-05 · in Ask HN: What is your (AI) dev tech stack / workflow?
  7. given his ds4 project, likely collaborated with DeepSeek for this release: https://github.com/antirez/ds4
    comment by focusgroup0 · 2026-06-05 · in Redis 8.8: New array data structure, rate limiter, performance improvements
  8. …v4 Pro, but I've run DeepSeek v4 Flash on my 128GB MacBook Pro using antirez's carefully quantized https://github.com/antirez/ds4 and it's impressive.
    comment by simonw · 2026-05-27 · in I think Anthropic and OpenAI have found product-market fit
  9. …that you can run on a macbook with 128gb ram. an that one is perfectly usable for a lot of tasks. https://github.com/antirez/ds4
    comment by disiplus · 2026-05-27 · in I think Anthropic and OpenAI have found product-market fit
  10. …for memory and derailment tests. Slow? Yes, but ... private. Unconditionally. And recently with https://github.com/antirez/ds4 one can use just one system to a very, very decent speed and ttft for chat inference. Again, private.
    comment by kappuchino · 2026-05-23 · in Was my $48K GPU server worth it?
  11. You only need about a mac w 96GB or 128gb to run deepseek v4flash with ds4( https://github.com/antirez/ds4 ). Works mostly well
    comment by Bnjoroge · 2026-05-21 · in OpenAI Is Preparing to File for an IPO Soon
  12. https://github.com/antirez/ds4
    comment by zackify · 2026-05-21 · in OpenAI Is Preparing to File for an IPO Soon
  13. We have a "DeepSeek moment", https://github.com/antirez/ds4 (see https://news.ycombinator.com/item?id=48142108 ). Or if you prefer smaller ones, Qwen3.6-35B-A3B, https://huggingface.co/bartowski/Qwen_Qwen3.6-35B-A3B-GGUF
    comment by stared · 2026-05-19 · in Gemini 3.5 Flash
  14. …because we are genuinely grateful, we keep the GGML authors copyright notice in our LICENSE file. - https://github.com/antirez/ds4#acknowledgements-to-llamacpp-... Been a lot of fun to play around with it since…
    comment by embedding-shape · 2026-05-16 · in DeepSeek-V4-Flash means LLM steering is interesting again
  15. More information about DwarfStar 4 (DS4) in the readme: https://github.com/antirez/ds4 The code seems based on llama.cpp and GGML. I don't fully understand why it is a standalone project. The readme discusses this: DwarfStar 4 is a small…
    comment by albertzeyer · 2026-05-15 · in A few words on DS4
  16. …the other contributors. Edit: aww, doesn't seem to support offloading to system RAM[0] (yet) [0] https://github.com/antirez/ds4/issues/108 Guess I'll have to keep watching the llama.cpp issue[1] [1] https://github.com/ggml-org/llama.cpp/iss…
    comment by karmakaze · 2026-05-15 · in A few words on DS4
  17. That prefill number isn't right. M4 Max hits 200-300: https://github.com/antirez/ds4/blob/main/speed-bench/m4_max_...
    comment by fgfarben · 2026-05-15 · in A few words on DS4
  18. https://www.github.com/antirez/ds4 (from Antirez of Redis fame) runs a 2-bit quant on Apple Silicon hardware and 96GB or 128GB RAM.
    comment by zozbot234 · 2026-05-11 · in Local AI needs to be the norm
  19. …velocity is already good enough and the real moat is the handshake, trust, marketing, etc etc [0] https://github.com/antirez/ds4
    comment by frangonf · 2026-05-08 · in Ask HN: Are we gonna back less powerful local LLMs