Hacker GitHub

← All repos

ggml-org/whisper.cpp

View on GitHub ↗ ★ 54,861 C++

Port of OpenAI's Whisper model in C/C++

117 mentions on Hacker News by 97 people: 19 stories, 98 comments · first 2022-10-07 · latest 2026-07-19

Mentions per year 117 mentions · busiest year 2023 (65)
20082026
AllStoriesComments NewestTopOldest
  1. …you can use AirCaption (www.aircaption.com). It's an electron desktop app running Whisper.cpp ( https://github.com/ggerganov/whisper.cpp ). Just released a few days ago.
    comment by Kevin2379 · 2023-03-18 · in Writeout.ai – Transcribe and translate any audio files
  2. …High-performance inference of OpenAI's Whisper automatic speech recognition (ASR) model ( https://github.com/ggerganov/whisper.cpp )
    comment by jhen0409 · 2023-03-16 · in React Native Binding of Whisper.cpp
  3. …to make it clear - I'm no expert in Core ML / ANE, so these conclusions could be totally wrong. [0] https://github.com/ggerganov/whisper.cpp/discussions/548#dis...
    comment by ggerganov · 2023-03-12 · in Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon support
  4. I thought that as well. But then I noticed the same author has an existing project with a ggml.c ( https://github.com/ggerganov/whisper.cpp/blob/master/ggml.c 8000+ lines), so maybe he "just" wrote 2000 lines in an evening. Sounds much…
    comment by hnfong · 2023-03-11 · in Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon support
  5. …indicating he will be working on that in the next few weeks. He has already done great work here: https://github.com/ggerganov/whisper.cpp
    comment by schappim · 2023-03-11 · in Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon support
  6. …out his other work, bringing Apple Silicon support to OpenAI's Whisper (speech-to-text model): https://github.com/ggerganov/whisper.cpp
    comment by schappim · 2023-03-11 · in Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon support
  7. …on the neural engine but the author has a branch for his whisper.cpp project which uses it here: https://github.com/ggerganov/whisper.cpp/pull/566 - so it may not be long before we see it applied here as well. All of this is to say that it…
    comment by kamranjon · 2023-03-11 · in Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon support
  8. …on Macs. 1. https://machinelearning.apple.com/research/neural-engine-tra... Edit: just found this: https://github.com/ggerganov/whisper.cpp/pull/566
    comment by ojosilva · 2023-03-10 · in Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon support
  9. …author of whisper.cpp, which enables highly accurate real-time audio transcription on the M1/M2: https://github.com/ggerganov/whisper.cpp
    comment by SheinhardtWigCo · 2023-03-10 · in Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon support
  10. Here is a version that runs locally with WASM https://whisper.ggerganov.com/ https://github.com/ggerganov/whisper.cpp/tree/master/example...
    comment by cloudking · 2023-03-08 · in Writeout.ai – Transcribe and translate any audio files
  11. https://github.com/ggerganov/whisper.cpp makes it relatively feasible to run on CPU.
    comment by adgjlsfhk1 · 2023-03-08 · in Writeout.ai – Transcribe and translate any audio files
  12. …If you own a gpu use this one https://github.com/openai/whisper If you don't own a gpu use this one https://github.com/ggerganov/whisper.cpp (this one is very very slow)
    comment by htrp · 2023-03-08 · in Writeout.ai – Transcribe and translate any audio files
  13. …and load the one you want to use (typically with dlopen/dlsym etc..): Example from whisper.cpp: https://github.com/ggerganov/whisper.cpp/blob/master/example... if (loadVfpv4) { Log.d(LOG_TAG, "Loading libwhisper_vfpv4.so")…
    comment by saidinesh5 · 2023-03-08 · in Linker Notes on AArch64
  14. Now use Whisper.cpp to talk to Jarvis https://github.com/ggerganov/whisper.cpp
    comment by ducktective · 2023-03-08 · in ChatGPT-Linux-Assistant
  15. …around one second. [0] - https://youtube.com/watch?v=Aor6CFkcWzU&si=EnSIkaIECMiOmarE [1] - https://github.com/ggerganov/whisper.cpp/discussions/166
    comment by kkielhofner · 2023-03-07 · in Amazon’s big dreams for Alexa fall short
  16. You can run whisper.cpp (a very solid TTS) on a Raspberry Pi ( https://github.com/ggerganov/whisper.cpp/discussions/166 ), so I'm pretty sure with a modest CPU upgrade an Echo would be more than capable of running it locally.
    comment by gigel82 · 2023-03-07 · in Amazon’s big dreams for Alexa fall short
  17. …API; the compute isn't huge, I used CPU only (an M1) and the memory requirements aren't much. [1] https://github.com/ggerganov/whisper.cpp
    comment by mk_stjames · 2023-03-01 · in Introducing ChatGPT and Whisper APIs
  18. …my use case was very sensitive to latency, I ultimately went with https://deepgram.com/ - but https://github.com/ggerganov/whisper.cpp provided a great stepping stone while prototyping a streaming use case locally on a laptop.
    comment by jmccarthy · 2023-03-01 · in Introducing ChatGPT and Whisper APIs
  19. Maybe they meant to link to something like this: https://github.com/ggerganov/whisper.cpp/pull/540 Web demo: https://whisper.ggerganov.com/
    comment by moyix · 2023-03-01 · in Introducing ChatGPT and Whisper APIs
  20. The C++ is compiled to WASM. You can look into [1] to see emscripten there. [1] https://github.com/ggerganov/whisper.cpp/blob/master/CMakeLi...
    comment by iib · 2023-03-01 · in Introducing ChatGPT and Whisper APIs
  21. …(locally) so no need to pay for the API, plus the bandwidth. It actually works surprisingly well: https://github.com/ggerganov/whisper.cpp
    comment by gigel82 · 2023-03-01 · in Introducing ChatGPT and Whisper APIs
  22. https://github.com/ggerganov/whisper.cpp
    comment by ur-whale · 2023-02-21 · in Whispers of A.I.’s Modular Future
  23. …to always respect the licenses) If you want to play with whisper.cpp you can use this SwiftUI demo: https://github.com/ggerganov/whisper.cpp/tree/master/example...
    comment by ArminRS · 2023-02-20 · in Show HN: Whisper.cpp and YAKE to Analyse Voice Reflections [iOS]
  24. https://github.com/ggerganov/whisper.cpp has diarization
    comment by 19h · 2023-02-15 · in Show HN: Self-host Whisper As a Service with GUI and queueing
  25. Do you mean something like Whisper.cpp? [0] See the demo there. [0]: https://github.com/ggerganov/whisper.cpp#whispercpp
    comment by haensi · 2023-02-14 · in Ask HN: What's the best way to run whisper large on Apple Silicon?
  26. …project, but still relevant) [1]. 0. https://github.com/openai/whisper/discussions/332 1. https://github.com/ggerganov/whisper.cpp/issues/10
    comment by nojs · 2023-02-13 · in Show HN: Self-host Whisper As a Service with GUI and queueing
  27. By the way there is also another project called Whisper.cpp: https://github.com/ggerganov/whisper.cpp Which uses x8 less memory than the Python implementation for the tiny model. It would be a good idea to keep an eye on it since there are…
    comment by henry_viii · 2023-02-13 · in Show HN: Self-host Whisper As a Service with GUI and queueing
  28. …end. Submissions like yours and other projects like this one (recently featured here as well) -> https://github.com/ggerganov/whisper.cpp , makes it pretty clear to me that this intuition is correct. There's a couple tools I created back…
    comment by moralestapia · 2023-01-11 · in NanoGPT
  29. …I believe this runs client side, but whether it counts as open source is likely open for debate: https://github.com/ggerganov/whisper.cpp
    comment by DougBTX · 2023-01-10 · in Microsoft eyes $10B bet on ChatGPT
  30. …Check out Whipser here https://openai.com/blog/whisper/ Check out Whipser.cpp here https://github.com/ggerganov/whisper.cpp
    comment by tonym128 · 2022-12-19 · in Shhh bot – A free telegram bot for Speech to Text on a PI 4 with Whisper.cpp
  31. This script for whisper.cpp works really well https://github.com/ggerganov/whisper.cpp/blob/master/example... for my purposes I changed the output from subtitles to txt (so I could pipe the result into chatgpt)
    comment by cavisne · 2022-12-18 · in YouTube Transcript – read YouTube videos
  32. …re-implementation that performs well and can definitely transcribe in realtime on many machines: https://github.com/ggerganov/whisper.cpp
    comment by deet · 2022-12-18 · in Live Captions: an application that provides live captions for the Linux desktop
  33. …an interesting strategy to achieve this. Still a prototype, but I think it looks very promising: https://github.com/ggerganov/whisper.cpp/pull/271 The source code is in the `command.cpp` and I will soon write some more details how it…
    comment by ggerganov · 2022-12-14 · in Show HN: Port of OpenAI's Whisper model in C/C++
  34. …try, here are the steps I took over about an hour to set it up: 1. Downloaded the Win10 artifact: https://github.com/ggerganov/whisper.cpp/actions/runs/363552... at the bottom of the page by logging in to Github. Extract and placed this…
    comment by NWoodsman · 2022-12-10 · in Show HN: Port of OpenAI's Whisper model in C/C++
  35. …your hands dirty with real code. I would take a look at those: https://github.com/geohot/tinygrad https://github.com/ggerganov/whisper.cpp
    comment by stephc_int13 · 2022-12-10 · in Ask HN: How to get back into AI?
  36. …prepend 8 lines of text (prompt/context) and keep appending every new transcribed line at the end: https://github.com/ggerganov/whisper.cpp/blob/master/example...
    comment by ggerganov · 2022-12-07 · in Talk = GPT-2 and Whisper and WASM
  37. …stack is just incredible! edit: Got it going in 1 min! I grabbed the prebuilt artifacts (windows) - https://github.com/ggerganov/whisper.cpp/actions/runs/363552... Then downloaded ggml-base.bin (148mb) and put it in models/ggml-base.en.bin…
    comment by stevenhuang · 2022-12-07 · in Show HN: Port of OpenAI's Whisper model in C/C++
  38. …and that includes Qatar, the UAE, the Islamic organization of countries, the Gulf Corps... [0] https://github.com/ggerganov/whisper.cpp/blob/master/example...
    comment by ggerganov · 2022-12-07 · in OpenAI quietly launched Whisper V2 in a GitHub commit
  39. You probably want to check this port : https://github.com/ggerganov/whisper.cpp
    comment by GistNoesis · 2022-12-07 · in OpenAI quietly launched Whisper V2 in a GitHub commit
  40. Have you tried whisper-cpp? https://github.com/ggerganov/whisper.cpp/tree/master/example...
    comment by synesthesiam · 2022-12-07 · in OpenAI quietly launched Whisper V2 in a GitHub commit
  41. whisper.cpp ( https://github.com/ggerganov/whisper.cpp ) supports streaming!
    comment by dgtlntv · 2022-12-07 · in OpenAI quietly launched Whisper V2 in a GitHub commit
  42. …`make [model]` and you are ready to go. No Python, no frameworks, no packages - plain and simple. https://github.com/ggerganov/whisper.cpp
    comment by ggerganov · 2022-12-02 · in Stable Diffusion with Core ML on Apple Silicon
  43. Not a hack per se but a complete reimplementation. https://github.com/ggerganov/whisper.cpp This is a C/C++ version of Whisper which uses the CPU. It's astoundingly fast. Maybe it won't work in your use case, but you should try!
    comment by EMIRELADERO · 2022-11-19 · in Show HN: I made a free transcription service powered by Whisper AI
  44. …performance to the 1070 while running on M1 CPU. It is easy to build and run and well documented. https://github.com/ggerganov/whisper.cpp I hope this doesn’t come off the wrong way, I love this project and I’m glad to see the technology…
    comment by n8cpdx · 2022-11-19 · in Show HN: I made a free transcription service powered by Whisper AI
  45. …helps to wrap this functionality in a proper Vim plugin. [0] https://youtu.be/3flN9kTcZJY [1] https://github.com/ggerganov/whisper.cpp/tree/master/example...
    comment by ggerganov · 2022-11-10 · in Hey, GitHub – Waiting list signup
  46. …in other projects and you can control how many CPU threads to be used during the processing. [0] https://github.com/ggerganov/whisper.cpp
    comment by ggerganov · 2022-11-01 · in Rewind: The Search Engine for Your Life
  47. …decoder and medium model, I can transcribe 1 hour audio in just 10 minutes (~x6 real-time) [0]. [0] https://github.com/ggerganov/whisper.cpp
    comment by ggerganov · 2022-10-20 · in Show HN: Record voice memo, receive transcription in email
  48. You can try my C/C++ port of Whisper: https://github.com/ggerganov/whisper.cpp No dependencies, no Python, runs efficiently on the CPU.
    comment by ggerganov · 2022-10-07 · in How to really know another person