Hacker GitHub

← All repos

ggml-org/whisper.cpp

View on GitHub ↗ ★ 54,861 C++

Port of OpenAI's Whisper model in C/C++

117 mentions on Hacker News by 97 people: 19 stories, 98 comments · first 2022-10-07 · latest 2026-07-19

Mentions per year 117 mentions · busiest year 2023 (65)
20082026
AllStoriesComments NewestTopOldest
  1. Yes NEON works on recent Pis. RPi CPU tuning: https://github.com/ggerganov/whisper.cpp/blob/70567eff232773...
    comment by anotherhue · 2023-04-25 · in QuiLLMan: Voice chat with Vicuna-13B
  2. ▲ 2
    Talk.wasm: OpenAI's Whisper run in browser
    story by behnamoh · 2023-04-18 · 0 comments
  3. ▲ 70
    Whisper.cpp now has CoreML suppprt
    story by schappim · 2023-04-15 · 5 comments
  4. A partial answer: https://github.com/ggerganov/whisper.cpp/issues/10
    comment by mkl · 2023-04-05 · in Show HN: Live coaching app for remote SWE interviews, uses Whisper and GPT-4
  5. Nice! Are you aware that whisper.cpp has a WASM-version as well? See https://github.com/ggerganov/whisper.cpp/tree/master/example... - demo at https://whisper.ggerganov.com/
    comment by NiekvdMaas · 2023-04-05 · in Show HN: Ermine.ai – Record and transcribe speech, 100% client-side (WASM)
  6. Thanks! Not sure if it'll work on an Arduino, but maybe take a look at https://github.com/ggerganov/whisper.cpp -- it works on a Raspberry Pi at least, so resource requirements are fairly minimal
    comment by vishnumenon · 2023-04-04 · in Show HN: Ermine.ai – Record and transcribe speech, 100% client-side (WASM)
  7. …it because I transcribe Japanese podcasts, but whisper.cpp[0] seems to support streaming. [0]: https://github.com/ggerganov/whisper.cpp#real-time-audio-inp...
    comment by idleproc · 2023-03-30 · in Universal Speech Model
  8. …CPU based tests (likely your most user base), works much much faster compared to OpenAI whisper [1] https://github.com/ggerganov/whisper.cpp
    comment by wanderingmind · 2023-03-29 · in Launch HN: Vocode (YC W23) – Library for voice conversation with LLMs
  9. This is close: https://github.com/ggerganov/whisper.cpp
    comment by intalentive · 2023-03-25 · in What we know about the Apple Neural Engine
  10. …- https://github.com/oobabooga/text-generation-webui - https://github.com/hizkifw/WebChatRWKVstic - https://github.com/ggerganov/whisper.cpp - https://github.com/qwopqwop200/GPTQ-for-LLaMa - https://github.com/oobabooga/text-generation-webu…
    comment by lxe · 2023-03-22 · in Show HN: Finetune LLaMA-7B on commodity GPUs using your own text
  11. ▲ 5
    Show HN: OpenTheo – Transcribed and searchable Bible teaching with Whisper.cpp
    story by dinoleif · 2023-03-22 · 0 comments
  12. …you can use AirCaption (www.aircaption.com). It's an electron desktop app running Whisper.cpp ( https://github.com/ggerganov/whisper.cpp ). Just released a few days ago.
    comment by Kevin2379 · 2023-03-18 · in Writeout.ai – Transcribe and translate any audio files
  13. …High-performance inference of OpenAI's Whisper automatic speech recognition (ASR) model ( https://github.com/ggerganov/whisper.cpp )
    comment by jhen0409 · 2023-03-16 · in React Native Binding of Whisper.cpp
  14. ▲ 2
    Show HN: bigWav.app – web based transcription powered by Whipser and WASM
    story by emadda · 2023-03-13 · 0 comments
  15. …to make it clear - I'm no expert in Core ML / ANE, so these conclusions could be totally wrong. [0] https://github.com/ggerganov/whisper.cpp/discussions/548#dis...
    comment by ggerganov · 2023-03-12 · in Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon support
  16. I thought that as well. But then I noticed the same author has an existing project with a ggml.c ( https://github.com/ggerganov/whisper.cpp/blob/master/ggml.c 8000+ lines), so maybe he "just" wrote 2000 lines in an evening. Sounds much…
    comment by hnfong · 2023-03-11 · in Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon support
  17. …indicating he will be working on that in the next few weeks. He has already done great work here: https://github.com/ggerganov/whisper.cpp
    comment by schappim · 2023-03-11 · in Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon support
  18. …out his other work, bringing Apple Silicon support to OpenAI's Whisper (speech-to-text model): https://github.com/ggerganov/whisper.cpp
    comment by schappim · 2023-03-11 · in Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon support
  19. …on the neural engine but the author has a branch for his whisper.cpp project which uses it here: https://github.com/ggerganov/whisper.cpp/pull/566 - so it may not be long before we see it applied here as well. All of this is to say that it…
    comment by kamranjon · 2023-03-11 · in Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon support
  20. …on Macs. 1. https://machinelearning.apple.com/research/neural-engine-tra... Edit: just found this: https://github.com/ggerganov/whisper.cpp/pull/566
    comment by ojosilva · 2023-03-10 · in Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon support
  21. …author of whisper.cpp, which enables highly accurate real-time audio transcription on the M1/M2: https://github.com/ggerganov/whisper.cpp
    comment by SheinhardtWigCo · 2023-03-10 · in Llama.cpp: Port of Facebook's LLaMA model in C/C++, with Apple Silicon support
  22. Here is a version that runs locally with WASM https://whisper.ggerganov.com/ https://github.com/ggerganov/whisper.cpp/tree/master/example...
    comment by cloudking · 2023-03-08 · in Writeout.ai – Transcribe and translate any audio files
  23. https://github.com/ggerganov/whisper.cpp makes it relatively feasible to run on CPU.
    comment by adgjlsfhk1 · 2023-03-08 · in Writeout.ai – Transcribe and translate any audio files
  24. …If you own a gpu use this one https://github.com/openai/whisper If you don't own a gpu use this one https://github.com/ggerganov/whisper.cpp (this one is very very slow)
    comment by htrp · 2023-03-08 · in Writeout.ai – Transcribe and translate any audio files
  25. …and load the one you want to use (typically with dlopen/dlsym etc..): Example from whisper.cpp: https://github.com/ggerganov/whisper.cpp/blob/master/example... if (loadVfpv4) { Log.d(LOG_TAG, "Loading libwhisper_vfpv4.so")…
    comment by saidinesh5 · 2023-03-08 · in Linker Notes on AArch64
  26. Now use Whisper.cpp to talk to Jarvis https://github.com/ggerganov/whisper.cpp
    comment by ducktective · 2023-03-08 · in ChatGPT-Linux-Assistant
  27. …around one second. [0] - https://youtube.com/watch?v=Aor6CFkcWzU&si=EnSIkaIECMiOmarE [1] - https://github.com/ggerganov/whisper.cpp/discussions/166
    comment by kkielhofner · 2023-03-07 · in Amazon’s big dreams for Alexa fall short
  28. You can run whisper.cpp (a very solid TTS) on a Raspberry Pi ( https://github.com/ggerganov/whisper.cpp/discussions/166 ), so I'm pretty sure with a modest CPU upgrade an Echo would be more than capable of running it locally.
    comment by gigel82 · 2023-03-07 · in Amazon’s big dreams for Alexa fall short
  29. …API; the compute isn't huge, I used CPU only (an M1) and the memory requirements aren't much. [1] https://github.com/ggerganov/whisper.cpp
    comment by mk_stjames · 2023-03-01 · in Introducing ChatGPT and Whisper APIs
  30. …my use case was very sensitive to latency, I ultimately went with https://deepgram.com/ - but https://github.com/ggerganov/whisper.cpp provided a great stepping stone while prototyping a streaming use case locally on a laptop.
    comment by jmccarthy · 2023-03-01 · in Introducing ChatGPT and Whisper APIs
  31. Maybe they meant to link to something like this: https://github.com/ggerganov/whisper.cpp/pull/540 Web demo: https://whisper.ggerganov.com/
    comment by moyix · 2023-03-01 · in Introducing ChatGPT and Whisper APIs
  32. The C++ is compiled to WASM. You can look into [1] to see emscripten there. [1] https://github.com/ggerganov/whisper.cpp/blob/master/CMakeLi...
    comment by iib · 2023-03-01 · in Introducing ChatGPT and Whisper APIs
  33. …(locally) so no need to pay for the API, plus the bandwidth. It actually works surprisingly well: https://github.com/ggerganov/whisper.cpp
    comment by gigel82 · 2023-03-01 · in Introducing ChatGPT and Whisper APIs
  34. https://github.com/ggerganov/whisper.cpp
    comment by ur-whale · 2023-02-21 · in Whispers of A.I.’s Modular Future
  35. …to always respect the licenses) If you want to play with whisper.cpp you can use this SwiftUI demo: https://github.com/ggerganov/whisper.cpp/tree/master/example...
    comment by ArminRS · 2023-02-20 · in Show HN: Whisper.cpp and YAKE to Analyse Voice Reflections [iOS]
  36. https://github.com/ggerganov/whisper.cpp has diarization
    comment by 19h · 2023-02-15 · in Show HN: Self-host Whisper As a Service with GUI and queueing
  37. Do you mean something like Whisper.cpp? [0] See the demo there. [0]: https://github.com/ggerganov/whisper.cpp#whispercpp
    comment by haensi · 2023-02-14 · in Ask HN: What's the best way to run whisper large on Apple Silicon?
  38. …project, but still relevant) [1]. 0. https://github.com/openai/whisper/discussions/332 1. https://github.com/ggerganov/whisper.cpp/issues/10
    comment by nojs · 2023-02-13 · in Show HN: Self-host Whisper As a Service with GUI and queueing
  39. By the way there is also another project called Whisper.cpp: https://github.com/ggerganov/whisper.cpp Which uses x8 less memory than the Python implementation for the tiny model. It would be a good idea to keep an eye on it since there are…
    comment by henry_viii · 2023-02-13 · in Show HN: Self-host Whisper As a Service with GUI and queueing
  40. ▲ 43
    Show HN: Windows port of OpenAI's Whisper automatic speech recognition model
    story by Const-me · 2023-01-16 · 20 comments
  41. …end. Submissions like yours and other projects like this one (recently featured here as well) -> https://github.com/ggerganov/whisper.cpp , makes it pretty clear to me that this intuition is correct. There's a couple tools I created back…
    comment by moralestapia · 2023-01-11 · in NanoGPT
  42. …I believe this runs client side, but whether it counts as open source is likely open for debate: https://github.com/ggerganov/whisper.cpp
    comment by DougBTX · 2023-01-10 · in Microsoft eyes $10B bet on ChatGPT
  43. …Check out Whipser here https://openai.com/blog/whisper/ Check out Whipser.cpp here https://github.com/ggerganov/whisper.cpp
    comment by tonym128 · 2022-12-19 · in Shhh bot – A free telegram bot for Speech to Text on a PI 4 with Whisper.cpp
  44. This script for whisper.cpp works really well https://github.com/ggerganov/whisper.cpp/blob/master/example... for my purposes I changed the output from subtitles to txt (so I could pipe the result into chatgpt)
    comment by cavisne · 2022-12-18 · in YouTube Transcript – read YouTube videos
  45. …re-implementation that performs well and can definitely transcribe in realtime on many machines: https://github.com/ggerganov/whisper.cpp
    comment by deet · 2022-12-18 · in Live Captions: an application that provides live captions for the Linux desktop
  46. …an interesting strategy to achieve this. Still a prototype, but I think it looks very promising: https://github.com/ggerganov/whisper.cpp/pull/271 The source code is in the `command.cpp` and I will soon write some more details how it…
    comment by ggerganov · 2022-12-14 · in Show HN: Port of OpenAI's Whisper model in C/C++
  47. …try, here are the steps I took over about an hour to set it up: 1. Downloaded the Win10 artifact: https://github.com/ggerganov/whisper.cpp/actions/runs/363552... at the bottom of the page by logging in to Github. Extract and placed this…
    comment by NWoodsman · 2022-12-10 · in Show HN: Port of OpenAI's Whisper model in C/C++
  48. …your hands dirty with real code. I would take a look at those: https://github.com/geohot/tinygrad https://github.com/ggerganov/whisper.cpp
    comment by stephc_int13 · 2022-12-10 · in Ask HN: How to get back into AI?
  49. …prepend 8 lines of text (prompt/context) and keep appending every new transcribed line at the end: https://github.com/ggerganov/whisper.cpp/blob/master/example...
    comment by ggerganov · 2022-12-07 · in Talk = GPT-2 and Whisper and WASM
  50. …stack is just incredible! edit: Got it going in 1 min! I grabbed the prebuilt artifacts (windows) - https://github.com/ggerganov/whisper.cpp/actions/runs/363552... Then downloaded ggml-base.bin (148mb) and put it in models/ggml-base.en.bin…
    comment by stevenhuang · 2022-12-07 · in Show HN: Port of OpenAI's Whisper model in C/C++