Vaibhavs10/insanely-fast-whisper
View on GitHub ↗ ★ 13,060 Jupyter Notebook
13 mentions on Hacker News by 13 people: 3 stories, 10 comments · first 2023-11-14 · latest 2026-03-27
20082026
-
Is this even faster? https://github.com/Vaibhavs10/insanely-fast-whisper If so, is the quality still acceptable?
comment by dloss · 2024-08-03 · in AiOla open-sources ultra-fast ‘multi-head’ speech recognition model -
You mean ' https://github.com/Vaibhavs10/insanely-fast-whisper ' ? Did not know that until now. I'm running all of that since over ~10 months and just had it running. Happy to try that out. The GPU is fully utilized by using whisper and…
comment by owehrens · 2023-12-13 · in Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX -
There's a better parallel/batching that works on the 30s chunks resulting in 40X. From HF at https://github.com/Vaibhavs10/insanely-fast-whisper This is again not native PyTorch so there's still room to have better RTFX numbers.
comment by iAkashPaul · 2023-12-13 · in Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX -
…models tend to to have massively hand optimized Nvidia implementations. Whisper is no exception: https://github.com/Vaibhavs10/insanely-fast-whisper SDXL is actually an interesting exception for Nvidia because most users still tend to run…
comment by brucethemoose2 · 2023-12-13 · in Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX -
…derivative repo instead - one hour of audio gets transcribed within a minute or less on most GPUs - https://github.com/Vaibhavs10/insanely-fast-whisper
comment by mightytravels · 2023-12-13 · in Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX -
How does this compare to insanely-fast-whisper though? https://github.com/Vaibhavs10/insanely-fast-whisper I think that not using optimizations allows this to be a 1:1 comparison, but if the optimizations are not ported to MLX, then it…
comment by Flux159 · 2023-12-13 · in Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX -
…I hope the submission gets replaced with the upstream repo so the author gets full credit. :) [0] https://github.com/Vaibhavs10/insanely-fast-whisper/pull/42 [1] https://github.com/replicate/cog
comment by bfirsh · 2023-11-14 · in Insanely Fast Whisper -
…for replicate.com? It is missing the most recent commits from what appears to be the real source: https://github.com/Vaibhavs10/insanely-fast-whisper The only added commit is adding a replicate.com example, whatever that means.
comment by coder543 · 2023-11-14 · in Insanely Fast Whisper -
…this seems a bit suspicious - this seems like someone just forked another persons active repo ( https://github.com/Vaibhavs10/insanely-fast-whisper ) and posted as their own?
comment by kamranjon · 2023-11-14 · in Insanely Fast Whisper -
…I could find is someone claiming to get a similar time on their RTX3090 on an issue in the repo. https://github.com/Vaibhavs10/insanely-fast-whisper/issues/3...
comment by TOMDM · 2023-11-14 · in Insanely Fast Whisper