David SmithJan 15, 2023

I'm working on reviving my old podcast searching system using OpenAI's Whisper engine (https://github.com/openai/whisper).

The results so far are amazing. I can run the transcription right on my Mac at roughly 5X realtime, and the accuracy is super impressive. It even gets brand names and weird words right nearly every time.

For example, this segment from The Talk Show where @marcoarment and @gruber argue about how to pronounce databases was perfectly transcribed, down the even the mispronunciations. 🤯

GitHub - openai/whisper: Robust Speech Recognition via Large-Scale Weak Supervision

Robust Speech Recognition via Large-Scale Weak Supervision - openai/whisper

GitHub
Show threadJohn SiracusaJan 15, 2023
@_Davidsmith Can it do speaker identification?
Show threadDavid SmithJan 15, 2023
@siracusa not directly, there are other tools you can run that will segment by speaker, so if you wanted to I suppose you could combine them.
Show threadDavid Friedman
@_Davidsmith @siracusa I have done it with this clunky/imperfect workflow:
1) Use Whisper for free transcription
2) Remove all carriage returns from the generated txt file
3) Upload the original audio file to Descript but *do not* have Descript transcribe it.
4) Add the whisper-generated transcript to Descript, which only charges for its own transcription time. It's free to have Descript synchronize a file to your own provided transcript.
3) Have Descript detect speakers.
4) Export
Jan 18, 2023 at 3:44pmWeb