u/grahamdietz

Better models for Audio than Whisper?

I have been handed a data pipeline side-quest: I need to create a reliable pipeline that transcribes short (<10min) audio .m4a files.
I work with structured data, and audio processing with async queue-based processing is new to me.
The team who sandboxed this worked on Whisper, but it's pretty resource hungry and I am looking for something of similar quality, hopefully faster, that we can host ourselves.
The pipeline is not time sensitive: it runs daily and is used for summarization of customer issues. ~100 to 200 audio files a day.
AI is suggesting exploring:

  • faster-whisper
  • whisper.cpp
  • WhisperX
  • Insanely Fast Whisper

Any advice on which model might be best would be welcome. No budget for external APIs sadly. We run on AWS EKS. I looked at Amazon Transcribe but at first glance, it does not support .m4a

reddit.com
u/grahamdietz — 19 hours ago