Menu

Whisper Hallucinates on Silence: 61 of 700 Pauses Became 'Thank You'
📰

Whisper Hallucinates on Silence: 61 of 700 Pauses Became 'Thank You'

DEV Community: python·jidonglab·6 days ago
#O2E3pqjg
#devtopython#devto#dev#whisper#chunks
Reading 0:00
15s threshold

A user's transcript said "Thank you." in the middle of an answer about database indexing. They never said it. They paused for four seconds to think, and Whisper filled the silence with a polite sentence that didn't exist.

That one line sent me on a two-day audit. The short version: Whisper hallucinates on silence , my default settings let it through, and the parameter that sounds like it should stop this ( no_speech_threshold ) has a catch most people miss.

TL;DR

I fed Whisper large-v3 (via faster-whisper) 700 audio chunks that I had verified were pure silence or room noise. 61 of them (8.7%) came back with text.

The top outputs: "Thank you." (34), "Thanks for watching!" (9), a lone "you" (8), a repeat of the previous sentence (6), and subtitle-credit style lines (4).

no_speech_threshold didn't save me because Whisper only skips a segment when no_speech_prob is high AND avg_logprob is low.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.