If you use faster-whisper or openai-whisper with an initial_prompt , try this sometime. Record two seconds of a fan, or a keyboard, or nothing in particular, loud enough to pass whatever loudness check you have. Transcribe it.
There is a decent chance you get your prompt back.
In YazSes , the offline dictation tool I work on, the built-in prompt is one short sentence:
BUILTIN_PROMPT = " The app is called YazSes. "
Enter fullscreen mode
Exit fullscreen mode
It is there so Whisper spells the app's name right. And on a noisy burst with no speech in it, Whisper would sometimes transcribe it as... "The app is called YazSes." Typed straight into whatever window you had open. ( #598 has the details.)
Why this happens
Whisper treats initial_prompt as if it were the text that came just before the audio. My working explanation (a hypothesis, not something I have proven inside the model) is that when the audio carries no words, the easiest thing for the decoder to produce is the text it was just shown.…