Menu

Whisper typed its own prompt into my document
📰

Whisper typed its own prompt into my document

DEV Community: python·Mohsen Seyedkazemi Ardebili·17 days ago
#QCw8exJJ
#devtopython#devto#dev#whisper#speech
Long article (921 words) — no AI summary yet.
Reading 0:00
15s threshold

If you use faster-whisper or openai-whisper with an initial_prompt , try this sometime. Record two seconds of a fan, or a keyboard, or nothing in particular, loud enough to pass whatever loudness check you have. Transcribe it.

There is a decent chance you get your prompt back.

In YazSes , the offline dictation tool I work on, the built-in prompt is one short sentence:

BUILTIN_PROMPT = " The app is called YazSes. "

Enter fullscreen mode

Exit fullscreen mode

It is there so Whisper spells the app's name right. And on a noisy burst with no speech in it, Whisper would sometimes transcribe it as... "The app is called YazSes." Typed straight into whatever window you had open. ( #598 has the details.)

Why this happens

Whisper treats initial_prompt as if it were the text that came just before the audio. My working explanation (a hypothesis, not something I have proven inside the model) is that when the audio carries no words, the easiest thing for the decoder to produce is the text it was just shown.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.