Menu

Deploying Underdog Bark 3.0 Pro: verbatim transcripts, custom backends and the chunk setting
📰

Deploying Underdog Bark 3.0 Pro: verbatim transcripts, custom backends and the chunk setting

DEV Community: opensource·InferenceKey·10 days ago
#MoupwNgc
#devtoopensource#devto#dev#bark#qwen3
Reading 0:00
15s threshold

When you pick a speech-to-text model for a product, the first question is not which one hears better. It is whether your transcripts should keep every "uh, you know" the speaker said. We ran into that while putting Underdog Bark 3.0 Pro next to Qwen3-ASR-1.7B on one RTX 3090 on our cloud.

On 40 English clips drawn from the Open ASR Leaderboard test data, Bark got 6.28% of the words wrong and Qwen3-ASR-1.7B got 7.03%. Bark is 1,254 MB on disk, Qwen3-ASR-1.7B is 4,699 MB. Bark is the third link in a chain: NVIDIA's Parakeet TDT 0.6B v3 is the base, Moondream improved it, and Conway Research post-trained and compressed the result. The clips and the leaderboard itself come from the hf-audio team. We packaged it and did the counting. The per-set numbers and the method are in the full Bark 3.0 Pro vs Qwen3-ASR test write-up . Here is what matters when you build on it.

Split the error rate before you trust it

Word error rate adds up words heard wrong, words left out and words added.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.