When you pick a speech-to-text model for a product, the first question is not which one hears better. It is whether your transcripts should keep every "uh, you know" the speaker said. We ran into that while putting Underdog Bark 3.0 Pro next to Qwen3-ASR-1.7B on one RTX 3090 on our cloud.
On 40 English clips drawn from the Open ASR Leaderboard test data, Bark got 6.28% of the words wrong and Qwen3-ASR-1.7B got 7.03%. Bark is 1,254 MB on disk, Qwen3-ASR-1.7B is 4,699 MB. Bark is the third link in a chain: NVIDIA's Parakeet TDT 0.6B v3 is the base, Moondream improved it, and Conway Research post-trained and compressed the result. The clips and the leaderboard itself come from the hf-audio team. We packaged it and did the counting. The per-set numbers and the method are in the full Bark 3.0 Pro vs Qwen3-ASR test write-up . Here is what matters when you build on it.
Split the error rate before you trust it
Word error rate adds up words heard wrong, words left out and words added.…