Menu

Where Does the Clock Start? Measuring Voice Agent Latency Honestly
📰

Where Does the Clock Start? Measuring Voice Agent Latency Honestly

DEV Community: typescript·Aqib·6 days ago
#IbH9yQo1
#devtotypescript#devto#dev#caller#first
Reading 0:00
15s threshold

When someone says their voice agent responds in 500 milliseconds, my first question is always the same: 500 milliseconds from when to when? This week I saw three different benchmarks report three different reply times for the same voice platform. None of them was necessarily wrong. They just started and stopped the clock at different points, and on a voice call those points can be far apart.

This post walks through where the time actually goes in a voice agent turn, why the number on your dashboard is usually smaller than what the caller feels, and how I'd set up measurement so the number means something.

The turn, step by step

Take a simple cascaded agent: speech-to-text (STT), then an LLM, then text-to-speech (TTS), connected to a phone call. The caller says "I want to check my order status" and stops talking.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.