Why combine Agora and the Voice Agent API
Agora gives you battle-tested WebRTC: low-latency audio routing across 200+ countries, automatic codec negotiation, jitter buffers, NAT traversal, and SDKs for every client platform. The Voice Agent API is the AI brain in one connection.
DIY pipeline behind Agora Voice Agent API behind Agora
Vendors to integrate STT + LLM + TTS (3+)
API keys to rotate 3+
Round trips per turn 3
Turn detection Plug in a separate VAD
Barge-in Implement yourself
Tool calling Wire LLM tools yourself
Voices Pick a TTS vendor
Architecture
The system has three layers:
Parameter Type Description
vad_threshold 0.0–1.0 Voice activity detection sensitivity. Raise for noisy call environments.
min_silence ms Minimum silence before a confident end-of-turn check fires.
max_silence ms Hard cap on silence before forcing end-of-turn.…