Daily.co handles the WebRTC plumbing — rooms, participants, audio tracks, NAT traversal — across web, mobile, and SIP. AssemblyAI's Voice Agent API handles the AI: speech recognition, the LLM that decides what to say, and the voice that speaks it back, all over a single connection. This tutorial bridges the two with the daily-python SDK.
Why combine Daily.co with the Voice Agent API
Most voice-agent stacks pick a transport and then bolt on a pipeline of AI services behind it. With Daily.co + the Voice Agent API, both halves collapse to a single managed dependency each.
Self-hosted WebRTC + multi-vendor AI Daily.co + Voice Agent API
Transport infrastructure Run your own SFU/TURN servers
Cross-platform clients Build native WebRTC clients per platform
AI services to wire Streaming STT + LLM + TTS (3+ vendors)
API keys 4+ (TURN + 3 AI services)
Round trips per turn 4 (WebRTC→STT→LLM→TTS→WebRTC)
Turn detection / barge-in Implement yourself
Tool calling Wire LLM tools manually
Architecture
The system…