Menu

I Built a Fully-Local Voice AI Assistant with a 3D Avatar — Here's What I Learned
📰

I Built a Fully-Local Voice AI Assistant with a 3D Avatar — Here's What I Learned

DEV Community: typescript·lujianfu2008·9 days ago
#uDYQSbd3
#devtotypescript#devto#dev#assistant#voice
Reading 0:00
15s threshold

For the past few months I've been building a personal AI assistant called Xiaoqingting ("Little Dragonfly"). Not a chat wrapper — a full desktop assistant: voice in, voice out, tools that actually touch my machine, multiple agents with different jobs, and a 3D anime avatar that talks to me.

Everything important runs locally. The LLM is the only cloud component.

It's open source: github.com/lujianfu2008/xiaoqingting

This post is the architecture tour and the honest lessons list — including the bugs that cost me full nights.

Architecture: Two Processes and a Contract

┌─────────────────┐ REST + WebSocket ┌─────────────────┐ │ @blm/desktop │ ◄──────────────────► │ @blm/server │ │ │ │ │ │ Electron client │ │ Fastify + SDK │ │ voice / chat / │ │ agents / auth │ │ tools / browser │ │ gateway / keys │ └─────────────────┘ └─────────────────┘

Enter fullscreen mode

Exit fullscreen mode

Two packages, one monorepo:

@blm/desktop — the Electron client.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.