For the past few months I've been building a personal AI assistant called Xiaoqingting ("Little Dragonfly"). Not a chat wrapper — a full desktop assistant: voice in, voice out, tools that actually touch my machine, multiple agents with different jobs, and a 3D anime avatar that talks to me.
Everything important runs locally. The LLM is the only cloud component.
It's open source: github.com/lujianfu2008/xiaoqingting
This post is the architecture tour and the honest lessons list — including the bugs that cost me full nights.
Architecture: Two Processes and a Contract
┌─────────────────┐ REST + WebSocket ┌─────────────────┐ │ @blm/desktop │ ◄──────────────────► │ @blm/server │ │ │ │ │ │ Electron client │ │ Fastify + SDK │ │ voice / chat / │ │ agents / auth │ │ tools / browser │ │ gateway / keys │ └─────────────────┘ └─────────────────┘
Enter fullscreen mode
Exit fullscreen mode
Two packages, one monorepo:
@blm/desktop — the Electron client.…