I run language models on my own hardware, and the hard part was never running them. It was living with them. A terminal for quick questions, a separate web UI per server, history scattered everywhere. So I built Klepai: a free, open-source desktop app for macOS, Windows and Linux that gives self-hosted models one proper chat window. Version 0.0.1 (Alpha) is out.
Klepai by CrystalPlatforms
Klepai is a private, self-hosted LLM manager: a desktop chat app for macOS, Windows and Linux that connects to your own model servers over the LAN.
Ollama first-class + any OpenAI-compatible endpoint
Rich chat: streaming, markdown, code blocks, thinking blocks
Agent mode : your server models code in a project folder through built-in tools, with Claude Code and Codex CLI as ready-made extra brains
Everything local: SQLite, no accounts, no telemetry
Status: Klepai Alpha v.0.0.1 (in development) · see PRD.md
Updates
Update bundles are signature-verified against GitHub Releases: the app ships with the public key in…