When building a desktop knowledge workspace that integrates local LLMs (Ollama) and on-device machine learning, the conventional shortcut is obvious: spin up an Electron wrapper, bundle an embedded Chromium runtime, and ship.
After all, almost every major desktop AI app in 2024β2026 is an Electron shell.
However, after running into severe memory ceilings and thermal throttling during heavy research sessions, we decided to build Knovum on a radically different stack: Tauri 2, Vue 3, and a compiled Rust backend .
Here is an honest engineering breakdown of what we gained, the hardest technical problems we had to solve (including running ONNX OCR on CPU without Python), and why we'll never go back to Electron.
1. The Real Cost of Electron: The 800MB Memory Baseline
Local AI introduces a resource constraint that web apps never faced:
Model weights live in physical memory (RAM / VRAM).
If a user runs a 7B or 8B parameter model via Ollama (e.g., Llama 3.2 or Qwen 2.5), that model demands 4.5GBβ6GB of RAM.β¦