#Localai

LocalAI is the open source AI engine. Run any model, LLMs, vision, voice, image and video, on any hardware. No GPU required.

Gemma 4 31B is the new local baseline on M4 24GB. omlx ships LLM inference as a menu-bar app. The Apple Silicon substrate just got real.

We migrated because our AI orchestrator became something that needed tests, trust boundaries, and...