this is my second progress update for the Decentralize AI Hackathon by HackerNoon and Nosana.
In my first article, I Built a Local AI Linux Assistant That Doesn't Rely on the Cloud , I introduced zkzkAgent: an AI agent that manages a Linux machine through plain language and runs entirely on my own hardware with Ollama.
That is still how it works by default. But running everything locally has a ceiling, and I kept hitting it.
The Problem: The Model That Fits on a Laptop
zkzkAgent doesn't push every request through one big prompt. A small classifier node first decides what kind of request it is: a question to answer, a single action to run, or a task that needs a plan. Plans are where the agent is most useful, and they are also where the model works hardest. To scaffold a project, the planner writes every step, including the full content of every file, before anything runs.
On my laptop, I run a 2B model ( qwen3.5:2b ). It fits in memory and answers quickly. A 27B model does not fit.…