Menu

1 / 3

My Local AI Agent Needed a Bigger Brain, So I Gave It a Decentralized GPU

#hackernoon#technology#model#nosana#zkzkagent
Reading 0:00
15s threshold

this is my second progress update for the Decentralize AI Hackathon by HackerNoon and Nosana.

In my first article, I Built a Local AI Linux Assistant That Doesn't Rely on the Cloud , I introduced zkzkAgent: an AI agent that manages a Linux machine through plain language and runs entirely on my own hardware with Ollama.

That is still how it works by default. But running everything locally has a ceiling, and I kept hitting it.

The Problem: The Model That Fits on a Laptop

zkzkAgent doesn't push every request through one big prompt. A small classifier node first decides what kind of request it is: a question to answer, a single action to run, or a task that needs a plan. Plans are where the agent is most useful, and they are also where the model works hardest. To scaffold a project, the planner writes every step, including the full content of every file, before anything runs.

On my laptop, I run a 2B model ( qwen3.5:2b ). It fits in memory and answers quickly. A 27B model does not fit.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.