Menu

1 / 9

What I Learned Building a Lightweight Local AI Agent

DEV Community·Evgenii Engineer·6 months ago
#EhpEfbrl
#from#ai#llm#skill#openlight
Reading 0:00
15s threshold

When I wrote the first post about openLight in March, the project was a 1.0 commit, a Raspberry Pi, and a Telegram bot. I had a Pi running tailscale, a small Matrix homeserver, and I was tired of ssh [email protected] && systemctl status … from a phone keyboard. So I wrote a Go binary that talked to a Telegram bot, kept state in SQLite, and could fall back to a local Ollama model when the rule-based router didn't recognize the request.

Two months later the binary is still ~25 MB, still one config file, still SQLite. Almost everything underneath has been rewritten at least once. The identity I'd write today is shorter than anything in the v0.0.1 README:

openLight is a lightweight operational layer for personal servers, not a generic AI assistant.

That sentence didn't exist in March. It took two months of building, deleting, and re-building to find it. This is the retrospective I wish I had read before starting.

Five moments where it earned its keep

A train station, 11pm. Synapse is down on the VPS.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.