Someone spends an evening reading "best local LLM" roundups, settles on whichever name keeps showing up at the top, downloads it, and points it at the thing they actually needed help with that week, say, cleaning up a Python script. But it's mediocre at that. Not broken, just unimpressive, in the specific way a generalist is unimpressive at a specialist's job. The model wasn't bad. It was never a coding model to begin with, and nothing in the roundup that recommended it ever said so.

That mismatch is the entire reason this guide exists. "Best" was never a single ranking, and treating it like one is how a genuinely capable model ends up feeling disappointing for no fault of its own. This article works the other way around: what a local language model actually is, why running one on your own hardware is worth doing at all, and then, model by model, with real cited proof rather than vibes, exactly what each one is good at.…