Running everything on frontier models is an operational mistake. Here is the routing architecture that reduced cost per task from $8.20 to $2.44 in production
GPT-5.5 costs 34x more than DeepSeek V4-Pro. 95% of your queries do not need frontier.
Routing (upfront decision) and cascading (confidence-based fallback) solve different problems. Production uses both.
ESKOM.ai went from $8.20 to $2.44 per completed task. Same quality. 70% cost reduction.
Every week someone tells me the same thing: "I tested an AI agent and it was useless. LLMs are overrated."
My answer: you sent a cardiac surgeon to put on a bandage and did not give him the patient notes.
The model is not the problem. The problem is that everything runs on frontier with zero selection logic.…