Hightouch published a benchmark this week (581 points on Hacker News) claiming that Jev, a cheap "decision model", gets you Claude Opus accuracy at 4x lower cost if you let it hand the uncertain cases to Opus. On their easy dataset that's true. On their hard dataset, the same setup is only about 1.8x cheaper than Opus alone. If you're trying to reduce Claude Opus API cost, the 1.8x number is the one you should plan around, because your production data is probably not the easy set.
I still think the pattern is worth copying. The headline is the part I'd discount.
One disclaimer up front: I didn't run any of this. Every number below comes from Hightouch's post (Nov 4, 2026), the Hacker News thread about it, and TypeSafe's Jev announcement . It's one company's benchmark on one task with synthetic data.
What was actually tested
The task is identity resolution.…