Built for the AWS Agent Experience Hackathon: Strands Decider . Decision pattern: Policy (also demonstrates Guardrails). Repo, live demo, and a 90 second video are linked at the end.
The bug nobody wants to talk about
Give an LLM agent a confident-sounding input and it will commit to things it has no business committing to. This is not a vibe, it is measured. A July 2026 paper (arXiv 2608.27167) put twelve frontier models in front of a professional-looking market panel and asked them to call a provably unpredictable outcome. Commitment jumped from 6.5% on the bare question to 54.0% once the input looked authoritative. The evidence was noise. The models acted anyway.
If you have shipped an agent with real tools, you have felt this. A user phrases a request confidently, and the agent issues the refund, closes the account, or runs the destructive tool, because nothing in the loop had a calibrated sense of whether it should. The usual fix is to ask a second LLM to double check.…