People are trusting their AI agents with much more important work, but doing so still carries significant risks.
Just ask Jeremy Crane , founder of PocketOS, a startup that builds software for car rental businesses. Crane wrote a long post on X, detailing how a popular AI agent caused a 30-plus-hour outage for his business (and for businesses that rely on PocketOS software).
The agent in question was Cursor , using Anthropic's Claude Opus 4.6 model, one of the best-performing coding models in the world.
"This matters because the easy counter-argument from any AI vendor in this situation is 'well, you should have used a better model.' We did," Crane wrote. "We were running the best model the industry sells, configured with explicit safety rules in our project configuration, integrated through Cursor — the most-marketed AI coding tool in the category."
This Tweet is currently unavailable.…