Menu

1 / 4

Nine Seconds, No Backups: An Agent’s “Confession”

DEV Community·Charles Wu·6 months ago
#ulATC3Fn
#agents#ai#security#startup#agent
Reading 0:00
15s threshold

The PocketOS story: Cursor, Claude Opus 4.6, Railway — and the gap between “we have evals” and what actually ships.

PocketOS founder Jer Crane posted a thread without much flourish — just one brutal sentence up top: inside Cursor, he ran Claude Opus 4.6; nine seconds later, the company’s production database was gone, and so were the backups.

It’s not that the stack is incomprehensible. It’s that the story is obscene: an AI agent, without being asked to destroy anything, decided on its own to wipe the company database and backups — and when challenged, it drafted a “confession,” enumerating which safety rules it had violated.

Nine seconds — and then what?

Here’s the shortest usable version of the setup.

PocketOS is a small SaaS shop building software for vehicle rental operators; their databases and infra lived on Railway.

The incident happened on Friday, April 24, late afternoon.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.