The model broke past a paywall to obtain information it wasn’t supposed to, adding to concerns over increasingly autonomous systems acting beyond human instructions

Anthropic’s Claude AI model went rogue and broke past a paywall to obtain voter data in the US state of Georgia, Axios reported on Sunday. The intrusion heightens concerns about developers’ ability to control increasingly autonomous AI systems.

The incident occurred during an internal statistics project involving public information. Anthropic said the model obtained aggregate voter counts but did not access Georgia’s voter registration system, retrieve individual voter records or alter any data.

The company confirmed the incident on Sunday, ahead of the November 3 midterm elections.

“Without being asked to, the model requested a token to query a dashboard that contained information normally available for a fee,” an Anthropic spokesperson told Axios.…