Rogue artificial intelligence (AI) agents operating outside human control and regularly improving themselves pose a threat to human civilisation, experts warn in a new report released on Tuesday.
Big Tech firms, including OpenAI , Anthropic , Google DeepMind , and Meta have all disclosed that over the Summer of 2026 , their AI agents evaded human oversight during cybersecurity evaluation tasks and attacked real-world organisations.
In July, OpenAI’s rogue AI compromised user accounts at Hugging Face and tested the site for security vulnerabilities.
Google also disclosed that its Gemini AI model hacked three companies during cybersecurity evaluations in May.
These are examples of rogue AI running outside human control to pursue fixed goals, but there can also be agents that pursue open-ended, evolving survival, researchers say.
Such “sovereign” AI agents may “pursue open-ended, evolving survival”, and if they are “not already possible, they will be soon”, according to the latest report by the bipartisan…