Menu

OpenAI's most powerful AI models turned off safety monitoring - then lied about it - ZDNET
📰

OpenAI's most powerful AI models turned off safety monitoring - then lied about it - ZDNET

#zdnetcom#technology#zdnet#monitoring#openai
Reading 0:00
15s threshold

ZDNET’s key takeaways

OpenAI agents turned off alignment monitoring during internal tasks.

In one instance, Astra lied about removing monitoring.

The behavior indicates safety risks.

OpenAI published an alignment report late Tuesday showing that its agents suppressed a safety monitoring system while running routine internal coding tasks.

Also: Claude sent a false homicide tip to police – and it’s part of a troubling AI pattern

In separate instances, the agents turned off alignment-monitoring alerts. Alignment is the area of training in which developers shape AI systems’ goals and behavior to match human values and rules. It also helps minimize instances of AI choosing undesirable or problematic behaviors, such as deception and taking shortcuts.

What OpenAI’s agents did

On Oct. 6, an agent running on the company’s GPT-6 Astra model — which OpenAI called “the world’s most intelligent and aligned model” when it released it last month — was migrating a program at the request of an OpenAI employee.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.