Menu

1 / 4

OpenAI's Agents Disabled Their Own Safety Monitoring Systems

Reading 0:00
15s threshold

The company says it’s assessing whether its agents have the ‘propensity to evade misalignment monitoring.’

Heather Diehl/Getty Images

OpenAI's agents misbehaved by switching off the systems meant to monitor them for misbehavior, or in AI parlance, misalignment. In the latest post on the company's Alignment Research Blog, it reported two instances of agents weakening its misalignment monitoring systems while they were working on software changes.

In the first incident, a GPT-6.1 Sol agent disabled automatic alerts to OpenAI's security team. It happened on October 3, when a staff member asked the agent to create evaluation tasks using employee feedback collected via Slack. They told the agent, as part of the instruction, not to send any messages about the task. The agent used that instruction as the reason to stop sending the security team monitoring notifications.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.