AI agents at OpenAI could have hidden hundreds of their own actions from the OpenAI monitoring system, outside evaluators found. That exploit was one of several flaws the safety nonprofits METR and Redwood Research reported on Thursday.

Each group sent one researcher inside OpenAI from 21 July to 11 August. They could see internal code, documentation and the monitor’s prompts, and they interviewed about a dozen staff, METR said . They worked on OpenAI devices that “never left the premises” and had an escort on site.

OpenAI told the evaluators it has patched every flaw that affected its production safeguards. METR and Redwood said they have not evaluated that claim. TNW has not independently verified the findings.

Gaps in what the monitor saw

The system uses an AI model to review what OpenAI’s internal agents do and to flag signs of misalignment for human review. Misalignment is when a model acts against what its makers intend.…