OpenAI announced Monday the release of a new tool to detect child sexual abuse material (CSAM), including content generated by artificial intelligence .
The tool is a classifier that looks for visual signs of abuse in images. It then scores images to help human reviewers prioritize which of them warrant attention. OpenAI said its CSAM classifier is the first broadly available tool of its kind to include a specific signal indicating the image may be generated with AI.
This capability is becoming critical as AI-generated CSAM skyrockets.
A new analysis conducted by Childlight — Global Child Safety Institute at the University of Edinburgh found AI-related reports of CSAM increased globally by more than 8,400 percent from 2023 to 2025. Last year, the National Center for Missing & Exploited Children received more than 400,000 of these reports.…