Menu

OpenAI Launches AI Tool to Detect Child Abuse Images
📰

OpenAI Launches AI Tool to Detect Child Abuse Images

Reading 0:00
15s threshold

AI-generated child sexual abuse material is creating new challenges for online safety teams, particularly when images have never been seen or flagged before.

OpenAI has introduced an image classifier designed to identify potential child sexual abuse material (CSAM), including AI-generated images. The company says early testing reduced the number of images requiring human review by 48% while identifying roughly the same amount of abusive material as its existing system.

The tool is being offered free through an API to vetted organizations, with support from the National Center for Missing & Exploited Children (NCMEC).

OpenAI is also introducing stronger ChatGPT interventions for users seeking material that sexualizes children, expanding its efforts beyond detection to prevention and enforcement.

Partner evaluations produced additional findings, although the organizations measured different outcomes and the results should not be treated as directly comparable.

The partner testing produced additional…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.