OpenAI adds CSAM image classifier and 24-hour ChatGPT suspensions for abuse-seeking prompts
OpenAI announced an image classifier to detect child sexual abuse material, including AI-generated images, plus ChatGPT warnings and 24-hour suspensions for users who try to access such content, and new tools for developers and law enforcement.
1 / 2
The story, neutrally told
Centre · 1OpenAI announced a set of tools to combat child sexual abuse material (CSAM): an image classifier, warnings and temporary blocks in ChatGPT, guidelines for developers, and tools for law enforcement. TechCrunchN “These features include a new image classifier to detect CSAM, warnings and temporary blocks to prevent users from creating or accessing content that sexualizes children, a new guideline for developers, and a set of tools for law enforcement.” Read at TechCrunch ↗ Mixed · 2The classifier can detect CSAM images, including AI-generated ones, by looking for visual signs of abuse in images not seen before and assigning a score to guide human reviewers. TechCrunchN “The tool looks for visual signs of abuse in images not seen before and assigns a score that can give an indicative direction to reviewers about dealing with CSAM.” Read at TechCrunch ↗ Fox NewsR “That allows it to flag suspected abuse even when the content has never been identified before.” Read at Fox News ↗ Mixed · 2OpenAI says it developed the classifier with the National Center for Missing and Exploited Children (NCMEC) and is offering it at no cost, through its API, to select or vetted organisations; it is working with Tech Coalition and ROOST to share access. TechCrunchN “OpenAI said that it developed this classifier with the National Center for Missing and Exploited Children (NCMEC), and it is working with Tech Coalition and ROOST to share access to the tool.” Read at TechCrunch ↗ Fox NewsR “The company is offering the classifier at no cost to vetted organizations through its API.” Read at Fox News ↗
Mixed · 2In early testing with partners, OpenAI says the classifier flagged 48% fewer images while finding the same amount of abusive material, and flagged images were about twice as likely to be abusive. TechCrunchN “the classifier flags 48% fewer images while finding the same number of abusive images, reducing the work of reviewers” Read at TechCrunch ↗ Fox NewsR “Pictures flagged by the new classifier were also about twice as likely to contain abuse.” Read at Fox News ↗ Right · 1Fox News adds results from outside organisations: AI platform Fal said reviewers confirmed 72% of high-confidence flags as previously unidentified CSAM, and SafetyKit said the tool detected 90% of cases involving drawings or animations that sexualize children. Fox notes these figures come from OpenAI and participating organisations, and that independent testing will be needed. Fox NewsR “AI platform Fal said its reviewers confirmed 72% of high-confidence flags as previously unidentified CSAM.”“These results come from OpenAI and participating organizations. Independent testing will help determine how reliably the technology performs across different platforms.” Read at Fox News ↗ Centre · 1In ChatGPT, users attempting to access material that sexualizes children will see a warning, be directed to specialised support to stop harmful behaviour, and have their account suspended for 24 hours; repeated offences could lead to permanent removal. ChatGPT already blocks CSAM content and related requests. TechCrunchN “ChatGPT will show an alert to users attempting such prompts, direct users towards specialized support to stop harmful behaviour, and also suspend the account for 24 hours as a warning.”“It said that repeated offences could lead to the account being removed permanently.” Read at TechCrunch ↗
Right · 1Fox News adds that OpenAI will also remove the flagged conversation, that repeated violations may bring longer restrictions or reports to authorities, and that the warnings target attempts to find abusive material, while existing policy already bans accounts and reports attempts to generate or upload CSAM to NCMEC. Fox NewsR “OpenAI says it will remove the flagged conversation and pause access to ChatGPT for 24 hours.”“Under its existing policies, OpenAI says it bans accounts and reports attempts to generate or upload CSAM to NCMEC.” Read at Fox News ↗ Centre · 1OpenAI says it shaped the warning messages with organisations and researchers including Protect Children, the Lucy Faithfull Foundation, and Joel Scanlan of the University of Tasmania, who independently evaluated a trial of deterrent messages. TechCrunchN “Protect Children, the Lucy Faithfull Foundation, and Joel Scanlan at the University of Tasmania, who independently evaluated a trial of deterrent messages.” Read at TechCrunch ↗ Mixed · 2OpenAI is publishing guidelines for developers to prevent, detect and report CSAM, and says early testing has helped a number of developers adopt child safety tooling and register to report to NCMEC. It is also giving child-safety law enforcement AI-powered tools, training and a field guide; Fox adds that OpenAI has joined the Tech Coalition's Lantern programme and that a first tool helps authorised teams review lengthy chat logs obtained through legal processes. TechCrunchN “It is also providing training to investigators along with a field guide on how to use AI.” Read at TechCrunch ↗ Fox NewsR “The company says it has begun participating in the Tech Coalition's Lantern program” Read at Fox News ↗
Mixed · 2TechCrunch places the announcement against lawsuits blaming OpenAI's technology for harming users, especially children, Common Sense Media's 'unacceptable risk' label for teens, and misuse of Grok to create sexualized imagery of children. Fox cites NCMEC data that its CyberTipline received more than 400,000 reports involving generative AI in 2025, though not all involved creating or sharing AI-generated abuse material. TechCrunchN “OpenAI has had several lawsuits against the company blaming its technology for harming users, especially children.” Read at TechCrunch ↗ Fox NewsR “its CyberTipline received more than 400,000 reports involving generative AI in 2025” Read at Fox News ↗ Right · 1Whether the warnings actually deter future abuse remains to be shown; Fox says this will require continued evaluation. Fox NewsR “However, whether these interventions prevent future abuse will require continued evaluation.” Read at Fox News ↗
Every sentence links to the reporting it rests on. The pill in front of each says where its sources sit: Left, Centre or Right when one side supplies at least half of them, Mixed when they are evenly split. The number is how many outlets it cites.
Left0 outlets
No left outlet in our sources has covered this story yet.
Centre1 outlet
- Framing
- A concise news report of the announcement, setting it against lawsuits over harm to children and the misuse of other chatbots such as Grok.
- Emphasis
- The list of new tools, the 48% test result, partners and the surrounding legal and safety criticism of OpenAI.
- Leaves out or plays down
- Does not give outside partners' results, NCMEC's report figures, or the caveat that results are self-reported.
- For example
-
“OpenAI has had several lawsuits against the company blaming its technology for harming users, especially children.” — TechCrunch
Right1 outlet
- Framing
- A Fox News CyberGuy consumer-advice column opening with a hypothetical teen deepfake scenario and addressing parents, ending in an endorsement of OpenAI's steps.
- Emphasis
- How the tool works, parent takeaways, partner results (Fal, SafetyKit), NCMEC's 400,000 reports figure and the caveat that results are self-reported.
- Leaves out or plays down
- Does not mention the lawsuits against OpenAI, Common Sense Media's rating or the Grok imagery cases.
- Charged language
- “The scale of the problem is alarming”
What every side reports
- OpenAI announced a classifier to detect CSAM, including AI-generated images, developed with NCMEC.
- The classifier is offered free through OpenAI's API to select/vetted organisations.
- In early testing it flagged 48% fewer images while finding about the same amount of abuse material.
- ChatGPT will warn users attempting to access CSAM and suspend the account for 24 hours.
- Repeated offences may lead to harsher consequences, including permanent account closure.
- OpenAI is also issuing developer guidelines and tools and training for law enforcement.
Where accounts differ
-
What happens to the account on repeat offences
- Centre
- TechCrunch: repeated offences could lead to permanent removal of the account.
- Right
- Fox News: repeated violations may lead to longer restrictions or permanent closure, and could result in reports to authorities.
OpenAI organisation
Presents the package as a set of protections: a classifier built with NCMEC, deterrent warnings with suspensions, and tools for developers and investigators, backed by early test results it reports itself.
“OpenAI today announced new tools to combat child sexual abuse material (CSAM) amid growing safety concerns around the use of AI tools.” — TechCrunch
“OpenAI says its early testing produced encouraging results.” — Fox News
ChatGPT product
ChatGPT will interrupt abuse-seeking prompts with a warning and support referral and pause the account for 24 hours, on top of existing blocks on CSAM requests.
“The app already blocks CSAM content and requests related to it.” — TechCrunch
Left0 articles
No coverage yet.
Centre1 article
-
OpenAI releases a new image classifier and ChatGPT warnings to combat CSAM
Neutral Straight product-news report listing the tools and results, with context on lawsuits and criticism of OpenAI.

Right1 article
-
OpenAI child safety tools target AI-generated abuse
Sympathetic Consumer-advice column for parents that explains the tools, flags that results are self-reported, and endorses OpenAI's steps.

- 16 Nov 17:00 First TechCrunchN OpenAI releases a new image classifier and ChatGPT warnings to combat CSAM
- 16 Nov 17:00 +1m Fox NewsR OpenAI child safety tools target AI-generated abuse
Times are when each article was published, or when we first saw it if the outlet gave no time.
Ask about this story
Loading…