OpenAI has launched a CSAM classifier to help child abuse hotlines filter AI-generated deepfake content.
Automated summary · Based on collected summaries; not individually verified
Prepared by HotAI
What happened
OpenAI has launched a classifier capable of identifying Child Sexual Abuse Material (CSAM) and flagging whether content was generated by AI. The tool reports a 48% reduction in false positives and doubles the probability of detecting images containing abuse material. It is freely available to vetted organizations and represents the first widely accessible CSAM classifier with AI generation labeling. Users attempting to generate such content via ChatGPT's image generator will face a 24-hour access suspension and a warning that may lead to a permanent ban.
Background
What is a prompt? Writing task instructions, references, and input boundaries
A prompt is model input expressing a task or context, ranging from a short request to references and examples. Interfaces may include roles and multimodal content. Clear prompts help define a task but do not guarantee capability or turn missing information into verified facts.
What is a token? Its relationship to text length, usage, and context budgets
A token is a discrete unit used to process text, potentially a character, part of a word, or punctuation depending on the tokenizer. It is not a fixed number of Chinese characters or English words. Budgets and usage often use tokens, but accounting differs by model and interface. Use the target model’s counting method and inspect reported usage.
Reading notes
The event summary comes from collected excerpts. Background passages quote existing HotAI articles to explain terms and do not establish new facts about this event. Check the original sources for product results, conditions and subsequent updates.
Original source
Sources and collection timeline
| Source | Report title | Original publication time | Collected by HotAI |
|---|---|---|---|
| theverge.com | OpenAI has launched a CSAM classifier to help child abuse hotlines filter AI-generated deepfake content. | 2026-11-17 03:23 | 2026-11-17 03:42 |