OpenAI releases a CSAM image classifier and adds warning and ban mechanisms to ChatGPT
Automated summary · Based on collected summaries; not individually verified
Prepared by HotAI
What happened
OpenAI unveils new tools to combat child sexual abuse material (CSAM), including an image classifier capable of detecting AI-generated images developed in partnership with NCMEC. The tool is being made available via API to select enterprises at no cost. In early testing, the classifier identified fewer images flagged as violations compared to a control group of the same size, while the proportion of violations among flagged images doubled.
Background
What is an API? How applications request functions and data
An API defines how programs call functions or exchange data through agreed inputs, results and errors. It need not be a web interface or AI-specific. An address does not grant access and a successful status does not validate business content; check the requested result.
What is a token? Its relationship to text length, usage, and context budgets
A token is a discrete unit used to process text, potentially a character, part of a word, or punctuation depending on the tokenizer. It is not a fixed number of Chinese characters or English words. Budgets and usage often use tokens, but accounting differs by model and interface. Use the target model’s counting method and inspect reported usage.
Reading notes
The event summary comes from collected excerpts. Background passages quote existing HotAI articles to explain terms and do not establish new facts about this event. Check the original sources for product results, conditions and subsequent updates.
Original source
Sources and collection timeline
| Source | Report title | Original publication time | Collected by HotAI |
|---|---|---|---|
| techcrunch.com | OpenAI releases a CSAM image classifier and adds warning and ban mechanisms to ChatGPT | 2026-11-17 01:00 | 2026-11-17 01:37 |