OpenAI, Google, Microsoft, and Anthropic will support a unified exit standard for AI crawling within robots.txt.
OpenAI, Google, Microsoft, and Anthropic have announced they will adopt a new standard allowing publishers to declare training preferences for multiple AI companies in a single policy token shared via robots.txt.
AI companies plan a shared training opt-out. Should you change robots.txt now?
The collected summary says four AI companies plan to adopt a shared training opt-out signal. Define the use you want to restrict and establish the published syntax and support before making a change; planned adoption is not full deployment.
Reading AnalysisReturn to original text
A short introduction is retained here; the full text from the source website is not reposted. For specific wording and subsequent updates, please refer to the original article.
Open AIHOT original