News summarySina FinanceNov 1, 2026, 03:17 PM
OpenAI and Peers Announce Adoption of an AI Scraping Opt-Out Standard
OpenAI, Google, Microsoft, and Anthropic announced they would adopt a new standard allowing publishers to opt out of AI scraping of their websites. [[fact:fact-i1mzcroaj]] The standard lets content publishers state their preferences for AI model training use across multiple companies at once. [[fact:fact-sfnlocq3j]] Anthropic technical lead Kevin Kelley submitted the standard to the IETF, and it is set to be integrated into websites’ robots.txt files. [[fact:fact-kfgf0ak5h]] Anthropic has adopted the standard; OpenAI plans to implement it in the coming months, while Google and Microsoft are expected to support it next year. [[fact:fact-7ul1joixn]]