“Anthropic, OpenAI, Google, and Microsoft will make it easier for publishers to opt out of being scraped”

Key points

• Publishers can opt out by using a shared robots.txt signal with participating AI providers.
• The signal will let multiple providers read publisher preferences for AI training use.
• Anthropic proposed the signal through IETF work and already supports it.
• OpenAI plans to implement in coming months; Google and Microsoft expect to follow next year.
• Meta lauded the move as important for publishers' control over content used for training.