The development
What happened
OpenAI announced that it intends to honor a common robots.txt signal through which website operators can express preferences about using their content to train foundational generative AI models. The voluntary signal is intended to communicate one preference to participating providers, but it is not yet active in OpenAI’s systems.
Key facts
OpenAI says implementation is planned for the coming months, with details to follow.
Existing OpenAI crawler controls will remain in place and continue to apply.
OpenAI links the effort to the IETF AI Preferences working group and says it is participating in the standards discussion.
The context
Why it matters
A shared signal could reduce the need for website operators to maintain separate rules for each participating provider. Its practical effect remains uncertain until implementation details and provider participation are known; it is not a finalized standard or a universal commitment.