POLICY · REGULATION · #2843
OpenAI to honor shared robots.txt signal for AI training preferences
OpenAI will honor a shared robots.txt signal that lets website operators communicate whether they want participating providers to use their site content for AI training. The change is intended to make it easier for sites to express training preferences across providers that agree to respect the signal.
KEY POINTS
- OpenAI will honor a shared robots.txt signal that lets website operators communicate whether they want participating providers to use their site content for AI training.
- The change is intended to make it easier for sites to express training preferences across providers that agree to respect the signal.
- This affects how web content may be included in AI training datasets and could give site operators clearer, standardized control over training use across participating providers.
WHY IT MATTERS
This affects how web content may be included in AI training datasets and could give site operators clearer, standardized control over training use across participating providers.