OpenAI to honor shared robots.txt signal for AI training preferences
OpenAI will honor a shared robots.txt signal that lets website operators communicate whether they want participating providers to use their site content for AI training. The change is intended to make it easier for sites to express training preferences across providers that agree to respect the signal.