AI agent crawlers, which fetch web pages in real time on behalf of users, will be subject to new restrictions starting September 15, 2026. Cloudflare announced this change on July 1, highlighting that while coverage has largely centered around Google, the real implications lie in the requirements for those developing AI agents and the adjustments […]
