CLOUDFLARE SAYS AI’S FREE RIDE ON PUBLISHER CONTENT IS OVER AND WILL START BLOCKING SCRAPERS BY DEFAULT IN SEPTEMBER Cloudflare, the infrastructure company that routes a significant portion of the world’s web traffic, announced a major policy shift that will default to blocking AI crawlers from accessing ad-supported publisher content starting September 15, 2026. Under the new rules, any crawler that blends search, agent use and training data collection will be locked out of pages carrying advertising unless the site owner actively changes the default setting. More significant than the blocking mechanism is what Cloudflare is building to replace it. The company is launching a Pay Per Use system that compensates publishers when AI actually uses their content, not simply when a crawler fetches a page. The payment triggers on actual utilization rather than access, working initially with partners Ceramic.ai and You.com. When a publisher opts in, they receive payment when their content surfaces in AI search results or when a connected AI agent pulls from their material. The practical stakes are enormous. AI labs have trained their models on massive crawls of the open web without compensation to the publishers, news organizations and writers whose work provided the raw material. Cloudflare sits between those publishers and the crawlers and has now decided to use that position to force a reckoning. Other infrastructure providers will be watching closely to see whether the model holds. Keywords: Cloudflare AI content policy, AI pay for publisher content, AI web scraping payments, AI copyright compensation