
8/28/2025 · Will Allen, Pulkita Kini, Cam Whiteside
What this post added
Introduces AI Crawl Control (formerly AI Audit) to general availability, rebranding it to emphasize control over AI crawler access. Details the use of HTTP 402 ('Payment Required') status codes to facilitate licensing agreements between content creators and AI crawlers, allowing customization of messages for communication and commercial terms. Outlines plans for future enhancements to include structured data on content value, freshness, and licensing terms within 402 responses, and mentions the ongoing beta of 'pay per crawl' for automated monetization.