An AI Index for all our customers

What this post added

Introduces AI Index, a new system for creating AI-optimized search indexes for customer domains, enabling discoverability and monetization of content for AI builders. It also introduces the Open Index, an aggregated layer of participating AI Indexes. The system leverages existing AI Search technology and introduces new APIs like MCP server, LLMs.txt, and pub/sub connections for real-time content updates. It integrates with AI Crawl Control and Pay per crawl for access management and monetization.