An AI Index for all our customers

This post introduces AI Index, a new capability that automatically creates AI-optimized search indexes for customer domains. It provides APIs for AI builders to discover and retrieve web content, including MCP server, search API, LLMs.txt, bulk data API, and pub/sub subscriptions. It also introduces the Open Index, an aggregated layer of participating AI Indexes. Monetization options like Pay per crawl and x402 integrations are highlighted. The system leverages existing AI Search technology for index creation and AI Crawl Control for access management.