
2/4/2025 · David Belson
What this post added
Introduced a new dedicated "AI Insights" page on Cloudflare Radar, expanding on existing AI bot and crawler traffic graphs. The new page incorporates additional metrics to understand AI-related trends from multiple perspectives, including: relative popularity of publicly available Generative AI services based on 1.1.1.1 DNS resolver traffic, usage of robots.txt directives to restrict AI bot access to content, and open source model usage as seen by Cloudflare Workers AI. The AI Insights page provides visibility into AI bots and crawlers traffic trends, the popularity of Generative AI services, analysis of robots.txt files for AI user agents, and the popularity of models and tasks on Workers AI.