
9/27/2024 · Adam Martinetti, Harsh Saxena, Gauri Baraskar, Carlos Azevedo, David Belson
What this post added
This post introduces three key advancements in Cloudflare's AI and bot management capabilities: 1. AI Assistant for WAF Rule Builder: A new feature that allows users to generate WAF custom and rate-limiting rules using natural language prompts. This assistant provides a foundation for rules that can be further refined. 2. AI Bot Traffic Insights on Cloudflare Radar: The Cloudflare Radar platform now includes a graph on its Traffic page displaying insights into AI bot and crawler traffic trends over selected time periods, based on the ai.robots.txt list. Time series and summary data are available via the Radar API. 3. Enhanced AI Bot Blocking Capabilities: The existing AI bot blocking feature has been updated to include 27 signatures of AI bots that do not respect robots.txt or crawl rates. This enhanced rule logic is now powered by Cloudflare managed rules, enabling real-time updates. The ML model for bot detection has been improved with additional heuristics, increasing detection rates and certainty. These updates have led to a significant reduction in AI bot traffic.