Website Security & Threat Management
Declare your AIndependence: block AI bots, scrapers and crawlers with a single click

Declare your AIndependence: block AI bots, scrapers and crawlers with a single click

7/3/2024 · Alex Bocharov, Santiago Vargas, Adam Martinetti, Reid Tatoris, Carlos Azevedo

What this post added

Introduced a one-click feature to block all AI bots and scrapers, leveraging global machine learning models to identify and block AI traffic, even when user agents are spoofed. This feature automatically updates with new bot fingerprints and is available to all customers. The post also details analysis of AI bot activity on Cloudflare's network, including popular AI bots by request volume and share of websites accessed, and discusses how website operators currently block AI bots.

Read the original post ↗