To build a better Internet in the age of AI, we need responsible AI bot principles. Here’s our proposal.
Sep 24, 2025Leah Romm, Sebastian Hufnagel

Summary
This post proposes five responsible AI bot principles: public disclosure, self-identification (with a future emphasis on cryptographic verification via Web Bot Auth), declared single purpose, respect for preferences, and acting with good intent. It details the rationale behind these principles, highlighting the impact of AI bots on web publishers and the need for consensus among stakeholders. It also references Cloudflare's existing efforts in bot management and AI crawler policies.
More from the Artificial Intelligence Integration & Impact trail
- Introducing Clef-omni with full multimodality, plus a faster Clef and a cheaper Clef-flash
- Introducing Web Search API via AI Gateway
- Introducing Clef: our open-source decision models, and new RL fine-tuning platform
- One year later: Sovereign AI and the fight for choice
- AI Search is now generally available