Forget IPs: using cryptography to verify bot and agent traffic
May 15, 2025Thibault Meunier, Mari Galicer

Summary
This post introduces two proposals for authenticating bot and agent traffic: HTTP Message Signatures (RFC 9421) and request mTLS. It details how these mechanisms work, including the use of `Signature-Input` and `Signature-Agent` headers for HTTP Message Signatures, and provides examples of how agents can generate these signatures using libraries like `web-bot-auth` and Chrome's `webRequest` API. The post also discusses the limitations of existing verification methods (User-Agent and IP addresses) and highlights the benefits of cryptographic signing for improved bot identification and control.
More from the Website Security & Threat Management trail
- We tested our own WAF with frontier AI models. Here’s what we found
- When scanners miss the attack: how Cloudflare Client-Side Security protects storefronts
- Introducing automatic remediation policies with Cloudflare CASB
- Introducing context-aware vulnerability discovery and remediation with Cloudflare Managed Defense and OpenAI Daybreak Models
- Introducing Adaptive Intelligence: undermining the economics of every bot attack