Take control of public AI application security with Cloudflare's Firewall for AI

What this post added

This post introduces Firewall for AI, an inline security solution that protects user-facing LLM-powered applications. It focuses on three key capabilities: discovering LLM-powered endpoints using heuristics like request path signatures, server-sent events, and origin response bitrate; detecting Personally Identifiable Information (PII) in prompts using a hybrid approach of regex and Named Entity Recognition (NER) models deployed via Workers AI with Presidio; and mitigating risks by integrating with Cloudflare's WAF for policy enforcement. The post details the technical challenges and solutions for discovering LLM endpoints and the architecture for PII detection and mitigation.