Automatic Audit Logs: new updates deliver increased transparency and accountability

What this post added

Introduced Automatic Audit Logs, a new system that standardizes and automates audit log generation across Cloudflare products. This system leverages an API Gateway, Audit Log Redactor Workers, OpenAPI schemas for data redaction, and an Ingestor service to process and enrich logs. Key technical details include streaming HTTP requests via RPC, using OpenAPI schemas to identify and redact sensitive information, and a data pipeline involving Logfwdr, Logreceiver, and Buftee buffers. The Ingestor service transforms requests into standardized audit log records, and logs are enriched with user and authentication details before being stored. The system currently stores 30 days of logs, with plans to extend this to 18 months.