Post Mortem: The Ugly, the Bad & the Good
Feb 24, 2012Matthew Prince
Summary
This post details a major incident involving a failed DNS infrastructure update that caused significant downtime for customers. It highlights the challenges of DNS propagation, the impact of external caches (like ISPs), and how concurrent DDoS attacks exacerbated the issue. The post also discusses the immediate response, the process of recovery, and the implementation of new safeguards to prevent similar incidents, particularly focusing on improving DNS update speed and hardening against DNS-directed DDoS attacks.
More from the Website Security & Threat Management trail
- We tested our own WAF with frontier AI models. Here’s what we found
- When scanners miss the attack: how Cloudflare Client-Side Security protects storefronts
- Introducing automatic remediation policies with Cloudflare CASB
- Introducing context-aware vulnerability discovery and remediation with Cloudflare Managed Defense and OpenAI Daybreak Models
- Introducing Adaptive Intelligence: undermining the economics of every bot attack