Cloudflare

How we improved DNS record build speed by more than 4,000x

May 25, 2022Alex Fattouche
How we improved DNS record build speed by more than 4,000x
SummaryAI, from the source post

Introduced a per-record build type for the DNS Zone Builder, complementing the existing full build type. This involved creating a new Kafka event pipeline for record changes, separating the Zone Builder into distinct scheduler types (full and per-record), implementing a new Quicksilver interface for the per-record scheduler, and ensuring locking between schedulers to prevent stale data overwrites. Addressed a bug where record name changes led to stale records in Quicksilver by treating updates as separate create and delete events. This resulted in a 150x average improvement in build times and a 4250x improvement for large zones.

More from the DNS Infrastructure & Naming Conventions trail