How Discord Indexes Trillions of Messages

This post details the evolution of Discord's message search infrastructure from indexing billions to trillions of messages. It describes the initial architecture using Elasticsearch sharded by guild/DM, the challenges encountered with growth, and the ongoing efforts to optimize indexing and querying for massive message volumes. The post highlights the need for continued development and optimization to handle the scale of Discord's message data.