How Roblox Uses AI to Moderate Content on a Massive Scale

This post details the evolution of Roblox's AI-powered content moderation systems over approximately five years, emphasizing the integration of ML models, scalable infrastructure, and human experts to handle massive volumes of user-generated content (chat messages, voice communication, assets). It highlights the system's principles: proactive moderation, real-time feedback, deploying AI only when it significantly outperforms humans in precision and recall at scale, and leveraging humans for continuous AI improvement, evolving and rare cases, complex investigations, and appeals. The system processes billions of creations and messages daily, with a median time to action of ten minutes for illegal content notices.