How Unity Built a Massive Data Infrastructure with Confluent Platform

This post details Unity's successful migration of petabytes of data and operations from AWS to GCP using Confluent Replicator. It highlights the use of Confluent Platform and Apache Kafka for their data infrastructure, handling approximately half a million events per second with peaks of a million events per second, and achieving zero outages resulting in money loss. The migration was completed over a few months with Confluent Professional Services' guidance on Kafka architecture and best practices, ensuring safety and speed to mitigate doubled cloud costs. The post also touches upon the shift from batch to event streaming models, reducing data latency from two days to 15 minutes, and the improved reliability of Kafka on Confluent Platform, leading to teams building more event streaming systems and exploring its use for faster machine learning model training.