How Unity Built a Massive Data Infrastructure with Confluent Platform

What this post added

Unity migrated its massive data infrastructure from AWS to GCP, handling half a million to a million events per second, using Confluent Platform and Kafka. They employed Confluent Replicator for a safe, zero-downtime, zero-data-loss migration of petabytes of data. This transition enabled a move from batch processing to event streaming, reducing data latency significantly and improving the perceived stability of Kafka, leading to increased adoption for new event streaming systems and plans for ML model integration.