Enterprise Streaming Multi-Datacenter Replication with Kafka | Confluent

What this post added

Introduces Multi-Datacenter Replication as a new Confluent Platform capability to automate data copying between Kafka clusters in different datacenters. Highlights limitations of MirrorMaker and details the features of the new solution: dynamic topic creation with matching partition counts, replication factors, and topic configurations; automatic topic resizing and reconfiguration; topic selection via whitelists, blacklists, and regex; support for secure Kafka clusters; scalability and fault tolerance via Kafka Connect API; and integration with Confluent Control Center. Explains the implementation using a Kafka source connector and Kafka Connect, and provides an example of an aggregation use case.