Optimizing Kafka Streams Applications | Confluent

What this post added

This post introduces the processor topology optimization framework in Kafka Streams starting from version 2.1.0. It details the evolution of topology generation, explaining the previous approach and highlighting inefficiencies in stateful operations. The post describes the refactoring that enables optimizations and introduces specific techniques available in Kafka 2.1. It also provides operational guidelines for enabling these optimizations and elaborates on how keyed stateful operators utilize data parallelism through repartition topics and sub-topology execution.