Kafka Broker and Streams Enhancements
Provisioned Mode for Lambda's Kafka ESM: New Controls and Autoscaling

Provisioned Mode for Lambda's Kafka ESM: New Controls and Autoscaling

2/12/2025 · Braeden Quirante

What this post added

Introduces Provisioned Mode for AWS Lambda's Kafka Event Source Mapping (ESM), enabling granular control over throughput via minimum and maximum event pollers. This mode simplifies networking by eliminating the need for PrivateLink or NAT Gateway, and provides responsive auto-scaling based on offset lag. Performance benchmarks show significant improvements in message processing time compared to the default On-Demand mode, with specific scenarios demonstrating up to 78.57% faster backlog draining.

Read the original post ↗