Kafka Connect: How to Increase Throughput on Source Connectors

This post provides detailed guidance on tuning Kafka Connect source connectors to increase throughput. It covers what aspects of a connector can be tuned (connector configurations, producer configurations) and what cannot (converter, transformations). Specific producer configurations like batch.size, linger.ms, buffer.memory, and compression.type are explained with examples. It also lists essential JMX metrics for monitoring connector, broker, and producer performance, and provides a walk-through example using a JDBC Source connector to demonstrate the tuning process.