
6/1/2016 · Duncan Pauly
What this post added
Introduces a new Kafka Connect sink connector for PostgreSQL, detailing its implementation for streaming Kafka messages into PostgreSQL-compatible databases. Explains the connector's architecture, use cases, performance metrics (e.g., 200,000+ messages/sec), JSON parsing mechanism with path extraction, database connection configuration, and three delivery modes (fastest, guaranteed, synchronized) with a focus on achieving exactly-once semantics by storing Kafka offsets within database transactions. Also covers buffer size configuration and a setup walkthrough.