The Simplest Useful Kafka Connect Data Pipeline in the World – Part 3

What this post added

This post introduces and demonstrates the use of Single Message Transforms (SMTs) in Kafka Connect. It covers setting keys for data from the JDBC Source Connector, adding metadata for data lineage (topic name, source details), field masking and blacklisting, and message routing using regular expressions and timestamps. It also provides configuration examples and discusses potential issues with Elasticsearch integration.