
5/4/2022 · Dr. Jan Henrik Ziegeldorf
What this post added
This post details how Aedifion uses Confluent Cloud for building automation and IoT analytics. It covers their requirements for scalability, security, and availability, their choice of Apache Kafka and Confluent Cloud, and the setup of their data pipeline. Key technical aspects include using Confluent REST Proxy for HTTP-only environments, a strict topic naming schema for access control and tenant separation, and self-built stateless connectors for ingesting data into SQL and NoSQL databases. The post highlights the advantages of Kafka as a buffer and its replay capabilities, and mentions a minor hurdle with MQTT-native hardware while awaiting Confluent's MQTT Proxy.