
1/26/2022 · Venkatesh Shanbhag
What this post added
This post presents a reference architecture and implementation guide for building IoT pipelines using Confluent and MongoDB. It details two solution architectures: 'thick edge' for large industries and 'thin edge' for businesses with smaller devices. For thick edge, it describes aggregating data at the edge, pushing it to Confluent Platform using connectors (MQTT/REST), storing it transiently in Kafka for edge processing, and replicating it to Confluent Cloud. For thin edge, data is directly published to Confluent Cloud. A cash logistics use case is elaborated, demonstrating the implementation with Confluent Cloud, MongoDB Realm, time series collections, and database triggers. It includes ksqlDB queries for data transformation and connector configurations for writing data to MongoDB Atlas (both time series and geospatial collections). The post also highlights the use of MongoDB Realm Sync for mobile applications and MongoDB Webhooks for accessing time series data.