Confluent at a Fully Disconnected Edge | Confluent Deploying Apache Kafka at the Edge with Confluent and AWS
May 12, 2022Joseph Morais
Summary
This post details the implementation of Apache Kafka at the edge using Confluent Platform and AWS Snowball Edge for disconnected environments. It outlines the preparation steps, including deploying the S3 source connector (using AWS Fargate for a serverless experience) and creating a custom AMI for Confluent Platform on Snowball Edge. The deployment process involves ordering a Snowball Edge device with the custom image and field deployment. It also discusses data processing at the edge using ksqlDB and the rotation scheduling for data syncing to the cloud via S3.
More from the Edge Data Ingestion and Processing trail
- Bridge AWS IoT Core and Confluent Cloud to Contextualize Your IoT Data
- Unlocking the Edge: Data Streaming Goes Where You Go with Confluent
- The Role of Data Streaming in Smart Cities | Confluent for IoT
- From the Cellar to the Cloud – How Aedifion is Driving Next-Generation Building Automation with Confluent | Confluent Smart Buildings with Real-Time IoT Analytics Using Confluent and Aedifion
- IoT Reference Architecture and Implementation Guide Using Confluent and MongoDB Realm | Confluent Build Your Own IoT Platform with Confluent and MongoDB