Monitoring and Observability for Kafka Clusters on Kubernetes
Nov 29, 2022Geetha Anne
Summary
This post details the integration of Confluent Platform deployed via Confluent for Kubernetes (CFK) on AWS EKS with Datadog for monitoring. It outlines the steps for deploying CFK, creating Datadog API keys, installing Datadog agents on Kubernetes nodes, configuring Datadog site name, and integrating Confluent Platform components (Kafka, ZooKeeper, Connect, Schema Registry) using Datadog annotations. It also describes how to validate the Datadog agent installation and leverage the Confluent Platform dashboard in Datadog for comprehensive visibility into key metrics, logs, and traces.
More from the Observability for Self-Managed Kafka on Kubernetes trail
- SIEM Optimization for Better Cyber Security
- Monitoring Event Streams: Visualize Kafka Clients in Confluent Cloud
- Monitor Apache Kafka Clusters with Prometheus, Grafana, and Confluent
- Integrate Kafka Clients with Jaeger for Distributed Tracing and Monitoring
- Apache Kafka Lag Monitoring and Metrics at AppsFlyer