Unified Stream Manager GA in Confluent Platform 8.1

This post announces the General Availability (GA) of Unified Stream Manager (USM) with Confluent Platform 8.1. USM provides a unified management and monitoring experience for on-premises and cloud-based Confluent clusters. Key technical contributions include: establishing a secure private network connection (initially AWS PrivateLink) between on-prem Confluent Platform and Confluent Cloud for metadata and telemetry sharing; making Confluent Cloud Schema Registry the single source of truth for schemas across hybrid environments, with on-prem Schema Registries acting as read-only caches; enabling consistent data contract enforcement and client-side field-level encryption (CSFLE) for sensitive data; consolidating observability into a single Confluent Cloud UI for monitoring on-prem Kafka brokers, topics, connectors, and clients; integrating Data Portal for unified data discovery; and introducing end-to-end data stream tracing across hybrid environments. The USM agent is a lightweight component deployed on-prem to collect and stream operational data securely. The post also highlights additional enhancements in Confluent Platform 8.1, including Control Center visibility tools, Queues for Kafka open preview, Azure UAMI for Kafka OAuth, and updates to Confluent Platform for Apache Flink® (support for Flink 2.0.0/2.1.0, REST API for savepoints, PyFlink/TableAPI, and external metadata storage).