Schema Registry Best Practices
Using Data Contracts to Ensure Data Quality and Reliability

Using Data Contracts to Ensure Data Quality and Reliability

10/18/2023 · Robert Yokota

What this post added

This post introduces and demonstrates the implementation of data contracts within Confluent Schema Registry. It covers defining an initial Avro schema, enhancing it with business metadata (owner, SLOs), adding data quality rules using Google Common Expression Language (CEL) for validation (e.g., totalPriceCents > 0), and specifying custom rule executors and actions. An example of a custom `EmailAction` is provided to check timeliness SLOs and send alerts. The post details how to register these enhancements as new schema versions in Schema Registry and provides command-line examples for producer/consumer interaction and registration.

Read the original post ↗