Flink 1.20 Adds Significant Improvements Along w/Deprecations
Aug 2, 2024Fabian Paul

Summary
Flink 1.20 introduces the DISTRIBUTED BY clause (FLIP-376) for unified bucketing strategies in Flink SQL, replacing connector-specific syntax. It also adds MATERIALIZED tables (FLIP-435) to manage data freshness requirements directly within Flink, deciding between streaming or batch refresh modes based on configuration. The DataStream API now supports parallel aggregations on non-keyed streams in batch mode (FLIP-380). Operational improvements include unified file merging for checkpoints (FLIP-306) to reduce blob storage load and costs, and enhanced recovery for batch jobs from JobMaster failures (FLIP-383). Legacy SinkFunction API and other configuration options are deprecated in preparation for Flink 2.0.
More from the Flink AI Model Inference trail
- Flink: Programmatic Capabilities for Developers and dbt/SQL-Native for Data Practitioners
- Add Your First Flink Streaming Transformation
- Focal Systems: Boosting Store Performance with an AI Retail Operating System and Real-Time Data
- Detecting the Unexpected: Built-in Real-Time Anomaly Detection in Confluent Cloud for Apache Flink®
- Why Flink Agents Are the Future of Enterprise AI