Streaming Machine Learning with Tiered Storage
Jan 28, 2020Kai Waehner

Summary
This post introduces the concept of streaming machine learning, where data is consumed directly from Kafka into ML frameworks like TensorFlow, eliminating the need for a separate data lake. It highlights the benefits of this approach for scalability, reliability, and reduced operational effort. It also discusses how Tiered Storage complements this by providing cost-effective long-term storage for Kafka data, enabling reprocessing for various use cases and simplifying ML infrastructure.
More from the Kafka Infinite Storage trail
- Apache Kafka® vs Confluent Cloud: Latency Benchmarking Results
- Lowering Kafka Costs by Improving Utilization and Ease of Use
- Kafka Storage That’s 10x More Scalable and Elastic with Confluent
- Making Confluent Cloud 10x More Elastic Than Apache Kafka | Confluent Making Confluent Cloud 10x More Elastic Than Apache Kafka
- How Instacart Used Confluent to Scale 10 Years of Growth in 6 Weeks