
1/20/2022 · Dusty Pearce
What this post added
Instacart details their experience scaling their event streaming infrastructure with Confluent Cloud to handle a massive surge in demand. They migrated client streams to Kafka, focusing on topic design, infrastructure resilience, and partitioning. The use of Confluent Cloud's serverless architecture and Infinite Storage allowed for rapid scaling and simplified storage management. This enabled real-time data integration for inventory management, predictive models, and fraud detection, supporting their move towards a data mesh architecture.