Unlocking Real-time Predictions with Shopify's Machine Learning Platform - Shopify

This post details the development of Merlin Online Inference, a system for deploying and serving machine learning models for real-time predictions. It covers the architecture, including the serving layer (using MLServer or FastAPI) and deployment on Kubernetes, and highlights the requirements for low latency, robustness, and integration with the broader Merlin platform. The post also introduces the concept of online inference and its use cases at Shopify.