Unlocking Real-time Predictions with Shopify's Machine Learning Platform - Shopify

What this post added

This post details the development and enhancement of Shopify's Merlin Online Inference capabilities, a component of the broader ML experimentation platform. It focuses on enabling the deployment and serving of machine learning models for real-time predictions at scale. Key contributions include the architecture for dedicated services on Kubernetes, the serving layer design (API for predictions, model loading), and the support for multiple serving layer types (MLServer, FastAPI) to cater to different user needs and customization levels. It also highlights the integration with model registries (Comet ML) and feature stores (Pano) for seamless end-to-end ML workflows.