SkyPilot at Shopify: Multi-cloud GPUs without the pain (2026) - Shopify

What this post added

This post details the integration of SkyPilot for multi-cloud GPU workload management at Shopify. Key contributions include building a SkyPilot plugin to intercept requests and route them to appropriate Kubernetes clusters based on hardware needs (e.g., H200s on Nebius, L4s/CPUs on GCP). It also covers the implementation of custom labels for cost allocation (`showback_cost_owner_ref`) and fair-share scheduling via Kueue (`ml.shopify.io/quota-group`, `ml.shopify.io/priority-class`). Specific Nebius integration details include automatic mounting of InfiniBand-related devices and shared caches, and dynamic storage provisioning. A development environment pattern is introduced with the `ml.shopify.io/dev: "true"` label, enabling interactive sessions with different scheduling and resource policies.