TechPrufer
Get started
Shopify
Shopify logoShopify · Feature trail

Multi-cloud GPU Orchestration

1 post · Jan 2026

What this trail covers

Shopify has integrated SkyPilot to manage multi-cloud GPU workloads, enabling engineers to define jobs in YAML and run them on available Kubernetes clusters across different cloud providers (Nebius, GCP). This includes a custom plugin for routing based on hardware requirements (H200s to Nebius, L4s/CPUs to GCP), fair-share scheduling via Kueue, and automatic injection of necessary configurations for specific hardware like InfiniBand. The system also supports development environments with dedicated.

All Shopify trails
  1. SkyPilot at Shopify: Multi-cloud GPUs without the pain (2026) - ShopifyThis post details the integration of SkyPilot into Shopify's ML platform, focusing on a custom plugin that routes GPU workloads to specific cloud providers (Nebius for H200s, GCP for L4s/CPUs) based on hardware requirements. It describes how the plugin injects necessary configurations for InfiniBand on Nebius, automates shared cache mounting, and implements fair-share scheduling using Kueue. The post also outlines the pattern for development environments with specific labels and autostop configurations.