Future Proofing Our Cloud Storage Usage - Shopify
Feb 26, 2018

Summary
Introduced hash-generated digests to new shops' asset operations (e.g., /s/3582/2410/1317/files/theme.scss) to distribute writes across many S3 partitions, mitigating 'SlowDown' exceptions caused by single-shop activity hitting partition rate limits. This change resulted in a near-complete drop in SlowDown events and significant reductions in S3 GET latencies (median by ~60%, 95th percentile by ~25%).