This post details AI Dungeon's migration to CoreWeave's Inference Service, highlighting a reduction in compute instance spin-up times to 45 seconds, minimization of idle compute, and a 76% reduction in computing costs. It also notes a 50% drop in inference latencies using CoreWeave's Inference Optimized V100 instances, leading to a better in-game experience for users and reduced resource planning for AI Dungeon.