This post details the advantages of using GPT-J, an 6B parameter open-source NLP model, on CoreWeave's infrastructure. It highlights CoreWeave's fast spin-up times, responsive autoscaling (including scale-to-zero), and competitive pricing for serving GPT-J. Customer examples from AI Dungeon and NovelAI demonstrate significant cost savings (75%) and latency reductions (50% and 3x faster serving respectively). The post also mentions CoreWeave's collaboration with EleutherAI on a DGX A100 training cluster and the availability of CoreWeave engineers for DevOps optimization.