NLP-as-a-Service – The Next Evolution in AI

This post announces GooseAI, a fully managed NLP inference service built on CoreWeave Cloud, offering feature parity with existing APIs at a lower cost (50% savings mentioned, with a claim of over 70% cost savings by changing one line of code). It highlights the availability of open-source models like GPT-NeoX-20B and emphasizes CoreWeave's advantages such as fast spin-up times and responsive auto-scaling for serving these models. The post also references previous investments in AI infrastructure, including an A100 cluster for distributed training and partnership with EleutherAI for GPT-NeoX-20B.