The best place on Region: Earth for inference
Sep 27, 2023Rita Kozlov, James Allworth, Seph Zdarko
Summary
This post announces Cloudflare's entry into the AI space with three new products: Workers AI (serverless GPU inference), Vectorize (vector database), and AI Gateway (caching, rate limiting, and observability for AI deployments). It details the rationale for placing inference workloads on the network edge due to latency sensitivity. It also highlights partnerships with NVIDIA, Microsoft, Hugging Face, Databricks, and Meta, and discusses the role of ONNX runtime for model portability across devices, edge, and cloud.
More from the Artificial Intelligence Integration & Impact trail
- Introducing Clef-omni with full multimodality, plus a faster Clef and a cheaper Clef-flash
- Introducing Web Search API via AI Gateway
- Introducing Clef: our open-source decision models, and new RL fine-tuning platform
- One year later: Sovereign AI and the fight for choice
- AI Search is now generally available