Globally distributed AI and a Constellation update

This post announces updates to Cloudflare's Constellation platform, which enables globally distributed AI inference. Key updates include increasing the model size limit from 10MB to 50MB, introducing tensor caching to reduce network and parsing overhead for repeated inference tasks with similar inputs, and adding support for the XGBoost runtime in addition to the existing ONNX runtime. The post also discusses the broader implications of globally distributed AI for custom web experiences and making devices smarter, highlighting the performance benefits of running inference closer to users.