AI Edge Torch: High Performance Inference of PyTorch Models on Mobile Devices- Google Developers Blog

What this post added

Introduced AI Edge Torch, a new tool that provides a direct conversion path from PyTorch models to the TensorFlow Lite (TFLite) runtime. This feature offers improved CPU performance, initial GPU support, and compatibility with over 70% of core_aten operators. It leverages TorchDynamo and torch.export for model conversion and supports quantization workflows. Performance benchmarks show competitive results against existing workflows like ONNX2TF and ONNX runtime. The release includes early adoption by partners like Shopify and hardware acceleration support through silicon partnerships.