MediaTek NPU and LiteRT: Powering the next generation of on-device AI- Google Developers Blog

This post introduces the LiteRT NeuroPilot Accelerator, a successor to TFLite NeuroPilot delegate, enabling seamless deployment of AI models on MediaTek NPUs. It highlights a unified development workflow with AOT and on-device compilation options, simplified C++ API with Native Hardware Buffer Interoperability for zero-copy data passing, and rich generative AI capabilities with optimized support for models like Gemma and Qwen. Performance benchmarks show significant acceleration for Gemma models on MediaTek chipsets compared to CPU and GPU. The post also details integration paths for developers using LiteRT-LM for text generation and LiteRT for embedding models.