On-device inference

12 posts · 4 sources

GoogleBlog1w

ML Drift: Next-Gen GPU AI/ML Inference at the Edge- Google Developers Blog

NVIDIABlog19 Aug

Post-Train NVIDIA Cosmos 3 Edge for On-Device Robot Control

GoogleBlog11 Aug

Mastering Edge AI on Raspberry Pi with LiteRT and Gemma- Google Developers Blog

Hugging FaceBlog5 Aug

Run fast, private agents on-device with LFM2.5-24B-A2B

GoogleBlog9 Jul

LiteRT.js, Google's high performance Web AI Inference- Google Developers Blog

NVIDIABlog25 Jun

Q&A: How KRAFTON Built PUBG Ally, a Co-Playable Character Powered by NVIDIA ACE

GoogleBlog3 Jun

Gemma 4 12B: The Developer Guide- Google Developers Blog

RampBlog13 Apr

Automating Receipt Collection: Apple Intelligence for On-Device Inference

GoogleBlog15 Oct

Introducing Coral NPU: A full-stack platform for Edge AI- Google Developers Blog

GoogleBlog8 Oct

Own your AI: Learn how to fine-tune Gemma 3 270M and run it on-device- Google Developers Blog

Hugging FaceBlog28 Nov

Bringing Robotics AI to Embedded Platforms: Dataset Recording, VLA Fine‑Tuning, and On‑Device Optimizations

GoogleBlog5 Dec

Announcing Core ML support in TensorFlow Lite- Google Developers Blog