On-device small language models with multimodality, RAG, and Function Calling- Google Developers Blog

What this post added

Introduced support for over a dozen on-device small language models (SLMs) including Gemma 3 and Gemma 3n, with Gemma 3n being the first multimodal on-device SLM supporting text, image, video, and audio inputs. Added new Retrieval Augmented Generation (RAG) and Function Calling libraries for on-device AI features. Enhanced model support through the LiteRT Hugging Face community. Introduced new quantization schemes for int4 post-training quantization, reducing model size and latency. Detailed performance metrics for Gemma 3 1B and Gemma 3n. Provided libraries for RAG and Function Calling on Android, with more platforms to follow. Introduced a Python tool simulation library for custom function calling.