Own your AI: Learn how to fine-tune Gemma 3 270M and run it on-device- Google Developers Blog
Oct 8, 2025Ian Ballantyne, Jason Mayes, Kristen Quan

Summary
This post details the process of fine-tuning Gemma 3 270M for a specific task (text-to-emoji translation) using QLoRA for parameter-efficient fine-tuning. It then describes quantizing the model to under 300MB for on-device deployment and running it client-side in a web app using MediaPipe or Transformers.js, leveraging WebGPU for local computation. This demonstrates a practical workflow for creating and deploying specialized, on-device AI models.
More from the AI-Assisted Spec-Driven Development trail
- The Anatomy of Harness Engineering: How to Evaluate, Iterate, and Guard AI Coding Agents- Google Developers Blog
- Enable on-demand expertise with Agent Skills in Genkit Go- Google Developers Blog
- Agent and Model Evaluations in Gemini Enterprise Agent Platform are now GA- Google Developers Blog
- How to use Google microbenchmarks for evaluating TPU performance- Google Developers Blog
- Evolving Spec-Driven Development: Conductor Now Supports Antigravity- Google Developers Blog