TechPrufer
Get started
DeepMind
DeepMind logoDeepMind · Feature trail

LLM Interpretability Tools

1 post · Dec 2025

What this trail covers

Gemma Scope 2 is released, a comprehensive, open suite of interpretability tools for all Gemma 3 model sizes (270M to 27B parameters). It enables tracing potential risks across the model's internal workings by combining sparse autoencoders (SAEs) and transcoders. New features include full coverage at scale for larger models, skip-transcoders and cross-layer transcoders for deciphering multi-step computations, advanced training techniques like Matryoshka, and targeted tools for analyzing chatbot behavior.

All DeepMind trails
  1. Gemma Scope 2: Helping the AI Safety Community Deepen Understanding of Complex Language Model BehaviorThis post announces Gemma Scope 2, an expanded suite of interpretability tools for Gemma 3 models. It introduces full coverage at scale for models up to 27B parameters, skip-transcoders and cross-layer transcoders for deciphering multi-step computations, advanced training techniques like Matryoshka, and specific tools for analyzing chatbot behaviors such as jailbreaks and refusal mechanisms. The release involves storing ~110 PB of data and training over 1 trillion parameters.