Gemma explained: An overview of Gemma model family architectures- Google Developers Blog

This post details the architecture of the Gemma model family, including Transformer decoder-only models, variations like CodeGemma, Gemma 2, RecurrentGemma, and PaliGemma, and their core parameters such as d_model, layers, feedforward hidden dims, num heads, num KV heads, head size, and vocab size. It also provides code examples for exploring model architectures.