Google

Gemma Family Expands with Models Tailored for Developers and Researchers- Google Developers Blog

Apr 9, 2024Tris Warkentin, Jane Fine
Gemma Family Expands with Models Tailored for Developers and Researchers- Google Developers Blog
SummaryAI, from the source post

Introduces CodeGemma, a 7B pretrained and instruction-tuned variant, and a 2B pretrained variant, specialized for code completion and generation tasks. Also introduces RecurrentGemma, an efficiency-optimized architecture leveraging recurrent neural networks and local attention for improved memory efficiency and higher throughput, showcasing a non-transformer model. Updates Gemma 1.1 with performance improvements and bug fixes. Details compatibility with various frameworks and hardware.

More from the Diffusion Models for Text Generation trail