Introducing Metrax: performant, efficient, and robust model evaluation metrics in JAX- Google Developers Blog
Nov 13, 2025Yufeng Guo, Jiwon Shin, Jeff Carpenter

Summary
Introduces Metrax, a new high-performance library for model evaluation metrics in JAX. Metrax provides predefined metrics for classification, regression, recommendation, vision, audio, and language models, and supports parallel computation of 'at K' metrics (e.g., PrecisionAtK, RecallAtK, NDCGAtK) using JAX's `vmap` and `jit` for efficiency. It integrates with the JAX AI Stack and is already used in production at Google. The post includes code examples for computing metrics and merging batch states, and highlights community contributions.
More from the JAX Model Evaluation Metrics trail
- Accelerating Spatio-Temporal Attention for Video Diffusion on TPUs- Google Developers Blog
- Reproducing OLMo 3 7B Pre-training in MaxText: case study of large scale training on TPUs- Google Developers Blog
- Decoding cosmic signals with deep learning and Keras- Google Developers Blog
- Enterprise-Grade Precision for Long-Context Multimodal Embedding Inference on Cloud TPU- Google Developers Blog
- HeyGen x Google Cloud: Bringing Avatar IV to TPUs- Google Developers Blog