Google

Introducing Metrax: performant, efficient, and robust model evaluation metrics in JAX- Google Developers Blog

Nov 13, 2025Yufeng Guo, Jiwon Shin, Jeff Carpenter
Introducing Metrax: performant, efficient, and robust model evaluation metrics in JAX- Google Developers Blog
SummaryAI, from the source post

Introduces Metrax, a new high-performance library for model evaluation metrics in JAX. Metrax provides predefined metrics for classification, regression, recommendation, vision, audio, and language models, and supports parallel computation of 'at K' metrics (e.g., PrecisionAtK, RecallAtK, NDCGAtK) using JAX's `vmap` and `jit` for efficiency. It integrates with the JAX AI Stack and is already used in production at Google. The post includes code examples for computing metrics and merging batch states, and highlights community contributions.

More from the JAX Model Evaluation Metrics trail