Stop “vibe testing” your LLMs. It's time for real evals.- Google Developers Blog

Introduces Stax, an experimental developer tool designed to streamline the LLM evaluation lifecycle. Stax allows developers to build custom benchmarks and autoraters (LLM-as-a-judge) to rigorously test their AI stacks, moving beyond subjective 'vibe testing' to data-driven decision-making. It supports bringing or building datasets, offers out-of-the-box autoraters for common checks, and enables custom autorater creation based on specific criteria like brand voice or application rules.