DeepMind

FACTS Benchmark Suite: a new way to systematically evaluate LLMs factuality

Dec 9, 2025The FACTS team
FACTS Benchmark Suite: a new way to systematically evaluate LLMs factuality
SummaryAI, from the source post

Introduces the FACTS Benchmark Suite, comprising Parametric, Search, and Multimodal benchmarks, alongside an updated Grounding Benchmark v2. Details the methodology, dataset size (3,513 examples), and evaluation process managed by Kaggle. Presents results showing Gemini 3 Pro leading with a 68.8% FACTS Score, highlighting error rate reductions in Search and Parametric benchmarks. Notes that Multimodal benchmarks generally had lower scores across all evaluated models.