FACTS Benchmark Suite: a new way to systematically evaluate LLMs factuality
Dec 9, 2025The FACTS team
Summary
Introduces the FACTS Benchmark Suite, comprising Parametric, Search, and Multimodal benchmarks, alongside an updated Grounding Benchmark v2. Details the methodology, dataset size (3,513 examples), and evaluation process managed by Kaggle. Presents results showing Gemini 3 Pro leading with a 68.8% FACTS Score, highlighting error rate reductions in Search and Parametric benchmarks. Notes that Multimodal benchmarks generally had lower scores across all evaluated models.