Introducing Exa's People Search Benchmarks

What this post added

This post introduces Exa's new people search capability, which indexes over 1 billion people using hybrid retrieval combining fine-tuned Exa embeddings with Exa search. The ingestion pipeline is designed to handle over 50 million updates per week. The post details the methodology for generating role-based queries and discovery queries, including sampling executives from various company tiers and using an LLM for structured taxonomy generation. It also outlines the evaluation methodology using recall@k, NDCG, and an LLM judge for role-based discovery. An open-source evaluation harness and dataset are released as a public benchmark for people search.