Web Search API Evals: Exa's Neural Network Search Engine vs. The Competition

This post introduces new benchmarks (SimpleQA and MSMARCO) for evaluating search API performance, specifically comparing Exa's search engine against competitors like Bing and Perplexity in RAG and classic search contexts. It details the evaluation methodology using LLMs as judges and reports Exa's superior performance in factuality and retrieval accuracy, attributing this to its design for LLM consumption.