Modernizing the Facebook Groups Search to Unlock the Power of Community Knowledge

What this post added

This post details the modernization of Facebook Groups Search by implementing a hybrid retrieval architecture that combines lexical search (Unicorn inverted index) with semantic search (Faiss ANN search using dense vector representations from a 12-layer, 200-million-parameter model). It introduces an L2 ranking stage using a Multi-Task Multi-Label (MTML) architecture to jointly optimize for clicks, shares, and comments. Additionally, it describes the integration of automated offline evaluation using Llama 3 to grade search results, addressing the challenges of validating semantic search quality at scale. Future work includes applying LLMs in the ranking stage and developing adaptive retrieval strategies.