Nemo: Data discovery at Facebook

What this post added

Introduced Nemo, an internal data discovery engine that significantly improved data search success rate by over 50%. Nemo leverages Unicorn search infrastructure, supports sophisticated filtering and personalization, and parses natural language queries. It incorporates trust signals for data quality, recency, usage, and lineage into its ranking process. The architecture includes bulk and instant indexing, and a serving component with NLP and ML models for ranking.