Milvus

Getting Started with Hybrid Semantic / Full-Text Search with Milvus 2.5

Dec 17, 2024Stefan Webb
Getting Started with Hybrid Semantic / Full-Text Search with Milvus 2.5
SummaryAI, from the source post

This post details the implementation of full-text search in Milvus 2.5 by introducing the `Function` object and `FunctionType.BM25`. It demonstrates how to define a schema with a VARCHAR field enabled for analysis and a SPARSE_FLOAT_VECTOR field to store BM25 embeddings. The post shows how to add a `Function` to the schema to automatically generate sparse vectors from text, configure a `SPARSE_INVERTED_INDEX` with `BM25` metric type, and perform full-text searches. It also illustrates how to combine this with dense vector search using `hybrid_search` and `RRFRanker` for improved recall.

More from the Multilingual Full-Text Search trail