Milvus

How Milvus Realizes the Delete Function

Aug 22, 2020milvus
How Milvus Realizes the Delete Function
SummaryAI, from the source post

Introduced a soft deletion mechanism for flushed data by saving deleted IDs in a separate DEL file, which are filtered during read operations. Implemented segments as the basic unit for data operations, containing raw files, index files, and a DEL file. Utilized counting bloom filters per segment to optimize the identification of segments containing deleted IDs.

More from the AI Data Storage Engine trail