AI Data Storage Engine
How Milvus Realizes the Delete Function

How Milvus Realizes the Delete Function

8/22/2020 · milvus

What this post added

Introduced a soft deletion mechanism for flushed data by saving deleted IDs in a separate DEL file, which are filtered during read operations. Implemented segments as the basic unit for data operations, containing raw files, index files, and a DEL file. Utilized counting bloom filters per segment to optimize the identification of segments containing deleted IDs.

Read the original post ↗