
8/22/2020 · milvus
What this post added
Introduced a soft deletion mechanism for flushed data by saving deleted IDs in a separate DEL file, which are filtered during read operations. Implemented segments as the basic unit for data operations, containing raw files, index files, and a DEL file. Utilized counting bloom filters per segment to optimize the identification of segments containing deleted IDs.