Improvements of the Data File Cleanup Mechanism

This post details the previous unreliable 5-minute interval strategy for hard-deleting soft-deleted files in Milvus, which could lead to query failures or excessive disk usage. It introduces the improved strategy implemented in v0.6.0, which uses reference counting to hard-delete files only when they are no longer in use by any task. This ensures reliable deletion and efficient disk usage.