Benchmarking and Performance Analysis
Milvus 2.3.4: Faster Searches, Expanded Data Support, Improved Monitoring, and More

Milvus 2.3.4: Faster Searches, Expanded Data Support, Improved Monitoring, and More

1/12/2024 · Ken Zhang, Fendy Feng

What this post added

Milvus 2.3.4 introduces access logs for improved monitoring of gRPC interactions, enabling performance analysis and security auditing. It adds support for importing Parquet files, enhancing data processing efficiency and making Parquet the default output for the BulkWriter tool. Search performance is significantly improved with the implementation of a binlog index on growing segments, leading to up to tenfold faster searches. The system now supports up to 10,000 collections/partitions, addressing needs for nuanced data organization in use cases like knowledge base management and multi-tenancy. Other enhancements include reduced memory usage during data retrieval and variable-length data handling, refined error messaging, accelerated loading speed, and improved query shard balance.

Read the original post ↗