Milvus

Milvus 2.3.4: Faster Searches, Expanded Data Support, Improved Monitoring, and More

Jan 12, 2024Ken Zhang, Fendy Feng
Milvus 2.3.4: Faster Searches, Expanded Data Support, Improved Monitoring, and More
SummaryAI, from the source post

Milvus 2.3.4 introduces access logs for improved monitoring of gRPC interactions, enabling performance analysis and security auditing. It adds support for importing Parquet files, enhancing data processing efficiency and making Parquet the default output for the BulkWriter tool. Search performance is significantly improved with the implementation of a binlog index on growing segments, leading to up to tenfold faster searches. The system now supports up to 10,000 collections/partitions, addressing needs for nuanced data organization in use cases like knowledge base management and multi-tenancy. Other enhancements include reduced memory usage during data retrieval and variable-length data handling, refined error messaging, accelerated loading speed, and improved query shard balance.

More from the Benchmarking and Performance Analysis trail