Milvus performance on AVX-512 vs. AVX2
Nov 10, 2020milvus

Summary
This post details performance comparisons of Milvus on AVX-512 versus AVX2 instruction sets. It outlines system configuration, Milvus parameters (cache size, nlist, nprobe), and the SIFT10M dataset used for testing. Performance results are presented for IVF_FLAT, IVF_SQ8, and HNSW index types, showing consistent speed improvements with AVX-512. The analysis concludes that while AVX-512 offers theoretical benefits, real-world performance gains are influenced by other system tasks. It also highlights IVF_SQ8's efficiency over IVF_FLAT due to memory bandwidth constraints.
More from the Benchmarking and Performance Analysis trail
- Troubleshooting a Search Slowdown After Upgrading Milvus: Lessons from the WPS Team
- How to Safely Upgrade from Milvus 2.5.x to Milvus 2.6.x
- How to Debug Slow Search Requests in Milvus
- Hands-On with VDBBench: Benchmarking Vector Databases for POCs That Match Production
- https://zilliz.com/blog/vdbbench-1-0-benchmarking-with-your-real-world-production-workloads