https://zilliz.com/blog/vdbbench-1-0-benchmarking-with-your-real-world-production-workloads
Jul 4, 2025

Summary
This post announces VDBBench 1.0, an open-source benchmarking tool for Milvus. It emphasizes simulating real-world production workloads by focusing on realistic datasets, production-focused metrics (P95/P99 latency, sustainable throughput, recall), and testing methodologies that reflect actual usage scenarios such as continuous ingestion, filtering, and streaming data. The goal is to provide engineers with reliable data for infrastructure decisions, moving away from misleading traditional benchmarks.
More from the Benchmarking and Performance Analysis trail
- Troubleshooting a Search Slowdown After Upgrading Milvus: Lessons from the WPS Team
- How to Safely Upgrade from Milvus 2.5.x to Milvus 2.6.x
- How to Debug Slow Search Requests in Milvus
- Hands-On with VDBBench: Benchmarking Vector Databases for POCs That Match Production
- We Benchmarked 20+ Embedding APIs with Milvus: 7 Insights That Will Surprise You