AI Data Storage Engine
Optimizing NVIDIA CAGRA in Milvus: A Hybrid GPU–CPU Approach to Faster Indexing and Cheaper Queries

Optimizing NVIDIA CAGRA in Milvus: A Hybrid GPU–CPU Approach to Faster Indexing and Cheaper Queries

12/10/2025 · Marcelo Chen

What this post added

Introduces and details the hybrid GPU-CPU approach for CAGRA indexing in Milvus 2.6.1. Explains the CAGRA algorithm (NN-Descent and 2-hop pruning) and its GPU acceleration. Details the `adapt_for_cpu` parameter and its four execution modes for balancing GPU construction with CPU querying. Presents experimental results demonstrating significant index build time improvements (12-15x) and discusses query performance and recall accuracy.

Read the original post ↗