TechPrufer
Sign inGet started

Blogs›Milvus›Query Load Balancing

Query Load Balancing

Query Load Balancing

1
posts
2022

Milvus 2.0 introduces a query load balancing mechanism to ensure even distribution of data segments across query nodes. This is triggered by the query coordinator based on RAM usage thresholds and differences between nodes. The process involves transferring segments and updating node information via sealedSegmentChangeInfo messages, ensuring balanced resource utilization and improved search performance.

2022

How Milvus Balances Query Load across Nodes?

2/28/2022

This post details the implementation of query load balancing in Milvus 2.0. It explains how the query coordinator monitors query node RAM usage and triggers balancing when thresholds are exceeded or significant differences exist between nodes. The mechanism involves transferring segments between query nodes and communicating these changes via sealedSegmentChangeInfo messages to ensure consistent data availability and balanced resource utilization.