NVIDIA PAIR Virtual Inference Router Expands Available Compute on Your Local Network | NVIDIA Technical Blog

This post announces the beta release of NVIDIA PAIR, a virtual inference router designed to distribute AI inference requests across compatible systems on a local network. It addresses multi-agent bottlenecks by routing independent requests to available nodes, supporting Ollama and LM Studio without requiring agent harness modifications. PAIR utilizes mDNS for discovery and MTLS for encryption, with scheduling logic considering node readiness, engine state, model presence, and GPU utilization. A demonstration showed a three-device PAIR cluster completing a five-subagent workload significantly faster than a single device.