Hardware-Rooted AI Security That Won’t Slow You Down | NVIDIA Technical Blog

This post details the implementation and performance of NVIDIA Confidential Computing (CC) on Blackwell GPUs for AI inference. It highlights the hardware root of trust (fused private signing keys, NVLink encryption), the attestation process via NRAS, and performance optimizations in inference frameworks (FlashInfer, SGLang) to mitigate overheads. Benchmarks on HGX B300 with Qwen 3.5-397B-A17B-FP8 demonstrate that CC incurs minimal throughput and time per output token overhead (typically under 8%) compared to non-CC solutions, enabling secure, high-performance AI inference.