Hardware-Rooted AI Security That Won’t Slow You Down | NVIDIA Technical Blog

What this post added

This post introduces NVIDIA Confidential Computing (CC) as a hardware-rooted AI security solution. It details the integration of CC into Blackwell GPUs, including fused private signing keys and NVLink encryption. The post explains the remote attestation process using NRAS to verify workload integrity before execution. Benchmarks on HGX B300 with the Qwen 3.5-397B-A17B-FP8 model demonstrate minimal performance overhead (under 8%) for throughput and per-token latency. It also highlights optimizations in inference frameworks like FlashInfer and SGLang (CC-safe autotuning, async D2H copy worker, piecewise CUDA graph support) that mitigate performance impacts.