Frontier Reasoning Reaches the Edge: How to Deploy and Optimize Models on NVIDIA Jetson | NVIDIA Technical Blog

This post details the deployment and optimization of compact open models (Nemotron 3.5 Lightning, Qwen3.8-27B) on NVIDIA Jetson platforms. It introduces NVFP4 quantization and speculative decoding (DSpark, DFlash2) as key techniques to improve inference performance, demonstrating up to 6.28x decode throughput speedup over BF16. It highlights the importance of choosing models based on workload characteristics (MoE vs. dense) and testing specific optimization configurations for different models. The post also emphasizes application-level validation with representative prompts to ensure critical behaviors are preserved.