Sub-second image generation with Flux.2 and Qwen-Image

This post details optimizations for image generation serving, specifically for Flux.2 [dev] and Qwen-Image models on NVIDIA Blackwell and Hopper GPUs. Key technical contributions include: hardware-aware quantization (FP4 on B200, FP8 on H100), memory optimizations, optimized attention kernels, specialized element-wise kernels, and runtime-level serving improvements. These optimizations resulted in significant latency reductions, achieving sub-second inference for Flux.2 [dev] on B200 (0.98s) and Qwen-Image on B200 (0.87s), outperforming baseline configurations by up to 5.4x and 4x respectively. The post also outlines the benchmarking methodology and common image generation inference parameters supported by the optimized stack.