Run DiffusionGemma on NVIDIA for Developer-Ready, High-Throughput Text Generation | NVIDIA Technical Blog

This post details the deployment and optimization of DiffusionGemma, a diffusion-based text generation model, on NVIDIA platforms. It highlights the model's parallel token generation capability for high throughput, achieving up to 1000 tokens/sec on an H100 GPU. The post provides practical guidance on accessing and deploying DiffusionGemma through Hugging Face Transformers, NVIDIA NIM (with containerized inference and OpenAI-compatible API), and NVIDIA NeMo AutoModel for fine-tuning. It also specifies supported hardware (H100, DGX Spark, DGX Station, RTX/RTX PRO) and precision formats (BF16, NVFP4), and includes code examples for NIM deployment and testing.