Build Low-Latency Multilingual Voice Agents: Open Weights & Full Deployment Control with NVIDIA Magpie TTS

This post introduces NVIDIA Magpie TTS Multilingual, a 364M-parameter open-weights model supporting 12 languages (English, Spanish, French, German, Italian, Vietnamese, Mandarin, Hindi, Japanese, Modern Standard Arabic, Korean, Brazilian Portuguese). It highlights architectural improvements like frame stacking and local transformers for reduced inference time and natural speech quality. The post also details performance metrics (TTFA, RTFX) on various NVIDIA GPUs and emphasizes the benefits of open weights for deployment control, latency optimization, and customization. It also mentions improvements in character error rates (CER) and speaker similarity (SSIM) for existing languages and establishes baselines for new languages.