One Model Family, Two Gold-Level Results: Fine-Tuning Nemotron for IOI and IMO
Sep 17, 2026

Summary
This post details the successful fine-tuning of Nemotron foundation models for specialized domains (IOI and IMO) using SFT and RL, achieving gold-medal level results. It introduces a reusable specialization recipe involving strong base models, curated domain-specific data and traces, standard post-training methods, and inference loops for generation, evaluation, and refinement. Specifics include the performance gains of Nemotron-3-Nano-CC and Nemotron-3-Ultra-CC on IOI tasks, and the complementary strengths of SFT and RL checkpoints for IMO. The post also highlights the co-design of models, data, and inference workflows, and makes the specialized models, datasets, and recipes available on Hugging Face.
More from the Parameter-Efficient Fine-Tuning (PEFT) trail
- Beyond LoRA: Can you beat the most popular fine-tuning technique?
- NeoMME: an efficient Multimodal-native and Multilingual Encoder
- Fine-tuning a 350M Model for Better Structured Outputs in 100 GRPO Steps
- Training a coding model to paint watercolours with TRL and OpenEnv
- Making Knowledge Distillation Cheap Enough to Run at Scale