Transform OpenAI gpt-oss Models into Domain Experts with Together AI Fine-Tuning
Aug 19, 2025

Summary
This post details the integration of OpenAI's gpt-oss-120B and gpt-oss-20B models into the Together AI Fine-Tuning Platform. It highlights the ability to perform LoRA fine-tuning with a 16K context window for supervised fine-tuning (SFT) and an 8K context window for direct preference optimization (DPO). The post emphasizes the platform's ability to abstract away the complexities of distributed training infrastructure, memory allocation issues, and resource utilization, offering a simplified three-step API process for users.
More from the Fine-Tuning Platform trail
- How to train your own Jev for $17
- Together AI expands fine-tuning service with more models, live metrics, and finer controls
- DeepSeek-V4 Flash 0731 vs GPT-5.6 Luna on DeepSWE: Cost and Coding
- Accelerate RL rollouts by up to 50% with distribution-aware speculative decoding
- Together AI expands fine-tuning service with tool calling, reasoning, and vision support