How to run TorchForge reinforcement learning pipelines in the Together AI Native Cloud
Dec 3, 2025

Summary
This post details the integration of TorchForge reinforcement learning (RL) pipelines with Together AI's Instant Clusters. It highlights the use of Instant Clusters' low-latency GPU communication, preconfigured drivers, and heterogeneous scheduling for RL workloads. The post also describes the integration of Together CodeSandbox and Together Code Interpreter as environments for RL agents, enabling tool-use and code execution. A demo is provided for training a BlackJack agent using GRPO, vLLM, and TorchStore, and a standalone integration for using Code Interpreter as an OpenEnv environment is also released.
More from the Instant GPU Clusters trail
- Expanding our enterprise inference capacity with IBM Cloud and NVIDIA
- Introducing preemptible compute: the same compute, half the price
- New in Together GPU Clusters: Reliability and control for production GPU clusters
- Capacity without conflict: A guide to multi-tenant GPU cluster design for AI-native teams
- What is an AI Native Cloud?