Building an RL theorem-proving workflow on Modal | Modal Blog

This post details the implementation of an RL theorem-proving workflow on Modal using Evolution Strategies (ES). It highlights the use of separate container images for GPU inference (vLLM) and CPU-based Lean verification, parallel GPU fan-out with `.map()` for ES iterations, and sandboxed Lean verification for isolation. It also describes stateless checkpointing using seed histories and volumes for base model storage, reducing download times. The implementation achieved a 60% reduction in project completion time compared to alternative platforms.