Dynamic Batching
Introducing Modal Batch: Process 1 million jobs with 1 line of code

Introducing Modal Batch: Process 1 million jobs with 1 line of code

5/22/2025

What this post added

Introduced Modal Batch, a new interface backed by a new durable queue system designed for large-scale, fault-tolerant job processing. Key improvements include an overhauled queue system supporting 1 million inputs (up from 2000), guaranteed input execution for up to 7 days (up from 1 day), and a native `.spawn_map` handler for batch job initiation. This builds upon the existing dynamic batching feature by providing a more robust and scalable solution for massive jobs.

Read the original post ↗