Modal

Product updates: Running batch jobs with 1M inputs, ephemeral apps, and a new TensorRT-LLM example

Apr 17, 2025
Product updates: Running batch jobs with 1M inputs, ephemeral apps, and a new TensorRT-LLM example
SummaryAI, from the source post

Increased the maximum number of inputs per Modal Function to 1 million (from 2k). Raised the `.spawn()` rate limit for faster input submission. Extended `FunctionCall` result persistence to 7 days.

More from the Dynamic Batching trail