Product updates: memory snapshotting, OIDC, async job queues & more
Dec 28, 2024

Summary
Introduced faster memory snapshotting for models like Stable Diffusion, cutting cold start times by half. Expanded async job queues to support up to 1 million inputs. Added OpenID Connect (OIDC) for short-lived token authentication against external resources, replacing Modal Secrets. Enabled eStargz compression for faster image builds from external registries. Updated CLI with `--detach` flag for `modal launch` and added streaming output, timeout, workdir, and secrets parameters to `Sandbox.exec`.
More from the ETL Platform trail
- Seamless computational bio at Chai Discovery | Modal Blog
- Modal + Datalab: Deploy high-throughput document intelligence in <5 minutes
- How a top tier European soccer team sped up their data processing and reduced costs by 50%
- Building a cost-effective analytics stack with Modal, dlt, and dbt
- Why you should move your ETL stack to Modal