Introducing Notebooks – launch ML experiments with zero cold boots

Introduced Modal Notebooks, a collaborative environment for high-performance interactive computing. Key technical contributions include: a GPU-enabled Python kernel launching in seconds (<5s cold-start) on arbitrary container images and hardware up to 8 H100/B200 GPUs; auto-idling and resume functionality for kernels to optimize cost; seamless integration with existing Modal Apps, including Volumes (distributed storage) and Secrets; true real-time collaborative editing with multiple cursors and live presence; integration with Pyright language server for enhanced developer experience; and AI completions for code exploration. The underlying infrastructure leverages Modal's existing AI infrastructure and FUSE filesystem for fast package loading.
More from the Sandboxed Code Execution trail
- Runtime Roundup: VM Sandboxes, Multi-node clusters, and more | Modal Blog
- VM Sandboxes: Full computers for agents | Modal Blog
- Sidecars: A low-latency trust boundary for Sandboxes | Modal Blog
- Product updates: Sandbox Sidecars, new models, a refreshed dashboard, and more | Modal Blog
- Devin Outposts on Modal | Modal Blog