Meta

Serverless Jupyter Notebooks at Meta

Jun 10, 2024Steve Dini
Serverless Jupyter Notebooks at Meta
SummaryAI, from the source post

Introduced serverless Jupyter notebooks for lite workloads within the Bento platform by integrating Pyodide and WebAssembly. This enables in-browser code execution, removing the need for remote compute provisioning for prototyping and simple ML workflows. Implemented a kernel bridge abstraction for seamless switching between server-based and serverless kernels, and adapted cell magics (e.g., %%sql, %%googlesheet, %%graphql) to run in the browser context. Utilized web workers to prevent browser lock-up during kernel operations and integrated with Tupperware for data uploads.

More from the Data Warehousing and Analytics Platform trail