Data Warehousing and Analytics Platform
Serverless Jupyter Notebooks at Meta

Serverless Jupyter Notebooks at Meta

6/10/2024 · Steve Dini

What this post added

Introduced serverless Jupyter notebooks for lite workloads within the Bento platform by integrating Pyodide and WebAssembly. This enables in-browser code execution, removing the need for remote compute provisioning for prototyping and simple ML workflows. Implemented a kernel bridge abstraction for seamless switching between server-based and serverless kernels, and adapted cell magics (e.g., %%sql, %%googlesheet, %%graphql) to run in the browser context. Utilized web workers to prevent browser lock-up during kernel operations and integrated with Tupperware for data uploads.

Read the original post ↗