Baseten

Build with OpenAI’s Whisper model in five minutes

Oct 18, 2022
Build with OpenAI’s Whisper model in five minutes
SummaryAI, from the source post

This post details the process of packaging and deploying OpenAI's Whisper ASR model using Baseten's Truss library. It covers installing Truss, initializing a new Truss project, configuring dependencies (including a Git+HTTPS requirement for the Whisper repository and system packages like ffmpeg), and specifying GPU resource requirements. The core `predict` function is shown, along with `preprocess` and `postprocess` functions for handling audio input from a URL. The deployment process using `truss push` and prediction via `truss predict` is also demonstrated.

More from the Baseten AI Model Deployment and Serving Platform trail