How to price serverless GPUs

This post introduces a cost model for pricing serverless GPUs versus reserved GPUs, focusing on the peak-to-average demand ratio as a critical factor. It provides equations and a conceptual framework for understanding when serverless GPUs are more economical. The post also discusses the assumptions and limitations of the model, including perfect prediction of demand and instant allocation/deallocation, and touches upon the developer productivity benefits of serverless GPU access.