Export your model inference metrics to your favorite observability tool

This post introduces a new integration for exporting model inference metrics from Baseten to external observability platforms. The implementation uses OpenTelemetry and exposes a `/metrics` endpoint compatible with Prometheus scraping. It details the types of metrics available (request count, response time, replica count, hardware usage) and provides configuration examples for Prometheus. The goal is to enable users to incorporate AI model performance into their existing production monitoring and alerting workflows.