Your client code matters: 12x higher embedding throughput with Python and Rust

Introduced the Baseten Performance Client, an open-source Python library built with Rust, to achieve up to 12x higher embedding throughput by releasing the Python GIL during network-bound tasks. This allows for true parallel request execution using a Rust Tokio runtime, leading to significantly lower latencies under heavy loads and efficient multi-core CPU utilization. The client supports both synchronous and asynchronous APIs and general batch requests for various inference tasks.