Run Qwen3 Embedding on NVIDIA Blackwell GPUs

This post introduces Baseten Embeddings Inference (BEI) for NVIDIA Blackwell GPUs, showcasing benchmark results for the Qwen3 Embedding 8B model. It highlights 1.5x higher token per second throughput on B200s compared to BEI on H100, 3.3x higher than vLLM, and 3.6x higher than TEI on H100 for high query-throughput (500 tokens/request). For low query-throughput (5 tokens/request), BEI on B200s offers 8.4x higher throughput than vLLM and 1.6x higher than TEI. The post also links to a technical deep dive on BEI optimization with TensorRT-LLM.