Cerebras

Cerebras

Aug 15, 2025
Cerebras
SummaryAI, from the source post

This post announces the availability of OpenAI's GPT OSS 120B model on the Cerebras Inference Cloud, highlighting record-breaking inference speeds (up to 3,000 tokens/sec, 15x faster than leading GPUs) and low latency (280ms time to first token). It emphasizes the model's accuracy on reasoning benchmarks (AIME 2025) and its suitability for agentic and coding applications due to its speed. The post also details a significant price-performance advantage (8.4x tokens/sec/dollar) compared to GPU clouds.

More from the AI Inference Latency Optimization trail