Llama 3.1 405B now runs at 969 tokens/s on Cerebras Inference - Cerebras

Achieved 969 output tokens/s for Llama 3.1 405B, a 12x improvement over best GPU results. Demonstrated 240ms time-to-first-token latency. Supported 128K context length with high performance. Showcased 16-bit weights for full model accuracy. Achieved 539 tokens/s with a 100,000 token prompt, outperforming competitors significantly. Detailed pricing for Q1 2025 availability.