Cerebras

NinjaTech AI and Cerebras launch fastest Deep Research

Aug 15, 2025
NinjaTech AI and Cerebras launch fastest Deep Research
SummaryAI, from the source post

Introduces Llama 4 Scout running at 2,600 tokens/sec, a 38x speedup over 4o-mini, with 19% higher model eval scores. Achieves total response time under 1 second for 1000 input/500 output tokens. Claims 19x faster output speed than highest recorded GPU solution and superior price-performance.

More from the AI Inference Latency Optimization trail