Cerebras Launches World Fastest DeepSeek R1 Llama-70B Inference - Cerebras

This post announces the deployment of DeepSeek R1 Llama-70B on Cerebras Inference, achieving over 1,500 tokens/s, which is 57x faster than GPU solutions. It highlights the reduction of reasoning prompt time from minutes to seconds (e.g., 22 seconds on o1-mini to 1.5 seconds on Cerebras for a coding prompt). The post emphasizes the practical benefits of this speedup for coding, research, and agent applications, and reiterates Cerebras's commitment to data privacy and security with US-based infrastructure and zero data retention.