An AI Chip With Unprecedented Performance To Do the Unimaginable - Cerebras

This post introduces the Wafer Scale Engine 2 (WSE-2), the largest AI accelerator chip with 850,000 cores on a single wafer, providing 220Pb/s of aggregate fabric bandwidth and 40GB of on-wafer memory. It highlights the system's ability to harvest sparsity in computations, improving power efficiency and performance. The uniform fabric across the wafer simplifies programming and optimizes time-to-solution by allowing seamless mapping of problems without regard to physical placement. The architecture enables high utilization and sustained throughput for large models by overlapping compute and communication effectively.